2024-05-23T22:31:12.655266182Z ..... 2024-05-23T22:31:13.220944480Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-23T22:31:14.171718497Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-23T22:31:18.626712360Z [2024-05-23T22:31:18.624+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-05-23T22:31:19.627959425Z [2024-05-23T22:31:19.627+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-05-23T22:31:20.636802784Z [2024-05-23T22:31:20.636+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-05-23T22:31:32.005423127Z 2024-05-23T22:31:32.943826112Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-23T22:31:33.761154869Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-23T22:31:38.026937133Z ____________ _____________ 2024-05-23T22:31:38.026953140Z ____ |__( )_________ __/__ /________ __ 2024-05-23T22:31:38.026957009Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-05-23T22:31:38.026960062Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-05-23T22:31:38.026962994Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-05-23T22:31:38.026966349Z [2024-05-23T22:31:38.026+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-05-23T22:31:38.027461578Z [2024-05-23T22:31:38.026+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-05-23T22:31:38.545438760Z [2024-05-23T22:31:38.544+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-05-23T22:31:38.585876879Z [2024-05-23T22:31:38.567+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 16 2024-05-23T22:31:38.598576498Z [2024-05-23T22:31:38.594+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T22:31:38.600420216Z [2024-05-23T22:31:38.595+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-05-23T22:31:38.608305997Z [2024-05-23T22:31:38.607+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-05-23T22:32:40.762026251Z [2024-05-23T22:32:40.761+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:32:40.804996641Z [2024-05-23T22:32:40.804+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:32:40.805045516Z 2024-05-23T22:32:40.805056613Z [2024-05-23T22:32:40.804+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:32:40.805500946Z [2024-05-23T22:32:40.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:32:40.805520666Z 2024-05-23T22:32:40.808093977Z [2024-05-23T22:32:40.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:32:40.808624194Z [2024-05-23T22:32:40.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:32:41.043070512Z [2024-05-23T22:32:41.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:32:41.059380982Z [2024-05-23T22:32:41.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6f49682-4342-41ea-9d95-25ba6e47f3d4 2024-05-23T22:33:12.488113380Z [2024-05-23T22:33:12.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:33:12.494271308Z [2024-05-23T22:33:12.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:32:41.816857+00:00, run_end_date=2024-05-23 22:33:12.266171+00:00, run_duration=30.449314, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=2, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:32:40.805689+00:00, queued_by_job_id=1, pid=49 2024-05-23T22:33:22.697994498Z [2024-05-23T22:33:22.697+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:33:22.698020767Z 2024-05-23T22:33:22.698415284Z [2024-05-23T22:33:22.697+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:33:22.699181357Z [2024-05-23T22:33:22.698+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:33:22.699200076Z 2024-05-23T22:33:22.702195327Z [2024-05-23T22:33:22.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:33:22.702222896Z [2024-05-23T22:33:22.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:33:22.805244899Z [2024-05-23T22:33:22.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 2 2024-05-23T22:33:22.832734588Z [2024-05-23T22:33:22.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec944d62-8126-4bb3-b6bd-2185b324d5d4 2024-05-23T22:33:45.981919176Z [2024-05-23T22:33:45.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:33:45.989538944Z [2024-05-23T22:33:45.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:30:00+00:00, run_id=scheduled__2024-05-23T22:30:00+00:00, run_start_date=2024-05-23 22:32:40.770656+00:00, run_end_date=2024-05-23 22:33:45.981829+00:00, run_duration=65.211173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:30:00+00:00, data_interval_end=2024-05-23 22:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:33:46.020817909Z [2024-05-23T22:33:46.020+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:32:00+00:00, run_after=2024-05-23T22:34:00+00:00 2024-05-23T22:33:46.107915282Z [2024-05-23T22:33:46.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 2 2024-05-23T22:33:46.123322318Z [2024-05-23T22:33:46.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:33:23.406279+00:00, run_end_date=2024-05-23 22:33:45.819903+00:00, run_duration=22.413624, state=success, executor_state=success, try_number=2, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:33:22.699649+00:00, queued_by_job_id=1, pid=67 2024-05-23T22:34:00.822063334Z [2024-05-23T22:34:00.821+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:34:00.868977925Z [2024-05-23T22:34:00.868+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:34:00.868991859Z 2024-05-23T22:34:00.869175525Z [2024-05-23T22:34:00.868+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:34:00.870576181Z [2024-05-23T22:34:00.870+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:34:00.870589874Z 2024-05-23T22:34:00.872959284Z [2024-05-23T22:34:00.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:34:00.873064066Z [2024-05-23T22:34:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:34:00.936236033Z [2024-05-23T22:34:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:32:00+00:00 exited with status queued for try_number 1 2024-05-23T22:34:00.942618559Z [2024-05-23T22:34:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c6192ef-e544-4242-b583-2380b912ad2a 2024-05-23T22:34:02.659847545Z [2024-05-23T22:34:02.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:34:02.660206886Z [2024-05-23T22:34:02.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:32:00+00:00, run_id=scheduled__2024-05-23T22:32:00+00:00, run_start_date=2024-05-23 22:34:00.838843+00:00, run_end_date=2024-05-23 22:34:02.659657+00:00, run_duration=1.820814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:32:00+00:00, data_interval_end=2024-05-23 22:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:34:02.675935748Z [2024-05-23T22:34:02.675+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:34:00+00:00, run_after=2024-05-23T22:36:00+00:00 2024-05-23T22:34:03.011413970Z [2024-05-23T22:34:03.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:32:00+00:00 exited with status success for try_number 1 2024-05-23T22:34:03.023726516Z [2024-05-23T22:34:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:32:00+00:00, map_index=-1, run_start_date=2024-05-23 22:34:01.718838+00:00, run_end_date=2024-05-23 22:34:02.109833+00:00, run_duration=0.390995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:34:00.871071+00:00, queued_by_job_id=1, pid=74 2024-05-23T22:36:00.272944082Z [2024-05-23T22:36:00.272+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:36:00.310494867Z [2024-05-23T22:36:00.310+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:36:00.310532169Z 2024-05-23T22:36:00.310750385Z [2024-05-23T22:36:00.310+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:36:00.311301025Z [2024-05-23T22:36:00.311+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:36:00.311312460Z 2024-05-23T22:36:00.314100563Z [2024-05-23T22:36:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:36:00.314113975Z [2024-05-23T22:36:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:36:00.396834743Z [2024-05-23T22:36:00.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:34:00+00:00 exited with status queued for try_number 1 2024-05-23T22:36:00.407532085Z [2024-05-23T22:36:00.407+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf809377-3f3e-4927-ab18-33c688cea9c1 2024-05-23T22:36:01.573023160Z [2024-05-23T22:36:01.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:36:01.573451714Z [2024-05-23T22:36:01.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:34:00+00:00, run_id=scheduled__2024-05-23T22:34:00+00:00, run_start_date=2024-05-23 22:36:00.282330+00:00, run_end_date=2024-05-23 22:36:01.573137+00:00, run_duration=1.290807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:34:00+00:00, data_interval_end=2024-05-23 22:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:36:01.584283430Z [2024-05-23T22:36:01.584+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:36:00+00:00, run_after=2024-05-23T22:38:00+00:00 2024-05-23T22:36:02.719885730Z [2024-05-23T22:36:02.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:34:00+00:00 exited with status success for try_number 1 2024-05-23T22:36:02.732593771Z [2024-05-23T22:36:02.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:34:00+00:00, map_index=-1, run_start_date=2024-05-23 22:36:01.153989+00:00, run_end_date=2024-05-23 22:36:01.523253+00:00, run_duration=0.369264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:36:00.311529+00:00, queued_by_job_id=1, pid=107 2024-05-23T22:36:38.788127516Z [2024-05-23T22:36:38.787+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T22:38:00.807239158Z [2024-05-23T22:38:00.806+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:38:00.853541573Z [2024-05-23T22:38:00.853+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:00.853552619Z 2024-05-23T22:38:00.853689125Z [2024-05-23T22:38:00.853+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:38:00.854071199Z [2024-05-23T22:38:00.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:00.854078713Z 2024-05-23T22:38:00.857184969Z [2024-05-23T22:38:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:38:00.857317605Z [2024-05-23T22:38:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:38:00.941180709Z [2024-05-23T22:38:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:36:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:00.941207963Z [2024-05-23T22:38:00.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f1ec60a-2c7b-4312-b679-82ad31317913 2024-05-23T22:38:02.387104921Z [2024-05-23T22:38:02.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:38:02.387276740Z [2024-05-23T22:38:02.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:36:00+00:00, run_id=scheduled__2024-05-23T22:36:00+00:00, run_start_date=2024-05-23 22:38:00.821846+00:00, run_end_date=2024-05-23 22:38:02.387053+00:00, run_duration=1.565207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:36:00+00:00, data_interval_end=2024-05-23 22:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:38:02.398032567Z [2024-05-23T22:38:02.397+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:38:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:38:02.425544898Z [2024-05-23T22:38:02.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:36:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:02.435867103Z [2024-05-23T22:38:02.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:36:00+00:00, map_index=-1, run_start_date=2024-05-23 22:38:01.828867+00:00, run_end_date=2024-05-23 22:38:02.257363+00:00, run_duration=0.428496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:00.854320+00:00, queued_by_job_id=1, pid=140 2024-05-23T22:38:30.178317961Z [2024-05-23T22:38:30.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:35:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:38:30.242056125Z [2024-05-23T22:38:30.241+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:30.242149512Z 2024-05-23T22:38:30.242704168Z [2024-05-23T22:38:30.241+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:38:30.245134084Z [2024-05-23T22:38:30.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:30.245162690Z 2024-05-23T22:38:30.263628709Z [2024-05-23T22:38:30.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:38:30.263683103Z [2024-05-23T22:38:30.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:38:30.347224273Z [2024-05-23T22:38:30.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:30.354566425Z [2024-05-23T22:38:30.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10385113-e0b0-490d-821e-e898fd8ecca7 2024-05-23T22:38:32.643032306Z [2024-05-23T22:38:32.642+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:32.643062382Z 2024-05-23T22:38:32.643119781Z [2024-05-23T22:38:32.642+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:38:32.643624018Z [2024-05-23T22:38:32.643+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:32.643632691Z 2024-05-23T22:38:32.645516376Z [2024-05-23T22:38:32.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:38:32.645650127Z [2024-05-23T22:38:32.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:38:32.871230528Z [2024-05-23T22:38:32.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:32.893808463Z [2024-05-23T22:38:32.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fa5288e-dbe4-45fc-9d3a-0163f53a46ce 2024-05-23T22:38:33.057019121Z [2024-05-23T22:38:33.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:33.069673855Z [2024-05-23T22:38:33.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:38:32.225499+00:00, run_end_date=2024-05-23 22:38:32.584761+00:00, run_duration=0.359262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:30.245797+00:00, queued_by_job_id=1, pid=166 2024-05-23T22:38:34.105518587Z [2024-05-23T22:38:34.105+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:38:34.157032660Z [2024-05-23T22:38:34.156+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:34.157062950Z 2024-05-23T22:38:34.157403984Z [2024-05-23T22:38:34.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:38:34.158013048Z [2024-05-23T22:38:34.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:34.158027384Z 2024-05-23T22:38:34.160806374Z [2024-05-23T22:38:34.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:38:34.161054626Z [2024-05-23T22:38:34.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:38:34.267279596Z [2024-05-23T22:38:34.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:37:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:34.275147039Z [2024-05-23T22:38:34.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to eefb62e8-c967-4685-ae1f-3cbb10c758ee 2024-05-23T22:38:35.506455903Z [2024-05-23T22:38:35.505+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:35.506483284Z 2024-05-23T22:38:35.506923208Z [2024-05-23T22:38:35.506+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:38:35.508336875Z [2024-05-23T22:38:35.507+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:35.508357246Z 2024-05-23T22:38:35.512249368Z [2024-05-23T22:38:35.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:38:35.512291955Z [2024-05-23T22:38:35.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:38:35.598157458Z [2024-05-23T22:38:35.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:35.598555775Z [2024-05-23T22:38:35.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:35.619203673Z [2024-05-23T22:38:35.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to e11cb461-dd32-476c-b743-84886219b759 2024-05-23T22:38:35.619769723Z [2024-05-23T22:38:35.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:38:34.709153+00:00, run_end_date=2024-05-23 22:38:35.210217+00:00, run_duration=0.501064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:32.643986+00:00, queued_by_job_id=1, pid=180 2024-05-23T22:38:35.669433240Z [2024-05-23T22:38:35.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:38:00+00:00, run_after=2024-05-23T22:39:00+00:00 2024-05-23T22:38:35.789326269Z [2024-05-23T22:38:35.789+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:35.789341031Z 2024-05-23T22:38:35.789369913Z [2024-05-23T22:38:35.789+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:38:35.791428963Z [2024-05-23T22:38:35.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:35.791441673Z 2024-05-23T22:38:35.793524544Z [2024-05-23T22:38:35.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:38:35.793581304Z [2024-05-23T22:38:35.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:38:35.927217804Z [2024-05-23T22:38:35.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:37:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:35.936656765Z [2024-05-23T22:38:35.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 555b0472-8c41-48c6-8835-c6d1a55ec8bb 2024-05-23T22:38:38.264235954Z [2024-05-23T22:38:38.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:38:38.264499430Z [2024-05-23T22:38:38.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:37:00+00:00, run_id=scheduled__2024-05-23T22:37:00+00:00, run_start_date=2024-05-23 22:38:34.114681+00:00, run_end_date=2024-05-23 22:38:38.264127+00:00, run_duration=4.149446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:37:00+00:00, data_interval_end=2024-05-23 22:38:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:38:38.278066931Z [2024-05-23T22:38:38.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:38:00+00:00, run_after=2024-05-23T22:39:00+00:00 2024-05-23T22:38:38.304528929Z [2024-05-23T22:38:38.304+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:38.304548593Z 2024-05-23T22:38:38.304969144Z [2024-05-23T22:38:38.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:38:38.305931753Z [2024-05-23T22:38:38.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:38.305942063Z 2024-05-23T22:38:38.309272666Z [2024-05-23T22:38:38.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:38:38.309627317Z [2024-05-23T22:38:38.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:38:38.375284315Z [2024-05-23T22:38:38.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:38.375587888Z [2024-05-23T22:38:38.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:37:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:38.375701409Z [2024-05-23T22:38:38.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:38.388134738Z [2024-05-23T22:38:38.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:37:00+00:00, map_index=-1, run_start_date=2024-05-23 22:38:36.125633+00:00, run_end_date=2024-05-23 22:38:37.748047+00:00, run_duration=1.622414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:34.158426+00:00, queued_by_job_id=1, pid=189 2024-05-23T22:38:38.388839103Z [2024-05-23T22:38:38.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=0, run_start_date=2024-05-23 22:38:37.376244+00:00, run_end_date=2024-05-23 22:38:37.800059+00:00, run_duration=0.423815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:35.509232+00:00, queued_by_job_id=1, pid=202 2024-05-23T22:38:38.389105818Z [2024-05-23T22:38:38.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ceeeeaf-da92-48dd-adfe-a1f486c211e4 2024-05-23T22:38:40.305837700Z [2024-05-23T22:38:40.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:38:40.306119916Z [2024-05-23T22:38:40.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:37:00+00:00, run_id=scheduled__2024-05-23T22:37:00+00:00, run_start_date=2024-05-23 22:38:35.680787+00:00, run_end_date=2024-05-23 22:38:40.305838+00:00, run_duration=4.625051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:37:00+00:00, data_interval_end=2024-05-23 22:38:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:38:40.313986403Z [2024-05-23T22:38:40.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:38:00+00:00, run_after=2024-05-23T22:39:00+00:00 2024-05-23T22:38:40.322123433Z [2024-05-23T22:38:40.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:38:40.322336918Z [2024-05-23T22:38:40.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:30:00+00:00, run_id=scheduled__2024-05-23T22:30:00+00:00, run_start_date=2024-05-23 22:38:30.189908+00:00, run_end_date=2024-05-23 22:38:40.322124+00:00, run_duration=10.132216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:30:00+00:00, data_interval_end=2024-05-23 22:35:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T22:38:40.330379179Z [2024-05-23T22:38:40.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:35:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:38:40.371375798Z [2024-05-23T22:38:40.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:37:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:40.380337411Z [2024-05-23T22:38:40.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:37:00+00:00, map_index=-1, run_start_date=2024-05-23 22:38:37.881767+00:00, run_end_date=2024-05-23 22:38:39.380067+00:00, run_duration=1.4983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:35.791798+00:00, queued_by_job_id=1, pid=208 2024-05-23T22:38:40.496362489Z [2024-05-23T22:38:40.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:40.503442329Z [2024-05-23T22:38:40.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:38:39.928538+00:00, run_end_date=2024-05-23 22:38:40.270177+00:00, run_duration=0.341639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:38.307276+00:00, queued_by_job_id=1, pid=221 2024-05-23T22:38:50.792549351Z [2024-05-23T22:38:50.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:38:00+00:00, run_after=2024-05-23T22:39:00+00:00 2024-05-23T22:38:50.822769868Z [2024-05-23T22:38:50.822+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:38:50.822819900Z 2024-05-23T22:38:50.822842747Z [2024-05-23T22:38:50.822+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:38:50.823269923Z [2024-05-23T22:38:50.823+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:38:50.823287975Z 2024-05-23T22:38:50.825066783Z [2024-05-23T22:38:50.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:38:50.825297062Z [2024-05-23T22:38:50.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:38:50.883636413Z [2024-05-23T22:38:50.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:37:00+00:00 exited with status queued for try_number 1 2024-05-23T22:38:50.892502931Z [2024-05-23T22:38:50.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b61b5d3-b40b-4396-bebc-d1020fc3cc02 2024-05-23T22:38:52.798359421Z [2024-05-23T22:38:52.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:38:52.798966389Z [2024-05-23T22:38:52.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:37:00+00:00, run_id=scheduled__2024-05-23T22:37:00+00:00, run_start_date=2024-05-23 22:38:50.801044+00:00, run_end_date=2024-05-23 22:38:52.798428+00:00, run_duration=1.997384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:37:00+00:00, data_interval_end=2024-05-23 22:38:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:38:52.812755397Z [2024-05-23T22:38:52.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:38:00+00:00, run_after=2024-05-23T22:39:00+00:00 2024-05-23T22:38:52.853011845Z [2024-05-23T22:38:52.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:37:00+00:00 exited with status success for try_number 1 2024-05-23T22:38:52.859769609Z [2024-05-23T22:38:52.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:37:00+00:00, map_index=-1, run_start_date=2024-05-23 22:38:51.633138+00:00, run_end_date=2024-05-23 22:38:52.035590+00:00, run_duration=0.402452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:38:50.823502+00:00, queued_by_job_id=1, pid=228 2024-05-23T22:39:00.200615287Z [2024-05-23T22:39:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:00.231010292Z [2024-05-23T22:39:00.230+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:39:00.241852235Z [2024-05-23T22:39:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:00.302666194Z [2024-05-23T22:39:00.302+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:39:00.302689896Z 2024-05-23T22:39:00.302693603Z 2024-05-23T22:39:00.302696667Z 2024-05-23T22:39:00.302833286Z [2024-05-23T22:39:00.302+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:39:00.303074916Z [2024-05-23T22:39:00.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:39:00.303254744Z [2024-05-23T22:39:00.303+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:39:00.303803356Z [2024-05-23T22:39:00.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:39:00.303818190Z 2024-05-23T22:39:00.303833670Z 2024-05-23T22:39:00.303836532Z 2024-05-23T22:39:00.307445422Z [2024-05-23T22:39:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:39:00.307618603Z [2024-05-23T22:39:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:39:00.307875463Z [2024-05-23T22:39:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:39:00.308058290Z [2024-05-23T22:39:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:39:00.308329289Z [2024-05-23T22:39:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:39:00.308546283Z [2024-05-23T22:39:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:39:00.770278201Z [2024-05-23T22:39:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:00.770672070Z [2024-05-23T22:39:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:00.770924881Z [2024-05-23T22:39:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:00.785749601Z [2024-05-23T22:39:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f7647e6-308b-44ef-bbbb-10f966d99301 2024-05-23T22:39:00.790839773Z [2024-05-23T22:39:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3783f35c-c622-4316-811a-0fe0284ee8fc 2024-05-23T22:39:00.790993385Z [2024-05-23T22:39:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74d7406a-c69c-4bf2-9b12-aeb542861ac7 2024-05-23T22:39:03.006615841Z [2024-05-23T22:39:03.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:39:03.007447675Z [2024-05-23T22:39:03.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:38:00+00:00, run_id=scheduled__2024-05-23T22:38:00+00:00, run_start_date=2024-05-23 22:39:00.254558+00:00, run_end_date=2024-05-23 22:39:03.007011+00:00, run_duration=2.752453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:38:00+00:00, data_interval_end=2024-05-23 22:39:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:39:03.031747470Z [2024-05-23T22:39:03.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:03.110170443Z [2024-05-23T22:39:03.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:03.124571722Z [2024-05-23T22:39:03.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:38:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:01.761542+00:00, run_end_date=2024-05-23 22:39:02.211404+00:00, run_duration=0.449862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:00.304348+00:00, queued_by_job_id=1, pid=243 2024-05-23T22:39:05.501718415Z [2024-05-23T22:39:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:39:05.502061314Z [2024-05-23T22:39:05.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:38:00+00:00, run_id=scheduled__2024-05-23T22:38:00+00:00, run_start_date=2024-05-23 22:39:00.252953+00:00, run_end_date=2024-05-23 22:39:05.501732+00:00, run_duration=5.248779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:38:00+00:00, data_interval_end=2024-05-23 22:39:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:39:05.513845542Z [2024-05-23T22:39:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:05.520847864Z [2024-05-23T22:39:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:39:05.521124284Z [2024-05-23T22:39:05.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:38:00+00:00, run_id=scheduled__2024-05-23T22:38:00+00:00, run_start_date=2024-05-23 22:39:00.254252+00:00, run_end_date=2024-05-23 22:39:05.520853+00:00, run_duration=5.266601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:38:00+00:00, data_interval_end=2024-05-23 22:39:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:39:05.529442322Z [2024-05-23T22:39:05.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:05.560820385Z [2024-05-23T22:39:05.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:05.560931165Z [2024-05-23T22:39:05.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:05.566815009Z [2024-05-23T22:39:05.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:38:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:02.949429+00:00, run_end_date=2024-05-23 22:39:05.158271+00:00, run_duration=2.208842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:00.304348+00:00, queued_by_job_id=1, pid=261 2024-05-23T22:39:05.567022797Z [2024-05-23T22:39:05.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:38:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:02.776024+00:00, run_end_date=2024-05-23 22:39:04.274029+00:00, run_duration=1.498005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:00.304348+00:00, queued_by_job_id=1, pid=260 2024-05-23T22:39:34.275866208Z [2024-05-23T22:39:34.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:35:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:34.313769627Z [2024-05-23T22:39:34.313+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:39:34.313794642Z 2024-05-23T22:39:34.313799788Z [2024-05-23T22:39:34.313+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:39:34.314277615Z [2024-05-23T22:39:34.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:39:34.314283293Z 2024-05-23T22:39:34.317465696Z [2024-05-23T22:39:34.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:39:34.317740980Z [2024-05-23T22:39:34.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:39:34.374560343Z [2024-05-23T22:39:34.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:34.391971500Z [2024-05-23T22:39:34.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0aa78a2a-a496-406b-a12c-502dbf26b141 2024-05-23T22:39:36.651484118Z [2024-05-23T22:39:36.651+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:39:36.651504715Z 2024-05-23T22:39:36.651758846Z [2024-05-23T22:39:36.651+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:39:36.652336762Z [2024-05-23T22:39:36.652+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:39:36.652361755Z 2024-05-23T22:39:36.654713773Z [2024-05-23T22:39:36.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='split_metrics', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:39:36.654938451Z [2024-05-23T22:39:36.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'split_metrics', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:39:36.693525833Z [2024-05-23T22:39:36.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.split_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:36.693548084Z [2024-05-23T22:39:36.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:36.702054590Z [2024-05-23T22:39:36.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:35.864746+00:00, run_end_date=2024-05-23 22:39:36.219878+00:00, run_duration=0.355132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:34.314490+00:00, queued_by_job_id=1, pid=293 2024-05-23T22:39:36.702174822Z [2024-05-23T22:39:36.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6540725d-ea87-4078-9c12-ea5a7a76db9c 2024-05-23T22:39:38.966592773Z [2024-05-23T22:39:38.961+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:39:39.025438938Z [2024-05-23T22:39:39.024+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:39:39.025469436Z 2024-05-23T22:39:39.025472937Z 2024-05-23T22:39:39.025476288Z [2024-05-23T22:39:39.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:39:39.025479297Z [2024-05-23T22:39:39.024+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:39:39.026335784Z [2024-05-23T22:39:39.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:39:39.026363193Z 2024-05-23T22:39:39.026367324Z 2024-05-23T22:39:39.029520268Z [2024-05-23T22:39:39.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:39:39.029744315Z [2024-05-23T22:39:39.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'collect_metrics', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:39:39.030012275Z [2024-05-23T22:39:39.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:39:39.030177517Z [2024-05-23T22:39:39.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:39:39.254144194Z [2024-05-23T22:39:39.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.collect_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:39.254407117Z [2024-05-23T22:39:39.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:39.256585536Z [2024-05-23T22:39:39.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.split_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:39.269967101Z [2024-05-23T22:39:39.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to abf89599-0ab6-4d1d-9bd8-9894715443bf 2024-05-23T22:39:39.274935959Z [2024-05-23T22:39:39.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=split_metrics, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:38.258920+00:00, run_end_date=2024-05-23 22:39:38.618706+00:00, run_duration=0.359786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:36.652779+00:00, queued_by_job_id=1, pid=306 2024-05-23T22:39:39.275205362Z [2024-05-23T22:39:39.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51cebb40-405b-4281-8f98-9af2c1224071 2024-05-23T22:39:41.108075894Z [2024-05-23T22:39:41.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:41.183824512Z [2024-05-23T22:39:41.183+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:39:41.183838113Z 2024-05-23T22:39:41.184046222Z [2024-05-23T22:39:41.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:39:41.185499596Z [2024-05-23T22:39:41.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:39:41.185510313Z 2024-05-23T22:39:41.188922458Z [2024-05-23T22:39:41.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:39:41.189152904Z [2024-05-23T22:39:41.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:39:41.276719135Z [2024-05-23T22:39:41.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:41.286211398Z [2024-05-23T22:39:41.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc178560-e32f-4729-b5f8-09f80150dd20 2024-05-23T22:39:41.361809768Z [2024-05-23T22:39:41.361+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:39:41.361840189Z 2024-05-23T22:39:41.361882668Z [2024-05-23T22:39:41.361+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:39:41.362413022Z [2024-05-23T22:39:41.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:39:41.362421364Z 2024-05-23T22:39:41.366083808Z [2024-05-23T22:39:41.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:39:41.366162592Z [2024-05-23T22:39:41.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'send_prometheus', 'scheduled__2024-05-23T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:39:41.441724892Z [2024-05-23T22:39:41.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.send_prometheus run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status queued for try_number 1 2024-05-23T22:39:41.442936507Z [2024-05-23T22:39:41.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.collect_metrics run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:41.451549720Z [2024-05-23T22:39:41.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e973b00-20f0-4a3f-8945-6dd3f2ad12a2 2024-05-23T22:39:41.451665810Z [2024-05-23T22:39:41.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=0, run_start_date=2024-05-23 22:39:40.905517+00:00, run_end_date=2024-05-23 22:39:41.282367+00:00, run_duration=0.37685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:39.027046+00:00, queued_by_job_id=1, pid=321 2024-05-23T22:39:43.357815481Z [2024-05-23T22:39:43.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:39:43.358624735Z [2024-05-23T22:39:43.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:38:00+00:00, run_id=scheduled__2024-05-23T22:38:00+00:00, run_start_date=2024-05-23 22:39:38.970708+00:00, run_end_date=2024-05-23 22:39:43.358249+00:00, run_duration=4.387541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:38:00+00:00, data_interval_end=2024-05-23 22:39:00+00:00, dag_hash=7a7e47b14dadd5dc0462fdae4cf3272e 2024-05-23T22:39:43.373416650Z [2024-05-23T22:39:43.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:43.436983156Z [2024-05-23T22:39:43.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:43.445425329Z [2024-05-23T22:39:43.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:38:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:41.045535+00:00, run_end_date=2024-05-23 22:39:42.804543+00:00, run_duration=1.759008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:39.027046+00:00, queued_by_job_id=1, pid=322 2024-05-23T22:39:44.505661257Z [2024-05-23T22:39:44.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:39:44.506027913Z [2024-05-23T22:39:44.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:30:00+00:00, run_id=scheduled__2024-05-23T22:30:00+00:00, run_start_date=2024-05-23 22:39:34.285931+00:00, run_end_date=2024-05-23 22:39:44.505558+00:00, run_duration=10.219627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:30:00+00:00, data_interval_end=2024-05-23 22:35:00+00:00, dag_hash=6b693a7fa30823eb170688396a87da12 2024-05-23T22:39:44.515742699Z [2024-05-23T22:39:44.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:35:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:44.522714491Z [2024-05-23T22:39:44.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:39:44.523082226Z [2024-05-23T22:39:44.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:38:00+00:00, run_id=scheduled__2024-05-23T22:38:00+00:00, run_start_date=2024-05-23 22:39:41.117738+00:00, run_end_date=2024-05-23 22:39:44.522643+00:00, run_duration=3.404905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:38:00+00:00, data_interval_end=2024-05-23 22:39:00+00:00, dag_hash=7520c51b48a656eaf39381587a54a765 2024-05-23T22:39:44.547513261Z [2024-05-23T22:39:44.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:39:00+00:00, run_after=2024-05-23T22:40:00+00:00 2024-05-23T22:39:44.591578778Z [2024-05-23T22:39:44.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.send_prometheus run_id=scheduled__2024-05-23T22:30:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:44.601477360Z [2024-05-23T22:39:44.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:30:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:43.508890+00:00, run_end_date=2024-05-23 22:39:43.941919+00:00, run_duration=0.433029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:41.362755+00:00, queued_by_job_id=1, pid=348 2024-05-23T22:39:45.687452576Z [2024-05-23T22:39:45.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status success for try_number 1 2024-05-23T22:39:45.694436622Z [2024-05-23T22:39:45.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:38:00+00:00, map_index=-1, run_start_date=2024-05-23 22:39:43.157572+00:00, run_end_date=2024-05-23 22:39:44.438912+00:00, run_duration=1.28134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:39:41.185899+00:00, queued_by_job_id=1, pid=337 2024-05-23T22:40:00.207501616Z [2024-05-23T22:40:00.206+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:40:00.223591197Z [2024-05-23T22:40:00.223+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:40:00.231317462Z [2024-05-23T22:40:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:40:00.242651263Z [2024-05-23T22:40:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:40:00.252170991Z [2024-05-23T22:40:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:00.261885952Z [2024-05-23T22:40:00.261+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:00.272162691Z [2024-05-23T22:40:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:00.282406228Z [2024-05-23T22:40:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:40:00.431200416Z [2024-05-23T22:40:00.430+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-05-23T22:40:00.431223598Z 2024-05-23T22:40:00.431227064Z 2024-05-23T22:40:00.431230270Z 2024-05-23T22:40:00.431236639Z 2024-05-23T22:40:00.431239944Z 2024-05-23T22:40:00.431243031Z 2024-05-23T22:40:00.431246135Z 2024-05-23T22:40:00.431249229Z 2024-05-23T22:40:00.431258434Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:40:00.431323883Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:40:00.431386117Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:40:00.431466724Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:40:00.431531200Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG vim_status_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:40:00.431603386Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:40:00.431666756Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:40:00.431745401Z [2024-05-23T22:40:00.431+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:40:00.432218830Z [2024-05-23T22:40:00.432+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:00.432229200Z 2024-05-23T22:40:00.432232536Z 2024-05-23T22:40:00.432236142Z 2024-05-23T22:40:00.432239296Z 2024-05-23T22:40:00.432242219Z 2024-05-23T22:40:00.432245265Z 2024-05-23T22:40:00.432248196Z 2024-05-23T22:40:00.432251122Z 2024-05-23T22:40:00.439283099Z [2024-05-23T22:40:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:40:00.439385177Z [2024-05-23T22:40:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:00.439551432Z [2024-05-23T22:40:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:40:00.439658933Z [2024-05-23T22:40:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:00.439816697Z [2024-05-23T22:40:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:00.439887772Z [2024-05-23T22:40:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:40:00.440078039Z [2024-05-23T22:40:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:00.440179417Z [2024-05-23T22:40:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:40:00.440283873Z [2024-05-23T22:40:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:00.440367833Z [2024-05-23T22:40:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:40:00.440604517Z [2024-05-23T22:40:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:00.440738908Z [2024-05-23T22:40:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:40:00.440928761Z [2024-05-23T22:40:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:00.440998167Z [2024-05-23T22:40:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:40:00.442050057Z [2024-05-23T22:40:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:00.442054961Z [2024-05-23T22:40:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:40:01.345000376Z [2024-05-23T22:40:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.345945586Z [2024-05-23T22:40:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.346116026Z [2024-05-23T22:40:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.346411496Z [2024-05-23T22:40:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.346536491Z [2024-05-23T22:40:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.346784676Z [2024-05-23T22:40:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.346950508Z [2024-05-23T22:40:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.351027747Z [2024-05-23T22:40:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:01.387642100Z [2024-05-23T22:40:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83326e03-442d-4791-ba42-27f9da287764 2024-05-23T22:40:01.387757269Z [2024-05-23T22:40:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to abe4153a-bbb6-44fd-85d1-3346ce1656c7 2024-05-23T22:40:01.388043983Z [2024-05-23T22:40:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to a03227b5-1662-4060-b048-87059bb32552 2024-05-23T22:40:01.388279044Z [2024-05-23T22:40:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to e686521f-046f-445e-99e6-bf2852af447e 2024-05-23T22:40:01.388775889Z [2024-05-23T22:40:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cbc7f24-b74d-4cfb-98b3-9c9786411a70 2024-05-23T22:40:01.389906965Z [2024-05-23T22:40:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 541f6317-719b-4798-821d-8b0c86f552c4 2024-05-23T22:40:01.389919631Z [2024-05-23T22:40:01.389+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4f03851-51d2-4958-9bef-2c6efe31971e 2024-05-23T22:40:01.389938951Z [2024-05-23T22:40:01.389+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f2b9f1a-9756-4436-92e0-2c22315bfdf4 2024-05-23T22:40:04.981006325Z [2024-05-23T22:40:04.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:04.981563301Z [2024-05-23T22:40:04.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:38:00+00:00, run_id=scheduled__2024-05-23T22:38:00+00:00, run_start_date=2024-05-23 22:40:00.294038+00:00, run_end_date=2024-05-23 22:40:04.980992+00:00, run_duration=4.686954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:38:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:40:05.015003393Z [2024-05-23T22:40:05.014+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:40:05.026048786Z [2024-05-23T22:40:05.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:05.026630021Z [2024-05-23T22:40:05.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:39:00+00:00, run_id=scheduled__2024-05-23T22:39:00+00:00, run_start_date=2024-05-23 22:40:00.297093+00:00, run_end_date=2024-05-23 22:40:05.025957+00:00, run_duration=4.728864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:39:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:40:05.040850264Z [2024-05-23T22:40:05.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:05.237004670Z [2024-05-23T22:40:05.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:38:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:05.237067557Z [2024-05-23T22:40:05.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:05.249352703Z [2024-05-23T22:40:05.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:38:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:02.770917+00:00, run_end_date=2024-05-23 22:40:03.797608+00:00, run_duration=1.026691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=363 2024-05-23T22:40:05.249645982Z [2024-05-23T22:40:05.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:39:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:03.025638+00:00, run_end_date=2024-05-23 22:40:04.221474+00:00, run_duration=1.195836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=365 2024-05-23T22:40:06.479576677Z [2024-05-23T22:40:06.479+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:40:06.479598364Z 2024-05-23T22:40:06.479601630Z 2024-05-23T22:40:06.479698456Z [2024-05-23T22:40:06.479+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:40:06.479860635Z [2024-05-23T22:40:06.479+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:40:06.481533822Z [2024-05-23T22:40:06.481+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:06.481550070Z 2024-05-23T22:40:06.481553670Z 2024-05-23T22:40:06.485699860Z [2024-05-23T22:40:06.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:40:06.485946442Z [2024-05-23T22:40:06.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:06.486268102Z [2024-05-23T22:40:06.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='split_metrics', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:40:06.486442101Z [2024-05-23T22:40:06.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'split_metrics', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:06.885397937Z [2024-05-23T22:40:06.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:06.885675515Z [2024-05-23T22:40:06.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.split_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:06.885918483Z [2024-05-23T22:40:06.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:06.886065696Z [2024-05-23T22:40:06.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:06.886208341Z [2024-05-23T22:40:06.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:06.912290463Z [2024-05-23T22:40:06.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to e500d186-a18b-430b-8d21-92e36cbb75df 2024-05-23T22:40:06.913988114Z [2024-05-23T22:40:06.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:05.769766+00:00, run_end_date=2024-05-23 22:40:06.272027+00:00, run_duration=0.502261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=413 2024-05-23T22:40:06.914337921Z [2024-05-23T22:40:06.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3cd1035-1849-418e-985c-9b5f13d5dfe8 2024-05-23T22:40:06.914645456Z [2024-05-23T22:40:06.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:04.737526+00:00, run_end_date=2024-05-23 22:40:05.682019+00:00, run_duration=0.944493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=391 2024-05-23T22:40:06.914918447Z [2024-05-23T22:40:06.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:39:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:04.186085+00:00, run_end_date=2024-05-23 22:40:06.333506+00:00, run_duration=2.147421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=383 2024-05-23T22:40:07.007157577Z [2024-05-23T22:40:07.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:07.007577019Z [2024-05-23T22:40:07.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:39:00+00:00, run_id=scheduled__2024-05-23T22:39:00+00:00, run_start_date=2024-05-23 22:40:00.296152+00:00, run_end_date=2024-05-23 22:40:07.007179+00:00, run_duration=6.711027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:39:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=7520c51b48a656eaf39381587a54a765 2024-05-23T22:40:07.024746777Z [2024-05-23T22:40:07.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:07.540979181Z [2024-05-23T22:40:07.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:07.541489914Z [2024-05-23T22:40:07.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:39:00+00:00, run_id=scheduled__2024-05-23T22:39:00+00:00, run_start_date=2024-05-23 22:40:00.299087+00:00, run_end_date=2024-05-23 22:40:07.541164+00:00, run_duration=7.242077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:39:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=7a7e47b14dadd5dc0462fdae4cf3272e 2024-05-23T22:40:07.562198187Z [2024-05-23T22:40:07.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:07.783418333Z [2024-05-23T22:40:07.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:07.807684158Z [2024-05-23T22:40:07.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:39:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:05.331380+00:00, run_end_date=2024-05-23 22:40:07.375855+00:00, run_duration=2.044475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=402 2024-05-23T22:40:10.260425262Z [2024-05-23T22:40:10.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:10.260694849Z [2024-05-23T22:40:10.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:39:00+00:00, run_id=scheduled__2024-05-23T22:39:00+00:00, run_start_date=2024-05-23 22:40:00.294988+00:00, run_end_date=2024-05-23 22:40:10.260322+00:00, run_duration=9.965334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:39:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:40:10.272824380Z [2024-05-23T22:40:10.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:10.279097551Z [2024-05-23T22:40:10.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:10.286432183Z [2024-05-23T22:40:10.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:39:00+00:00, run_id=scheduled__2024-05-23T22:39:00+00:00, run_start_date=2024-05-23 22:40:00.298101+00:00, run_end_date=2024-05-23 22:40:10.286021+00:00, run_duration=9.98792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:39:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:40:10.322737060Z [2024-05-23T22:40:10.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:10.369140303Z [2024-05-23T22:40:10.368+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:40:10.369161173Z 2024-05-23T22:40:10.369318671Z [2024-05-23T22:40:10.369+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:40:10.369831239Z [2024-05-23T22:40:10.369+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:10.369840415Z 2024-05-23T22:40:10.372173657Z [2024-05-23T22:40:10.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:40:10.372306848Z [2024-05-23T22:40:10.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'collect_metrics', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:40:10.589205970Z [2024-05-23T22:40:10.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.collect_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:10.589647619Z [2024-05-23T22:40:10.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:10.591241663Z [2024-05-23T22:40:10.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:10.591454338Z [2024-05-23T22:40:10.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.split_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:10.660968924Z [2024-05-23T22:40:10.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:39:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:07.001636+00:00, run_end_date=2024-05-23 22:40:09.435117+00:00, run_duration=2.433481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=437 2024-05-23T22:40:10.666891236Z [2024-05-23T22:40:10.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:39:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:06.927915+00:00, run_end_date=2024-05-23 22:40:08.968711+00:00, run_duration=2.040796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:00.433584+00:00, queued_by_job_id=1, pid=436 2024-05-23T22:40:10.667216832Z [2024-05-23T22:40:10.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=split_metrics, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:08.991008+00:00, run_end_date=2024-05-23 22:40:09.541922+00:00, run_duration=0.550914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:06.482236+00:00, queued_by_job_id=1, pid=455 2024-05-23T22:40:10.670958231Z [2024-05-23T22:40:10.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb03d230-4cd2-411e-8b26-4f059e2e743b 2024-05-23T22:40:11.052467407Z [2024-05-23T22:40:11.051+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:40:11.052487676Z 2024-05-23T22:40:11.052735031Z [2024-05-23T22:40:11.052+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:40:11.053322881Z [2024-05-23T22:40:11.053+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:11.053334171Z 2024-05-23T22:40:11.056651578Z [2024-05-23T22:40:11.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:40:11.056939367Z [2024-05-23T22:40:11.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:40:11.167256949Z [2024-05-23T22:40:11.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:11.168140403Z [2024-05-23T22:40:11.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:11.176836331Z [2024-05-23T22:40:11.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:09.958778+00:00, run_end_date=2024-05-23 22:40:10.627904+00:00, run_duration=0.669126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:06.482236+00:00, queued_by_job_id=1, pid=461 2024-05-23T22:40:11.177876237Z [2024-05-23T22:40:11.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69c8b7da-a40b-4515-9e69-ef04d6ed752f 2024-05-23T22:40:14.196935723Z [2024-05-23T22:40:14.196+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:40:14.196975777Z 2024-05-23T22:40:14.197000293Z 2024-05-23T22:40:14.197256486Z [2024-05-23T22:40:14.196+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:40:14.197548830Z [2024-05-23T22:40:14.197+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:40:14.198413011Z [2024-05-23T22:40:14.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:14.198426417Z 2024-05-23T22:40:14.198431205Z 2024-05-23T22:40:14.202125638Z [2024-05-23T22:40:14.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:14.202244261Z [2024-05-23T22:40:14.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:14.202565040Z [2024-05-23T22:40:14.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:14.207078224Z [2024-05-23T22:40:14.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'send_prometheus', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:14.407070086Z [2024-05-23T22:40:14.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:14.407105362Z [2024-05-23T22:40:14.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.send_prometheus run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:14.407138030Z [2024-05-23T22:40:14.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.collect_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:14.407227143Z [2024-05-23T22:40:14.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:14.420577875Z [2024-05-23T22:40:14.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=0, run_start_date=2024-05-23 22:40:13.573881+00:00, run_end_date=2024-05-23 22:40:13.906117+00:00, run_duration=0.332236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:11.054811+00:00, queued_by_job_id=1, pid=477 2024-05-23T22:40:14.420895631Z [2024-05-23T22:40:14.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 243b48fa-3388-4ff1-b40d-55ac170474b5 2024-05-23T22:40:14.421065013Z [2024-05-23T22:40:14.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=0, run_start_date=2024-05-23 22:40:12.805093+00:00, run_end_date=2024-05-23 22:40:13.363711+00:00, run_duration=0.558618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:10.370118+00:00, queued_by_job_id=1, pid=471 2024-05-23T22:40:14.421658798Z [2024-05-23T22:40:14.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fe2ec54-5f62-4c00-8b34-a651b67fde1f 2024-05-23T22:40:16.706247349Z [2024-05-23T22:40:16.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:16.706703485Z [2024-05-23T22:40:16.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:35:00+00:00, run_id=scheduled__2024-05-23T22:35:00+00:00, run_start_date=2024-05-23 22:40:00.292034+00:00, run_end_date=2024-05-23 22:40:16.706265+00:00, run_duration=16.414231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:35:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T22:40:16.713015665Z [2024-05-23T22:40:16.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:40:16.719464645Z [2024-05-23T22:40:16.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:16.719699581Z [2024-05-23T22:40:16.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:35:00+00:00, run_id=scheduled__2024-05-23T22:35:00+00:00, run_start_date=2024-05-23 22:40:00.293100+00:00, run_end_date=2024-05-23 22:40:16.719458+00:00, run_duration=16.426358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:35:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=6b693a7fa30823eb170688396a87da12 2024-05-23T22:40:16.725756572Z [2024-05-23T22:40:16.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:40:16.761131826Z [2024-05-23T22:40:16.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e.send_prometheus run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:16.768851459Z [2024-05-23T22:40:16.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:16.115296+00:00, run_end_date=2024-05-23 22:40:16.585446+00:00, run_duration=0.47015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:14.199199+00:00, queued_by_job_id=1, pid=492 2024-05-23T22:40:17.856087673Z [2024-05-23T22:40:17.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:17.868258595Z [2024-05-23T22:40:17.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:16.248857+00:00, run_end_date=2024-05-23 22:40:16.630611+00:00, run_duration=0.381754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:14.199199+00:00, queued_by_job_id=1, pid=493 2024-05-23T22:40:38.397465537Z [2024-05-23T22:40:38.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:40:38.456671825Z [2024-05-23T22:40:38.455+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:40:38.456722375Z 2024-05-23T22:40:38.457184604Z [2024-05-23T22:40:38.456+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:40:38.459083967Z [2024-05-23T22:40:38.458+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:38.459114687Z 2024-05-23T22:40:38.464433922Z [2024-05-23T22:40:38.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:40:38.464846928Z [2024-05-23T22:40:38.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:38.528392671Z [2024-05-23T22:40:38.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:38.543403771Z [2024-05-23T22:40:38.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5718c4c-3fdc-48a6-a7b6-b503a4bd3ba2 2024-05-23T22:40:40.471539148Z [2024-05-23T22:40:40.471+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:40:40.471586993Z 2024-05-23T22:40:40.472688472Z [2024-05-23T22:40:40.471+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:40:40.473780584Z [2024-05-23T22:40:40.473+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:40.473793132Z 2024-05-23T22:40:40.477345881Z [2024-05-23T22:40:40.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='split_metrics', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:40:40.477406034Z [2024-05-23T22:40:40.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'split_metrics', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:40.521639892Z [2024-05-23T22:40:40.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.split_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:40.527534858Z [2024-05-23T22:40:40.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 234d39f1-cd94-49bb-a74b-3e378eb72236 2024-05-23T22:40:40.620166499Z [2024-05-23T22:40:40.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:40.627861324Z [2024-05-23T22:40:40.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:40.054331+00:00, run_end_date=2024-05-23 22:40:40.418916+00:00, run_duration=0.364585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:38.459917+00:00, queued_by_job_id=1, pid=513 2024-05-23T22:40:42.550625297Z [2024-05-23T22:40:42.550+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:40:42.550664768Z 2024-05-23T22:40:42.550672277Z [2024-05-23T22:40:42.550+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:40:42.551214923Z [2024-05-23T22:40:42.550+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:42.551233258Z 2024-05-23T22:40:42.552922793Z [2024-05-23T22:40:42.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:40:42.552962657Z [2024-05-23T22:40:42.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'collect_metrics', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:40:42.609744714Z [2024-05-23T22:40:42.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.collect_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:42.611096489Z [2024-05-23T22:40:42.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.split_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:42.617181906Z [2024-05-23T22:40:42.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=split_metrics, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:41.900109+00:00, run_end_date=2024-05-23 22:40:42.244423+00:00, run_duration=0.344314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:40.474534+00:00, queued_by_job_id=1, pid=526 2024-05-23T22:40:42.618030933Z [2024-05-23T22:40:42.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 403417cf-d221-420a-adad-4e8a1f8777f5 2024-05-23T22:40:44.724421245Z [2024-05-23T22:40:44.723+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:40:44.790318487Z [2024-05-23T22:40:44.789+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:40:44.790347546Z 2024-05-23T22:40:44.790353696Z 2024-05-23T22:40:44.790496432Z [2024-05-23T22:40:44.790+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:40:44.790895477Z [2024-05-23T22:40:44.790+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:40:44.791714860Z [2024-05-23T22:40:44.791+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:44.791727591Z 2024-05-23T22:40:44.791732797Z 2024-05-23T22:40:44.795636023Z [2024-05-23T22:40:44.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:44.795833047Z [2024-05-23T22:40:44.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'send_prometheus', 'scheduled__2024-05-23T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:40:44.796204895Z [2024-05-23T22:40:44.796+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:44.796499877Z [2024-05-23T22:40:44.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:40:44.962335844Z [2024-05-23T22:40:44.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.send_prometheus run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:44.962459430Z [2024-05-23T22:40:44.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:44.962642637Z [2024-05-23T22:40:44.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.collect_metrics run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:44.971437427Z [2024-05-23T22:40:44.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to a29dfb43-fa05-4bc0-aa49-135a2837217c 2024-05-23T22:40:44.971692904Z [2024-05-23T22:40:44.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=0, run_start_date=2024-05-23 22:40:44.203223+00:00, run_end_date=2024-05-23 22:40:44.601918+00:00, run_duration=0.398695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:42.551348+00:00, queued_by_job_id=1, pid=534 2024-05-23T22:40:44.971996867Z [2024-05-23T22:40:44.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to d37336e6-f641-4d26-99c9-00d11c385e1a 2024-05-23T22:40:46.109910390Z [2024-05-23T22:40:46.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:46.158241127Z [2024-05-23T22:40:46.157+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:40:46.158270357Z 2024-05-23T22:40:46.158654475Z [2024-05-23T22:40:46.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:40:46.159237015Z [2024-05-23T22:40:46.159+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:40:46.159247319Z 2024-05-23T22:40:46.161546262Z [2024-05-23T22:40:46.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:40:46.161937227Z [2024-05-23T22:40:46.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:40:46.217265432Z [2024-05-23T22:40:46.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status queued for try_number 1 2024-05-23T22:40:46.222883639Z [2024-05-23T22:40:46.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0aafa059-c437-4b13-a531-64086f59dad8 2024-05-23T22:40:47.391059456Z [2024-05-23T22:40:47.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:47.391196965Z [2024-05-23T22:40:47.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4, execution_date=2024-05-23 22:35:00+00:00, run_id=scheduled__2024-05-23T22:35:00+00:00, run_start_date=2024-05-23 22:40:38.410743+00:00, run_end_date=2024-05-23 22:40:47.390869+00:00, run_duration=8.980126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:35:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=6213dbf7e0999001f334feda1a25ef51 2024-05-23T22:40:47.398873873Z [2024-05-23T22:40:47.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:40:47.433089116Z [2024-05-23T22:40:47.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4.send_prometheus run_id=scheduled__2024-05-23T22:35:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:47.441315111Z [2024-05-23T22:40:47.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:35:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:46.445990+00:00, run_end_date=2024-05-23 22:40:46.753133+00:00, run_duration=0.307143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:44.792617+00:00, queued_by_job_id=1, pid=551 2024-05-23T22:40:48.504085685Z [2024-05-23T22:40:48.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:48.504844160Z [2024-05-23T22:40:48.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, execution_date=2024-05-23 22:39:00+00:00, run_id=scheduled__2024-05-23T22:39:00+00:00, run_start_date=2024-05-23 22:40:44.733054+00:00, run_end_date=2024-05-23 22:40:48.503994+00:00, run_duration=3.77094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:39:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=0ff87c7f3844be6f92a7510f9796e1ed 2024-05-23T22:40:48.528619375Z [2024-05-23T22:40:48.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:48.574385114Z [2024-05-23T22:40:48.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:48.580196799Z [2024-05-23T22:40:48.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:39:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:46.435602+00:00, run_end_date=2024-05-23 22:40:48.116973+00:00, run_duration=1.681371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:44.792617+00:00, queued_by_job_id=1, pid=550 2024-05-23T22:40:49.849536246Z [2024-05-23T22:40:49.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:40:49.850178351Z [2024-05-23T22:40:49.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, execution_date=2024-05-23 22:39:00+00:00, run_id=scheduled__2024-05-23T22:39:00+00:00, run_start_date=2024-05-23 22:40:46.120602+00:00, run_end_date=2024-05-23 22:40:49.849663+00:00, run_duration=3.729061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:39:00+00:00, data_interval_end=2024-05-23 22:40:00+00:00, dag_hash=3d47774f8dd0b615fd6b8fd1d6d55545 2024-05-23T22:40:49.863618233Z [2024-05-23T22:40:49.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:40:00+00:00, run_after=2024-05-23T22:41:00+00:00 2024-05-23T22:40:49.896216336Z [2024-05-23T22:40:49.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:39:00+00:00 exited with status success for try_number 1 2024-05-23T22:40:49.902268440Z [2024-05-23T22:40:49.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:39:00+00:00, map_index=-1, run_start_date=2024-05-23 22:40:47.770317+00:00, run_end_date=2024-05-23 22:40:49.051373+00:00, run_duration=1.281056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:40:46.159669+00:00, queued_by_job_id=1, pid=563 2024-05-23T22:41:01.000633051Z [2024-05-23T22:41:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:01.023109240Z [2024-05-23T22:41:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:01.040654214Z [2024-05-23T22:41:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:01.048967048Z [2024-05-23T22:41:01.048+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:41:01.065928514Z [2024-05-23T22:41:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:01.074329599Z [2024-05-23T22:41:01.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:41:01.082845611Z [2024-05-23T22:41:01.082+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:41:01.211594155Z [2024-05-23T22:41:01.211+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-05-23T22:41:01.211631602Z 2024-05-23T22:41:01.211641408Z 2024-05-23T22:41:01.211650355Z 2024-05-23T22:41:01.211658376Z 2024-05-23T22:41:01.211666002Z 2024-05-23T22:41:01.211673192Z 2024-05-23T22:41:01.211680640Z 2024-05-23T22:41:01.211760594Z [2024-05-23T22:41:01.211+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:41:01.211981334Z [2024-05-23T22:41:01.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:41:01.212400502Z [2024-05-23T22:41:01.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:41:01.212660551Z [2024-05-23T22:41:01.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:41:01.212855536Z [2024-05-23T22:41:01.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:41:01.213066083Z [2024-05-23T22:41:01.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:41:01.213241286Z [2024-05-23T22:41:01.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:41:01.214477552Z [2024-05-23T22:41:01.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:41:01.214486892Z 2024-05-23T22:41:01.214492308Z 2024-05-23T22:41:01.214497388Z 2024-05-23T22:41:01.214534314Z 2024-05-23T22:41:01.214562881Z 2024-05-23T22:41:01.214568086Z 2024-05-23T22:41:01.214573128Z 2024-05-23T22:41:01.224242837Z [2024-05-23T22:41:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:01.224300146Z [2024-05-23T22:41:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:41:01.224624620Z [2024-05-23T22:41:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:01.224758991Z [2024-05-23T22:41:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:41:01.224983622Z [2024-05-23T22:41:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:01.225110381Z [2024-05-23T22:41:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:41:01.225361167Z [2024-05-23T22:41:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:01.225484177Z [2024-05-23T22:41:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:41:01.225697712Z [2024-05-23T22:41:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:01.225828842Z [2024-05-23T22:41:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:41:01.226045736Z [2024-05-23T22:41:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:01.226180909Z [2024-05-23T22:41:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:41:01.226418023Z [2024-05-23T22:41:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:01.226590497Z [2024-05-23T22:41:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:41:02.158063898Z [2024-05-23T22:41:02.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:41:02.158196976Z [2024-05-23T22:41:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:41:02.158332085Z [2024-05-23T22:41:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:41:02.158454179Z [2024-05-23T22:41:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:41:02.158587657Z [2024-05-23T22:41:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:41:02.158710708Z [2024-05-23T22:41:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:41:02.158829158Z [2024-05-23T22:41:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:41:02.199602645Z [2024-05-23T22:41:02.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to f28b579c-44ac-48f9-9e16-b87081429706 2024-05-23T22:41:02.200122959Z [2024-05-23T22:41:02.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to df616932-2bea-41d1-be65-7984b62a9bed 2024-05-23T22:41:02.200294718Z [2024-05-23T22:41:02.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb41e23c-74f1-47ee-b128-abb8ff59cbf4 2024-05-23T22:41:02.200871955Z [2024-05-23T22:41:02.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 508748f2-a135-46c4-bcd3-996180a59afb 2024-05-23T22:41:02.201065389Z [2024-05-23T22:41:02.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to f05543c8-9502-4182-992d-9500ce549c93 2024-05-23T22:41:02.201245461Z [2024-05-23T22:41:02.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dc1011d-9a83-4332-a784-161dfdf44bd6 2024-05-23T22:41:02.201423773Z [2024-05-23T22:41:02.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a549063-1e66-47fa-9623-54175c3e4289 2024-05-23T22:41:02.878972955Z [2024-05-23T22:41:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:41:02.879297800Z [2024-05-23T22:41:02.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:41:01.105400+00:00, run_end_date=2024-05-23 22:41:02.878980+00:00, run_duration=1.77358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:41:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:41:02.887673974Z [2024-05-23T22:41:02.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:02.962918285Z [2024-05-23T22:41:02.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:41:02.967701421Z [2024-05-23T22:41:02.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:41:02.264725+00:00, run_end_date=2024-05-23 22:41:02.661437+00:00, run_duration=0.396712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:01.217501+00:00, queued_by_job_id=1, pid=581 2024-05-23T22:41:04.050402513Z [2024-05-23T22:41:04.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status failed for try_number 1 2024-05-23T22:41:04.057528351Z [2024-05-23T22:41:04.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:01.217501+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:41:04.057841233Z [2024-05-23T22:41:04.057+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:04.063964818Z [2024-05-23T22:41:04.063+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:04.107889801Z [2024-05-23T22:41:04.107+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240523T224000, start_date=, end_date=20240523T224104 2024-05-23T22:41:05.349846787Z [2024-05-23T22:41:05.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status failed for try_number 1 2024-05-23T22:41:05.357621262Z [2024-05-23T22:41:05.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:01.217501+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:41:05.358398322Z [2024-05-23T22:41:05.357+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:05.361598861Z [2024-05-23T22:41:05.361+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:05.386801347Z [2024-05-23T22:41:05.386+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240523T224000, start_date=, end_date=20240523T224105 2024-05-23T22:41:06.458198820Z [2024-05-23T22:41:06.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:41:06.458683327Z [2024-05-23T22:41:06.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:41:01.108245+00:00, run_end_date=2024-05-23 22:41:06.458309+00:00, run_duration=5.350064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:41:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:41:06.467995942Z [2024-05-23T22:41:06.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:06.474454583Z [2024-05-23T22:41:06.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:41:06.474848962Z [2024-05-23T22:41:06.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:41:01.113673+00:00, run_end_date=2024-05-23 22:41:06.474547+00:00, run_duration=5.360874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:41:00+00:00, dag_hash=3d47774f8dd0b615fd6b8fd1d6d55545 2024-05-23T22:41:06.485012997Z [2024-05-23T22:41:06.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:06.491191036Z [2024-05-23T22:41:06.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:41:06.491698236Z [2024-05-23T22:41:06.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:41:01.115295+00:00, run_end_date=2024-05-23 22:41:06.491403+00:00, run_duration=5.376108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:41:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:41:06.515333911Z [2024-05-23T22:41:06.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:06.525601277Z [2024-05-23T22:41:06.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:41:06.526057047Z [2024-05-23T22:41:06.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:41:01.116911+00:00, run_end_date=2024-05-23 22:41:06.525432+00:00, run_duration=5.408521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:41:00+00:00, dag_hash=0ff87c7f3844be6f92a7510f9796e1ed 2024-05-23T22:41:06.538270621Z [2024-05-23T22:41:06.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:06.610834561Z [2024-05-23T22:41:06.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:41:06.611272815Z [2024-05-23T22:41:06.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:41:06.611620452Z [2024-05-23T22:41:06.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:41:06.611969729Z [2024-05-23T22:41:06.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:41:06.623243170Z [2024-05-23T22:41:06.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:41:04.275398+00:00, run_end_date=2024-05-23 22:41:05.640308+00:00, run_duration=1.36491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:01.217501+00:00, queued_by_job_id=1, pid=619 2024-05-23T22:41:06.623537359Z [2024-05-23T22:41:06.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:41:04.182710+00:00, run_end_date=2024-05-23 22:41:05.930920+00:00, run_duration=1.74821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:01.217501+00:00, queued_by_job_id=1, pid=613 2024-05-23T22:41:06.623879262Z [2024-05-23T22:41:06.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:41:04.741918+00:00, run_end_date=2024-05-23 22:41:06.013437+00:00, run_duration=1.271519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:01.217501+00:00, queued_by_job_id=1, pid=646 2024-05-23T22:41:06.624277855Z [2024-05-23T22:41:06.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:41:04.520940+00:00, run_end_date=2024-05-23 22:41:06.079016+00:00, run_duration=1.558076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:01.217501+00:00, queued_by_job_id=1, pid=636 2024-05-23T22:41:14.149114433Z [2024-05-23T22:41:14.148+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:41:14.149152237Z 2024-05-23T22:41:14.149560202Z [2024-05-23T22:41:14.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:41:14.150879334Z [2024-05-23T22:41:14.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:41:14.150892913Z 2024-05-23T22:41:14.155548465Z [2024-05-23T22:41:14.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:14.155935991Z [2024-05-23T22:41:14.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:41:14.215964815Z [2024-05-23T22:41:14.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 2 2024-05-23T22:41:14.222672510Z [2024-05-23T22:41:14.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3f65f3e-a08a-4177-8a31-4b3de4cd97e7 2024-05-23T22:41:15.443410474Z [2024-05-23T22:41:15.443+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:41:15.443477843Z 2024-05-23T22:41:15.443505304Z [2024-05-23T22:41:15.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_39aac174-71a6-4443-b155-28edd3cdd68e has 0/16 running and queued tasks 2024-05-23T22:41:15.443942391Z [2024-05-23T22:41:15.443+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:41:15.443983482Z 2024-05-23T22:41:15.445788862Z [2024-05-23T22:41:15.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:41:15.445875297Z [2024-05-23T22:41:15.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39aac174-71a6-4443-b155-28edd3cdd68e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:41:15.505864775Z [2024-05-23T22:41:15.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 2 2024-05-23T22:41:15.512814707Z [2024-05-23T22:41:15.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81f01720-9533-4447-936c-a50cf0d57337 2024-05-23T22:41:16.689503970Z [2024-05-23T22:41:16.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status failed for try_number 2 2024-05-23T22:41:16.695526852Z [2024-05-23T22:41:16.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-23 22:41:04.073146+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:14.151665+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:41:16.696282564Z [2024-05-23T22:41:16.696+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:16.699257363Z [2024-05-23T22:41:16.698+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:16.714484404Z [2024-05-23T22:41:16.714+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240523T224000, start_date=, end_date=20240523T224116 2024-05-23T22:41:17.784240422Z [2024-05-23T22:41:17.783+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-23T22:41:17.784689646Z [2024-05-23T22:41:17.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:41:01.112029+00:00, run_end_date=2024-05-23 22:41:17.784150+00:00, run_duration=16.672121, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:41:00+00:00, dag_hash=7a7e47b14dadd5dc0462fdae4cf3272e 2024-05-23T22:41:17.799008819Z [2024-05-23T22:41:17.798+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:17.829078500Z [2024-05-23T22:41:17.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39aac174-71a6-4443-b155-28edd3cdd68e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status failed for try_number 2 2024-05-23T22:41:17.834299238Z [2024-05-23T22:41:17.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-23 22:41:05.368285+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:41:15.444141+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:41:17.834877238Z [2024-05-23T22:41:17.834+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:17.838930299Z [2024-05-23T22:41:17.838+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:41:17.854283678Z [2024-05-23T22:41:17.853+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240523T224000, start_date=, end_date=20240523T224117 2024-05-23T22:41:18.910563362Z [2024-05-23T22:41:18.909+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-23T22:41:18.911234715Z [2024-05-23T22:41:18.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39aac174-71a6-4443-b155-28edd3cdd68e, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:41:01.110140+00:00, run_end_date=2024-05-23 22:41:18.910480+00:00, run_duration=17.80034, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:41:00+00:00, dag_hash=7520c51b48a656eaf39381587a54a765 2024-05-23T22:41:18.919567838Z [2024-05-23T22:41:18.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39aac174-71a6-4443-b155-28edd3cdd68e to 2024-05-23T22:41:00+00:00, run_after=2024-05-23T22:42:00+00:00 2024-05-23T22:41:38.853504545Z [2024-05-23T22:41:38.852+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T22:42:01.098597634Z [2024-05-23T22:42:01.097+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:42:01.122224227Z [2024-05-23T22:42:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:42:01.136551642Z [2024-05-23T22:42:01.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:42:01.148311560Z [2024-05-23T22:42:01.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:42:01.154978187Z [2024-05-23T22:42:01.154+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:42:01.161291954Z [2024-05-23T22:42:01.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:42:01.324021736Z [2024-05-23T22:42:01.323+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-23T22:42:01.324063577Z 2024-05-23T22:42:01.324075291Z 2024-05-23T22:42:01.324082267Z 2024-05-23T22:42:01.324113579Z 2024-05-23T22:42:01.324120877Z 2024-05-23T22:42:01.324127469Z 2024-05-23T22:42:01.324506919Z [2024-05-23T22:42:01.323+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:42:01.324810254Z [2024-05-23T22:42:01.324+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:42:01.325133621Z [2024-05-23T22:42:01.324+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:42:01.325407210Z [2024-05-23T22:42:01.325+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:42:01.325759648Z [2024-05-23T22:42:01.325+0000] {scheduler_job.py:425} INFO - DAG vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:42:01.326064443Z [2024-05-23T22:42:01.325+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:42:01.327340428Z [2024-05-23T22:42:01.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:42:01.327374911Z 2024-05-23T22:42:01.327417551Z 2024-05-23T22:42:01.327433758Z 2024-05-23T22:42:01.327448983Z 2024-05-23T22:42:01.327461295Z 2024-05-23T22:42:01.327473470Z 2024-05-23T22:42:01.335844418Z [2024-05-23T22:42:01.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:01.335944071Z [2024-05-23T22:42:01.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:42:01.336287719Z [2024-05-23T22:42:01.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:01.336484553Z [2024-05-23T22:42:01.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:42:01.336862750Z [2024-05-23T22:42:01.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:01.337067150Z [2024-05-23T22:42:01.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:42:01.337641934Z [2024-05-23T22:42:01.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:01.337859978Z [2024-05-23T22:42:01.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:42:01.338397918Z [2024-05-23T22:42:01.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:01.338691288Z [2024-05-23T22:42:01.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:42:01.339071710Z [2024-05-23T22:42:01.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:01.339368490Z [2024-05-23T22:42:01.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:42:02.074011803Z [2024-05-23T22:42:02.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:42:02.074061310Z [2024-05-23T22:42:02.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status queued for try_number 1 2024-05-23T22:42:02.075250932Z [2024-05-23T22:42:02.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status queued for try_number 1 2024-05-23T22:42:02.075419666Z [2024-05-23T22:42:02.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status queued for try_number 1 2024-05-23T22:42:02.075555377Z [2024-05-23T22:42:02.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status queued for try_number 1 2024-05-23T22:42:02.076041788Z [2024-05-23T22:42:02.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status queued for try_number 1 2024-05-23T22:42:02.115503738Z [2024-05-23T22:42:02.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b84211f-3446-40cc-ba01-5f688d07de1b 2024-05-23T22:42:02.115561234Z [2024-05-23T22:42:02.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to e76b3d8c-772d-442e-83dd-184517ac703f 2024-05-23T22:42:02.115797170Z [2024-05-23T22:42:02.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to c354290e-6b76-48ca-872d-2e58e69f0657 2024-05-23T22:42:02.116083774Z [2024-05-23T22:42:02.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18be3bcf-59ba-4bea-ba48-3e47114f80e4 2024-05-23T22:42:02.116237867Z [2024-05-23T22:42:02.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62c3eb83-ed52-406e-be59-a7c05737e346 2024-05-23T22:42:02.116459375Z [2024-05-23T22:42:02.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5188a2a-0276-40f3-8d91-706411b5bbfe 2024-05-23T22:42:03.384189826Z [2024-05-23T22:42:03.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:42:03.384430289Z [2024-05-23T22:42:03.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:42:01.170702+00:00, run_end_date=2024-05-23 22:42:03.384106+00:00, run_duration=2.213404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:42:03.392290750Z [2024-05-23T22:42:03.391+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:44:00+00:00 2024-05-23T22:42:03.402081814Z [2024-05-23T22:42:03.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:42:03.402218502Z [2024-05-23T22:42:03.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:41:00+00:00, run_id=scheduled__2024-05-23T22:41:00+00:00, run_start_date=2024-05-23 22:42:01.176247+00:00, run_end_date=2024-05-23 22:42:03.402001+00:00, run_duration=2.225754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:41:00+00:00, data_interval_end=2024-05-23 22:42:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:42:03.415814305Z [2024-05-23T22:42:03.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:42:03.472448559Z [2024-05-23T22:42:03.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:42:03.472477111Z [2024-05-23T22:42:03.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status success for try_number 1 2024-05-23T22:42:03.478256270Z [2024-05-23T22:42:03.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:42:02.332820+00:00, run_end_date=2024-05-23 22:42:03.253830+00:00, run_duration=0.92101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:01.328904+00:00, queued_by_job_id=1, pid=706 2024-05-23T22:42:03.478365024Z [2024-05-23T22:42:03.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:41:00+00:00, map_index=-1, run_start_date=2024-05-23 22:42:02.333226+00:00, run_end_date=2024-05-23 22:42:03.043535+00:00, run_duration=0.710309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:01.328904+00:00, queued_by_job_id=1, pid=705 2024-05-23T22:42:04.590230036Z [2024-05-23T22:42:04.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status failed for try_number 1 2024-05-23T22:42:04.590443139Z [2024-05-23T22:42:04.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status failed for try_number 1 2024-05-23T22:42:04.597876617Z [2024-05-23T22:42:04.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:01.328904+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:42:04.598569850Z [2024-05-23T22:42:04.598+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:04.601719884Z [2024-05-23T22:42:04.601+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:04.615372150Z [2024-05-23T22:42:04.615+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240523T224100, start_date=, end_date=20240523T224204 2024-05-23T22:42:04.622761560Z [2024-05-23T22:42:04.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:01.328904+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:42:04.623263963Z [2024-05-23T22:42:04.623+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:04.625447889Z [2024-05-23T22:42:04.625+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:04.636318103Z [2024-05-23T22:42:04.636+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240523T224100, start_date=, end_date=20240523T224204 2024-05-23T22:42:06.297015054Z [2024-05-23T22:42:06.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:42:06.297627807Z [2024-05-23T22:42:06.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:41:00+00:00, run_id=scheduled__2024-05-23T22:41:00+00:00, run_start_date=2024-05-23 22:42:01.171902+00:00, run_end_date=2024-05-23 22:42:06.296986+00:00, run_duration=5.125084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:41:00+00:00, data_interval_end=2024-05-23 22:42:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:42:06.316891472Z [2024-05-23T22:42:06.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:42:06.325769401Z [2024-05-23T22:42:06.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:42:06.326036096Z [2024-05-23T22:42:06.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:41:00+00:00, run_id=scheduled__2024-05-23T22:41:00+00:00, run_start_date=2024-05-23 22:42:01.173886+00:00, run_end_date=2024-05-23 22:42:06.325622+00:00, run_duration=5.151736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:41:00+00:00, data_interval_end=2024-05-23 22:42:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:42:06.336813449Z [2024-05-23T22:42:06.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:42:06.406260998Z [2024-05-23T22:42:06.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status success for try_number 1 2024-05-23T22:42:06.406711031Z [2024-05-23T22:42:06.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status success for try_number 1 2024-05-23T22:42:06.417724221Z [2024-05-23T22:42:06.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:41:00+00:00, map_index=-1, run_start_date=2024-05-23 22:42:04.131986+00:00, run_end_date=2024-05-23 22:42:05.397160+00:00, run_duration=1.265174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:01.328904+00:00, queued_by_job_id=1, pid=736 2024-05-23T22:42:06.418039749Z [2024-05-23T22:42:06.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:41:00+00:00, map_index=-1, run_start_date=2024-05-23 22:42:04.358245+00:00, run_end_date=2024-05-23 22:42:05.885157+00:00, run_duration=1.526912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:01.328904+00:00, queued_by_job_id=1, pid=752 2024-05-23T22:42:14.700150449Z [2024-05-23T22:42:14.699+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:42:14.700186364Z 2024-05-23T22:42:14.700189914Z 2024-05-23T22:42:14.700598963Z [2024-05-23T22:42:14.700+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:42:14.700889565Z [2024-05-23T22:42:14.700+0000] {scheduler_job.py:425} INFO - DAG vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 has 0/16 running and queued tasks 2024-05-23T22:42:14.701710132Z [2024-05-23T22:42:14.701+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:42:14.701723865Z 2024-05-23T22:42:14.701728423Z 2024-05-23T22:42:14.705694218Z [2024-05-23T22:42:14.705+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:41:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:14.706028724Z [2024-05-23T22:42:14.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:42:14.706486119Z [2024-05-23T22:42:14.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:41:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:42:14.706834846Z [2024-05-23T22:42:14.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eeffd9fe-9257-406c-b826-c09945c545b4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:42:14.850040308Z [2024-05-23T22:42:14.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status queued for try_number 2 2024-05-23T22:42:14.850076331Z [2024-05-23T22:42:14.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status queued for try_number 2 2024-05-23T22:42:14.858960798Z [2024-05-23T22:42:14.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98bbcf28-d43b-436a-8db4-cbadf851c60c 2024-05-23T22:42:14.858995297Z [2024-05-23T22:42:14.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to c45e3b93-2d95-4b8d-9508-0fedafcc46a6 2024-05-23T22:42:16.559057710Z [2024-05-23T22:42:16.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status failed for try_number 2 2024-05-23T22:42:16.559518891Z [2024-05-23T22:42:16.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eeffd9fe-9257-406c-b826-c09945c545b4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:41:00+00:00 exited with status failed for try_number 2 2024-05-23T22:42:16.570922838Z [2024-05-23T22:42:16.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-23 22:42:04.604078+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:14.702594+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:42:16.571761626Z [2024-05-23T22:42:16.571+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:16.575441085Z [2024-05-23T22:42:16.574+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:16.596611118Z [2024-05-23T22:42:16.596+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240523T224100, start_date=, end_date=20240523T224216 2024-05-23T22:42:16.605810534Z [2024-05-23T22:42:16.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-23 22:42:04.627516+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:42:14.702594+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:42:16.606324517Z [2024-05-23T22:42:16.606+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:16.608884998Z [2024-05-23T22:42:16.608+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:42:16.622500561Z [2024-05-23T22:42:16.622+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240523T224100, start_date=, end_date=20240523T224216 2024-05-23T22:42:17.690487830Z [2024-05-23T22:42:17.689+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-23T22:42:17.692154196Z [2024-05-23T22:42:17.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4, execution_date=2024-05-23 22:41:00+00:00, run_id=scheduled__2024-05-23T22:41:00+00:00, run_start_date=2024-05-23 22:42:01.172924+00:00, run_end_date=2024-05-23 22:42:17.690215+00:00, run_duration=16.517291, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:41:00+00:00, data_interval_end=2024-05-23 22:42:00+00:00, dag_hash=0ff87c7f3844be6f92a7510f9796e1ed 2024-05-23T22:42:17.713280292Z [2024-05-23T22:42:17.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:42:17.722652834Z [2024-05-23T22:42:17.722+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-23T22:42:17.723021331Z [2024-05-23T22:42:17.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eeffd9fe-9257-406c-b826-c09945c545b4, execution_date=2024-05-23 22:41:00+00:00, run_id=scheduled__2024-05-23T22:41:00+00:00, run_start_date=2024-05-23 22:42:01.175059+00:00, run_end_date=2024-05-23 22:42:17.722664+00:00, run_duration=16.547605, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:41:00+00:00, data_interval_end=2024-05-23 22:42:00+00:00, dag_hash=3d47774f8dd0b615fd6b8fd1d6d55545 2024-05-23T22:42:17.732950262Z [2024-05-23T22:42:17.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eeffd9fe-9257-406c-b826-c09945c545b4 to 2024-05-23T22:42:00+00:00, run_after=2024-05-23T22:43:00+00:00 2024-05-23T22:43:00.257155788Z [2024-05-23T22:43:00.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:43:00+00:00, run_after=2024-05-23T22:44:00+00:00 2024-05-23T22:43:00.263136306Z [2024-05-23T22:43:00.262+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:43:00.273509653Z [2024-05-23T22:43:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:43:00+00:00, run_after=2024-05-23T22:44:00+00:00 2024-05-23T22:43:00.330703967Z [2024-05-23T22:43:00.330+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:43:00.330725201Z 2024-05-23T22:43:00.330729019Z 2024-05-23T22:43:00.330732176Z 2024-05-23T22:43:00.331252620Z [2024-05-23T22:43:00.330+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:43:00.331334229Z [2024-05-23T22:43:00.330+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:43:00.331345161Z [2024-05-23T22:43:00.331+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:43:00.331663260Z [2024-05-23T22:43:00.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:43:00.331678332Z 2024-05-23T22:43:00.331685844Z 2024-05-23T22:43:00.331693484Z 2024-05-23T22:43:00.335621570Z [2024-05-23T22:43:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:43:00.335718325Z [2024-05-23T22:43:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:43:00.335859086Z [2024-05-23T22:43:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:43:00.335957407Z [2024-05-23T22:43:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:43:00.336484841Z [2024-05-23T22:43:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:43:00.336844977Z [2024-05-23T22:43:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:43:00.606914409Z [2024-05-23T22:43:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status queued for try_number 1 2024-05-23T22:43:00.606953825Z [2024-05-23T22:43:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status queued for try_number 1 2024-05-23T22:43:00.607149645Z [2024-05-23T22:43:00.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status queued for try_number 1 2024-05-23T22:43:00.613999514Z [2024-05-23T22:43:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 355aacdf-305e-42e8-a737-65366ebd6c3e 2024-05-23T22:43:00.614036597Z [2024-05-23T22:43:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 979b4dd4-e28d-404f-b6b8-dcf29791515c 2024-05-23T22:43:00.614227783Z [2024-05-23T22:43:00.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85841198-2aa4-4462-9d5a-6db72d6c70c4 2024-05-23T22:43:02.219175357Z [2024-05-23T22:43:02.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:43:02.219688909Z [2024-05-23T22:43:02.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:42:00+00:00, run_id=scheduled__2024-05-23T22:42:00+00:00, run_start_date=2024-05-23 22:43:00.284889+00:00, run_end_date=2024-05-23 22:43:02.219096+00:00, run_duration=1.934207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:42:00+00:00, data_interval_end=2024-05-23 22:43:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:43:02.229976478Z [2024-05-23T22:43:02.229+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:43:00+00:00, run_after=2024-05-23T22:44:00+00:00 2024-05-23T22:43:02.272370893Z [2024-05-23T22:43:02.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status success for try_number 1 2024-05-23T22:43:02.279004674Z [2024-05-23T22:43:02.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:42:00+00:00, map_index=-1, run_start_date=2024-05-23 22:43:01.230829+00:00, run_end_date=2024-05-23 22:43:01.629237+00:00, run_duration=0.398408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:43:00.332194+00:00, queued_by_job_id=1, pid=808 2024-05-23T22:43:03.950352753Z [2024-05-23T22:43:03.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:43:03.950838724Z [2024-05-23T22:43:03.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:42:00+00:00, run_id=scheduled__2024-05-23T22:42:00+00:00, run_start_date=2024-05-23 22:43:00.282660+00:00, run_end_date=2024-05-23 22:43:03.950444+00:00, run_duration=3.667784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:42:00+00:00, data_interval_end=2024-05-23 22:43:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:43:03.961556974Z [2024-05-23T22:43:03.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:43:00+00:00, run_after=2024-05-23T22:44:00+00:00 2024-05-23T22:43:03.968588059Z [2024-05-23T22:43:03.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:43:03.968914044Z [2024-05-23T22:43:03.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:42:00+00:00, run_id=scheduled__2024-05-23T22:42:00+00:00, run_start_date=2024-05-23 22:43:00.283888+00:00, run_end_date=2024-05-23 22:43:03.968453+00:00, run_duration=3.684565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:42:00+00:00, data_interval_end=2024-05-23 22:43:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:43:03.980796188Z [2024-05-23T22:43:03.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:43:00+00:00, run_after=2024-05-23T22:44:00+00:00 2024-05-23T22:43:04.023582422Z [2024-05-23T22:43:04.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status success for try_number 1 2024-05-23T22:43:04.023775235Z [2024-05-23T22:43:04.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status success for try_number 1 2024-05-23T22:43:04.031566299Z [2024-05-23T22:43:04.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:42:00+00:00, map_index=-1, run_start_date=2024-05-23 22:43:01.979231+00:00, run_end_date=2024-05-23 22:43:03.769146+00:00, run_duration=1.789915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:43:00.332194+00:00, queued_by_job_id=1, pid=821 2024-05-23T22:43:04.031891395Z [2024-05-23T22:43:04.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:42:00+00:00, map_index=-1, run_start_date=2024-05-23 22:43:02.283351+00:00, run_end_date=2024-05-23 22:43:03.610285+00:00, run_duration=1.326934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:43:00.332194+00:00, queued_by_job_id=1, pid=827 2024-05-23T22:44:00.517759151Z [2024-05-23T22:44:00.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:44:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:44:00.526122765Z [2024-05-23T22:44:00.525+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:44:00.532310348Z [2024-05-23T22:44:00.532+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:44:00.544761924Z [2024-05-23T22:44:00.543+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:44:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:44:00.617072080Z [2024-05-23T22:44:00.616+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T22:44:00.617112685Z 2024-05-23T22:44:00.617133238Z 2024-05-23T22:44:00.617142382Z 2024-05-23T22:44:00.617151109Z 2024-05-23T22:44:00.617166427Z [2024-05-23T22:44:00.616+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:44:00.617244118Z [2024-05-23T22:44:00.616+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:44:00.617437381Z [2024-05-23T22:44:00.617+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:44:00.617450916Z [2024-05-23T22:44:00.617+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:44:00.618078213Z [2024-05-23T22:44:00.617+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:44:00.618106701Z 2024-05-23T22:44:00.618122443Z 2024-05-23T22:44:00.618136584Z 2024-05-23T22:44:00.618150779Z 2024-05-23T22:44:00.622090447Z [2024-05-23T22:44:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:44:00.622178222Z [2024-05-23T22:44:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:44:00.622611761Z [2024-05-23T22:44:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:44:00.622631871Z [2024-05-23T22:44:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:44:00.622876683Z [2024-05-23T22:44:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:44:00.622980164Z [2024-05-23T22:44:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:44:00.623238387Z [2024-05-23T22:44:00.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:44:00.623363834Z [2024-05-23T22:44:00.623+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:44:00.999679520Z [2024-05-23T22:44:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status queued for try_number 1 2024-05-23T22:44:01.000040290Z [2024-05-23T22:44:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:43:00+00:00 exited with status queued for try_number 1 2024-05-23T22:44:01.006568349Z [2024-05-23T22:44:01.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:43:00+00:00 exited with status queued for try_number 1 2024-05-23T22:44:01.006587991Z [2024-05-23T22:44:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:43:00+00:00 exited with status queued for try_number 1 2024-05-23T22:44:01.034715184Z [2024-05-23T22:44:01.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21ebc552-be91-41d1-8666-a725b504fc8a 2024-05-23T22:44:01.035014117Z [2024-05-23T22:44:01.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 389279b2-9d4f-4826-bb12-4532fb872770 2024-05-23T22:44:01.035252705Z [2024-05-23T22:44:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 599cc41d-a3a9-4e93-ad23-2b5780fb7488 2024-05-23T22:44:01.035519893Z [2024-05-23T22:44:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to e01719fa-199d-44e7-a93e-1f8c9308364d 2024-05-23T22:44:03.428344727Z [2024-05-23T22:44:03.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:44:03.428903626Z [2024-05-23T22:44:03.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:42:00+00:00, run_id=scheduled__2024-05-23T22:42:00+00:00, run_start_date=2024-05-23 22:44:00.553388+00:00, run_end_date=2024-05-23 22:44:03.428231+00:00, run_duration=2.874843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:42:00+00:00, data_interval_end=2024-05-23 22:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:44:03.443472875Z [2024-05-23T22:44:03.443+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:44:00+00:00, run_after=2024-05-23T22:46:00+00:00 2024-05-23T22:44:03.484437097Z [2024-05-23T22:44:03.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:44:03.485028912Z [2024-05-23T22:44:03.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:43:00+00:00, run_id=scheduled__2024-05-23T22:43:00+00:00, run_start_date=2024-05-23 22:44:00.556346+00:00, run_end_date=2024-05-23 22:44:03.484356+00:00, run_duration=2.92801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:43:00+00:00, data_interval_end=2024-05-23 22:44:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:44:03.505650352Z [2024-05-23T22:44:03.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:44:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:44:03.593580827Z [2024-05-23T22:44:03.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:42:00+00:00 exited with status success for try_number 1 2024-05-23T22:44:03.594127846Z [2024-05-23T22:44:03.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:43:00+00:00 exited with status success for try_number 1 2024-05-23T22:44:03.612289194Z [2024-05-23T22:44:03.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:42:00+00:00, map_index=-1, run_start_date=2024-05-23 22:44:02.076753+00:00, run_end_date=2024-05-23 22:44:02.621879+00:00, run_duration=0.545126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:44:00.618804+00:00, queued_by_job_id=1, pid=855 2024-05-23T22:44:03.614640581Z [2024-05-23T22:44:03.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:43:00+00:00, map_index=-1, run_start_date=2024-05-23 22:44:02.519479+00:00, run_end_date=2024-05-23 22:44:03.278428+00:00, run_duration=0.758949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:44:00.618804+00:00, queued_by_job_id=1, pid=862 2024-05-23T22:44:07.051943163Z [2024-05-23T22:44:07.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:44:07.052034461Z [2024-05-23T22:44:07.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:43:00+00:00, run_id=scheduled__2024-05-23T22:43:00+00:00, run_start_date=2024-05-23 22:44:00.554499+00:00, run_end_date=2024-05-23 22:44:07.051808+00:00, run_duration=6.497309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:43:00+00:00, data_interval_end=2024-05-23 22:44:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:44:07.061442336Z [2024-05-23T22:44:07.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:44:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:44:07.125962910Z [2024-05-23T22:44:07.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:43:00+00:00 exited with status success for try_number 1 2024-05-23T22:44:07.132058354Z [2024-05-23T22:44:07.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:43:00+00:00, map_index=-1, run_start_date=2024-05-23 22:44:04.135251+00:00, run_end_date=2024-05-23 22:44:06.340961+00:00, run_duration=2.20571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:44:00.618804+00:00, queued_by_job_id=1, pid=884 2024-05-23T22:44:09.759981420Z [2024-05-23T22:44:09.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:44:09.760273607Z [2024-05-23T22:44:09.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:43:00+00:00, run_id=scheduled__2024-05-23T22:43:00+00:00, run_start_date=2024-05-23 22:44:00.555448+00:00, run_end_date=2024-05-23 22:44:09.759858+00:00, run_duration=9.20441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:43:00+00:00, data_interval_end=2024-05-23 22:44:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:44:09.787107805Z [2024-05-23T22:44:09.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:44:00+00:00, run_after=2024-05-23T22:45:00+00:00 2024-05-23T22:44:09.856000402Z [2024-05-23T22:44:09.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:43:00+00:00 exited with status success for try_number 1 2024-05-23T22:44:09.876543023Z [2024-05-23T22:44:09.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:43:00+00:00, map_index=-1, run_start_date=2024-05-23 22:44:04.507079+00:00, run_end_date=2024-05-23 22:44:08.623250+00:00, run_duration=4.116171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:44:00.618804+00:00, queued_by_job_id=1, pid=885 2024-05-23T22:45:00.429244911Z [2024-05-23T22:45:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:45:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:45:00.449043989Z [2024-05-23T22:45:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:45:00+00:00, run_after=2024-05-23T22:46:00+00:00 2024-05-23T22:45:00.460207574Z [2024-05-23T22:45:00.459+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:45:00.496102776Z [2024-05-23T22:45:00.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:45:00+00:00, run_after=2024-05-23T22:46:00+00:00 2024-05-23T22:45:00.582278940Z [2024-05-23T22:45:00.581+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T22:45:00.582352973Z 2024-05-23T22:45:00.582361866Z 2024-05-23T22:45:00.582367777Z 2024-05-23T22:45:00.582373792Z 2024-05-23T22:45:00.582379712Z [2024-05-23T22:45:00.581+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:45:00.582409004Z [2024-05-23T22:45:00.582+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:45:00.582447033Z [2024-05-23T22:45:00.582+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:45:00.582458070Z [2024-05-23T22:45:00.582+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:45:00.582975785Z [2024-05-23T22:45:00.582+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:45:00.583002465Z 2024-05-23T22:45:00.583012152Z 2024-05-23T22:45:00.583020653Z 2024-05-23T22:45:00.583066916Z 2024-05-23T22:45:00.586283796Z [2024-05-23T22:45:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:45:00.586393765Z [2024-05-23T22:45:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:45:00.586629876Z [2024-05-23T22:45:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:45:00.586702221Z [2024-05-23T22:45:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:45:00.586866229Z [2024-05-23T22:45:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:45:00.587001159Z [2024-05-23T22:45:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:45:00.587287345Z [2024-05-23T22:45:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:45:00.587520731Z [2024-05-23T22:45:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:45:00.880113409Z [2024-05-23T22:45:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:45:00.880659122Z [2024-05-23T22:45:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status queued for try_number 1 2024-05-23T22:45:00.880877746Z [2024-05-23T22:45:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status queued for try_number 1 2024-05-23T22:45:00.881126631Z [2024-05-23T22:45:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status queued for try_number 1 2024-05-23T22:45:00.894284359Z [2024-05-23T22:45:00.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef2f1885-88c6-44df-8d1c-b48f902c6d41 2024-05-23T22:45:00.894486034Z [2024-05-23T22:45:00.894+0000] {scheduler_job.py:635} INFO - Setting external_id for to 112f7a30-045f-476b-9ad2-fc34ee591d40 2024-05-23T22:45:00.894765755Z [2024-05-23T22:45:00.894+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64f4def5-751e-40eb-8edd-f4a2e04adb3e 2024-05-23T22:45:00.894915644Z [2024-05-23T22:45:00.894+0000] {scheduler_job.py:635} INFO - Setting external_id for to 489fae67-5a6c-45aa-8986-4c53ff20ff6b 2024-05-23T22:45:03.424122606Z [2024-05-23T22:45:03.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:45:03.427616301Z [2024-05-23T22:45:03.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:44:00+00:00, run_id=scheduled__2024-05-23T22:44:00+00:00, run_start_date=2024-05-23 22:45:00.514014+00:00, run_end_date=2024-05-23 22:45:03.427086+00:00, run_duration=2.913072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:44:00+00:00, data_interval_end=2024-05-23 22:45:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:45:03.449695231Z [2024-05-23T22:45:03.449+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:45:00+00:00, run_after=2024-05-23T22:46:00+00:00 2024-05-23T22:45:03.520135427Z [2024-05-23T22:45:03.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status success for try_number 1 2024-05-23T22:45:03.524875508Z [2024-05-23T22:45:03.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:44:00+00:00, map_index=-1, run_start_date=2024-05-23 22:45:01.928972+00:00, run_end_date=2024-05-23 22:45:02.585783+00:00, run_duration=0.656811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:45:00.583625+00:00, queued_by_job_id=1, pid=918 2024-05-23T22:45:04.582901881Z [2024-05-23T22:45:04.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:45:04.583195993Z [2024-05-23T22:45:04.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:44:00+00:00, run_id=scheduled__2024-05-23T22:44:00+00:00, run_start_date=2024-05-23 22:45:00.516786+00:00, run_end_date=2024-05-23 22:45:04.582821+00:00, run_duration=4.066035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:44:00+00:00, data_interval_end=2024-05-23 22:45:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:45:04.593891143Z [2024-05-23T22:45:04.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:45:00+00:00, run_after=2024-05-23T22:46:00+00:00 2024-05-23T22:45:04.657311949Z [2024-05-23T22:45:04.656+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:45:04.657336557Z 2024-05-23T22:45:04.657468931Z [2024-05-23T22:45:04.657+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:45:04.658097716Z [2024-05-23T22:45:04.657+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:45:04.658111104Z 2024-05-23T22:45:04.660909490Z [2024-05-23T22:45:04.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:45:04.661107732Z [2024-05-23T22:45:04.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:45:04.705592978Z [2024-05-23T22:45:04.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:45:04.705782068Z [2024-05-23T22:45:04.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:45:04.705989518Z [2024-05-23T22:45:04.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status success for try_number 1 2024-05-23T22:45:04.719939200Z [2024-05-23T22:45:04.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:44:00+00:00, map_index=-1, run_start_date=2024-05-23 22:45:03.051323+00:00, run_end_date=2024-05-23 22:45:04.445154+00:00, run_duration=1.393831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:45:00.583625+00:00, queued_by_job_id=1, pid=935 2024-05-23T22:45:04.720459928Z [2024-05-23T22:45:04.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:45:03.388739+00:00, run_end_date=2024-05-23 22:45:03.930100+00:00, run_duration=0.541361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:45:00.583625+00:00, queued_by_job_id=1, pid=949 2024-05-23T22:45:04.720812522Z [2024-05-23T22:45:04.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8c6cac5-538f-4d07-a495-0233cfb0c2a7 2024-05-23T22:45:05.209035655Z [2024-05-23T22:45:05.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:45:05.219334740Z [2024-05-23T22:45:05.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:44:00+00:00, run_id=scheduled__2024-05-23T22:44:00+00:00, run_start_date=2024-05-23 22:45:00.515383+00:00, run_end_date=2024-05-23 22:45:05.208942+00:00, run_duration=4.693559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:44:00+00:00, data_interval_end=2024-05-23 22:45:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:45:05.234874486Z [2024-05-23T22:45:05.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:45:00+00:00, run_after=2024-05-23T22:46:00+00:00 2024-05-23T22:45:05.287490978Z [2024-05-23T22:45:05.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status success for try_number 1 2024-05-23T22:45:05.294949011Z [2024-05-23T22:45:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:44:00+00:00, map_index=-1, run_start_date=2024-05-23 22:45:03.444279+00:00, run_end_date=2024-05-23 22:45:05.105695+00:00, run_duration=1.661416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:45:00.583625+00:00, queued_by_job_id=1, pid=948 2024-05-23T22:45:07.476106127Z [2024-05-23T22:45:07.475+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:45:07.476142590Z 2024-05-23T22:45:07.476150164Z [2024-05-23T22:45:07.475+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:45:07.476755490Z [2024-05-23T22:45:07.476+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:45:07.476770902Z 2024-05-23T22:45:07.479321655Z [2024-05-23T22:45:07.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:45:07.479586105Z [2024-05-23T22:45:07.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:45:07.530292243Z [2024-05-23T22:45:07.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:45:07.530367251Z [2024-05-23T22:45:07.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:45:07.535982385Z [2024-05-23T22:45:07.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17fcb8a9-6f7b-4579-93a2-a2cbcb593e41 2024-05-23T22:45:07.536214833Z [2024-05-23T22:45:07.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:45:06.256657+00:00, run_end_date=2024-05-23 22:45:06.630322+00:00, run_duration=0.373665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:45:04.658495+00:00, queued_by_job_id=1, pid=967 2024-05-23T22:45:09.709651255Z [2024-05-23T22:45:09.709+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:45:09.709673409Z 2024-05-23T22:45:09.709778184Z [2024-05-23T22:45:09.709+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:45:09.711695169Z [2024-05-23T22:45:09.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:45:09.711711664Z 2024-05-23T22:45:09.713657109Z [2024-05-23T22:45:09.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:45:09.713782277Z [2024-05-23T22:45:09.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:45:09.799554039Z [2024-05-23T22:45:09.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status queued for try_number 1 2024-05-23T22:45:09.800038703Z [2024-05-23T22:45:09.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:45:09.809042422Z [2024-05-23T22:45:09.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=0, run_start_date=2024-05-23 22:45:09.110993+00:00, run_end_date=2024-05-23 22:45:09.445736+00:00, run_duration=0.334743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:45:07.477060+00:00, queued_by_job_id=1, pid=975 2024-05-23T22:45:09.809523225Z [2024-05-23T22:45:09.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to d078c6a5-7803-4c39-90f2-f942fc9bbcd2 2024-05-23T22:45:12.086033101Z [2024-05-23T22:45:12.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:45:12.086435904Z [2024-05-23T22:45:12.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:40:00+00:00, run_id=scheduled__2024-05-23T22:40:00+00:00, run_start_date=2024-05-23 22:45:00.511306+00:00, run_end_date=2024-05-23 22:45:12.086141+00:00, run_duration=11.574835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:40:00+00:00, data_interval_end=2024-05-23 22:45:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T22:45:12.092004647Z [2024-05-23T22:45:12.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:45:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:45:12.124221338Z [2024-05-23T22:45:12.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:40:00+00:00 exited with status success for try_number 1 2024-05-23T22:45:12.130352332Z [2024-05-23T22:45:12.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:40:00+00:00, map_index=-1, run_start_date=2024-05-23 22:45:11.394977+00:00, run_end_date=2024-05-23 22:45:11.813405+00:00, run_duration=0.418428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:45:09.712003+00:00, queued_by_job_id=1, pid=983 2024-05-23T22:46:00.376896245Z [2024-05-23T22:46:00.376+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:46:00.392831619Z [2024-05-23T22:46:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:46:00+00:00, run_after=2024-05-23T22:47:00+00:00 2024-05-23T22:46:00.410887415Z [2024-05-23T22:46:00.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:46:00+00:00, run_after=2024-05-23T22:47:00+00:00 2024-05-23T22:46:00.426468761Z [2024-05-23T22:46:00.424+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:46:00.757514281Z [2024-05-23T22:46:00.757+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T22:46:00.757538278Z 2024-05-23T22:46:00.757542851Z 2024-05-23T22:46:00.757546150Z 2024-05-23T22:46:00.757549351Z 2024-05-23T22:46:00.757799025Z [2024-05-23T22:46:00.757+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:46:00.757966447Z [2024-05-23T22:46:00.757+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:46:00.758178916Z [2024-05-23T22:46:00.758+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:46:00.758343933Z [2024-05-23T22:46:00.758+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:46:00.759159728Z [2024-05-23T22:46:00.758+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:46:00.759172293Z 2024-05-23T22:46:00.759178413Z 2024-05-23T22:46:00.759181451Z 2024-05-23T22:46:00.759184412Z 2024-05-23T22:46:00.762932157Z [2024-05-23T22:46:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:46:00.763142676Z [2024-05-23T22:46:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:46:00.763441767Z [2024-05-23T22:46:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:46:00.763605444Z [2024-05-23T22:46:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:46:00.763860204Z [2024-05-23T22:46:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:46:00.764041357Z [2024-05-23T22:46:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:46:00.764297923Z [2024-05-23T22:46:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:46:00.764584880Z [2024-05-23T22:46:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:46:01.184313494Z [2024-05-23T22:46:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status queued for try_number 1 2024-05-23T22:46:01.184727441Z [2024-05-23T22:46:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:46:01.184738896Z [2024-05-23T22:46:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:46:01.184821765Z [2024-05-23T22:46:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:46:01.194783408Z [2024-05-23T22:46:01.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65bf0805-4b83-49fb-bdb3-61df007b5a5a 2024-05-23T22:46:01.195101301Z [2024-05-23T22:46:01.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cf7ffa7-03a7-4e07-88fc-3c243379cb68 2024-05-23T22:46:01.195617931Z [2024-05-23T22:46:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfd5c415-cdd5-4979-9dc9-73bc85f2757a 2024-05-23T22:46:01.195858580Z [2024-05-23T22:46:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to be2f5fb5-38af-41bd-9dc5-516bc9163f8d 2024-05-23T22:46:03.738673919Z [2024-05-23T22:46:03.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:46:03.738707686Z [2024-05-23T22:46:03.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:44:00+00:00, run_id=scheduled__2024-05-23T22:44:00+00:00, run_start_date=2024-05-23 22:46:00.444127+00:00, run_end_date=2024-05-23 22:46:03.737698+00:00, run_duration=3.293571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:44:00+00:00, data_interval_end=2024-05-23 22:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:46:03.777287880Z [2024-05-23T22:46:03.776+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:46:00+00:00, run_after=2024-05-23T22:48:00+00:00 2024-05-23T22:46:03.784937546Z [2024-05-23T22:46:03.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:46:03.785387108Z [2024-05-23T22:46:03.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:45:00+00:00, run_id=scheduled__2024-05-23T22:45:00+00:00, run_start_date=2024-05-23 22:46:00.446630+00:00, run_end_date=2024-05-23 22:46:03.784845+00:00, run_duration=3.338215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:45:00+00:00, data_interval_end=2024-05-23 22:46:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:46:03.796785676Z [2024-05-23T22:46:03.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:46:00+00:00, run_after=2024-05-23T22:47:00+00:00 2024-05-23T22:46:03.841886215Z [2024-05-23T22:46:03.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:44:00+00:00 exited with status success for try_number 1 2024-05-23T22:46:03.842230370Z [2024-05-23T22:46:03.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:46:03.849027077Z [2024-05-23T22:46:03.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:44:00+00:00, map_index=-1, run_start_date=2024-05-23 22:46:02.146889+00:00, run_end_date=2024-05-23 22:46:03.038725+00:00, run_duration=0.891836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:46:00.760245+00:00, queued_by_job_id=1, pid=1006 2024-05-23T22:46:03.849384983Z [2024-05-23T22:46:03.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:46:02.345071+00:00, run_end_date=2024-05-23 22:46:03.317660+00:00, run_duration=0.972589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:46:00.760245+00:00, queued_by_job_id=1, pid=1007 2024-05-23T22:46:06.756899373Z [2024-05-23T22:46:06.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:46:06.757201522Z [2024-05-23T22:46:06.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:45:00+00:00, run_id=scheduled__2024-05-23T22:45:00+00:00, run_start_date=2024-05-23 22:46:00.451278+00:00, run_end_date=2024-05-23 22:46:06.756874+00:00, run_duration=6.305596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:45:00+00:00, data_interval_end=2024-05-23 22:46:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:46:06.766303795Z [2024-05-23T22:46:06.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:46:00+00:00, run_after=2024-05-23T22:47:00+00:00 2024-05-23T22:46:06.782528730Z [2024-05-23T22:46:06.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:46:06.783391614Z [2024-05-23T22:46:06.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:45:00+00:00, run_id=scheduled__2024-05-23T22:45:00+00:00, run_start_date=2024-05-23 22:46:00.452591+00:00, run_end_date=2024-05-23 22:46:06.782715+00:00, run_duration=6.330124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:45:00+00:00, data_interval_end=2024-05-23 22:46:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:46:06.801473958Z [2024-05-23T22:46:06.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:46:00+00:00, run_after=2024-05-23T22:47:00+00:00 2024-05-23T22:46:06.860369419Z [2024-05-23T22:46:06.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:46:06.860612523Z [2024-05-23T22:46:06.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:46:06.867263634Z [2024-05-23T22:46:06.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:46:04.494347+00:00, run_end_date=2024-05-23 22:46:05.788296+00:00, run_duration=1.293949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:46:00.760245+00:00, queued_by_job_id=1, pid=1025 2024-05-23T22:46:06.867560197Z [2024-05-23T22:46:06.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:46:04.818875+00:00, run_end_date=2024-05-23 22:46:06.479636+00:00, run_duration=1.660761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:46:00.760245+00:00, queued_by_job_id=1, pid=1031 2024-05-23T22:46:38.907756446Z [2024-05-23T22:46:38.905+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T22:47:00.325608165Z [2024-05-23T22:47:00.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:47:00+00:00, run_after=2024-05-23T22:48:00+00:00 2024-05-23T22:47:00.356182140Z [2024-05-23T22:47:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:47:00+00:00, run_after=2024-05-23T22:48:00+00:00 2024-05-23T22:47:00.368378059Z [2024-05-23T22:47:00.367+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:47:00.464197517Z [2024-05-23T22:47:00.456+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:47:00.464222958Z 2024-05-23T22:47:00.464226841Z 2024-05-23T22:47:00.464230272Z 2024-05-23T22:47:00.464234167Z [2024-05-23T22:47:00.456+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:47:00.464250253Z [2024-05-23T22:47:00.456+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:47:00.464253179Z [2024-05-23T22:47:00.456+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:47:00.464257821Z [2024-05-23T22:47:00.457+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:47:00.464260824Z 2024-05-23T22:47:00.464263611Z 2024-05-23T22:47:00.464266403Z 2024-05-23T22:47:00.464271025Z [2024-05-23T22:47:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:47:00.464274030Z [2024-05-23T22:47:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:47:00.464277007Z [2024-05-23T22:47:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:47:00.464279721Z [2024-05-23T22:47:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:47:00.464282572Z [2024-05-23T22:47:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:47:00.464285375Z [2024-05-23T22:47:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:47:00.851645118Z [2024-05-23T22:47:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status queued for try_number 1 2024-05-23T22:47:00.853784892Z [2024-05-23T22:47:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status queued for try_number 1 2024-05-23T22:47:00.853896994Z [2024-05-23T22:47:00.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status queued for try_number 1 2024-05-23T22:47:00.879393171Z [2024-05-23T22:47:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46676a34-3602-45b6-95c6-330c73de3c05 2024-05-23T22:47:00.879533739Z [2024-05-23T22:47:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69348e81-5a78-46a8-95ab-52d39f8a64d1 2024-05-23T22:47:00.879674385Z [2024-05-23T22:47:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ec2b8dd-de80-46c8-9fe8-df680bbe7f5a 2024-05-23T22:47:02.155778968Z [2024-05-23T22:47:02.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:47:02.156326905Z [2024-05-23T22:47:02.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:46:00+00:00, run_id=scheduled__2024-05-23T22:46:00+00:00, run_start_date=2024-05-23 22:47:00.388184+00:00, run_end_date=2024-05-23 22:47:02.155910+00:00, run_duration=1.767726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:46:00+00:00, data_interval_end=2024-05-23 22:47:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:47:02.166657183Z [2024-05-23T22:47:02.166+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:47:00+00:00, run_after=2024-05-23T22:48:00+00:00 2024-05-23T22:47:02.231837519Z [2024-05-23T22:47:02.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status success for try_number 1 2024-05-23T22:47:02.238245092Z [2024-05-23T22:47:02.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:46:00+00:00, map_index=-1, run_start_date=2024-05-23 22:47:01.431813+00:00, run_end_date=2024-05-23 22:47:01.836373+00:00, run_duration=0.40456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:47:00.457902+00:00, queued_by_job_id=1, pid=1063 2024-05-23T22:47:04.423314896Z [2024-05-23T22:47:04.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:47:04.425376212Z [2024-05-23T22:47:04.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:46:00+00:00, run_id=scheduled__2024-05-23T22:46:00+00:00, run_start_date=2024-05-23 22:47:00.389907+00:00, run_end_date=2024-05-23 22:47:04.424463+00:00, run_duration=4.034556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:46:00+00:00, data_interval_end=2024-05-23 22:47:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:47:04.452213477Z [2024-05-23T22:47:04.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:47:00+00:00, run_after=2024-05-23T22:48:00+00:00 2024-05-23T22:47:04.494550900Z [2024-05-23T22:47:04.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status success for try_number 1 2024-05-23T22:47:04.500682029Z [2024-05-23T22:47:04.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:46:00+00:00, map_index=-1, run_start_date=2024-05-23 22:47:02.701625+00:00, run_end_date=2024-05-23 22:47:04.103109+00:00, run_duration=1.401484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:47:00.457902+00:00, queued_by_job_id=1, pid=1081 2024-05-23T22:47:05.555367171Z [2024-05-23T22:47:05.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:47:05.555692384Z [2024-05-23T22:47:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:46:00+00:00, run_id=scheduled__2024-05-23T22:46:00+00:00, run_start_date=2024-05-23 22:47:00.391532+00:00, run_end_date=2024-05-23 22:47:05.555209+00:00, run_duration=5.163677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:46:00+00:00, data_interval_end=2024-05-23 22:47:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:47:05.566312242Z [2024-05-23T22:47:05.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:47:00+00:00, run_after=2024-05-23T22:48:00+00:00 2024-05-23T22:47:05.605095330Z [2024-05-23T22:47:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status success for try_number 1 2024-05-23T22:47:05.613306411Z [2024-05-23T22:47:05.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:46:00+00:00, map_index=-1, run_start_date=2024-05-23 22:47:02.789591+00:00, run_end_date=2024-05-23 22:47:05.204459+00:00, run_duration=2.414868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:47:00.457902+00:00, queued_by_job_id=1, pid=1082 2024-05-23T22:48:00.623314284Z [2024-05-23T22:48:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:48:00+00:00, run_after=2024-05-23T22:49:00+00:00 2024-05-23T22:48:00.633229017Z [2024-05-23T22:48:00.632+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:48:00.651620887Z [2024-05-23T22:48:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:48:00+00:00, run_after=2024-05-23T22:49:00+00:00 2024-05-23T22:48:00.661431301Z [2024-05-23T22:48:00.660+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:48:00.763376813Z [2024-05-23T22:48:00.762+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T22:48:00.763697875Z 2024-05-23T22:48:00.763711453Z 2024-05-23T22:48:00.763719757Z 2024-05-23T22:48:00.763727473Z 2024-05-23T22:48:00.763773651Z [2024-05-23T22:48:00.763+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:48:00.763791087Z [2024-05-23T22:48:00.763+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:48:00.763966082Z [2024-05-23T22:48:00.763+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:48:00.764220166Z [2024-05-23T22:48:00.763+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:48:00.765172462Z [2024-05-23T22:48:00.764+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:48:00.765195332Z 2024-05-23T22:48:00.765204328Z 2024-05-23T22:48:00.765212430Z 2024-05-23T22:48:00.765220327Z 2024-05-23T22:48:00.771395507Z [2024-05-23T22:48:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:48:00.771597531Z [2024-05-23T22:48:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:48:00.772029565Z [2024-05-23T22:48:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:48:00.772237961Z [2024-05-23T22:48:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:48:00.772530436Z [2024-05-23T22:48:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:48:00.772687800Z [2024-05-23T22:48:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:48:00.772940822Z [2024-05-23T22:48:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:48:00.773077007Z [2024-05-23T22:48:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:48:01.170337289Z [2024-05-23T22:48:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status queued for try_number 1 2024-05-23T22:48:01.170470126Z [2024-05-23T22:48:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:47:00+00:00 exited with status queued for try_number 1 2024-05-23T22:48:01.170613633Z [2024-05-23T22:48:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:47:00+00:00 exited with status queued for try_number 1 2024-05-23T22:48:01.170744408Z [2024-05-23T22:48:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:47:00+00:00 exited with status queued for try_number 1 2024-05-23T22:48:01.183765312Z [2024-05-23T22:48:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 366982b8-6d15-4b3f-b976-b4cadf0b2c7f 2024-05-23T22:48:01.183907198Z [2024-05-23T22:48:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b0ca949-7986-431f-8cb2-c6dfacf918d6 2024-05-23T22:48:01.184057864Z [2024-05-23T22:48:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to caca1d4b-a807-42b5-95ed-ce519b416f70 2024-05-23T22:48:01.184245431Z [2024-05-23T22:48:01.184+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d6bc692-0fea-40df-9bd3-507b1c515df5 2024-05-23T22:48:03.018572192Z [2024-05-23T22:48:03.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:48:03.018969047Z [2024-05-23T22:48:03.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:46:00+00:00, run_id=scheduled__2024-05-23T22:46:00+00:00, run_start_date=2024-05-23 22:48:00.678075+00:00, run_end_date=2024-05-23 22:48:03.018566+00:00, run_duration=2.340491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:46:00+00:00, data_interval_end=2024-05-23 22:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:48:03.032161103Z [2024-05-23T22:48:03.031+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:48:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:48:03.047803578Z [2024-05-23T22:48:03.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:48:03.048170507Z [2024-05-23T22:48:03.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:47:00+00:00, run_id=scheduled__2024-05-23T22:47:00+00:00, run_start_date=2024-05-23 22:48:00.679652+00:00, run_end_date=2024-05-23 22:48:03.047753+00:00, run_duration=2.368101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:47:00+00:00, data_interval_end=2024-05-23 22:48:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:48:03.065182748Z [2024-05-23T22:48:03.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:48:00+00:00, run_after=2024-05-23T22:49:00+00:00 2024-05-23T22:48:03.196485895Z [2024-05-23T22:48:03.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:46:00+00:00 exited with status success for try_number 1 2024-05-23T22:48:03.196833166Z [2024-05-23T22:48:03.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:47:00+00:00 exited with status success for try_number 1 2024-05-23T22:48:03.209901500Z [2024-05-23T22:48:03.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:46:00+00:00, map_index=-1, run_start_date=2024-05-23 22:48:01.644591+00:00, run_end_date=2024-05-23 22:48:02.038079+00:00, run_duration=0.393488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:48:00.766169+00:00, queued_by_job_id=1, pid=1115 2024-05-23T22:48:03.210396029Z [2024-05-23T22:48:03.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:47:00+00:00, map_index=-1, run_start_date=2024-05-23 22:48:01.865969+00:00, run_end_date=2024-05-23 22:48:02.243300+00:00, run_duration=0.377331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:48:00.766169+00:00, queued_by_job_id=1, pid=1116 2024-05-23T22:48:05.359379241Z [2024-05-23T22:48:05.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:48:05.359798367Z [2024-05-23T22:48:05.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:47:00+00:00, run_id=scheduled__2024-05-23T22:47:00+00:00, run_start_date=2024-05-23 22:48:00.682367+00:00, run_end_date=2024-05-23 22:48:05.359238+00:00, run_duration=4.676871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:47:00+00:00, data_interval_end=2024-05-23 22:48:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:48:05.368457406Z [2024-05-23T22:48:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:48:00+00:00, run_after=2024-05-23T22:49:00+00:00 2024-05-23T22:48:05.377334266Z [2024-05-23T22:48:05.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:48:05.377671390Z [2024-05-23T22:48:05.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:47:00+00:00, run_id=scheduled__2024-05-23T22:47:00+00:00, run_start_date=2024-05-23 22:48:00.680956+00:00, run_end_date=2024-05-23 22:48:05.377210+00:00, run_duration=4.696254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:47:00+00:00, data_interval_end=2024-05-23 22:48:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:48:05.391490162Z [2024-05-23T22:48:05.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:48:00+00:00, run_after=2024-05-23T22:49:00+00:00 2024-05-23T22:48:05.445459963Z [2024-05-23T22:48:05.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:47:00+00:00 exited with status success for try_number 1 2024-05-23T22:48:05.445520489Z [2024-05-23T22:48:05.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:47:00+00:00 exited with status success for try_number 1 2024-05-23T22:48:05.455964867Z [2024-05-23T22:48:05.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:47:00+00:00, map_index=-1, run_start_date=2024-05-23 22:48:03.048684+00:00, run_end_date=2024-05-23 22:48:04.405598+00:00, run_duration=1.356914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:48:00.766169+00:00, queued_by_job_id=1, pid=1139 2024-05-23T22:48:05.456175368Z [2024-05-23T22:48:05.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:47:00+00:00, map_index=-1, run_start_date=2024-05-23 22:48:03.090407+00:00, run_end_date=2024-05-23 22:48:04.847993+00:00, run_duration=1.757586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:48:00.766169+00:00, queued_by_job_id=1, pid=1140 2024-05-23T22:49:00.810808276Z [2024-05-23T22:49:00.809+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:49:00.827347693Z [2024-05-23T22:49:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:49:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:49:00.840728880Z [2024-05-23T22:49:00.840+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:49:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:49:00.902489955Z [2024-05-23T22:49:00.902+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:49:00.902546413Z 2024-05-23T22:49:00.902565211Z 2024-05-23T22:49:00.902568525Z 2024-05-23T22:49:00.902771960Z [2024-05-23T22:49:00.902+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:49:00.903022926Z [2024-05-23T22:49:00.902+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:49:00.903220226Z [2024-05-23T22:49:00.902+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:49:00.903890490Z [2024-05-23T22:49:00.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:49:00.903903806Z 2024-05-23T22:49:00.903907568Z 2024-05-23T22:49:00.903910776Z 2024-05-23T22:49:00.907215619Z [2024-05-23T22:49:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:49:00.907501231Z [2024-05-23T22:49:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:49:00.907851140Z [2024-05-23T22:49:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:49:00.908093776Z [2024-05-23T22:49:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:49:00.908504215Z [2024-05-23T22:49:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:49:00.908736011Z [2024-05-23T22:49:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:49:01.188231701Z [2024-05-23T22:49:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status queued for try_number 1 2024-05-23T22:49:01.188384612Z [2024-05-23T22:49:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status queued for try_number 1 2024-05-23T22:49:01.188416405Z [2024-05-23T22:49:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status queued for try_number 1 2024-05-23T22:49:01.196650974Z [2024-05-23T22:49:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65695eda-6789-4ccf-8af3-f6973a59ee33 2024-05-23T22:49:01.196694785Z [2024-05-23T22:49:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 628afd14-b141-4e1e-a4ab-028dd27ab114 2024-05-23T22:49:01.196820539Z [2024-05-23T22:49:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d8e8582-f8bd-41ed-ab04-3bac01d3336f 2024-05-23T22:49:02.389797822Z [2024-05-23T22:49:02.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:49:02.390255382Z [2024-05-23T22:49:02.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:48:00+00:00, run_id=scheduled__2024-05-23T22:48:00+00:00, run_start_date=2024-05-23 22:49:00.853794+00:00, run_end_date=2024-05-23 22:49:02.389896+00:00, run_duration=1.536102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:48:00+00:00, data_interval_end=2024-05-23 22:49:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:49:02.401953186Z [2024-05-23T22:49:02.401+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:49:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:49:02.448960449Z [2024-05-23T22:49:02.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status success for try_number 1 2024-05-23T22:49:02.454251552Z [2024-05-23T22:49:02.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:48:00+00:00, map_index=-1, run_start_date=2024-05-23 22:49:01.761532+00:00, run_end_date=2024-05-23 22:49:02.170654+00:00, run_duration=0.409122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:49:00.904638+00:00, queued_by_job_id=1, pid=1173 2024-05-23T22:49:05.117894758Z [2024-05-23T22:49:05.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:49:05.118332479Z [2024-05-23T22:49:05.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:48:00+00:00, run_id=scheduled__2024-05-23T22:48:00+00:00, run_start_date=2024-05-23 22:49:00.851326+00:00, run_end_date=2024-05-23 22:49:05.117702+00:00, run_duration=4.266376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:48:00+00:00, data_interval_end=2024-05-23 22:49:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:49:05.136028127Z [2024-05-23T22:49:05.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:49:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:49:05.149716244Z [2024-05-23T22:49:05.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:49:05.150268995Z [2024-05-23T22:49:05.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:48:00+00:00, run_id=scheduled__2024-05-23T22:48:00+00:00, run_start_date=2024-05-23 22:49:00.852668+00:00, run_end_date=2024-05-23 22:49:05.149595+00:00, run_duration=4.296927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:48:00+00:00, data_interval_end=2024-05-23 22:49:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:49:05.165750063Z [2024-05-23T22:49:05.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:49:00+00:00, run_after=2024-05-23T22:50:00+00:00 2024-05-23T22:49:05.200039733Z [2024-05-23T22:49:05.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status success for try_number 1 2024-05-23T22:49:05.200326211Z [2024-05-23T22:49:05.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status success for try_number 1 2024-05-23T22:49:05.213172032Z [2024-05-23T22:49:05.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:48:00+00:00, map_index=-1, run_start_date=2024-05-23 22:49:02.958017+00:00, run_end_date=2024-05-23 22:49:04.251973+00:00, run_duration=1.293956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:49:00.904638+00:00, queued_by_job_id=1, pid=1191 2024-05-23T22:49:05.213403674Z [2024-05-23T22:49:05.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:48:00+00:00, map_index=-1, run_start_date=2024-05-23 22:49:02.972705+00:00, run_end_date=2024-05-23 22:49:04.630379+00:00, run_duration=1.657674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:49:00.904638+00:00, queued_by_job_id=1, pid=1192 2024-05-23T22:50:00.075517228Z [2024-05-23T22:50:00.074+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:50:00.084755217Z [2024-05-23T22:50:00.084+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:50:00.101341562Z [2024-05-23T22:50:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:51:00+00:00 2024-05-23T22:50:00.119192306Z [2024-05-23T22:50:00.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:51:00+00:00 2024-05-23T22:50:00.130655313Z [2024-05-23T22:50:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:50:00.212289939Z [2024-05-23T22:50:00.211+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T22:50:00.212315770Z 2024-05-23T22:50:00.212320225Z 2024-05-23T22:50:00.212324835Z 2024-05-23T22:50:00.212328898Z 2024-05-23T22:50:00.212333093Z 2024-05-23T22:50:00.212471010Z [2024-05-23T22:50:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:50:00.212617955Z [2024-05-23T22:50:00.212+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:50:00.212760715Z [2024-05-23T22:50:00.212+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:50:00.212898793Z [2024-05-23T22:50:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:50:00.213035087Z [2024-05-23T22:50:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:50:00.213775660Z [2024-05-23T22:50:00.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:50:00.213783966Z 2024-05-23T22:50:00.213788690Z 2024-05-23T22:50:00.213796878Z 2024-05-23T22:50:00.213800949Z 2024-05-23T22:50:00.213804938Z 2024-05-23T22:50:00.219177041Z [2024-05-23T22:50:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:50:00.219376014Z [2024-05-23T22:50:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:50:00.219637617Z [2024-05-23T22:50:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:50:00.219790021Z [2024-05-23T22:50:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:50:00.220076420Z [2024-05-23T22:50:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:50:00.220392708Z [2024-05-23T22:50:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:50:00.220675282Z [2024-05-23T22:50:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:50:00.221040639Z [2024-05-23T22:50:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:50:00.221222474Z [2024-05-23T22:50:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:50:00.221416140Z [2024-05-23T22:50:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:50:00.600585379Z [2024-05-23T22:50:00.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:00.600614804Z [2024-05-23T22:50:00.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:00.606884512Z [2024-05-23T22:50:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:49:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:00.607075381Z [2024-05-23T22:50:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:49:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:00.607239360Z [2024-05-23T22:50:00.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:49:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:00.635794361Z [2024-05-23T22:50:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to f63ac11c-6f67-48d5-a4c0-531511473441 2024-05-23T22:50:00.635999925Z [2024-05-23T22:50:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 727b1817-1739-41f3-b5f2-425ea326baf0 2024-05-23T22:50:00.636166494Z [2024-05-23T22:50:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 587bdd70-7505-407b-bbaa-6b4d190cb8c3 2024-05-23T22:50:00.636330031Z [2024-05-23T22:50:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8a52cd7-bfe2-4374-beff-89f3f7d0ba7d 2024-05-23T22:50:00.636535463Z [2024-05-23T22:50:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b306b65-667c-43bf-9777-c8dff84352c5 2024-05-23T22:50:02.188261676Z [2024-05-23T22:50:02.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:50:02.188629634Z [2024-05-23T22:50:02.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:48:00+00:00, run_id=scheduled__2024-05-23T22:48:00+00:00, run_start_date=2024-05-23 22:50:00.140938+00:00, run_end_date=2024-05-23 22:50:02.188243+00:00, run_duration=2.047305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:48:00+00:00, data_interval_end=2024-05-23 22:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:50:02.197369075Z [2024-05-23T22:50:02.197+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:52:00+00:00 2024-05-23T22:50:02.203588693Z [2024-05-23T22:50:02.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:50:02.203863689Z [2024-05-23T22:50:02.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:49:00+00:00, run_id=scheduled__2024-05-23T22:49:00+00:00, run_start_date=2024-05-23 22:50:00.142872+00:00, run_end_date=2024-05-23 22:50:02.203578+00:00, run_duration=2.060706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:49:00+00:00, data_interval_end=2024-05-23 22:50:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:50:02.215068103Z [2024-05-23T22:50:02.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:51:00+00:00 2024-05-23T22:50:02.284255702Z [2024-05-23T22:50:02.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:49:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:02.298370652Z [2024-05-23T22:50:02.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:49:00+00:00, map_index=-1, run_start_date=2024-05-23 22:50:01.615563+00:00, run_end_date=2024-05-23 22:50:02.000233+00:00, run_duration=0.38467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:00.214756+00:00, queued_by_job_id=1, pid=1227 2024-05-23T22:50:03.395389876Z [2024-05-23T22:50:03.395+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:50:03.395421123Z 2024-05-23T22:50:03.395536758Z [2024-05-23T22:50:03.395+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:50:03.396111046Z [2024-05-23T22:50:03.395+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:50:03.396117832Z 2024-05-23T22:50:03.398339646Z [2024-05-23T22:50:03.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:50:03.398585754Z [2024-05-23T22:50:03.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:50:03.464025512Z [2024-05-23T22:50:03.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:03.464190094Z [2024-05-23T22:50:03.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:03.464313253Z [2024-05-23T22:50:03.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:48:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:03.477859824Z [2024-05-23T22:50:03.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:48:00+00:00, map_index=-1, run_start_date=2024-05-23 22:50:01.678608+00:00, run_end_date=2024-05-23 22:50:02.054888+00:00, run_duration=0.37628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:00.214756+00:00, queued_by_job_id=1, pid=1228 2024-05-23T22:50:03.478944494Z [2024-05-23T22:50:03.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:50:02.921761+00:00, run_end_date=2024-05-23 22:50:03.257914+00:00, run_duration=0.336153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:00.214756+00:00, queued_by_job_id=1, pid=1247 2024-05-23T22:50:03.479259549Z [2024-05-23T22:50:03.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01db2058-67fd-43c1-b68b-a2100983c76b 2024-05-23T22:50:04.872465975Z [2024-05-23T22:50:04.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:50:04.872576047Z [2024-05-23T22:50:04.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:49:00+00:00, run_id=scheduled__2024-05-23T22:49:00+00:00, run_start_date=2024-05-23 22:50:00.143952+00:00, run_end_date=2024-05-23 22:50:04.872300+00:00, run_duration=4.728348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:49:00+00:00, data_interval_end=2024-05-23 22:50:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:50:04.880640600Z [2024-05-23T22:50:04.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:51:00+00:00 2024-05-23T22:50:04.922973494Z [2024-05-23T22:50:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:49:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:04.927336595Z [2024-05-23T22:50:04.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:49:00+00:00, map_index=-1, run_start_date=2024-05-23 22:50:03.126302+00:00, run_end_date=2024-05-23 22:50:04.498746+00:00, run_duration=1.372444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:00.214756+00:00, queued_by_job_id=1, pid=1258 2024-05-23T22:50:05.973174787Z [2024-05-23T22:50:05.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:50:05.973244995Z [2024-05-23T22:50:05.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:49:00+00:00, run_id=scheduled__2024-05-23T22:49:00+00:00, run_start_date=2024-05-23 22:50:00.141929+00:00, run_end_date=2024-05-23 22:50:05.972984+00:00, run_duration=5.831055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:49:00+00:00, data_interval_end=2024-05-23 22:50:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:50:05.982589389Z [2024-05-23T22:50:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:51:00+00:00 2024-05-23T22:50:06.009430858Z [2024-05-23T22:50:06.009+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:50:06.009458052Z 2024-05-23T22:50:06.009496339Z [2024-05-23T22:50:06.009+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:50:06.009924730Z [2024-05-23T22:50:06.009+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:50:06.009937866Z 2024-05-23T22:50:06.012181306Z [2024-05-23T22:50:06.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:50:06.012267613Z [2024-05-23T22:50:06.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:50:06.066399886Z [2024-05-23T22:50:06.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:06.066620249Z [2024-05-23T22:50:06.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:49:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:06.066769362Z [2024-05-23T22:50:06.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:06.073708274Z [2024-05-23T22:50:06.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:49:00+00:00, map_index=-1, run_start_date=2024-05-23 22:50:03.244929+00:00, run_end_date=2024-05-23 22:50:05.460509+00:00, run_duration=2.21558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:00.214756+00:00, queued_by_job_id=1, pid=1264 2024-05-23T22:50:06.074079467Z [2024-05-23T22:50:06.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14ac0d04-a4f5-44de-842e-eae6a434a5c9 2024-05-23T22:50:06.074254540Z [2024-05-23T22:50:06.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:50:05.241742+00:00, run_end_date=2024-05-23 22:50:05.597297+00:00, run_duration=0.355555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:03.396487+00:00, queued_by_job_id=1, pid=1282 2024-05-23T22:50:08.357042017Z [2024-05-23T22:50:08.356+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:50:08.357068652Z 2024-05-23T22:50:08.357072916Z [2024-05-23T22:50:08.356+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:50:08.359841366Z [2024-05-23T22:50:08.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:50:08.359859589Z 2024-05-23T22:50:08.365844475Z [2024-05-23T22:50:08.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:50:08.366161648Z [2024-05-23T22:50:08.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:50:08.441926797Z [2024-05-23T22:50:08.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:50:08.441964567Z [2024-05-23T22:50:08.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:08.452595657Z [2024-05-23T22:50:08.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=0, run_start_date=2024-05-23 22:50:07.841979+00:00, run_end_date=2024-05-23 22:50:08.197070+00:00, run_duration=0.355091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:06.010363+00:00, queued_by_job_id=1, pid=1290 2024-05-23T22:50:08.452957798Z [2024-05-23T22:50:08.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3025a12-63fd-4c6f-a7e3-44ef13951dc9 2024-05-23T22:50:11.259809673Z [2024-05-23T22:50:11.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:50:11.260951984Z [2024-05-23T22:50:11.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:45:00+00:00, run_id=scheduled__2024-05-23T22:45:00+00:00, run_start_date=2024-05-23 22:50:00.139746+00:00, run_end_date=2024-05-23 22:50:11.259906+00:00, run_duration=11.12016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:45:00+00:00, data_interval_end=2024-05-23 22:50:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T22:50:11.279284890Z [2024-05-23T22:50:11.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:50:11.322136685Z [2024-05-23T22:50:11.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:50:11.328124532Z [2024-05-23T22:50:11.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:50:10.243654+00:00, run_end_date=2024-05-23 22:50:10.693133+00:00, run_duration=0.449479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:50:08.360526+00:00, queued_by_job_id=1, pid=1298 2024-05-23T22:51:00.845080543Z [2024-05-23T22:51:00.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:51:00+00:00, run_after=2024-05-23T22:52:00+00:00 2024-05-23T22:51:00.861112161Z [2024-05-23T22:51:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:51:00+00:00, run_after=2024-05-23T22:52:00+00:00 2024-05-23T22:51:00.868523382Z [2024-05-23T22:51:00.868+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:51:00.939869895Z [2024-05-23T22:51:00.939+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:51:00.939900689Z 2024-05-23T22:51:00.939904337Z 2024-05-23T22:51:00.939908595Z 2024-05-23T22:51:00.939992628Z [2024-05-23T22:51:00.939+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:51:00.940078329Z [2024-05-23T22:51:00.939+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:51:00.940148503Z [2024-05-23T22:51:00.940+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:51:00.940713862Z [2024-05-23T22:51:00.940+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:51:00.940719823Z 2024-05-23T22:51:00.940722988Z 2024-05-23T22:51:00.940726243Z 2024-05-23T22:51:00.946498333Z [2024-05-23T22:51:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:51:00.946612496Z [2024-05-23T22:51:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:51:00.946803825Z [2024-05-23T22:51:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:51:00.946888808Z [2024-05-23T22:51:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:51:00.947052834Z [2024-05-23T22:51:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:51:00.947130585Z [2024-05-23T22:51:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:51:01.183352163Z [2024-05-23T22:51:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:51:01.183448581Z [2024-05-23T22:51:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:51:01.183454452Z [2024-05-23T22:51:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:51:01.192596286Z [2024-05-23T22:51:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to c093ab05-d39b-4fe7-8f9a-1f9972f4bc59 2024-05-23T22:51:01.192669300Z [2024-05-23T22:51:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9298d6cd-a0f5-4267-ba90-c732ffa3a45b 2024-05-23T22:51:01.192757718Z [2024-05-23T22:51:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to db578bd2-8b37-4dbc-b1e5-fefd0011ad85 2024-05-23T22:51:02.434461017Z [2024-05-23T22:51:02.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:51:02.440774746Z [2024-05-23T22:51:02.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:51:01.832729+00:00, run_end_date=2024-05-23 22:51:02.292217+00:00, run_duration=0.459488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:51:00.941546+00:00, queued_by_job_id=1, pid=1320 2024-05-23T22:51:03.498419115Z [2024-05-23T22:51:03.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:51:03.498827079Z [2024-05-23T22:51:03.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:50:00+00:00, run_id=scheduled__2024-05-23T22:50:00+00:00, run_start_date=2024-05-23 22:51:00.879873+00:00, run_end_date=2024-05-23 22:51:03.498298+00:00, run_duration=2.618425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:50:00+00:00, data_interval_end=2024-05-23 22:51:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:51:03.509904442Z [2024-05-23T22:51:03.509+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:51:00+00:00, run_after=2024-05-23T22:52:00+00:00 2024-05-23T22:51:04.647879922Z [2024-05-23T22:51:04.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:51:04.653518324Z [2024-05-23T22:51:04.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:50:00+00:00, run_id=scheduled__2024-05-23T22:50:00+00:00, run_start_date=2024-05-23 22:51:00.878413+00:00, run_end_date=2024-05-23 22:51:04.647798+00:00, run_duration=3.769385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:50:00+00:00, data_interval_end=2024-05-23 22:51:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:51:04.661907968Z [2024-05-23T22:51:04.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:51:00+00:00, run_after=2024-05-23T22:52:00+00:00 2024-05-23T22:51:04.726559267Z [2024-05-23T22:51:04.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:51:04.735007462Z [2024-05-23T22:51:04.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:51:03.034859+00:00, run_end_date=2024-05-23 22:51:04.420302+00:00, run_duration=1.385443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:51:00.941546+00:00, queued_by_job_id=1, pid=1339 2024-05-23T22:51:04.815162579Z [2024-05-23T22:51:04.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:51:04.815309779Z [2024-05-23T22:51:04.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:50:00+00:00, run_id=scheduled__2024-05-23T22:50:00+00:00, run_start_date=2024-05-23 22:51:00.880951+00:00, run_end_date=2024-05-23 22:51:04.815068+00:00, run_duration=3.934117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:50:00+00:00, data_interval_end=2024-05-23 22:51:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:51:04.824191642Z [2024-05-23T22:51:04.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:51:00+00:00, run_after=2024-05-23T22:52:00+00:00 2024-05-23T22:51:04.859681669Z [2024-05-23T22:51:04.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:51:04.864479229Z [2024-05-23T22:51:04.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:51:03.019583+00:00, run_end_date=2024-05-23 22:51:04.716964+00:00, run_duration=1.697381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:51:00.941546+00:00, queued_by_job_id=1, pid=1338 2024-05-23T22:51:38.927126031Z [2024-05-23T22:51:38.926+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T22:52:00.539161145Z [2024-05-23T22:52:00.538+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:52:00.553525773Z [2024-05-23T22:52:00.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:52:00+00:00, run_after=2024-05-23T22:53:00+00:00 2024-05-23T22:52:00.566377823Z [2024-05-23T22:52:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:52:00+00:00, run_after=2024-05-23T22:53:00+00:00 2024-05-23T22:52:00.578243696Z [2024-05-23T22:52:00.577+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:52:00.663050582Z [2024-05-23T22:52:00.662+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T22:52:00.663084191Z 2024-05-23T22:52:00.663091201Z 2024-05-23T22:52:00.663097060Z 2024-05-23T22:52:00.663103575Z 2024-05-23T22:52:00.663110132Z [2024-05-23T22:52:00.662+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:52:00.663154367Z [2024-05-23T22:52:00.663+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:52:00.663216303Z [2024-05-23T22:52:00.663+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:52:00.663315796Z [2024-05-23T22:52:00.663+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:52:00.664013499Z [2024-05-23T22:52:00.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:52:00.664052930Z 2024-05-23T22:52:00.664060084Z 2024-05-23T22:52:00.664083824Z 2024-05-23T22:52:00.664088456Z 2024-05-23T22:52:00.667888457Z [2024-05-23T22:52:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:52:00.668034025Z [2024-05-23T22:52:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:52:00.668340104Z [2024-05-23T22:52:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:52:00.668511559Z [2024-05-23T22:52:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:52:00.668820948Z [2024-05-23T22:52:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:52:00.668931712Z [2024-05-23T22:52:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:52:00.669153360Z [2024-05-23T22:52:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:52:00.669250368Z [2024-05-23T22:52:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:52:01.087867563Z [2024-05-23T22:52:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:52:01.088059122Z [2024-05-23T22:52:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:51:00+00:00 exited with status queued for try_number 1 2024-05-23T22:52:01.088223678Z [2024-05-23T22:52:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:51:00+00:00 exited with status queued for try_number 1 2024-05-23T22:52:01.088391031Z [2024-05-23T22:52:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:51:00+00:00 exited with status queued for try_number 1 2024-05-23T22:52:01.096410486Z [2024-05-23T22:52:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 086024b1-fcba-40a1-949f-93765ae23170 2024-05-23T22:52:01.096817357Z [2024-05-23T22:52:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2de569d0-9002-4554-b16e-7dc23fe87e56 2024-05-23T22:52:01.097168097Z [2024-05-23T22:52:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fafafa7-d121-4785-a761-b5ed55371df2 2024-05-23T22:52:01.097489796Z [2024-05-23T22:52:01.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to 992f087f-0102-4d77-ae06-f7e8aa282676 2024-05-23T22:52:02.249533893Z [2024-05-23T22:52:02.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:52:02.250140632Z [2024-05-23T22:52:02.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:50:00+00:00, run_id=scheduled__2024-05-23T22:50:00+00:00, run_start_date=2024-05-23 22:52:00.597541+00:00, run_end_date=2024-05-23 22:52:02.249605+00:00, run_duration=1.652064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:50:00+00:00, data_interval_end=2024-05-23 22:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:52:02.265139460Z [2024-05-23T22:52:02.264+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:52:00+00:00, run_after=2024-05-23T22:54:00+00:00 2024-05-23T22:52:02.324065678Z [2024-05-23T22:52:02.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:52:02.324509145Z [2024-05-23T22:52:02.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:51:00+00:00 exited with status success for try_number 1 2024-05-23T22:52:02.341999116Z [2024-05-23T22:52:02.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:51:00+00:00, map_index=-1, run_start_date=2024-05-23 22:52:01.721604+00:00, run_end_date=2024-05-23 22:52:02.147576+00:00, run_duration=0.425972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:52:00.664811+00:00, queued_by_job_id=1, pid=1373 2024-05-23T22:52:02.342768723Z [2024-05-23T22:52:02.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:52:01.474240+00:00, run_end_date=2024-05-23 22:52:01.871361+00:00, run_duration=0.397121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:52:00.664811+00:00, queued_by_job_id=1, pid=1372 2024-05-23T22:52:03.397927807Z [2024-05-23T22:52:03.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:52:03.398299394Z [2024-05-23T22:52:03.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:51:00+00:00, run_id=scheduled__2024-05-23T22:51:00+00:00, run_start_date=2024-05-23 22:52:00.601505+00:00, run_end_date=2024-05-23 22:52:03.397834+00:00, run_duration=2.796329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:51:00+00:00, data_interval_end=2024-05-23 22:52:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:52:03.410123086Z [2024-05-23T22:52:03.409+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:52:00+00:00, run_after=2024-05-23T22:53:00+00:00 2024-05-23T22:52:04.508352890Z [2024-05-23T22:52:04.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:52:04.508443385Z [2024-05-23T22:52:04.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:51:00+00:00, run_id=scheduled__2024-05-23T22:51:00+00:00, run_start_date=2024-05-23 22:52:00.599303+00:00, run_end_date=2024-05-23 22:52:04.508127+00:00, run_duration=3.908824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:51:00+00:00, data_interval_end=2024-05-23 22:52:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:52:04.517418937Z [2024-05-23T22:52:04.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:52:00+00:00, run_after=2024-05-23T22:53:00+00:00 2024-05-23T22:52:04.586237796Z [2024-05-23T22:52:04.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:51:00+00:00 exited with status success for try_number 1 2024-05-23T22:52:04.591049168Z [2024-05-23T22:52:04.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:51:00+00:00, map_index=-1, run_start_date=2024-05-23 22:52:02.638256+00:00, run_end_date=2024-05-23 22:52:03.946130+00:00, run_duration=1.307874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:52:00.664811+00:00, queued_by_job_id=1, pid=1391 2024-05-23T22:52:06.172010449Z [2024-05-23T22:52:06.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:52:06.172472332Z [2024-05-23T22:52:06.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:51:00+00:00, run_id=scheduled__2024-05-23T22:51:00+00:00, run_start_date=2024-05-23 22:52:00.605032+00:00, run_end_date=2024-05-23 22:52:06.171977+00:00, run_duration=5.566945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:51:00+00:00, data_interval_end=2024-05-23 22:52:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:52:06.181957591Z [2024-05-23T22:52:06.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:52:00+00:00, run_after=2024-05-23T22:53:00+00:00 2024-05-23T22:52:06.237700829Z [2024-05-23T22:52:06.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:51:00+00:00 exited with status success for try_number 1 2024-05-23T22:52:06.289144467Z [2024-05-23T22:52:06.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:51:00+00:00, map_index=-1, run_start_date=2024-05-23 22:52:03.010367+00:00, run_end_date=2024-05-23 22:52:05.554261+00:00, run_duration=2.543894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:52:00.664811+00:00, queued_by_job_id=1, pid=1402 2024-05-23T22:53:00.830745011Z [2024-05-23T22:53:00.830+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:53:00.843738799Z [2024-05-23T22:53:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:53:00+00:00, run_after=2024-05-23T22:54:00+00:00 2024-05-23T22:53:00.855069089Z [2024-05-23T22:53:00.854+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:53:00+00:00, run_after=2024-05-23T22:54:00+00:00 2024-05-23T22:53:00.915558919Z [2024-05-23T22:53:00.915+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:53:00.915591869Z 2024-05-23T22:53:00.915595976Z 2024-05-23T22:53:00.915599538Z 2024-05-23T22:53:00.915811260Z [2024-05-23T22:53:00.915+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:53:00.916002575Z [2024-05-23T22:53:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:53:00.916187622Z [2024-05-23T22:53:00.916+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:53:00.916937113Z [2024-05-23T22:53:00.916+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:53:00.916948354Z 2024-05-23T22:53:00.916952063Z 2024-05-23T22:53:00.916955217Z 2024-05-23T22:53:00.922730962Z [2024-05-23T22:53:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:53:00.922758766Z [2024-05-23T22:53:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:53:00.922912926Z [2024-05-23T22:53:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:53:00.923007927Z [2024-05-23T22:53:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:53:00.923340595Z [2024-05-23T22:53:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:53:00.923463468Z [2024-05-23T22:53:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:53:01.229169195Z [2024-05-23T22:53:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status queued for try_number 1 2024-05-23T22:53:01.229395628Z [2024-05-23T22:53:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status queued for try_number 1 2024-05-23T22:53:01.229624634Z [2024-05-23T22:53:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status queued for try_number 1 2024-05-23T22:53:01.243563051Z [2024-05-23T22:53:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f3d87e1-c3ae-4f5b-bba5-facf8629f094 2024-05-23T22:53:01.243908415Z [2024-05-23T22:53:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b663e89-1f73-44ce-b340-e6760e1f8907 2024-05-23T22:53:01.244122779Z [2024-05-23T22:53:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 385ac895-1e24-4f1f-a837-932bee6feb62 2024-05-23T22:53:03.262394775Z [2024-05-23T22:53:03.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:53:03.262811597Z [2024-05-23T22:53:03.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:52:00+00:00, run_id=scheduled__2024-05-23T22:52:00+00:00, run_start_date=2024-05-23 22:53:00.867143+00:00, run_end_date=2024-05-23 22:53:03.262306+00:00, run_duration=2.395163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:52:00+00:00, data_interval_end=2024-05-23 22:53:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:53:03.273118043Z [2024-05-23T22:53:03.272+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:53:00+00:00, run_after=2024-05-23T22:54:00+00:00 2024-05-23T22:53:03.334410962Z [2024-05-23T22:53:03.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status success for try_number 1 2024-05-23T22:53:03.343171152Z [2024-05-23T22:53:03.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:52:00+00:00, map_index=-1, run_start_date=2024-05-23 22:53:01.924413+00:00, run_end_date=2024-05-23 22:53:02.418205+00:00, run_duration=0.493792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:53:00.917687+00:00, queued_by_job_id=1, pid=1429 2024-05-23T22:53:05.504358015Z [2024-05-23T22:53:05.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:53:05.505145823Z [2024-05-23T22:53:05.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:52:00+00:00, run_id=scheduled__2024-05-23T22:52:00+00:00, run_start_date=2024-05-23 22:53:00.864916+00:00, run_end_date=2024-05-23 22:53:05.504240+00:00, run_duration=4.639324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:52:00+00:00, data_interval_end=2024-05-23 22:53:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:53:05.519166725Z [2024-05-23T22:53:05.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:53:00+00:00, run_after=2024-05-23T22:54:00+00:00 2024-05-23T22:53:05.527452467Z [2024-05-23T22:53:05.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:53:05.527931101Z [2024-05-23T22:53:05.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:52:00+00:00, run_id=scheduled__2024-05-23T22:52:00+00:00, run_start_date=2024-05-23 22:53:00.866180+00:00, run_end_date=2024-05-23 22:53:05.527463+00:00, run_duration=4.661283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:52:00+00:00, data_interval_end=2024-05-23 22:53:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:53:05.545445620Z [2024-05-23T22:53:05.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:53:00+00:00, run_after=2024-05-23T22:54:00+00:00 2024-05-23T22:53:05.584642214Z [2024-05-23T22:53:05.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status success for try_number 1 2024-05-23T22:53:05.584847701Z [2024-05-23T22:53:05.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status success for try_number 1 2024-05-23T22:53:05.594201236Z [2024-05-23T22:53:05.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:52:00+00:00, map_index=-1, run_start_date=2024-05-23 22:53:03.030420+00:00, run_end_date=2024-05-23 22:53:05.148940+00:00, run_duration=2.11852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:53:00.917687+00:00, queued_by_job_id=1, pid=1447 2024-05-23T22:53:05.594622433Z [2024-05-23T22:53:05.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:52:00+00:00, map_index=-1, run_start_date=2024-05-23 22:53:03.063894+00:00, run_end_date=2024-05-23 22:53:04.827490+00:00, run_duration=1.763596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:53:00.917687+00:00, queued_by_job_id=1, pid=1448 2024-05-23T22:54:01.091312753Z [2024-05-23T22:54:01.090+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:54:01.109078399Z [2024-05-23T22:54:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:01.121638348Z [2024-05-23T22:54:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:01.128496237Z [2024-05-23T22:54:01.128+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:54:01.229717320Z [2024-05-23T22:54:01.229+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T22:54:01.229754136Z 2024-05-23T22:54:01.229762828Z 2024-05-23T22:54:01.229769538Z 2024-05-23T22:54:01.229776222Z 2024-05-23T22:54:01.230320165Z [2024-05-23T22:54:01.229+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:54:01.230825990Z [2024-05-23T22:54:01.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:54:01.231223791Z [2024-05-23T22:54:01.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:54:01.231642405Z [2024-05-23T22:54:01.231+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:54:01.232861663Z [2024-05-23T22:54:01.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:54:01.232886247Z 2024-05-23T22:54:01.232894269Z 2024-05-23T22:54:01.232901307Z 2024-05-23T22:54:01.232908124Z 2024-05-23T22:54:01.241608455Z [2024-05-23T22:54:01.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:54:01.242110861Z [2024-05-23T22:54:01.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:54:01.242913079Z [2024-05-23T22:54:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:54:01.243184411Z [2024-05-23T22:54:01.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:54:01.243615300Z [2024-05-23T22:54:01.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:54:01.243932528Z [2024-05-23T22:54:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:54:01.244289802Z [2024-05-23T22:54:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:54:01.244587354Z [2024-05-23T22:54:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:54:01.492660358Z [2024-05-23T22:54:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status queued for try_number 1 2024-05-23T22:54:01.492827350Z [2024-05-23T22:54:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status queued for try_number 1 2024-05-23T22:54:01.493038227Z [2024-05-23T22:54:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status queued for try_number 1 2024-05-23T22:54:01.493222070Z [2024-05-23T22:54:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status queued for try_number 1 2024-05-23T22:54:01.501432018Z [2024-05-23T22:54:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 361a0961-33a8-4edc-917b-238ce9c21156 2024-05-23T22:54:01.501748515Z [2024-05-23T22:54:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to af7e3412-9b5f-45a9-b1e7-a2f11df1f75a 2024-05-23T22:54:01.501980173Z [2024-05-23T22:54:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed68648f-1c31-4b40-84ee-d861e5737db6 2024-05-23T22:54:01.502210719Z [2024-05-23T22:54:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 098482b5-31e1-4dad-81a8-ed57db1c120a 2024-05-23T22:54:03.156313699Z [2024-05-23T22:54:03.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:54:03.157188501Z [2024-05-23T22:54:03.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:52:00+00:00, run_id=scheduled__2024-05-23T22:52:00+00:00, run_start_date=2024-05-23 22:54:01.139974+00:00, run_end_date=2024-05-23 22:54:03.156755+00:00, run_duration=2.016781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:52:00+00:00, data_interval_end=2024-05-23 22:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:54:03.166914607Z [2024-05-23T22:54:03.166+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:54:03.175017697Z [2024-05-23T22:54:03.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:54:03.175313771Z [2024-05-23T22:54:03.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:53:00+00:00, run_id=scheduled__2024-05-23T22:53:00+00:00, run_start_date=2024-05-23 22:54:01.141373+00:00, run_end_date=2024-05-23 22:54:03.174994+00:00, run_duration=2.033621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:53:00+00:00, data_interval_end=2024-05-23 22:54:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:54:03.185610941Z [2024-05-23T22:54:03.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:03.230190753Z [2024-05-23T22:54:03.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:52:00+00:00 exited with status success for try_number 1 2024-05-23T22:54:03.230282302Z [2024-05-23T22:54:03.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status success for try_number 1 2024-05-23T22:54:03.237058224Z [2024-05-23T22:54:03.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:52:00+00:00, map_index=-1, run_start_date=2024-05-23 22:54:02.426680+00:00, run_end_date=2024-05-23 22:54:02.898964+00:00, run_duration=0.472284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:54:01.236803+00:00, queued_by_job_id=1, pid=1483 2024-05-23T22:54:03.237336473Z [2024-05-23T22:54:03.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:53:00+00:00, map_index=-1, run_start_date=2024-05-23 22:54:02.334210+00:00, run_end_date=2024-05-23 22:54:02.789421+00:00, run_duration=0.455211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:54:01.236803+00:00, queued_by_job_id=1, pid=1482 2024-05-23T22:54:05.410331649Z [2024-05-23T22:54:05.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:54:05.410983773Z [2024-05-23T22:54:05.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:53:00+00:00, run_id=scheduled__2024-05-23T22:53:00+00:00, run_start_date=2024-05-23 22:54:01.142549+00:00, run_end_date=2024-05-23 22:54:05.410187+00:00, run_duration=4.267638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:53:00+00:00, data_interval_end=2024-05-23 22:54:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:54:05.421132522Z [2024-05-23T22:54:05.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:05.429158817Z [2024-05-23T22:54:05.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:54:05.429575328Z [2024-05-23T22:54:05.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:53:00+00:00, run_id=scheduled__2024-05-23T22:53:00+00:00, run_start_date=2024-05-23 22:54:01.143728+00:00, run_end_date=2024-05-23 22:54:05.429248+00:00, run_duration=4.28552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:53:00+00:00, data_interval_end=2024-05-23 22:54:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:54:05.438861605Z [2024-05-23T22:54:05.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:05.474244358Z [2024-05-23T22:54:05.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status success for try_number 1 2024-05-23T22:54:05.474723146Z [2024-05-23T22:54:05.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status success for try_number 1 2024-05-23T22:54:05.484008256Z [2024-05-23T22:54:05.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:53:00+00:00, map_index=-1, run_start_date=2024-05-23 22:54:03.496473+00:00, run_end_date=2024-05-23 22:54:04.827872+00:00, run_duration=1.331399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:54:01.236803+00:00, queued_by_job_id=1, pid=1507 2024-05-23T22:54:05.484462220Z [2024-05-23T22:54:05.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:53:00+00:00, map_index=-1, run_start_date=2024-05-23 22:54:03.496425+00:00, run_end_date=2024-05-23 22:54:05.224698+00:00, run_duration=1.728273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:54:01.236803+00:00, queued_by_job_id=1, pid=1506 2024-05-23T22:54:33.331854167Z [2024-05-23T22:54:33.331+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:54:33.374343102Z [2024-05-23T22:54:33.373+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:54:33.374372900Z 2024-05-23T22:54:33.374379333Z [2024-05-23T22:54:33.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:54:33.374875489Z [2024-05-23T22:54:33.374+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:54:33.374892402Z 2024-05-23T22:54:33.377127531Z [2024-05-23T22:54:33.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:54:33.377146277Z [2024-05-23T22:54:33.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:54:33.441119950Z [2024-05-23T22:54:33.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status queued for try_number 1 2024-05-23T22:54:33.448365894Z [2024-05-23T22:54:33.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to c206da26-5da8-421d-9b04-f246c4c8e325 2024-05-23T22:54:34.824796881Z [2024-05-23T22:54:34.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:34.870541009Z [2024-05-23T22:54:34.870+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:54:34.870570914Z 2024-05-23T22:54:34.870979481Z [2024-05-23T22:54:34.870+0000] {scheduler_job.py:425} INFO - DAG vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:54:34.871748882Z [2024-05-23T22:54:34.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:54:34.871798691Z 2024-05-23T22:54:34.874046912Z [2024-05-23T22:54:34.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:54:34.874090154Z [2024-05-23T22:54:34.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:54:34.936793033Z [2024-05-23T22:54:34.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status queued for try_number 1 2024-05-23T22:54:34.942380176Z [2024-05-23T22:54:34.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to a23312b2-4541-434a-8b0c-e3c7afafa5c5 2024-05-23T22:54:37.195636396Z [2024-05-23T22:54:37.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:54:37.199482886Z [2024-05-23T22:54:37.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:53:00+00:00, run_id=scheduled__2024-05-23T22:53:00+00:00, run_start_date=2024-05-23 22:54:33.344963+00:00, run_end_date=2024-05-23 22:54:37.195525+00:00, run_duration=3.850562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:53:00+00:00, data_interval_end=2024-05-23 22:54:00+00:00, dag_hash=3c79e232ddf7d3898d0a0c250a19cf1d 2024-05-23T22:54:37.215266562Z [2024-05-23T22:54:37.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:37.266009100Z [2024-05-23T22:54:37.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status success for try_number 1 2024-05-23T22:54:37.276894006Z [2024-05-23T22:54:37.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:53:00+00:00, map_index=-1, run_start_date=2024-05-23 22:54:34.945557+00:00, run_end_date=2024-05-23 22:54:36.486549+00:00, run_duration=1.540992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:54:33.375057+00:00, queued_by_job_id=1, pid=1539 2024-05-23T22:54:38.341318294Z [2024-05-23T22:54:38.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:54:38.342373655Z [2024-05-23T22:54:38.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:53:00+00:00, run_id=scheduled__2024-05-23T22:53:00+00:00, run_start_date=2024-05-23 22:54:34.837179+00:00, run_end_date=2024-05-23 22:54:38.341754+00:00, run_duration=3.504575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:53:00+00:00, data_interval_end=2024-05-23 22:54:00+00:00, dag_hash=f0ab7999537e4631281b41d288e7acf9 2024-05-23T22:54:38.358059935Z [2024-05-23T22:54:38.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:54:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:38.400171185Z [2024-05-23T22:54:38.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:53:00+00:00 exited with status success for try_number 1 2024-05-23T22:54:38.409820008Z [2024-05-23T22:54:38.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:53:00+00:00, map_index=-1, run_start_date=2024-05-23 22:54:36.442803+00:00, run_end_date=2024-05-23 22:54:37.637337+00:00, run_duration=1.194534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:54:34.872094+00:00, queued_by_job_id=1, pid=1551 2024-05-23T22:54:57.265006579Z [2024-05-23T22:54:57.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:54:57.330628158Z [2024-05-23T22:54:57.329+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:54:57.330660180Z 2024-05-23T22:54:57.331260056Z [2024-05-23T22:54:57.330+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:54:57.333177404Z [2024-05-23T22:54:57.332+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:54:57.333212193Z 2024-05-23T22:54:57.337715899Z [2024-05-23T22:54:57.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:54:57.337954029Z [2024-05-23T22:54:57.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:54:57.400237578Z [2024-05-23T22:54:57.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:54:57.408603179Z [2024-05-23T22:54:57.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c2a6034-a2f3-4ca2-b007-37b2d7bcd6ad 2024-05-23T22:55:00.284327550Z [2024-05-23T22:55:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:00.298499627Z [2024-05-23T22:55:00.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:55:00.310042952Z [2024-05-23T22:55:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:55:00.316346246Z [2024-05-23T22:55:00.316+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:55:00.322834855Z [2024-05-23T22:55:00.322+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:55:00.335658837Z [2024-05-23T22:55:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:00.355448091Z [2024-05-23T22:55:00.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:00.521421743Z [2024-05-23T22:55:00.520+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-05-23T22:55:00.521461148Z 2024-05-23T22:55:00.521469310Z 2024-05-23T22:55:00.521476137Z 2024-05-23T22:55:00.521485857Z 2024-05-23T22:55:00.521493973Z 2024-05-23T22:55:00.521501174Z 2024-05-23T22:55:00.521508973Z 2024-05-23T22:55:00.521540933Z 2024-05-23T22:55:00.521755204Z [2024-05-23T22:55:00.521+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:55:00.522127455Z [2024-05-23T22:55:00.521+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:55:00.522374843Z [2024-05-23T22:55:00.522+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 1/16 running and queued tasks 2024-05-23T22:55:00.522701507Z [2024-05-23T22:55:00.522+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:55:00.522927039Z [2024-05-23T22:55:00.522+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:55:00.523151796Z [2024-05-23T22:55:00.522+0000] {scheduler_job.py:425} INFO - DAG vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:55:00.523539696Z [2024-05-23T22:55:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:55:00.523751557Z [2024-05-23T22:55:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:55:00.524673545Z [2024-05-23T22:55:00.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:55:00.524690854Z 2024-05-23T22:55:00.524696440Z 2024-05-23T22:55:00.524701360Z 2024-05-23T22:55:00.524706581Z 2024-05-23T22:55:00.524711970Z 2024-05-23T22:55:00.524716795Z 2024-05-23T22:55:00.524721797Z 2024-05-23T22:55:00.524726608Z 2024-05-23T22:55:00.531009762Z [2024-05-23T22:55:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:55:00.531202537Z [2024-05-23T22:55:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:00.531496663Z [2024-05-23T22:55:00.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T22:55:00.531658569Z [2024-05-23T22:55:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:00.531888388Z [2024-05-23T22:55:00.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='split_metrics', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:55:00.532043609Z [2024-05-23T22:55:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'split_metrics', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:00.532291181Z [2024-05-23T22:55:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:00.532503639Z [2024-05-23T22:55:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:55:00.532750021Z [2024-05-23T22:55:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:00.532890739Z [2024-05-23T22:55:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:55:00.533113931Z [2024-05-23T22:55:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:00.533266417Z [2024-05-23T22:55:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:55:00.533549628Z [2024-05-23T22:55:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:00.533810125Z [2024-05-23T22:55:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:55:00.534057967Z [2024-05-23T22:55:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:00.534205926Z [2024-05-23T22:55:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:55:01.628964405Z [2024-05-23T22:55:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.629196077Z [2024-05-23T22:55:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.629350042Z [2024-05-23T22:55:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.split_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.629503249Z [2024-05-23T22:55:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.629642604Z [2024-05-23T22:55:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.629800408Z [2024-05-23T22:55:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.629961389Z [2024-05-23T22:55:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.634720200Z [2024-05-23T22:55:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:01.635012886Z [2024-05-23T22:55:01.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:01.650229982Z [2024-05-23T22:55:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18e2c350-3d13-4d3e-b800-37478e088669 2024-05-23T22:55:01.650459566Z [2024-05-23T22:55:01.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9994a63-a0b6-4c0c-a6cb-82bc417627fd 2024-05-23T22:55:01.650848238Z [2024-05-23T22:55:01.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:54:58.922627+00:00, run_end_date=2024-05-23 22:54:59.296650+00:00, run_duration=0.374023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:54:57.333758+00:00, queued_by_job_id=1, pid=1564 2024-05-23T22:55:01.651087053Z [2024-05-23T22:55:01.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc3ee589-d124-40ab-a72d-280a7f36b6b0 2024-05-23T22:55:01.651258271Z [2024-05-23T22:55:01.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to d760551d-d460-4c9a-a37d-412c894cb376 2024-05-23T22:55:01.651431467Z [2024-05-23T22:55:01.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba05b736-0f77-401e-95c2-dde9cd48176f 2024-05-23T22:55:01.651594102Z [2024-05-23T22:55:01.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d74edec-1a3e-46fc-9667-997d5544688c 2024-05-23T22:55:01.651761050Z [2024-05-23T22:55:01.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29b82cad-6ee7-422c-a24e-edf0ff832691 2024-05-23T22:55:01.651921851Z [2024-05-23T22:55:01.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97713ebc-85b1-4b4c-8208-dd1a47f9e7ae 2024-05-23T22:55:03.155868816Z [2024-05-23T22:55:03.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:03.156067922Z [2024-05-23T22:55:03.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:54:00+00:00, run_id=scheduled__2024-05-23T22:54:00+00:00, run_start_date=2024-05-23 22:55:00.382955+00:00, run_end_date=2024-05-23 22:55:03.155793+00:00, run_duration=2.772838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:54:00+00:00, data_interval_end=2024-05-23 22:55:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:55:03.176663424Z [2024-05-23T22:55:03.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:03.294880277Z [2024-05-23T22:55:03.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:03.311588243Z [2024-05-23T22:55:03.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:54:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:01.804739+00:00, run_end_date=2024-05-23 22:55:02.453953+00:00, run_duration=0.649214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1585 2024-05-23T22:55:05.852605798Z [2024-05-23T22:55:05.852+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:55:05.852625010Z 2024-05-23T22:55:05.852628847Z 2024-05-23T22:55:05.852633066Z 2024-05-23T22:55:05.852944594Z [2024-05-23T22:55:05.852+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:55:05.853194555Z [2024-05-23T22:55:05.852+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:55:05.853384406Z [2024-05-23T22:55:05.853+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 1/16 running and queued tasks 2024-05-23T22:55:05.854025919Z [2024-05-23T22:55:05.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:55:05.854036420Z 2024-05-23T22:55:05.854039720Z 2024-05-23T22:55:05.854043026Z 2024-05-23T22:55:05.861426795Z [2024-05-23T22:55:05.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='split_metrics', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:55:05.862434441Z [2024-05-23T22:55:05.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'split_metrics', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:05.862980712Z [2024-05-23T22:55:05.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T22:55:05.866776403Z [2024-05-23T22:55:05.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:05.867207106Z [2024-05-23T22:55:05.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:55:05.867487295Z [2024-05-23T22:55:05.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'collect_metrics', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:55:06.328165084Z [2024-05-23T22:55:06.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.split_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:06.330218140Z [2024-05-23T22:55:06.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:06.330501471Z [2024-05-23T22:55:06.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.collect_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:06.330819369Z [2024-05-23T22:55:06.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:06.331061725Z [2024-05-23T22:55:06.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:06.331315077Z [2024-05-23T22:55:06.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.split_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:06.349462059Z [2024-05-23T22:55:06.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 732caf58-1be2-4b66-91c8-ed7f68619446 2024-05-23T22:55:06.349805239Z [2024-05-23T22:55:06.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=split_metrics, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:05.184454+00:00, run_end_date=2024-05-23 22:55:05.647853+00:00, run_duration=0.463399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1639 2024-05-23T22:55:06.350054943Z [2024-05-23T22:55:06.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8657802b-ab1b-41c3-9a00-6b56b2e656a9 2024-05-23T22:55:06.350287916Z [2024-05-23T22:55:06.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:03.774007+00:00, run_end_date=2024-05-23 22:55:04.689173+00:00, run_duration=0.915166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1611 2024-05-23T22:55:06.350697022Z [2024-05-23T22:55:06.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd50a056-2d19-48f5-a55c-0b6c41d441c5 2024-05-23T22:55:06.351076413Z [2024-05-23T22:55:06.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:03.302250+00:00, run_end_date=2024-05-23 22:55:04.600270+00:00, run_duration=1.29802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1603 2024-05-23T22:55:06.438235560Z [2024-05-23T22:55:06.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:06.438764622Z [2024-05-23T22:55:06.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:54:00+00:00, run_id=scheduled__2024-05-23T22:54:00+00:00, run_start_date=2024-05-23 22:55:00.384585+00:00, run_end_date=2024-05-23 22:55:06.438374+00:00, run_duration=6.053789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:54:00+00:00, data_interval_end=2024-05-23 22:55:00+00:00, dag_hash=f0ab7999537e4631281b41d288e7acf9 2024-05-23T22:55:06.456093789Z [2024-05-23T22:55:06.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:06.603518092Z [2024-05-23T22:55:06.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:06.619396228Z [2024-05-23T22:55:06.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:54:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:04.186235+00:00, run_end_date=2024-05-23 22:55:06.191841+00:00, run_duration=2.005606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1613 2024-05-23T22:55:07.662209126Z [2024-05-23T22:55:07.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:07.662666853Z [2024-05-23T22:55:07.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:54:00+00:00, run_id=scheduled__2024-05-23T22:54:00+00:00, run_start_date=2024-05-23 22:55:00.388045+00:00, run_end_date=2024-05-23 22:55:07.662335+00:00, run_duration=7.27429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:54:00+00:00, data_interval_end=2024-05-23 22:55:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:55:07.671612322Z [2024-05-23T22:55:07.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:07.678762280Z [2024-05-23T22:55:07.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:07.679184660Z [2024-05-23T22:55:07.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:54:00+00:00, run_id=scheduled__2024-05-23T22:54:00+00:00, run_start_date=2024-05-23 22:55:00.386447+00:00, run_end_date=2024-05-23 22:55:07.678885+00:00, run_duration=7.292438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:54:00+00:00, data_interval_end=2024-05-23 22:55:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:55:07.687889664Z [2024-05-23T22:55:07.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:07.766312305Z [2024-05-23T22:55:07.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:07.766547981Z [2024-05-23T22:55:07.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:07.772491978Z [2024-05-23T22:55:07.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:54:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:05.460685+00:00, run_end_date=2024-05-23 22:55:07.021011+00:00, run_duration=1.560326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1646 2024-05-23T22:55:07.772910779Z [2024-05-23T22:55:07.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:54:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:05.384198+00:00, run_end_date=2024-05-23 22:55:07.117002+00:00, run_duration=1.732804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1645 2024-05-23T22:55:08.827382879Z [2024-05-23T22:55:08.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:08.827753580Z [2024-05-23T22:55:08.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:54:00+00:00, run_id=scheduled__2024-05-23T22:54:00+00:00, run_start_date=2024-05-23 22:55:00.381362+00:00, run_end_date=2024-05-23 22:55:08.827309+00:00, run_duration=8.445947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:54:00+00:00, data_interval_end=2024-05-23 22:55:00+00:00, dag_hash=3c79e232ddf7d3898d0a0c250a19cf1d 2024-05-23T22:55:08.840998190Z [2024-05-23T22:55:08.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T22:56:00+00:00 2024-05-23T22:55:08.953810631Z [2024-05-23T22:55:08.952+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:55:08.953844301Z 2024-05-23T22:55:08.953847939Z 2024-05-23T22:55:08.953850895Z [2024-05-23T22:55:08.952+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:55:08.953853838Z [2024-05-23T22:55:08.952+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 1/16 running and queued tasks 2024-05-23T22:55:08.953857539Z [2024-05-23T22:55:08.953+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:55:08.953860582Z 2024-05-23T22:55:08.953871769Z 2024-05-23T22:55:08.957237760Z [2024-05-23T22:55:08.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:55:08.957254727Z [2024-05-23T22:55:08.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:55:08.957258355Z [2024-05-23T22:55:08.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:08.957261996Z [2024-05-23T22:55:08.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'send_prometheus', 'scheduled__2024-05-23T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:09.371669310Z [2024-05-23T22:55:09.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:09.371707110Z [2024-05-23T22:55:09.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.send_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:09.371717276Z [2024-05-23T22:55:09.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:09.371776779Z [2024-05-23T22:55:09.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:09.371836679Z [2024-05-23T22:55:09.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.collect_metrics run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:09.395862085Z [2024-05-23T22:55:09.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:54:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:05.919809+00:00, run_end_date=2024-05-23 22:55:07.855074+00:00, run_duration=1.935265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:00.526990+00:00, queued_by_job_id=1, pid=1662 2024-05-23T22:55:09.396042209Z [2024-05-23T22:55:09.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=0, run_start_date=2024-05-23 22:55:08.195818+00:00, run_end_date=2024-05-23 22:55:08.659387+00:00, run_duration=0.463569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:05.854973+00:00, queued_by_job_id=1, pid=1685 2024-05-23T22:55:09.396273071Z [2024-05-23T22:55:09.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12877ec2-2d20-42e3-b487-f242682e1376 2024-05-23T22:55:09.396432385Z [2024-05-23T22:55:09.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:07.863002+00:00, run_end_date=2024-05-23 22:55:08.394302+00:00, run_duration=0.5313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:05.854973+00:00, queued_by_job_id=1, pid=1679 2024-05-23T22:55:09.396544662Z [2024-05-23T22:55:09.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 468d2c7d-15e8-439c-a1a9-1e7111bb4cd8 2024-05-23T22:55:09.623970085Z [2024-05-23T22:55:09.623+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T22:55:09.624003428Z 2024-05-23T22:55:09.624018580Z [2024-05-23T22:55:09.623+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 1/16 running and queued tasks 2024-05-23T22:55:09.626120266Z [2024-05-23T22:55:09.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:55:09.626139894Z 2024-05-23T22:55:09.629975083Z [2024-05-23T22:55:09.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T22:55:09.631324696Z [2024-05-23T22:55:09.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'collect_metrics', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T22:55:09.791392820Z [2024-05-23T22:55:09.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.collect_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:09.791578479Z [2024-05-23T22:55:09.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.split_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:09.811507261Z [2024-05-23T22:55:09.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49982be5-97bd-44f7-8941-55c03b69f172 2024-05-23T22:55:09.811690797Z [2024-05-23T22:55:09.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=split_metrics, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:08.559625+00:00, run_end_date=2024-05-23 22:55:09.042769+00:00, run_duration=0.483144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:05.854973+00:00, queued_by_job_id=1, pid=1691 2024-05-23T22:55:12.221820822Z [2024-05-23T22:55:12.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:12.222064973Z [2024-05-23T22:55:12.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:45:00+00:00, run_id=scheduled__2024-05-23T22:45:00+00:00, run_start_date=2024-05-23 22:54:57.276446+00:00, run_end_date=2024-05-23 22:55:12.221722+00:00, run_duration=14.945276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:45:00+00:00, data_interval_end=2024-05-23 22:50:00+00:00, dag_hash=d9d5d094ab1f613808366253e0256611 2024-05-23T22:55:12.228955655Z [2024-05-23T22:55:12.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:50:00+00:00, run_after=2024-05-23T22:55:00+00:00 2024-05-23T22:55:12.255042306Z [2024-05-23T22:55:12.254+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:55:12.255070852Z 2024-05-23T22:55:12.255076345Z 2024-05-23T22:55:12.255110744Z [2024-05-23T22:55:12.254+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:55:12.255154329Z [2024-05-23T22:55:12.255+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:55:12.255681328Z [2024-05-23T22:55:12.255+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:55:12.255701743Z 2024-05-23T22:55:12.255706456Z 2024-05-23T22:55:12.258203607Z [2024-05-23T22:55:12.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:12.258276604Z [2024-05-23T22:55:12.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'send_prometheus', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:12.258465519Z [2024-05-23T22:55:12.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:55:12.258576491Z [2024-05-23T22:55:12.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T22:55:12.521646904Z [2024-05-23T22:55:12.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.send_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:12.522001406Z [2024-05-23T22:55:12.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status queued for try_number 1 2024-05-23T22:55:12.522298229Z [2024-05-23T22:55:12.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:12.522480925Z [2024-05-23T22:55:12.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.send_prometheus run_id=scheduled__2024-05-23T22:45:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:12.522831546Z [2024-05-23T22:55:12.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.collect_metrics run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:12.533838416Z [2024-05-23T22:55:12.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:45:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:11.138878+00:00, run_end_date=2024-05-23 22:55:11.490726+00:00, run_duration=0.351848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:08.954419+00:00, queued_by_job_id=1, pid=1708 2024-05-23T22:55:12.534172261Z [2024-05-23T22:55:12.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=0, run_start_date=2024-05-23 22:55:11.174325+00:00, run_end_date=2024-05-23 22:55:11.558686+00:00, run_duration=0.384361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:08.954419+00:00, queued_by_job_id=1, pid=1709 2024-05-23T22:55:12.534498343Z [2024-05-23T22:55:12.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58ddb10f-02cd-4723-a5d1-c4b6076d543d 2024-05-23T22:55:12.534773450Z [2024-05-23T22:55:12.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0fa846b-6e54-474c-9649-7e9dc0725fa3 2024-05-23T22:55:12.535066201Z [2024-05-23T22:55:12.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=0, run_start_date=2024-05-23 22:55:11.683869+00:00, run_end_date=2024-05-23 22:55:12.042380+00:00, run_duration=0.358511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:09.626600+00:00, queued_by_job_id=1, pid=1715 2024-05-23T22:55:12.562881179Z [2024-05-23T22:55:12.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:55:14.817474375Z [2024-05-23T22:55:14.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:14.818341886Z [2024-05-23T22:55:14.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:50:00+00:00, run_id=scheduled__2024-05-23T22:50:00+00:00, run_start_date=2024-05-23 22:55:00.379457+00:00, run_end_date=2024-05-23 22:55:14.817807+00:00, run_duration=14.43835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:50:00+00:00, data_interval_end=2024-05-23 22:55:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T22:55:14.826991080Z [2024-05-23T22:55:14.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:55:14.844086138Z [2024-05-23T22:55:14.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:55:14.844740863Z [2024-05-23T22:55:14.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:50:00+00:00, run_id=scheduled__2024-05-23T22:50:00+00:00, run_start_date=2024-05-23 22:55:00.376707+00:00, run_end_date=2024-05-23 22:55:14.844220+00:00, run_duration=14.467513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:50:00+00:00, data_interval_end=2024-05-23 22:55:00+00:00, dag_hash=d9d5d094ab1f613808366253e0256611 2024-05-23T22:55:14.852027367Z [2024-05-23T22:55:14.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:55:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:55:14.887495152Z [2024-05-23T22:55:14.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.send_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:14.887834422Z [2024-05-23T22:55:14.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:50:00+00:00 exited with status success for try_number 1 2024-05-23T22:55:14.893970736Z [2024-05-23T22:55:14.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:14.138656+00:00, run_end_date=2024-05-23 22:55:14.467940+00:00, run_duration=0.329284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:12.256067+00:00, queued_by_job_id=1, pid=1731 2024-05-23T22:55:14.894474372Z [2024-05-23T22:55:14.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:50:00+00:00, map_index=-1, run_start_date=2024-05-23 22:55:14.113605+00:00, run_end_date=2024-05-23 22:55:14.507625+00:00, run_duration=0.39402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:55:12.256067+00:00, queued_by_job_id=1, pid=1730 2024-05-23T22:56:00.601282397Z [2024-05-23T22:56:00.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:00.613873160Z [2024-05-23T22:56:00.613+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:56:00.631040671Z [2024-05-23T22:56:00.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:00.643110963Z [2024-05-23T22:56:00.642+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:56:00.651213438Z [2024-05-23T22:56:00.650+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:56:00.666702010Z [2024-05-23T22:56:00.666+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:00.801653078Z [2024-05-23T22:56:00.800+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-23T22:56:00.801715519Z 2024-05-23T22:56:00.801731875Z 2024-05-23T22:56:00.801744857Z 2024-05-23T22:56:00.801757288Z 2024-05-23T22:56:00.801770380Z 2024-05-23T22:56:00.801782666Z 2024-05-23T22:56:00.802718133Z [2024-05-23T22:56:00.802+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:56:00.803118506Z [2024-05-23T22:56:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:56:00.803448283Z [2024-05-23T22:56:00.803+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:56:00.803904254Z [2024-05-23T22:56:00.803+0000] {scheduler_job.py:425} INFO - DAG vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:56:00.804206826Z [2024-05-23T22:56:00.803+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:56:00.804609050Z [2024-05-23T22:56:00.804+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:56:00.807725396Z [2024-05-23T22:56:00.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:56:00.807761091Z 2024-05-23T22:56:00.807768057Z 2024-05-23T22:56:00.807773769Z 2024-05-23T22:56:00.807779298Z 2024-05-23T22:56:00.807784789Z 2024-05-23T22:56:00.807790413Z 2024-05-23T22:56:00.816898454Z [2024-05-23T22:56:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:56:00.817066555Z [2024-05-23T22:56:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:56:00.817704208Z [2024-05-23T22:56:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:56:00.817978149Z [2024-05-23T22:56:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:56:00.818744375Z [2024-05-23T22:56:00.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:56:00.819113198Z [2024-05-23T22:56:00.818+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:56:00.819811180Z [2024-05-23T22:56:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:56:00.820015578Z [2024-05-23T22:56:00.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:56:00.820443326Z [2024-05-23T22:56:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:56:00.820637010Z [2024-05-23T22:56:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:56:00.821352098Z [2024-05-23T22:56:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:56:00.821536934Z [2024-05-23T22:56:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:56:01.591587361Z [2024-05-23T22:56:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status queued for try_number 1 2024-05-23T22:56:01.591796771Z [2024-05-23T22:56:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T22:56:01.591947580Z [2024-05-23T22:56:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T22:56:01.592084612Z [2024-05-23T22:56:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T22:56:01.592251325Z [2024-05-23T22:56:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T22:56:01.592375159Z [2024-05-23T22:56:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T22:56:01.613068028Z [2024-05-23T22:56:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13d54a46-3f5f-446f-a50b-ebeb4917eaf3 2024-05-23T22:56:01.613388068Z [2024-05-23T22:56:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea439423-97ee-449d-a1ac-3cfadd2a9300 2024-05-23T22:56:01.613646415Z [2024-05-23T22:56:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5a6bea6-d90a-49d3-a7f8-54e3dc0510de 2024-05-23T22:56:01.613856685Z [2024-05-23T22:56:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to b616685b-662a-4af0-ae7c-5ea0f0ea6d9c 2024-05-23T22:56:01.614139187Z [2024-05-23T22:56:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to de43949d-c94f-4912-a924-64bbede1abb1 2024-05-23T22:56:01.614335448Z [2024-05-23T22:56:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 883d1275-3023-4272-8679-a5ea820c6238 2024-05-23T22:56:03.067911178Z [2024-05-23T22:56:03.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:56:03.068149517Z [2024-05-23T22:56:03.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:54:00+00:00, run_id=scheduled__2024-05-23T22:54:00+00:00, run_start_date=2024-05-23 22:56:00.678009+00:00, run_end_date=2024-05-23 22:56:03.067840+00:00, run_duration=2.389831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:54:00+00:00, data_interval_end=2024-05-23 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:56:03.080946468Z [2024-05-23T22:56:03.080+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:56:03.130380031Z [2024-05-23T22:56:03.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:56:03.130775487Z [2024-05-23T22:56:03.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:55:00+00:00, run_id=scheduled__2024-05-23T22:55:00+00:00, run_start_date=2024-05-23 22:56:00.683297+00:00, run_end_date=2024-05-23 22:56:03.130417+00:00, run_duration=2.44712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:55:00+00:00, data_interval_end=2024-05-23 22:56:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:56:03.143493239Z [2024-05-23T22:56:03.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:03.235097022Z [2024-05-23T22:56:03.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:54:00+00:00 exited with status success for try_number 1 2024-05-23T22:56:03.235127061Z [2024-05-23T22:56:03.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T22:56:03.248796030Z [2024-05-23T22:56:03.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:54:00+00:00, map_index=-1, run_start_date=2024-05-23 22:56:02.084032+00:00, run_end_date=2024-05-23 22:56:02.464825+00:00, run_duration=0.380793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:56:00.811724+00:00, queued_by_job_id=1, pid=1758 2024-05-23T22:56:03.248910051Z [2024-05-23T22:56:03.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 22:56:01.921199+00:00, run_end_date=2024-05-23 22:56:02.288055+00:00, run_duration=0.366856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:56:00.811724+00:00, queued_by_job_id=1, pid=1757 2024-05-23T22:56:05.470970675Z [2024-05-23T22:56:05.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:56:05.471375724Z [2024-05-23T22:56:05.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:55:00+00:00, run_id=scheduled__2024-05-23T22:55:00+00:00, run_start_date=2024-05-23 22:56:00.680189+00:00, run_end_date=2024-05-23 22:56:05.470926+00:00, run_duration=4.790737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:55:00+00:00, data_interval_end=2024-05-23 22:56:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:56:05.484139519Z [2024-05-23T22:56:05.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:05.491581826Z [2024-05-23T22:56:05.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:56:05.491902170Z [2024-05-23T22:56:05.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:55:00+00:00, run_id=scheduled__2024-05-23T22:55:00+00:00, run_start_date=2024-05-23 22:56:00.681221+00:00, run_end_date=2024-05-23 22:56:05.491573+00:00, run_duration=4.810352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:55:00+00:00, data_interval_end=2024-05-23 22:56:00+00:00, dag_hash=f0ab7999537e4631281b41d288e7acf9 2024-05-23T22:56:05.500336149Z [2024-05-23T22:56:05.500+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:05.548060937Z [2024-05-23T22:56:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T22:56:05.548276663Z [2024-05-23T22:56:05.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T22:56:05.561028931Z [2024-05-23T22:56:05.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 22:56:03.729034+00:00, run_end_date=2024-05-23 22:56:05.246730+00:00, run_duration=1.517696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:56:00.811724+00:00, queued_by_job_id=1, pid=1804 2024-05-23T22:56:05.561344275Z [2024-05-23T22:56:05.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 22:56:03.334799+00:00, run_end_date=2024-05-23 22:56:05.054687+00:00, run_duration=1.719888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:56:00.811724+00:00, queued_by_job_id=1, pid=1783 2024-05-23T22:56:06.612417342Z [2024-05-23T22:56:06.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:56:06.612957149Z [2024-05-23T22:56:06.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:55:00+00:00, run_id=scheduled__2024-05-23T22:55:00+00:00, run_start_date=2024-05-23 22:56:00.679198+00:00, run_end_date=2024-05-23 22:56:06.612558+00:00, run_duration=5.93336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:55:00+00:00, data_interval_end=2024-05-23 22:56:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:56:06.623404667Z [2024-05-23T22:56:06.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:06.630180496Z [2024-05-23T22:56:06.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:56:06.630432906Z [2024-05-23T22:56:06.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:55:00+00:00, run_id=scheduled__2024-05-23T22:55:00+00:00, run_start_date=2024-05-23 22:56:00.682263+00:00, run_end_date=2024-05-23 22:56:06.630131+00:00, run_duration=5.947868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:55:00+00:00, data_interval_end=2024-05-23 22:56:00+00:00, dag_hash=3c79e232ddf7d3898d0a0c250a19cf1d 2024-05-23T22:56:06.639666734Z [2024-05-23T22:56:06.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:56:00+00:00, run_after=2024-05-23T22:57:00+00:00 2024-05-23T22:56:06.684505040Z [2024-05-23T22:56:06.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T22:56:06.684870639Z [2024-05-23T22:56:06.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T22:56:06.694369055Z [2024-05-23T22:56:06.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 22:56:03.220967+00:00, run_end_date=2024-05-23 22:56:05.495306+00:00, run_duration=2.274339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:56:00.811724+00:00, queued_by_job_id=1, pid=1782 2024-05-23T22:56:06.694729637Z [2024-05-23T22:56:06.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 22:56:03.790875+00:00, run_end_date=2024-05-23 22:56:05.682853+00:00, run_duration=1.891978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:56:00.811724+00:00, queued_by_job_id=1, pid=1805 2024-05-23T22:56:39.006084637Z [2024-05-23T22:56:39.003+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T22:57:00.199879779Z [2024-05-23T22:57:00.199+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:57:00.213870210Z [2024-05-23T22:57:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:57:00.225362862Z [2024-05-23T22:57:00.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:57:00.232827448Z [2024-05-23T22:57:00.232+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:57:00.239119982Z [2024-05-23T22:57:00.238+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:57:00.328255516Z [2024-05-23T22:57:00.327+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T22:57:00.328287021Z 2024-05-23T22:57:00.328293092Z 2024-05-23T22:57:00.328298053Z 2024-05-23T22:57:00.328302726Z 2024-05-23T22:57:00.328307278Z 2024-05-23T22:57:00.328408433Z [2024-05-23T22:57:00.328+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:57:00.328535456Z [2024-05-23T22:57:00.328+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:57:00.328703496Z [2024-05-23T22:57:00.328+0000] {scheduler_job.py:425} INFO - DAG vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:57:00.328930666Z [2024-05-23T22:57:00.328+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:57:00.328986608Z [2024-05-23T22:57:00.328+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:57:00.329806556Z [2024-05-23T22:57:00.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:57:00.329821899Z 2024-05-23T22:57:00.329828054Z 2024-05-23T22:57:00.329833388Z 2024-05-23T22:57:00.329838727Z 2024-05-23T22:57:00.329844093Z 2024-05-23T22:57:00.333691562Z [2024-05-23T22:57:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:57:00.333829797Z [2024-05-23T22:57:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:57:00.334110700Z [2024-05-23T22:57:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:57:00.334254959Z [2024-05-23T22:57:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:57:00.334529490Z [2024-05-23T22:57:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:57:00.334667366Z [2024-05-23T22:57:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:57:00.334922149Z [2024-05-23T22:57:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:57:00.335076371Z [2024-05-23T22:57:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:57:00.335365585Z [2024-05-23T22:57:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:57:00.335507038Z [2024-05-23T22:57:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:57:00.826079925Z [2024-05-23T22:57:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 1 2024-05-23T22:57:00.826227680Z [2024-05-23T22:57:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 1 2024-05-23T22:57:00.826354025Z [2024-05-23T22:57:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 1 2024-05-23T22:57:00.826478217Z [2024-05-23T22:57:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 1 2024-05-23T22:57:00.826602030Z [2024-05-23T22:57:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 1 2024-05-23T22:57:00.836867985Z [2024-05-23T22:57:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f95b7c0-23c0-438c-ab09-bbc58f41138c 2024-05-23T22:57:00.837033450Z [2024-05-23T22:57:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to c83a80fd-6551-4eda-9e05-33aa27f3fce2 2024-05-23T22:57:00.837200646Z [2024-05-23T22:57:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9cad623-d15f-4faa-9920-6f1eac829337 2024-05-23T22:57:00.837357711Z [2024-05-23T22:57:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d81e933-b22e-443f-b126-d469f2c5ba92 2024-05-23T22:57:00.837520193Z [2024-05-23T22:57:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9a3bb91-79bb-4b46-8d20-2d50029326a2 2024-05-23T22:57:02.059489063Z [2024-05-23T22:57:02.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:57:02.059669267Z [2024-05-23T22:57:02.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:56:00+00:00, run_id=scheduled__2024-05-23T22:56:00+00:00, run_start_date=2024-05-23 22:57:00.248200+00:00, run_end_date=2024-05-23 22:57:02.059381+00:00, run_duration=1.811181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:56:00+00:00, data_interval_end=2024-05-23 22:57:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:57:02.075965226Z [2024-05-23T22:57:02.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:57:02.114118704Z [2024-05-23T22:57:02.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status success for try_number 1 2024-05-23T22:57:02.118810918Z [2024-05-23T22:57:02.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=2024-05-23 22:57:01.350760+00:00, run_end_date=2024-05-23 22:57:01.753042+00:00, run_duration=0.402282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:57:00.330936+00:00, queued_by_job_id=1, pid=1839 2024-05-23T22:57:03.743960218Z [2024-05-23T22:57:03.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status failed for try_number 1 2024-05-23T22:57:03.744064383Z [2024-05-23T22:57:03.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status failed for try_number 1 2024-05-23T22:57:03.752737259Z [2024-05-23T22:57:03.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:57:00.330936+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:57:03.753226934Z [2024-05-23T22:57:03.752+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:03.755662627Z [2024-05-23T22:57:03.755+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:03.769449899Z [2024-05-23T22:57:03.769+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240523T225600, start_date=, end_date=20240523T225703 2024-05-23T22:57:03.779123449Z [2024-05-23T22:57:03.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:57:00.330936+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:57:03.779416384Z [2024-05-23T22:57:03.779+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:03.784242430Z [2024-05-23T22:57:03.783+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:03.796434432Z [2024-05-23T22:57:03.796+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240523T225600, start_date=, end_date=20240523T225703 2024-05-23T22:57:04.859424197Z [2024-05-23T22:57:04.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:57:04.859594352Z [2024-05-23T22:57:04.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:56:00+00:00, run_id=scheduled__2024-05-23T22:56:00+00:00, run_start_date=2024-05-23 22:57:00.250359+00:00, run_end_date=2024-05-23 22:57:04.859043+00:00, run_duration=4.608684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:56:00+00:00, data_interval_end=2024-05-23 22:57:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:57:04.871494200Z [2024-05-23T22:57:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:57:04.954039361Z [2024-05-23T22:57:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status success for try_number 1 2024-05-23T22:57:04.961525896Z [2024-05-23T22:57:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=2024-05-23 22:57:02.862267+00:00, run_end_date=2024-05-23 22:57:04.455033+00:00, run_duration=1.592766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:57:00.330936+00:00, queued_by_job_id=1, pid=1865 2024-05-23T22:57:06.021763084Z [2024-05-23T22:57:06.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:57:06.022705353Z [2024-05-23T22:57:06.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:56:00+00:00, run_id=scheduled__2024-05-23T22:56:00+00:00, run_start_date=2024-05-23 22:57:00.252229+00:00, run_end_date=2024-05-23 22:57:06.021990+00:00, run_duration=5.769761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:56:00+00:00, data_interval_end=2024-05-23 22:57:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:57:06.041685339Z [2024-05-23T22:57:06.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:57:06.121275239Z [2024-05-23T22:57:06.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status success for try_number 1 2024-05-23T22:57:06.130320495Z [2024-05-23T22:57:06.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=2024-05-23 22:57:03.133782+00:00, run_end_date=2024-05-23 22:57:05.037662+00:00, run_duration=1.90388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:57:00.330936+00:00, queued_by_job_id=1, pid=1880 2024-05-23T22:57:13.909809520Z [2024-05-23T22:57:13.909+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T22:57:13.909841587Z 2024-05-23T22:57:13.909846272Z 2024-05-23T22:57:13.910055053Z [2024-05-23T22:57:13.909+0000] {scheduler_job.py:425} INFO - DAG vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:57:13.910384519Z [2024-05-23T22:57:13.910+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 has 0/16 running and queued tasks 2024-05-23T22:57:13.911355001Z [2024-05-23T22:57:13.911+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:57:13.911370618Z 2024-05-23T22:57:13.911375320Z 2024-05-23T22:57:13.914931347Z [2024-05-23T22:57:13.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:57:13.915114485Z [2024-05-23T22:57:13.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:57:13.915591578Z [2024-05-23T22:57:13.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:57:13.915892077Z [2024-05-23T22:57:13.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:57:14.102434238Z [2024-05-23T22:57:14.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 2 2024-05-23T22:57:14.102459130Z [2024-05-23T22:57:14.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 2 2024-05-23T22:57:14.109379115Z [2024-05-23T22:57:14.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 067494f1-8c8e-43bd-959e-1ce293fd35f7 2024-05-23T22:57:14.109463093Z [2024-05-23T22:57:14.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1737eed-fc37-4d92-9e67-e3cc75d17ff0 2024-05-23T22:57:16.459483260Z [2024-05-23T22:57:16.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status failed for try_number 2 2024-05-23T22:57:16.459682380Z [2024-05-23T22:57:16.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status failed for try_number 2 2024-05-23T22:57:16.466613240Z [2024-05-23T22:57:16.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-23 22:57:03.758209+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:57:13.912123+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:57:16.467260010Z [2024-05-23T22:57:16.467+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:16.469618424Z [2024-05-23T22:57:16.469+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:16.484189347Z [2024-05-23T22:57:16.483+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240523T225600, start_date=, end_date=20240523T225716 2024-05-23T22:57:16.493213896Z [2024-05-23T22:57:16.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-23 22:57:03.786456+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:57:13.912123+00:00, queued_by_job_id=1, pid=None 2024-05-23T22:57:16.494040463Z [2024-05-23T22:57:16.493+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:16.496580326Z [2024-05-23T22:57:16.496+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-23T22:57:16.508801935Z [2024-05-23T22:57:16.508+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240523T225600, start_date=, end_date=20240523T225716 2024-05-23T22:57:17.359750958Z [2024-05-23T22:57:17.359+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-23T22:57:17.360274280Z [2024-05-23T22:57:17.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:56:00+00:00, run_id=scheduled__2024-05-23T22:56:00+00:00, run_start_date=2024-05-23 22:57:00.249418+00:00, run_end_date=2024-05-23 22:57:17.359478+00:00, run_duration=17.11006, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:56:00+00:00, data_interval_end=2024-05-23 22:57:00+00:00, dag_hash=f0ab7999537e4631281b41d288e7acf9 2024-05-23T22:57:17.380667325Z [2024-05-23T22:57:17.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:57:17.392463108Z [2024-05-23T22:57:17.391+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-23T22:57:17.392816158Z [2024-05-23T22:57:17.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0, execution_date=2024-05-23 22:56:00+00:00, run_id=scheduled__2024-05-23T22:56:00+00:00, run_start_date=2024-05-23 22:57:00.251322+00:00, run_end_date=2024-05-23 22:57:17.392186+00:00, run_duration=17.140864, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:56:00+00:00, data_interval_end=2024-05-23 22:57:00+00:00, dag_hash=3c79e232ddf7d3898d0a0c250a19cf1d 2024-05-23T22:57:17.405884595Z [2024-05-23T22:57:17.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_eab9a7ef-d54b-4ab4-9bbf-f9eff584edf0 to 2024-05-23T22:57:00+00:00, run_after=2024-05-23T22:58:00+00:00 2024-05-23T22:58:00.659357888Z [2024-05-23T22:58:00.658+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:58:00.670394027Z [2024-05-23T22:58:00.669+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:58:00.687917123Z [2024-05-23T22:58:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:58:00+00:00, run_after=2024-05-23T22:59:00+00:00 2024-05-23T22:58:00.703232870Z [2024-05-23T22:58:00.702+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:58:00+00:00, run_after=2024-05-23T22:59:00+00:00 2024-05-23T22:58:00.793570826Z [2024-05-23T22:58:00.793+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T22:58:00.793614428Z 2024-05-23T22:58:00.793623904Z 2024-05-23T22:58:00.793628659Z 2024-05-23T22:58:00.793633328Z 2024-05-23T22:58:00.793906959Z [2024-05-23T22:58:00.793+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T22:58:00.794197063Z [2024-05-23T22:58:00.793+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:58:00.794449810Z [2024-05-23T22:58:00.794+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:58:00.794740845Z [2024-05-23T22:58:00.794+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:58:00.795562090Z [2024-05-23T22:58:00.795+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:58:00.795577822Z 2024-05-23T22:58:00.795582540Z 2024-05-23T22:58:00.795586658Z 2024-05-23T22:58:00.795590792Z 2024-05-23T22:58:00.801224090Z [2024-05-23T22:58:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:58:00.801520577Z [2024-05-23T22:58:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T22:58:00.801946897Z [2024-05-23T22:58:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:58:00.802023727Z [2024-05-23T22:58:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:58:00.802470859Z [2024-05-23T22:58:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:58:00.802578893Z [2024-05-23T22:58:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:58:00.802966568Z [2024-05-23T22:58:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:58:00.803094387Z [2024-05-23T22:58:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:58:01.239742677Z [2024-05-23T22:58:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status queued for try_number 1 2024-05-23T22:58:01.239833599Z [2024-05-23T22:58:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:57:00+00:00 exited with status queued for try_number 1 2024-05-23T22:58:01.239844601Z [2024-05-23T22:58:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:57:00+00:00 exited with status queued for try_number 1 2024-05-23T22:58:01.239889997Z [2024-05-23T22:58:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:57:00+00:00 exited with status queued for try_number 1 2024-05-23T22:58:01.252579313Z [2024-05-23T22:58:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e848792-921f-45fa-a28b-e0b0e9661f2f 2024-05-23T22:58:01.252604267Z [2024-05-23T22:58:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c5a5e4a-2e3c-43f0-97a0-8e106fb0b967 2024-05-23T22:58:01.252608033Z [2024-05-23T22:58:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0e9be65-e481-4048-9732-cb1609648c20 2024-05-23T22:58:01.252624239Z [2024-05-23T22:58:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45353783-e1ee-4521-9980-fac020d9f8dc 2024-05-23T22:58:02.444697846Z [2024-05-23T22:58:02.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:58:02.444744111Z [2024-05-23T22:58:02.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:56:00+00:00, run_id=scheduled__2024-05-23T22:56:00+00:00, run_start_date=2024-05-23 22:58:00.714935+00:00, run_end_date=2024-05-23 22:58:02.444257+00:00, run_duration=1.729322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:56:00+00:00, data_interval_end=2024-05-23 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T22:58:02.461668145Z [2024-05-23T22:58:02.461+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T22:58:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:58:02.492110009Z [2024-05-23T22:58:02.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:58:02.492558960Z [2024-05-23T22:58:02.492+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:57:00+00:00, run_id=scheduled__2024-05-23T22:57:00+00:00, run_start_date=2024-05-23 22:58:00.719317+00:00, run_end_date=2024-05-23 22:58:02.492014+00:00, run_duration=1.772697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:57:00+00:00, data_interval_end=2024-05-23 22:58:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:58:02.502610570Z [2024-05-23T22:58:02.502+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:58:00+00:00, run_after=2024-05-23T22:59:00+00:00 2024-05-23T22:58:02.532101262Z [2024-05-23T22:58:02.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:57:00+00:00 exited with status success for try_number 1 2024-05-23T22:58:02.540065570Z [2024-05-23T22:58:02.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:57:00+00:00, map_index=-1, run_start_date=2024-05-23 22:58:01.763286+00:00, run_end_date=2024-05-23 22:58:02.335114+00:00, run_duration=0.571828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:58:00.796689+00:00, queued_by_job_id=1, pid=1937 2024-05-23T22:58:02.629051491Z [2024-05-23T22:58:02.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:56:00+00:00 exited with status success for try_number 1 2024-05-23T22:58:02.634671315Z [2024-05-23T22:58:02.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:56:00+00:00, map_index=-1, run_start_date=2024-05-23 22:58:01.858984+00:00, run_end_date=2024-05-23 22:58:02.421917+00:00, run_duration=0.562933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:58:00.796689+00:00, queued_by_job_id=1, pid=1938 2024-05-23T22:58:05.842558707Z [2024-05-23T22:58:05.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:58:05.843007595Z [2024-05-23T22:58:05.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:57:00+00:00, run_id=scheduled__2024-05-23T22:57:00+00:00, run_start_date=2024-05-23 22:58:00.716659+00:00, run_end_date=2024-05-23 22:58:05.842486+00:00, run_duration=5.125827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:57:00+00:00, data_interval_end=2024-05-23 22:58:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:58:05.855688464Z [2024-05-23T22:58:05.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:58:00+00:00, run_after=2024-05-23T22:59:00+00:00 2024-05-23T22:58:05.878448782Z [2024-05-23T22:58:05.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:58:05.878603071Z [2024-05-23T22:58:05.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:57:00+00:00, run_id=scheduled__2024-05-23T22:57:00+00:00, run_start_date=2024-05-23 22:58:00.717972+00:00, run_end_date=2024-05-23 22:58:05.877460+00:00, run_duration=5.159488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:57:00+00:00, data_interval_end=2024-05-23 22:58:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:58:05.892886529Z [2024-05-23T22:58:05.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:58:00+00:00, run_after=2024-05-23T22:59:00+00:00 2024-05-23T22:58:05.930302923Z [2024-05-23T22:58:05.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:57:00+00:00 exited with status success for try_number 1 2024-05-23T22:58:05.930559085Z [2024-05-23T22:58:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:57:00+00:00 exited with status success for try_number 1 2024-05-23T22:58:05.943319921Z [2024-05-23T22:58:05.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:57:00+00:00, map_index=-1, run_start_date=2024-05-23 22:58:03.056732+00:00, run_end_date=2024-05-23 22:58:05.244592+00:00, run_duration=2.18786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:58:00.796689+00:00, queued_by_job_id=1, pid=1961 2024-05-23T22:58:05.943550210Z [2024-05-23T22:58:05.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:57:00+00:00, map_index=-1, run_start_date=2024-05-23 22:58:03.210827+00:00, run_end_date=2024-05-23 22:58:04.727067+00:00, run_duration=1.51624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:58:00.796689+00:00, queued_by_job_id=1, pid=1962 2024-05-23T22:59:00.609885905Z [2024-05-23T22:59:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:59:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:59:00.618743399Z [2024-05-23T22:59:00.618+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T22:59:00.631226592Z [2024-05-23T22:59:00.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:59:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:59:00.713885028Z [2024-05-23T22:59:00.713+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T22:59:00.713923739Z 2024-05-23T22:59:00.713928752Z 2024-05-23T22:59:00.713933034Z 2024-05-23T22:59:00.714179808Z [2024-05-23T22:59:00.713+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:59:00.714412605Z [2024-05-23T22:59:00.714+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T22:59:00.714730636Z [2024-05-23T22:59:00.714+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T22:59:00.715881985Z [2024-05-23T22:59:00.715+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T22:59:00.715893769Z 2024-05-23T22:59:00.715898881Z 2024-05-23T22:59:00.715903329Z 2024-05-23T22:59:00.720034335Z [2024-05-23T22:59:00.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:59:00.720381737Z [2024-05-23T22:59:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T22:59:00.720857172Z [2024-05-23T22:59:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:59:00.721050181Z [2024-05-23T22:59:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T22:59:00.721264215Z [2024-05-23T22:59:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T22:59:00.721463251Z [2024-05-23T22:59:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T22:59:01.004653658Z [2024-05-23T22:59:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status queued for try_number 1 2024-05-23T22:59:01.004683943Z [2024-05-23T22:59:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status queued for try_number 1 2024-05-23T22:59:01.004687680Z [2024-05-23T22:59:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status queued for try_number 1 2024-05-23T22:59:01.015756852Z [2024-05-23T22:59:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to 606119cd-0fd7-41f9-8473-1efb83b5b5bd 2024-05-23T22:59:01.017757766Z [2024-05-23T22:59:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ee04c47-0624-44c9-85ce-35ab4cc1109e 2024-05-23T22:59:01.018032500Z [2024-05-23T22:59:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99625439-8c53-4451-8882-1f0500a08024 2024-05-23T22:59:02.805696683Z [2024-05-23T22:59:02.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:59:02.806015725Z [2024-05-23T22:59:02.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:58:00+00:00, run_id=scheduled__2024-05-23T22:58:00+00:00, run_start_date=2024-05-23 22:59:00.643649+00:00, run_end_date=2024-05-23 22:59:02.805581+00:00, run_duration=2.161932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:58:00+00:00, data_interval_end=2024-05-23 22:59:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T22:59:02.834579110Z [2024-05-23T22:59:02.834+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T22:59:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:59:02.924510100Z [2024-05-23T22:59:02.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status success for try_number 1 2024-05-23T22:59:02.934426599Z [2024-05-23T22:59:02.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:58:00+00:00, map_index=-1, run_start_date=2024-05-23 22:59:01.542920+00:00, run_end_date=2024-05-23 22:59:02.010988+00:00, run_duration=0.468068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:59:00.716883+00:00, queued_by_job_id=1, pid=1994 2024-05-23T22:59:03.995860075Z [2024-05-23T22:59:03.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:59:03.995912201Z [2024-05-23T22:59:03.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:58:00+00:00, run_id=scheduled__2024-05-23T22:58:00+00:00, run_start_date=2024-05-23 22:59:00.646173+00:00, run_end_date=2024-05-23 22:59:03.995391+00:00, run_duration=3.349218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:58:00+00:00, data_interval_end=2024-05-23 22:59:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T22:59:04.005153298Z [2024-05-23T22:59:04.004+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:59:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:59:04.623305154Z [2024-05-23T22:59:04.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T22:59:04.623676564Z [2024-05-23T22:59:04.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:58:00+00:00, run_id=scheduled__2024-05-23T22:58:00+00:00, run_start_date=2024-05-23 22:59:00.645030+00:00, run_end_date=2024-05-23 22:59:04.623277+00:00, run_duration=3.978247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:58:00+00:00, data_interval_end=2024-05-23 22:59:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T22:59:04.632367927Z [2024-05-23T22:59:04.632+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T22:59:00+00:00, run_after=2024-05-23T23:00:00+00:00 2024-05-23T22:59:04.671350711Z [2024-05-23T22:59:04.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status success for try_number 1 2024-05-23T22:59:04.671443284Z [2024-05-23T22:59:04.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status success for try_number 1 2024-05-23T22:59:04.685013651Z [2024-05-23T22:59:04.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:58:00+00:00, map_index=-1, run_start_date=2024-05-23 22:59:02.670826+00:00, run_end_date=2024-05-23 22:59:03.952253+00:00, run_duration=1.281427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:59:00.716883+00:00, queued_by_job_id=1, pid=2013 2024-05-23T22:59:04.685602242Z [2024-05-23T22:59:04.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:58:00+00:00, map_index=-1, run_start_date=2024-05-23 22:59:02.598202+00:00, run_end_date=2024-05-23 22:59:04.231320+00:00, run_duration=1.633118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 22:59:00.716883+00:00, queued_by_job_id=1, pid=2012 2024-05-23T23:00:00.573360521Z [2024-05-23T23:00:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:01:00+00:00 2024-05-23T23:00:00.584393990Z [2024-05-23T23:00:00.583+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:00:00.592122959Z [2024-05-23T23:00:00.591+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:00:00.604813882Z [2024-05-23T23:00:00.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:05:00+00:00 2024-05-23T23:00:00.630237096Z [2024-05-23T23:00:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:01:00+00:00 2024-05-23T23:00:00.768232720Z [2024-05-23T23:00:00.767+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T23:00:00.768282846Z 2024-05-23T23:00:00.768297429Z 2024-05-23T23:00:00.768310390Z 2024-05-23T23:00:00.768323923Z 2024-05-23T23:00:00.768336524Z 2024-05-23T23:00:00.768543056Z [2024-05-23T23:00:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:00:00.768766162Z [2024-05-23T23:00:00.768+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:00:00.769002161Z [2024-05-23T23:00:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:00:00.769193944Z [2024-05-23T23:00:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:00:00.769412096Z [2024-05-23T23:00:00.769+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:00:00.771041808Z [2024-05-23T23:00:00.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:00:00.771055708Z 2024-05-23T23:00:00.771080391Z 2024-05-23T23:00:00.771085010Z 2024-05-23T23:00:00.771089267Z 2024-05-23T23:00:00.771094066Z 2024-05-23T23:00:00.778059114Z [2024-05-23T23:00:00.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:00:00.778351729Z [2024-05-23T23:00:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:00:00.778876029Z [2024-05-23T23:00:00.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:00:00.779023823Z [2024-05-23T23:00:00.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:00:00.779431731Z [2024-05-23T23:00:00.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:00:00.779649226Z [2024-05-23T23:00:00.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:00:00.780053877Z [2024-05-23T23:00:00.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:00:00.780263371Z [2024-05-23T23:00:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:00:00.780703263Z [2024-05-23T23:00:00.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:00:00.780922420Z [2024-05-23T23:00:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:00:01.291473825Z [2024-05-23T23:00:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:01.294530874Z [2024-05-23T23:00:01.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:01.294730355Z [2024-05-23T23:00:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:59:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:01.294965022Z [2024-05-23T23:00:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:59:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:01.295190438Z [2024-05-23T23:00:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:59:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:01.311594246Z [2024-05-23T23:00:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec1d60fa-67c1-4cc1-bd80-0e2100de22d0 2024-05-23T23:00:01.311919149Z [2024-05-23T23:00:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 293be5ca-987d-4706-beda-eb96bdb14488 2024-05-23T23:00:01.312113396Z [2024-05-23T23:00:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e7cc58e-98c3-481d-b0fd-3d049f754f40 2024-05-23T23:00:01.312300343Z [2024-05-23T23:00:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba08b1d3-ffbb-4c29-bdc0-483f9b747237 2024-05-23T23:00:01.312506111Z [2024-05-23T23:00:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to f892659d-7e38-43cf-aa21-7daff9c190cd 2024-05-23T23:00:02.242294909Z [2024-05-23T23:00:02.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T22:58:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:02.250741968Z [2024-05-23T23:00:02.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T22:58:00+00:00, map_index=-1, run_start_date=2024-05-23 23:00:01.673196+00:00, run_end_date=2024-05-23 23:00:02.026077+00:00, run_duration=0.352881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:00.773233+00:00, queued_by_job_id=1, pid=2042 2024-05-23T23:00:03.208614992Z [2024-05-23T23:00:03.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:00:03.209092763Z [2024-05-23T23:00:03.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 22:58:00+00:00, run_id=scheduled__2024-05-23T22:58:00+00:00, run_start_date=2024-05-23 23:00:00.645726+00:00, run_end_date=2024-05-23 23:00:03.208738+00:00, run_duration=2.563012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:58:00+00:00, data_interval_end=2024-05-23 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:00:03.218343447Z [2024-05-23T23:00:03.218+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:02:00+00:00 2024-05-23T23:00:03.225906724Z [2024-05-23T23:00:03.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:00:03.226282201Z [2024-05-23T23:00:03.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 22:59:00+00:00, run_id=scheduled__2024-05-23T22:59:00+00:00, run_start_date=2024-05-23 23:00:00.647042+00:00, run_end_date=2024-05-23 23:00:03.225981+00:00, run_duration=2.578939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:59:00+00:00, data_interval_end=2024-05-23 23:00:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:00:03.236141488Z [2024-05-23T23:00:03.235+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:01:00+00:00 2024-05-23T23:00:03.288948064Z [2024-05-23T23:00:03.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:59:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:03.296755651Z [2024-05-23T23:00:03.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:59:00+00:00, map_index=-1, run_start_date=2024-05-23 23:00:02.256314+00:00, run_end_date=2024-05-23 23:00:02.765677+00:00, run_duration=0.509363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:00.773233+00:00, queued_by_job_id=1, pid=2054 2024-05-23T23:00:04.418627617Z [2024-05-23T23:00:04.417+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:00:04.418801139Z 2024-05-23T23:00:04.418857067Z [2024-05-23T23:00:04.418+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:00:04.419797865Z [2024-05-23T23:00:04.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:00:04.419840397Z 2024-05-23T23:00:04.423148571Z [2024-05-23T23:00:04.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:00:04.423685151Z [2024-05-23T23:00:04.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:00:04.516363555Z [2024-05-23T23:00:04.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:04.516504285Z [2024-05-23T23:00:04.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:04.526832789Z [2024-05-23T23:00:04.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5879000-a551-480d-9126-c3da211b0aae 2024-05-23T23:00:04.527205399Z [2024-05-23T23:00:04.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 23:00:03.279192+00:00, run_end_date=2024-05-23 23:00:03.754203+00:00, run_duration=0.475011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:00.773233+00:00, queued_by_job_id=1, pid=2073 2024-05-23T23:00:05.689340017Z [2024-05-23T23:00:05.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:00:05.689826254Z [2024-05-23T23:00:05.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:59:00+00:00, run_id=scheduled__2024-05-23T22:59:00+00:00, run_start_date=2024-05-23 23:00:00.648365+00:00, run_end_date=2024-05-23 23:00:05.689220+00:00, run_duration=5.040855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:59:00+00:00, data_interval_end=2024-05-23 23:00:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:00:05.703658422Z [2024-05-23T23:00:05.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:01:00+00:00 2024-05-23T23:00:05.721474535Z [2024-05-23T23:00:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:00:05.722261240Z [2024-05-23T23:00:05.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:59:00+00:00, run_id=scheduled__2024-05-23T22:59:00+00:00, run_start_date=2024-05-23 23:00:00.649960+00:00, run_end_date=2024-05-23 23:00:05.721347+00:00, run_duration=5.071387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:59:00+00:00, data_interval_end=2024-05-23 23:00:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:00:05.734747307Z [2024-05-23T23:00:05.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:01:00+00:00 2024-05-23T23:00:05.786151300Z [2024-05-23T23:00:05.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:59:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:05.786433080Z [2024-05-23T23:00:05.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T22:59:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:05.797988685Z [2024-05-23T23:00:05.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:59:00+00:00, map_index=-1, run_start_date=2024-05-23 23:00:03.211885+00:00, run_end_date=2024-05-23 23:00:04.884710+00:00, run_duration=1.672825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:00.773233+00:00, queued_by_job_id=1, pid=2072 2024-05-23T23:00:05.798852305Z [2024-05-23T23:00:05.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T22:59:00+00:00, map_index=-1, run_start_date=2024-05-23 23:00:03.652548+00:00, run_end_date=2024-05-23 23:00:05.054282+00:00, run_duration=1.401734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:00.773233+00:00, queued_by_job_id=1, pid=2089 2024-05-23T23:00:07.562842137Z [2024-05-23T23:00:07.562+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:00:07.562872808Z 2024-05-23T23:00:07.562876452Z [2024-05-23T23:00:07.562+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:00:07.563474841Z [2024-05-23T23:00:07.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:00:07.563486510Z 2024-05-23T23:00:07.565807953Z [2024-05-23T23:00:07.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:00:07.565839860Z [2024-05-23T23:00:07.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:00:07.631490530Z [2024-05-23T23:00:07.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:07.631862696Z [2024-05-23T23:00:07.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:07.639652206Z [2024-05-23T23:00:07.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 232598eb-64dc-4e7c-8ceb-a81a5a40a6d3 2024-05-23T23:00:07.640138029Z [2024-05-23T23:00:07.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 23:00:06.067655+00:00, run_end_date=2024-05-23 23:00:06.477666+00:00, run_duration=0.410011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:04.420286+00:00, queued_by_job_id=1, pid=2102 2024-05-23T23:00:11.013891908Z [2024-05-23T23:00:11.013+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:00:11.013931615Z 2024-05-23T23:00:11.014194817Z [2024-05-23T23:00:11.013+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:00:11.014925537Z [2024-05-23T23:00:11.014+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:00:11.014938753Z 2024-05-23T23:00:11.017332524Z [2024-05-23T23:00:11.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:00:11.017571333Z [2024-05-23T23:00:11.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:00:11.070841642Z [2024-05-23T23:00:11.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status queued for try_number 1 2024-05-23T23:00:11.071065045Z [2024-05-23T23:00:11.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:11.082476640Z [2024-05-23T23:00:11.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a57287d-d3bf-4fb5-9bb0-bdcf82806b31 2024-05-23T23:00:11.084066752Z [2024-05-23T23:00:11.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=0, run_start_date=2024-05-23 23:00:09.515112+00:00, run_end_date=2024-05-23 23:00:09.904046+00:00, run_duration=0.388934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:07.563766+00:00, queued_by_job_id=1, pid=2110 2024-05-23T23:00:13.411810972Z [2024-05-23T23:00:13.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:00:13.412193929Z [2024-05-23T23:00:13.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 22:55:00+00:00, run_id=scheduled__2024-05-23T22:55:00+00:00, run_start_date=2024-05-23 23:00:00.644208+00:00, run_end_date=2024-05-23 23:00:13.411718+00:00, run_duration=12.76751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 22:55:00+00:00, data_interval_end=2024-05-23 23:00:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:00:13.422247908Z [2024-05-23T23:00:13.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:00:00+00:00, run_after=2024-05-23T23:05:00+00:00 2024-05-23T23:00:13.461402226Z [2024-05-23T23:00:13.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T22:55:00+00:00 exited with status success for try_number 1 2024-05-23T23:00:13.473559412Z [2024-05-23T23:00:13.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T22:55:00+00:00, map_index=-1, run_start_date=2024-05-23 23:00:12.689491+00:00, run_end_date=2024-05-23 23:00:13.098353+00:00, run_duration=0.408862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:00:11.015346+00:00, queued_by_job_id=1, pid=2118 2024-05-23T23:01:00.385962225Z [2024-05-23T23:01:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:01:00+00:00, run_after=2024-05-23T23:02:00+00:00 2024-05-23T23:01:00.393287695Z [2024-05-23T23:01:00.392+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:01:00.404612017Z [2024-05-23T23:01:00.404+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:01:00+00:00, run_after=2024-05-23T23:02:00+00:00 2024-05-23T23:01:00.490476474Z [2024-05-23T23:01:00.490+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:01:00.490532970Z 2024-05-23T23:01:00.490539455Z 2024-05-23T23:01:00.490543128Z 2024-05-23T23:01:00.490638339Z [2024-05-23T23:01:00.490+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:01:00.490794876Z [2024-05-23T23:01:00.490+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:01:00.490955183Z [2024-05-23T23:01:00.490+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:01:00.491553904Z [2024-05-23T23:01:00.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:01:00.491558628Z 2024-05-23T23:01:00.491561934Z 2024-05-23T23:01:00.491579924Z 2024-05-23T23:01:00.495149781Z [2024-05-23T23:01:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:01:00.495329141Z [2024-05-23T23:01:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:01:00.495622644Z [2024-05-23T23:01:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:01:00.495782150Z [2024-05-23T23:01:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:01:00.496027731Z [2024-05-23T23:01:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:01:00.496183386Z [2024-05-23T23:01:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:01:00.720765569Z [2024-05-23T23:01:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:01:00.721019527Z [2024-05-23T23:01:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:01:00.721140487Z [2024-05-23T23:01:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:01:00.729347869Z [2024-05-23T23:01:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c7600ba-c158-4ead-9754-0e391375284e 2024-05-23T23:01:00.729579697Z [2024-05-23T23:01:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 719b0c23-9d54-4a0a-810b-f18321df5501 2024-05-23T23:01:00.729812038Z [2024-05-23T23:01:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf223ff-cbcb-4e33-af21-880bfc201408 2024-05-23T23:01:01.919060966Z [2024-05-23T23:01:01.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:01:01.919339301Z [2024-05-23T23:01:01.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:00:00+00:00, run_id=scheduled__2024-05-23T23:00:00+00:00, run_start_date=2024-05-23 23:01:00.414293+00:00, run_end_date=2024-05-23 23:01:01.918949+00:00, run_duration=1.504656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:00:00+00:00, data_interval_end=2024-05-23 23:01:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:01:01.937441367Z [2024-05-23T23:01:01.937+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:01:00+00:00, run_after=2024-05-23T23:02:00+00:00 2024-05-23T23:01:01.989108066Z [2024-05-23T23:01:01.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:01:02.005781707Z [2024-05-23T23:01:02.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=-1, run_start_date=2024-05-23 23:01:01.336023+00:00, run_end_date=2024-05-23 23:01:01.766838+00:00, run_duration=0.430815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:01:00.492340+00:00, queued_by_job_id=1, pid=2140 2024-05-23T23:01:04.703106141Z [2024-05-23T23:01:04.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:01:04.703735066Z [2024-05-23T23:01:04.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:00:00+00:00, run_id=scheduled__2024-05-23T23:00:00+00:00, run_start_date=2024-05-23 23:01:00.415765+00:00, run_end_date=2024-05-23 23:01:04.702992+00:00, run_duration=4.287227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:00:00+00:00, data_interval_end=2024-05-23 23:01:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:01:04.717422172Z [2024-05-23T23:01:04.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:01:00+00:00, run_after=2024-05-23T23:02:00+00:00 2024-05-23T23:01:04.726153520Z [2024-05-23T23:01:04.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:01:04.726337855Z [2024-05-23T23:01:04.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:00:00+00:00, run_id=scheduled__2024-05-23T23:00:00+00:00, run_start_date=2024-05-23 23:01:00.416937+00:00, run_end_date=2024-05-23 23:01:04.726073+00:00, run_duration=4.309136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:00:00+00:00, data_interval_end=2024-05-23 23:01:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:01:04.736702039Z [2024-05-23T23:01:04.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:01:00+00:00, run_after=2024-05-23T23:02:00+00:00 2024-05-23T23:01:04.779058274Z [2024-05-23T23:01:04.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:01:04.779129775Z [2024-05-23T23:01:04.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:01:04.789383479Z [2024-05-23T23:01:04.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=-1, run_start_date=2024-05-23 23:01:02.275458+00:00, run_end_date=2024-05-23 23:01:04.143254+00:00, run_duration=1.867796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:01:00.492340+00:00, queued_by_job_id=1, pid=2159 2024-05-23T23:01:04.789638416Z [2024-05-23T23:01:04.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=-1, run_start_date=2024-05-23 23:01:02.246704+00:00, run_end_date=2024-05-23 23:01:04.457624+00:00, run_duration=2.21092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:01:00.492340+00:00, queued_by_job_id=1, pid=2158 2024-05-23T23:01:39.079612424Z [2024-05-23T23:01:39.078+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:02:00.369965378Z [2024-05-23T23:02:00.369+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:02:00.381719019Z [2024-05-23T23:02:00.381+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:02:00+00:00, run_after=2024-05-23T23:03:00+00:00 2024-05-23T23:02:00.402074160Z [2024-05-23T23:02:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:02:00+00:00, run_after=2024-05-23T23:03:00+00:00 2024-05-23T23:02:00.416033163Z [2024-05-23T23:02:00.415+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:02:00.531889555Z [2024-05-23T23:02:00.530+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:02:00.531930377Z 2024-05-23T23:02:00.531939480Z 2024-05-23T23:02:00.531946319Z 2024-05-23T23:02:00.531953177Z 2024-05-23T23:02:00.532403310Z [2024-05-23T23:02:00.532+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:02:00.532849921Z [2024-05-23T23:02:00.532+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:02:00.533223935Z [2024-05-23T23:02:00.532+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:02:00.533565418Z [2024-05-23T23:02:00.533+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:02:00.534823859Z [2024-05-23T23:02:00.534+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:02:00.534862934Z 2024-05-23T23:02:00.534870877Z 2024-05-23T23:02:00.534876929Z 2024-05-23T23:02:00.534883866Z 2024-05-23T23:02:00.542266714Z [2024-05-23T23:02:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:02:00.543112677Z [2024-05-23T23:02:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:02:00.543670710Z [2024-05-23T23:02:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:02:00.543969297Z [2024-05-23T23:02:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:02:00.544442525Z [2024-05-23T23:02:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:02:00.544749104Z [2024-05-23T23:02:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:02:00.545180795Z [2024-05-23T23:02:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:02:00.545514774Z [2024-05-23T23:02:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:02:00.913991467Z [2024-05-23T23:02:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:02:00.914395679Z [2024-05-23T23:02:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:01:00+00:00 exited with status queued for try_number 1 2024-05-23T23:02:00.914660348Z [2024-05-23T23:02:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:01:00+00:00 exited with status queued for try_number 1 2024-05-23T23:02:00.914852696Z [2024-05-23T23:02:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:01:00+00:00 exited with status queued for try_number 1 2024-05-23T23:02:00.942301425Z [2024-05-23T23:02:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30835c65-fd52-446c-9fc9-edd54281b009 2024-05-23T23:02:00.942323224Z [2024-05-23T23:02:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0b8aa1d-087f-498e-bad7-7aa93f8036c6 2024-05-23T23:02:00.942326769Z [2024-05-23T23:02:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d044237-505d-409a-80c2-6fcab742771b 2024-05-23T23:02:00.942331069Z [2024-05-23T23:02:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5585052a-77a9-4d10-8c0e-f041443470f3 2024-05-23T23:02:02.106559937Z [2024-05-23T23:02:02.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:02:02.108195062Z [2024-05-23T23:02:02.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:00:00+00:00, run_id=scheduled__2024-05-23T23:00:00+00:00, run_start_date=2024-05-23 23:02:00.433453+00:00, run_end_date=2024-05-23 23:02:02.106413+00:00, run_duration=1.67296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:00:00+00:00, data_interval_end=2024-05-23 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:02:02.118291196Z [2024-05-23T23:02:02.117+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:02:00+00:00, run_after=2024-05-23T23:04:00+00:00 2024-05-23T23:02:02.234119028Z [2024-05-23T23:02:02.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:02:02.241584961Z [2024-05-23T23:02:02.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=-1, run_start_date=2024-05-23 23:02:01.407357+00:00, run_end_date=2024-05-23 23:02:01.895746+00:00, run_duration=0.488389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:02:00.536494+00:00, queued_by_job_id=1, pid=2187 2024-05-23T23:02:03.107823709Z [2024-05-23T23:02:03.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:02:03.108250178Z [2024-05-23T23:02:03.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:01:00+00:00, run_id=scheduled__2024-05-23T23:01:00+00:00, run_start_date=2024-05-23 23:02:00.435528+00:00, run_end_date=2024-05-23 23:02:03.107906+00:00, run_duration=2.672378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:01:00+00:00, data_interval_end=2024-05-23 23:02:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:02:03.117102664Z [2024-05-23T23:02:03.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:02:00+00:00, run_after=2024-05-23T23:03:00+00:00 2024-05-23T23:02:03.170252049Z [2024-05-23T23:02:03.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:01:00+00:00 exited with status success for try_number 1 2024-05-23T23:02:03.175678754Z [2024-05-23T23:02:03.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:01:00+00:00, map_index=-1, run_start_date=2024-05-23 23:02:01.765637+00:00, run_end_date=2024-05-23 23:02:02.285756+00:00, run_duration=0.520119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:02:00.536494+00:00, queued_by_job_id=1, pid=2193 2024-05-23T23:02:05.056557584Z [2024-05-23T23:02:05.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:02:05.056784604Z [2024-05-23T23:02:05.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:01:00+00:00, run_id=scheduled__2024-05-23T23:01:00+00:00, run_start_date=2024-05-23 23:02:00.437239+00:00, run_end_date=2024-05-23 23:02:05.056232+00:00, run_duration=4.618993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:01:00+00:00, data_interval_end=2024-05-23 23:02:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:02:05.068256824Z [2024-05-23T23:02:05.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:02:00+00:00, run_after=2024-05-23T23:03:00+00:00 2024-05-23T23:02:05.135039106Z [2024-05-23T23:02:05.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:01:00+00:00 exited with status success for try_number 1 2024-05-23T23:02:05.146183488Z [2024-05-23T23:02:05.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:01:00+00:00, map_index=-1, run_start_date=2024-05-23 23:02:02.934096+00:00, run_end_date=2024-05-23 23:02:04.641484+00:00, run_duration=1.707388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:02:00.536494+00:00, queued_by_job_id=1, pid=2216 2024-05-23T23:02:06.208818025Z [2024-05-23T23:02:06.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:02:06.209426690Z [2024-05-23T23:02:06.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:01:00+00:00, run_id=scheduled__2024-05-23T23:01:00+00:00, run_start_date=2024-05-23 23:02:00.438940+00:00, run_end_date=2024-05-23 23:02:06.208670+00:00, run_duration=5.76973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:01:00+00:00, data_interval_end=2024-05-23 23:02:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:02:06.222248395Z [2024-05-23T23:02:06.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:02:00+00:00, run_after=2024-05-23T23:03:00+00:00 2024-05-23T23:02:06.273531827Z [2024-05-23T23:02:06.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:01:00+00:00 exited with status success for try_number 1 2024-05-23T23:02:06.278568083Z [2024-05-23T23:02:06.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:01:00+00:00, map_index=-1, run_start_date=2024-05-23 23:02:02.932348+00:00, run_end_date=2024-05-23 23:02:05.117906+00:00, run_duration=2.185558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:02:00.536494+00:00, queued_by_job_id=1, pid=2217 2024-05-23T23:03:00.258781232Z [2024-05-23T23:03:00.258+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:03:00+00:00, run_after=2024-05-23T23:04:00+00:00 2024-05-23T23:03:00.266879031Z [2024-05-23T23:03:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:03:00.277902579Z [2024-05-23T23:03:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:03:00+00:00, run_after=2024-05-23T23:04:00+00:00 2024-05-23T23:03:00.370612751Z [2024-05-23T23:03:00.366+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:03:00.370635711Z 2024-05-23T23:03:00.370639074Z 2024-05-23T23:03:00.370642394Z 2024-05-23T23:03:00.370645360Z [2024-05-23T23:03:00.367+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:03:00.370659047Z [2024-05-23T23:03:00.367+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:03:00.370661815Z [2024-05-23T23:03:00.367+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:03:00.370665802Z [2024-05-23T23:03:00.367+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:03:00.370668660Z 2024-05-23T23:03:00.370671394Z 2024-05-23T23:03:00.370674189Z 2024-05-23T23:03:00.371406298Z [2024-05-23T23:03:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:03:00.371597742Z [2024-05-23T23:03:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:03:00.371827688Z [2024-05-23T23:03:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:03:00.371929734Z [2024-05-23T23:03:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:03:00.372133339Z [2024-05-23T23:03:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:03:00.372231971Z [2024-05-23T23:03:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:03:00.674866688Z [2024-05-23T23:03:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status queued for try_number 1 2024-05-23T23:03:00.674988781Z [2024-05-23T23:03:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status queued for try_number 1 2024-05-23T23:03:00.675080871Z [2024-05-23T23:03:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status queued for try_number 1 2024-05-23T23:03:00.686908070Z [2024-05-23T23:03:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15153f13-6c20-41b3-877f-fd9fed9e77fa 2024-05-23T23:03:00.686933588Z [2024-05-23T23:03:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2ec3bd3-1aab-4bee-98dd-96bf437e9540 2024-05-23T23:03:00.687054899Z [2024-05-23T23:03:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to a624e755-827f-466c-8343-33394630a2e6 2024-05-23T23:03:03.051990162Z [2024-05-23T23:03:03.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:03:03.052291067Z [2024-05-23T23:03:03.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:02:00+00:00, run_id=scheduled__2024-05-23T23:02:00+00:00, run_start_date=2024-05-23 23:03:00.293867+00:00, run_end_date=2024-05-23 23:03:03.051976+00:00, run_duration=2.758109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:02:00+00:00, data_interval_end=2024-05-23 23:03:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:03:03.072589731Z [2024-05-23T23:03:03.072+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:03:00+00:00, run_after=2024-05-23T23:04:00+00:00 2024-05-23T23:03:03.174040912Z [2024-05-23T23:03:03.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status success for try_number 1 2024-05-23T23:03:03.184394711Z [2024-05-23T23:03:03.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:02:00+00:00, map_index=-1, run_start_date=2024-05-23 23:03:01.691298+00:00, run_end_date=2024-05-23 23:03:02.276470+00:00, run_duration=0.585172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:03:00.368634+00:00, queued_by_job_id=1, pid=2250 2024-05-23T23:03:05.359802944Z [2024-05-23T23:03:05.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:03:05.359954838Z [2024-05-23T23:03:05.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:02:00+00:00, run_id=scheduled__2024-05-23T23:02:00+00:00, run_start_date=2024-05-23 23:03:00.308124+00:00, run_end_date=2024-05-23 23:03:05.359687+00:00, run_duration=5.051563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:02:00+00:00, data_interval_end=2024-05-23 23:03:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:03:05.381671458Z [2024-05-23T23:03:05.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:03:00+00:00, run_after=2024-05-23T23:04:00+00:00 2024-05-23T23:03:05.424726444Z [2024-05-23T23:03:05.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status success for try_number 1 2024-05-23T23:03:05.430267470Z [2024-05-23T23:03:05.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:02:00+00:00, map_index=-1, run_start_date=2024-05-23 23:03:02.727207+00:00, run_end_date=2024-05-23 23:03:04.442893+00:00, run_duration=1.715686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:03:00.368634+00:00, queued_by_job_id=1, pid=2267 2024-05-23T23:03:06.491270419Z [2024-05-23T23:03:06.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:03:06.491766488Z [2024-05-23T23:03:06.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:02:00+00:00, run_id=scheduled__2024-05-23T23:02:00+00:00, run_start_date=2024-05-23 23:03:00.310764+00:00, run_end_date=2024-05-23 23:03:06.491346+00:00, run_duration=6.180582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:02:00+00:00, data_interval_end=2024-05-23 23:03:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:03:06.505744365Z [2024-05-23T23:03:06.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:03:00+00:00, run_after=2024-05-23T23:04:00+00:00 2024-05-23T23:03:06.549745119Z [2024-05-23T23:03:06.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status success for try_number 1 2024-05-23T23:03:06.557827022Z [2024-05-23T23:03:06.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:02:00+00:00, map_index=-1, run_start_date=2024-05-23 23:03:02.952857+00:00, run_end_date=2024-05-23 23:03:05.476141+00:00, run_duration=2.523284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:03:00.368634+00:00, queued_by_job_id=1, pid=2268 2024-05-23T23:04:00.130872568Z [2024-05-23T23:04:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:04:00+00:00, run_after=2024-05-23T23:05:00+00:00 2024-05-23T23:04:00.138917648Z [2024-05-23T23:04:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:04:00.145777587Z [2024-05-23T23:04:00.145+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:04:00.171157359Z [2024-05-23T23:04:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:04:00+00:00, run_after=2024-05-23T23:05:00+00:00 2024-05-23T23:04:00.303089536Z [2024-05-23T23:04:00.299+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:04:00.303122807Z 2024-05-23T23:04:00.303128499Z 2024-05-23T23:04:00.303131613Z 2024-05-23T23:04:00.303134688Z 2024-05-23T23:04:00.303138568Z [2024-05-23T23:04:00.299+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:04:00.303141541Z [2024-05-23T23:04:00.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:04:00.303144595Z [2024-05-23T23:04:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:04:00.303147447Z [2024-05-23T23:04:00.300+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:04:00.303150525Z [2024-05-23T23:04:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:04:00.303153611Z 2024-05-23T23:04:00.303156551Z 2024-05-23T23:04:00.303159543Z 2024-05-23T23:04:00.303162425Z 2024-05-23T23:04:00.305754193Z [2024-05-23T23:04:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:04:00.305797643Z [2024-05-23T23:04:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:04:00.305810524Z [2024-05-23T23:04:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:04:00.305816536Z [2024-05-23T23:04:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:04:00.305821668Z [2024-05-23T23:04:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:04:00.305832979Z [2024-05-23T23:04:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:04:00.305965612Z [2024-05-23T23:04:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:04:00.306037153Z [2024-05-23T23:04:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:04:00.830274328Z [2024-05-23T23:04:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status queued for try_number 1 2024-05-23T23:04:00.830551030Z [2024-05-23T23:04:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:03:00+00:00 exited with status queued for try_number 1 2024-05-23T23:04:00.830773036Z [2024-05-23T23:04:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:03:00+00:00 exited with status queued for try_number 1 2024-05-23T23:04:00.830950450Z [2024-05-23T23:04:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:03:00+00:00 exited with status queued for try_number 1 2024-05-23T23:04:00.845256083Z [2024-05-23T23:04:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 938c5d23-5440-4162-9dd9-8a36c1500394 2024-05-23T23:04:00.845559551Z [2024-05-23T23:04:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7520573b-2980-439c-befb-1327fc55b597 2024-05-23T23:04:00.845855870Z [2024-05-23T23:04:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4605c9f-8b59-4d50-9870-d7e93880cef9 2024-05-23T23:04:00.846079845Z [2024-05-23T23:04:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fcf7fd1-094e-41c1-93e1-c78d3e1e1091 2024-05-23T23:04:02.139841213Z [2024-05-23T23:04:02.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:04:02.143370946Z [2024-05-23T23:04:02.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:02:00+00:00, run_id=scheduled__2024-05-23T23:02:00+00:00, run_start_date=2024-05-23 23:04:00.184068+00:00, run_end_date=2024-05-23 23:04:02.142866+00:00, run_duration=1.958798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:02:00+00:00, data_interval_end=2024-05-23 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:04:02.169893769Z [2024-05-23T23:04:02.164+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:04:00+00:00, run_after=2024-05-23T23:06:00+00:00 2024-05-23T23:04:02.301989325Z [2024-05-23T23:04:02.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:02:00+00:00 exited with status success for try_number 1 2024-05-23T23:04:02.319251003Z [2024-05-23T23:04:02.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:02:00+00:00, map_index=-1, run_start_date=2024-05-23 23:04:01.524167+00:00, run_end_date=2024-05-23 23:04:01.987087+00:00, run_duration=0.46292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:04:00.301571+00:00, queued_by_job_id=1, pid=2301 2024-05-23T23:04:03.424521743Z [2024-05-23T23:04:03.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:04:03.425024725Z [2024-05-23T23:04:03.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:03:00+00:00, run_id=scheduled__2024-05-23T23:03:00+00:00, run_start_date=2024-05-23 23:04:00.186346+00:00, run_end_date=2024-05-23 23:04:03.424395+00:00, run_duration=3.238049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:03:00+00:00, data_interval_end=2024-05-23 23:04:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:04:03.437241132Z [2024-05-23T23:04:03.436+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:04:00+00:00, run_after=2024-05-23T23:05:00+00:00 2024-05-23T23:04:03.504414781Z [2024-05-23T23:04:03.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:03:00+00:00 exited with status success for try_number 1 2024-05-23T23:04:03.510514265Z [2024-05-23T23:04:03.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:03:00+00:00, map_index=-1, run_start_date=2024-05-23 23:04:01.791040+00:00, run_end_date=2024-05-23 23:04:02.469299+00:00, run_duration=0.678259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:04:00.301571+00:00, queued_by_job_id=1, pid=2302 2024-05-23T23:04:05.635649416Z [2024-05-23T23:04:05.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:04:05.636222120Z [2024-05-23T23:04:05.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:03:00+00:00, run_id=scheduled__2024-05-23T23:03:00+00:00, run_start_date=2024-05-23 23:04:00.187805+00:00, run_end_date=2024-05-23 23:04:05.635806+00:00, run_duration=5.448001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:03:00+00:00, data_interval_end=2024-05-23 23:04:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:04:05.648754625Z [2024-05-23T23:04:05.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:04:00+00:00, run_after=2024-05-23T23:05:00+00:00 2024-05-23T23:04:05.657223415Z [2024-05-23T23:04:05.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:04:05.657672152Z [2024-05-23T23:04:05.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:03:00+00:00, run_id=scheduled__2024-05-23T23:03:00+00:00, run_start_date=2024-05-23 23:04:00.188979+00:00, run_end_date=2024-05-23 23:04:05.657375+00:00, run_duration=5.468396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:03:00+00:00, data_interval_end=2024-05-23 23:04:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:04:05.677285852Z [2024-05-23T23:04:05.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:04:00+00:00, run_after=2024-05-23T23:05:00+00:00 2024-05-23T23:04:05.727357594Z [2024-05-23T23:04:05.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:03:00+00:00 exited with status success for try_number 1 2024-05-23T23:04:05.727430293Z [2024-05-23T23:04:05.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:03:00+00:00 exited with status success for try_number 1 2024-05-23T23:04:05.735536040Z [2024-05-23T23:04:05.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:03:00+00:00, map_index=-1, run_start_date=2024-05-23 23:04:03.486974+00:00, run_end_date=2024-05-23 23:04:05.020748+00:00, run_duration=1.533774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:04:00.301571+00:00, queued_by_job_id=1, pid=2326 2024-05-23T23:04:05.735767447Z [2024-05-23T23:04:05.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:03:00+00:00, map_index=-1, run_start_date=2024-05-23 23:04:03.399464+00:00, run_end_date=2024-05-23 23:04:05.243597+00:00, run_duration=1.844133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:04:00.301571+00:00, queued_by_job_id=1, pid=2325 2024-05-23T23:05:01.039889422Z [2024-05-23T23:05:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:05:00+00:00, run_after=2024-05-23T23:06:00+00:00 2024-05-23T23:05:01.065838235Z [2024-05-23T23:05:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:05:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:05:01.081713351Z [2024-05-23T23:05:01.080+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:05:01.106049592Z [2024-05-23T23:05:01.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:05:00+00:00, run_after=2024-05-23T23:06:00+00:00 2024-05-23T23:05:01.211386862Z [2024-05-23T23:05:01.210+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:05:01.211414248Z 2024-05-23T23:05:01.211424225Z 2024-05-23T23:05:01.211427746Z 2024-05-23T23:05:01.211431023Z 2024-05-23T23:05:01.212208103Z [2024-05-23T23:05:01.211+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:05:01.212447471Z [2024-05-23T23:05:01.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:05:01.218896562Z [2024-05-23T23:05:01.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:05:01.219947768Z [2024-05-23T23:05:01.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:05:01.220576551Z [2024-05-23T23:05:01.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:05:01.220588193Z 2024-05-23T23:05:01.220592157Z 2024-05-23T23:05:01.220595723Z 2024-05-23T23:05:01.220599046Z 2024-05-23T23:05:01.234558703Z [2024-05-23T23:05:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:05:01.234990522Z [2024-05-23T23:05:01.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:05:01.235453776Z [2024-05-23T23:05:01.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:05:01.236071320Z [2024-05-23T23:05:01.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:05:01.236441496Z [2024-05-23T23:05:01.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:05:01.237803633Z [2024-05-23T23:05:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:05:01.238186616Z [2024-05-23T23:05:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:05:01.238363965Z [2024-05-23T23:05:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:05:01.733687375Z [2024-05-23T23:05:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:05:01.733949550Z [2024-05-23T23:05:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status queued for try_number 1 2024-05-23T23:05:01.734142093Z [2024-05-23T23:05:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status queued for try_number 1 2024-05-23T23:05:01.734315058Z [2024-05-23T23:05:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status queued for try_number 1 2024-05-23T23:05:01.752124192Z [2024-05-23T23:05:01.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3975e0d7-da36-483d-a5e8-b0e1e22a5208 2024-05-23T23:05:01.752396937Z [2024-05-23T23:05:01.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5cfdb91-9e24-4f80-b024-3ae11ad173f6 2024-05-23T23:05:01.752671115Z [2024-05-23T23:05:01.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cd43d3c-8749-4be4-a47c-1ebf069b0051 2024-05-23T23:05:01.752944279Z [2024-05-23T23:05:01.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c3ca243-8702-4857-912c-026819e3a6db 2024-05-23T23:05:06.293930323Z [2024-05-23T23:05:06.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:05:06.306643822Z [2024-05-23T23:05:06.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:04:00+00:00, run_id=scheduled__2024-05-23T23:04:00+00:00, run_start_date=2024-05-23 23:05:01.131300+00:00, run_end_date=2024-05-23 23:05:06.305807+00:00, run_duration=5.174507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:04:00+00:00, data_interval_end=2024-05-23 23:05:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:05:06.340633813Z [2024-05-23T23:05:06.340+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:05:00+00:00, run_after=2024-05-23T23:06:00+00:00 2024-05-23T23:05:07.314195329Z [2024-05-23T23:05:07.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status success for try_number 1 2024-05-23T23:05:07.344386007Z [2024-05-23T23:05:07.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:04:00+00:00, map_index=-1, run_start_date=2024-05-23 23:05:03.355462+00:00, run_end_date=2024-05-23 23:05:04.833341+00:00, run_duration=1.477879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:05:01.227780+00:00, queued_by_job_id=1, pid=2360 2024-05-23T23:05:12.761082930Z [2024-05-23T23:05:12.759+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:05:12.761116487Z 2024-05-23T23:05:12.761121026Z [2024-05-23T23:05:12.759+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:05:12.761462200Z [2024-05-23T23:05:12.761+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:05:12.761472160Z 2024-05-23T23:05:12.773220156Z [2024-05-23T23:05:12.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:05:12.773333592Z [2024-05-23T23:05:12.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:05:13.251106084Z [2024-05-23T23:05:13.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:05:13.274669790Z [2024-05-23T23:05:13.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 744698b7-0413-4d50-a812-e06984c4f60c 2024-05-23T23:05:13.498249771Z [2024-05-23T23:05:13.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:05:13.513227509Z [2024-05-23T23:05:13.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:04:00+00:00, run_id=scheduled__2024-05-23T23:04:00+00:00, run_start_date=2024-05-23 23:05:01.133756+00:00, run_end_date=2024-05-23 23:05:13.498175+00:00, run_duration=12.364419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:04:00+00:00, data_interval_end=2024-05-23 23:05:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:05:13.634683270Z [2024-05-23T23:05:13.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:05:00+00:00, run_after=2024-05-23T23:06:00+00:00 2024-05-23T23:05:14.191852563Z [2024-05-23T23:05:14.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:05:14.216033319Z [2024-05-23T23:05:14.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=-1, run_start_date=2024-05-23 23:05:09.931842+00:00, run_end_date=2024-05-23 23:05:12.476871+00:00, run_duration=2.545029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:05:01.227780+00:00, queued_by_job_id=1, pid=2385 2024-05-23T23:05:15.617211000Z [2024-05-23T23:05:15.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status success for try_number 1 2024-05-23T23:05:15.687326500Z [2024-05-23T23:05:15.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:04:00+00:00, map_index=-1, run_start_date=2024-05-23 23:05:07.271799+00:00, run_end_date=2024-05-23 23:05:12.952351+00:00, run_duration=5.680552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:05:01.227780+00:00, queued_by_job_id=1, pid=2374 2024-05-23T23:05:17.100089058Z [2024-05-23T23:05:17.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:05:17.148032738Z [2024-05-23T23:05:17.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:04:00+00:00, run_id=scheduled__2024-05-23T23:04:00+00:00, run_start_date=2024-05-23 23:05:01.132514+00:00, run_end_date=2024-05-23 23:05:17.099996+00:00, run_duration=15.967482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:04:00+00:00, data_interval_end=2024-05-23 23:05:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:05:17.180909952Z [2024-05-23T23:05:17.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:05:00+00:00, run_after=2024-05-23T23:06:00+00:00 2024-05-23T23:05:19.051647174Z [2024-05-23T23:05:19.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status success for try_number 1 2024-05-23T23:05:19.085300735Z [2024-05-23T23:05:19.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:04:00+00:00, map_index=-1, run_start_date=2024-05-23 23:05:12.229220+00:00, run_end_date=2024-05-23 23:05:16.737709+00:00, run_duration=4.508489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:05:01.227780+00:00, queued_by_job_id=1, pid=2396 2024-05-23T23:05:23.546361658Z [2024-05-23T23:05:23.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:05:23.546403828Z 2024-05-23T23:05:23.546726902Z [2024-05-23T23:05:23.546+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:05:23.547326338Z [2024-05-23T23:05:23.547+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:05:23.547336868Z 2024-05-23T23:05:23.549715896Z [2024-05-23T23:05:23.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:05:23.551870010Z [2024-05-23T23:05:23.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:05:23.624832113Z [2024-05-23T23:05:23.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:05:23.628752533Z [2024-05-23T23:05:23.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:05:23.647750138Z [2024-05-23T23:05:23.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14fa8d0a-dc09-4f93-8216-063b27413dad 2024-05-23T23:05:23.650306531Z [2024-05-23T23:05:23.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=-1, run_start_date=2024-05-23 23:05:21.479849+00:00, run_end_date=2024-05-23 23:05:22.429935+00:00, run_duration=0.950086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:05:12.761984+00:00, queued_by_job_id=1, pid=2418 2024-05-23T23:05:26.969659558Z [2024-05-23T23:05:26.969+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:05:26.969681187Z 2024-05-23T23:05:26.969685704Z [2024-05-23T23:05:26.969+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:05:26.970273555Z [2024-05-23T23:05:26.970+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:05:26.970284421Z 2024-05-23T23:05:26.975206814Z [2024-05-23T23:05:26.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:05:26.975308174Z [2024-05-23T23:05:26.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:05:27.147699800Z [2024-05-23T23:05:27.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status queued for try_number 1 2024-05-23T23:05:27.156357529Z [2024-05-23T23:05:27.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a7dc29e-db82-4994-843a-f3370a8b7f6e 2024-05-23T23:05:27.268460155Z [2024-05-23T23:05:27.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:05:27.278675367Z [2024-05-23T23:05:27.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=0, run_start_date=2024-05-23 23:05:26.484574+00:00, run_end_date=2024-05-23 23:05:26.903398+00:00, run_duration=0.418824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:05:23.547810+00:00, queued_by_job_id=1, pid=2429 2024-05-23T23:05:30.659369512Z [2024-05-23T23:05:30.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:05:30.659400126Z [2024-05-23T23:05:30.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:00:00+00:00, run_id=scheduled__2024-05-23T23:00:00+00:00, run_start_date=2024-05-23 23:05:01.127334+00:00, run_end_date=2024-05-23 23:05:30.658032+00:00, run_duration=29.530698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:00:00+00:00, data_interval_end=2024-05-23 23:05:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:05:30.677146517Z [2024-05-23T23:05:30.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:05:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:05:30.734598187Z [2024-05-23T23:05:30.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:00:00+00:00 exited with status success for try_number 1 2024-05-23T23:05:30.734625587Z [2024-05-23T23:05:30.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:00:00+00:00, map_index=-1, run_start_date=2024-05-23 23:05:29.335748+00:00, run_end_date=2024-05-23 23:05:29.811776+00:00, run_duration=0.476028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:05:26.970551+00:00, queued_by_job_id=1, pid=2437 2024-05-23T23:06:00.061184657Z [2024-05-23T23:06:00.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:06:00.083289549Z [2024-05-23T23:06:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:06:00+00:00, run_after=2024-05-23T23:07:00+00:00 2024-05-23T23:06:00.093350943Z [2024-05-23T23:06:00.093+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:06:00.124260346Z [2024-05-23T23:06:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:06:00+00:00, run_after=2024-05-23T23:07:00+00:00 2024-05-23T23:06:00.237821233Z [2024-05-23T23:06:00.237+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:06:00.237852092Z 2024-05-23T23:06:00.237880318Z 2024-05-23T23:06:00.237886698Z 2024-05-23T23:06:00.237892690Z 2024-05-23T23:06:00.238053217Z [2024-05-23T23:06:00.237+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:06:00.238378382Z [2024-05-23T23:06:00.238+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:06:00.238792845Z [2024-05-23T23:06:00.238+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:06:00.239005905Z [2024-05-23T23:06:00.238+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:06:00.240821534Z [2024-05-23T23:06:00.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:06:00.240836438Z 2024-05-23T23:06:00.240841656Z 2024-05-23T23:06:00.240845738Z 2024-05-23T23:06:00.240850231Z 2024-05-23T23:06:00.245844401Z [2024-05-23T23:06:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:06:00.246158285Z [2024-05-23T23:06:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:06:00.246558476Z [2024-05-23T23:06:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:06:00.246805807Z [2024-05-23T23:06:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:06:00.247183989Z [2024-05-23T23:06:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:06:00.247549421Z [2024-05-23T23:06:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:06:00.247911020Z [2024-05-23T23:06:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:06:00.248151884Z [2024-05-23T23:06:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:06:00.723039813Z [2024-05-23T23:06:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status queued for try_number 1 2024-05-23T23:06:00.723259947Z [2024-05-23T23:06:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status queued for try_number 1 2024-05-23T23:06:00.723566653Z [2024-05-23T23:06:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status queued for try_number 1 2024-05-23T23:06:00.723756765Z [2024-05-23T23:06:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status queued for try_number 1 2024-05-23T23:06:00.737061280Z [2024-05-23T23:06:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcab8e11-526c-477b-bbf8-15d3f9a4ec4f 2024-05-23T23:06:00.737240981Z [2024-05-23T23:06:00.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23662078-bad2-4e35-853b-4b4fd599a8ad 2024-05-23T23:06:00.737511887Z [2024-05-23T23:06:00.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf47c1ef-babe-42dc-aacd-c7d9dd113768 2024-05-23T23:06:00.737746824Z [2024-05-23T23:06:00.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86722240-7ce7-4a2b-848e-465b2191777e 2024-05-23T23:06:03.221484464Z [2024-05-23T23:06:03.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:06:03.221857889Z [2024-05-23T23:06:03.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:04:00+00:00, run_id=scheduled__2024-05-23T23:04:00+00:00, run_start_date=2024-05-23 23:06:00.139628+00:00, run_end_date=2024-05-23 23:06:03.221361+00:00, run_duration=3.081733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:04:00+00:00, data_interval_end=2024-05-23 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:06:03.234438497Z [2024-05-23T23:06:03.233+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:06:00+00:00, run_after=2024-05-23T23:08:00+00:00 2024-05-23T23:06:03.248614340Z [2024-05-23T23:06:03.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:06:03.249205799Z [2024-05-23T23:06:03.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:05:00+00:00, run_id=scheduled__2024-05-23T23:05:00+00:00, run_start_date=2024-05-23 23:06:00.147976+00:00, run_end_date=2024-05-23 23:06:03.248550+00:00, run_duration=3.100574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:05:00+00:00, data_interval_end=2024-05-23 23:06:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:06:03.260768110Z [2024-05-23T23:06:03.260+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:06:00+00:00, run_after=2024-05-23T23:07:00+00:00 2024-05-23T23:06:03.328792559Z [2024-05-23T23:06:03.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:04:00+00:00 exited with status success for try_number 1 2024-05-23T23:06:03.328880895Z [2024-05-23T23:06:03.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status success for try_number 1 2024-05-23T23:06:03.337647948Z [2024-05-23T23:06:03.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:04:00+00:00, map_index=-1, run_start_date=2024-05-23 23:06:01.756018+00:00, run_end_date=2024-05-23 23:06:02.428158+00:00, run_duration=0.67214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:06:00.241972+00:00, queued_by_job_id=1, pid=2442 2024-05-23T23:06:03.338037224Z [2024-05-23T23:06:03.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:05:00+00:00, map_index=-1, run_start_date=2024-05-23 23:06:02.280372+00:00, run_end_date=2024-05-23 23:06:02.960972+00:00, run_duration=0.6806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:06:00.241972+00:00, queued_by_job_id=1, pid=2454 2024-05-23T23:06:05.521061727Z [2024-05-23T23:06:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:06:05.522083963Z [2024-05-23T23:06:05.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:05:00+00:00, run_id=scheduled__2024-05-23T23:05:00+00:00, run_start_date=2024-05-23 23:06:00.142251+00:00, run_end_date=2024-05-23 23:06:05.520922+00:00, run_duration=5.378671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:05:00+00:00, data_interval_end=2024-05-23 23:06:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:06:05.539907582Z [2024-05-23T23:06:05.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:06:00+00:00, run_after=2024-05-23T23:07:00+00:00 2024-05-23T23:06:05.556052520Z [2024-05-23T23:06:05.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:06:05.556494537Z [2024-05-23T23:06:05.556+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:05:00+00:00, run_id=scheduled__2024-05-23T23:05:00+00:00, run_start_date=2024-05-23 23:06:00.146022+00:00, run_end_date=2024-05-23 23:06:05.555963+00:00, run_duration=5.409941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:05:00+00:00, data_interval_end=2024-05-23 23:06:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:06:05.573086566Z [2024-05-23T23:06:05.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:06:00+00:00, run_after=2024-05-23T23:07:00+00:00 2024-05-23T23:06:05.605370775Z [2024-05-23T23:06:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status success for try_number 1 2024-05-23T23:06:05.605692768Z [2024-05-23T23:06:05.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status success for try_number 1 2024-05-23T23:06:05.613377668Z [2024-05-23T23:06:05.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:05:00+00:00, map_index=-1, run_start_date=2024-05-23 23:06:03.343060+00:00, run_end_date=2024-05-23 23:06:04.925471+00:00, run_duration=1.582411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:06:00.241972+00:00, queued_by_job_id=1, pid=2472 2024-05-23T23:06:05.613901739Z [2024-05-23T23:06:05.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:05:00+00:00, map_index=-1, run_start_date=2024-05-23 23:06:03.133888+00:00, run_end_date=2024-05-23 23:06:04.587644+00:00, run_duration=1.453756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:06:00.241972+00:00, queued_by_job_id=1, pid=2471 2024-05-23T23:06:39.155052718Z [2024-05-23T23:06:39.154+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:07:00.881487108Z [2024-05-23T23:07:00.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:07:00+00:00, run_after=2024-05-23T23:08:00+00:00 2024-05-23T23:07:00.889498932Z [2024-05-23T23:07:00.889+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:07:00.903067388Z [2024-05-23T23:07:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:07:00+00:00, run_after=2024-05-23T23:08:00+00:00 2024-05-23T23:07:00.990959690Z [2024-05-23T23:07:00.990+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:07:00.990993393Z 2024-05-23T23:07:00.990999641Z 2024-05-23T23:07:00.991005334Z 2024-05-23T23:07:00.991051556Z [2024-05-23T23:07:00.990+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:07:00.991187841Z [2024-05-23T23:07:00.991+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:07:00.991291179Z [2024-05-23T23:07:00.991+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:07:00.992211020Z [2024-05-23T23:07:00.991+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:07:00.992222458Z 2024-05-23T23:07:00.992228849Z 2024-05-23T23:07:00.992235316Z 2024-05-23T23:07:00.996585896Z [2024-05-23T23:07:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:07:00.996759395Z [2024-05-23T23:07:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:07:00.997030415Z [2024-05-23T23:07:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:07:00.997241663Z [2024-05-23T23:07:00.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:07:00.997460414Z [2024-05-23T23:07:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:07:00.997565649Z [2024-05-23T23:07:00.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:07:01.239958466Z [2024-05-23T23:07:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status queued for try_number 1 2024-05-23T23:07:01.240083273Z [2024-05-23T23:07:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status queued for try_number 1 2024-05-23T23:07:01.240178762Z [2024-05-23T23:07:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status queued for try_number 1 2024-05-23T23:07:01.247526291Z [2024-05-23T23:07:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1249e4a2-84ff-4146-aab8-7265dc90918c 2024-05-23T23:07:01.247668754Z [2024-05-23T23:07:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 391a9700-fe5e-4b1b-922c-bc666a36c094 2024-05-23T23:07:01.247796860Z [2024-05-23T23:07:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 027d27ad-46d3-4535-bd3d-4306777fd040 2024-05-23T23:07:02.807639518Z [2024-05-23T23:07:02.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:07:02.809593782Z [2024-05-23T23:07:02.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:06:00+00:00, run_id=scheduled__2024-05-23T23:06:00+00:00, run_start_date=2024-05-23 23:07:00.926967+00:00, run_end_date=2024-05-23 23:07:02.809073+00:00, run_duration=1.882106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:06:00+00:00, data_interval_end=2024-05-23 23:07:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:07:02.826453482Z [2024-05-23T23:07:02.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:07:00+00:00, run_after=2024-05-23T23:08:00+00:00 2024-05-23T23:07:02.900880719Z [2024-05-23T23:07:02.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status success for try_number 1 2024-05-23T23:07:02.908850632Z [2024-05-23T23:07:02.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:06:00+00:00, map_index=-1, run_start_date=2024-05-23 23:07:01.823689+00:00, run_end_date=2024-05-23 23:07:02.245089+00:00, run_duration=0.4214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:07:00.993005+00:00, queued_by_job_id=1, pid=2504 2024-05-23T23:07:05.083190115Z [2024-05-23T23:07:05.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:07:05.083364448Z [2024-05-23T23:07:05.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:06:00+00:00, run_id=scheduled__2024-05-23T23:06:00+00:00, run_start_date=2024-05-23 23:07:00.924560+00:00, run_end_date=2024-05-23 23:07:05.082871+00:00, run_duration=4.158311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:06:00+00:00, data_interval_end=2024-05-23 23:07:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:07:05.094754648Z [2024-05-23T23:07:05.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:07:00+00:00, run_after=2024-05-23T23:08:00+00:00 2024-05-23T23:07:05.102857596Z [2024-05-23T23:07:05.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:07:05.104093004Z [2024-05-23T23:07:05.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:06:00+00:00, run_id=scheduled__2024-05-23T23:06:00+00:00, run_start_date=2024-05-23 23:07:00.917616+00:00, run_end_date=2024-05-23 23:07:05.103088+00:00, run_duration=4.185472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:06:00+00:00, data_interval_end=2024-05-23 23:07:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:07:05.117099793Z [2024-05-23T23:07:05.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:07:00+00:00, run_after=2024-05-23T23:08:00+00:00 2024-05-23T23:07:05.162352497Z [2024-05-23T23:07:05.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status success for try_number 1 2024-05-23T23:07:05.162746892Z [2024-05-23T23:07:05.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status success for try_number 1 2024-05-23T23:07:05.172964652Z [2024-05-23T23:07:05.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:06:00+00:00, map_index=-1, run_start_date=2024-05-23 23:07:02.897715+00:00, run_end_date=2024-05-23 23:07:04.642791+00:00, run_duration=1.745076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:07:00.993005+00:00, queued_by_job_id=1, pid=2517 2024-05-23T23:07:05.173652122Z [2024-05-23T23:07:05.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:06:00+00:00, map_index=-1, run_start_date=2024-05-23 23:07:03.136119+00:00, run_end_date=2024-05-23 23:07:04.602840+00:00, run_duration=1.466721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:07:00.993005+00:00, queued_by_job_id=1, pid=2523 2024-05-23T23:08:00.851820817Z [2024-05-23T23:08:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:08:00+00:00, run_after=2024-05-23T23:09:00+00:00 2024-05-23T23:08:00.863678614Z [2024-05-23T23:08:00.863+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:08:00.879187147Z [2024-05-23T23:08:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:08:00+00:00, run_after=2024-05-23T23:09:00+00:00 2024-05-23T23:08:00.888813895Z [2024-05-23T23:08:00.888+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:08:01.023850684Z [2024-05-23T23:08:01.023+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:08:01.023899921Z 2024-05-23T23:08:01.023910567Z 2024-05-23T23:08:01.023919372Z 2024-05-23T23:08:01.023927882Z 2024-05-23T23:08:01.023937323Z [2024-05-23T23:08:01.023+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:08:01.024078238Z [2024-05-23T23:08:01.023+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:08:01.024091069Z [2024-05-23T23:08:01.023+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:08:01.024099610Z [2024-05-23T23:08:01.023+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:08:01.024967259Z [2024-05-23T23:08:01.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:08:01.024988044Z 2024-05-23T23:08:01.024998203Z 2024-05-23T23:08:01.025035768Z 2024-05-23T23:08:01.025044577Z 2024-05-23T23:08:01.029807874Z [2024-05-23T23:08:01.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:08:01.029993644Z [2024-05-23T23:08:01.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:08:01.030298419Z [2024-05-23T23:08:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:08:01.030405945Z [2024-05-23T23:08:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:08:01.031750845Z [2024-05-23T23:08:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:08:01.031917510Z [2024-05-23T23:08:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:08:01.032026597Z [2024-05-23T23:08:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:08:01.032037959Z [2024-05-23T23:08:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:08:01.391716564Z [2024-05-23T23:08:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status queued for try_number 1 2024-05-23T23:08:01.391794968Z [2024-05-23T23:08:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:07:00+00:00 exited with status queued for try_number 1 2024-05-23T23:08:01.391804773Z [2024-05-23T23:08:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:07:00+00:00 exited with status queued for try_number 1 2024-05-23T23:08:01.391838574Z [2024-05-23T23:08:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:07:00+00:00 exited with status queued for try_number 1 2024-05-23T23:08:01.411789422Z [2024-05-23T23:08:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to c42df0fd-11ec-4edc-baa6-b1114bbae79d 2024-05-23T23:08:01.411930370Z [2024-05-23T23:08:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to c48486f6-1052-4cc4-aaad-4db87b984136 2024-05-23T23:08:01.412046634Z [2024-05-23T23:08:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to f80e68c1-c164-42e2-ab7a-cb3b2d1045a1 2024-05-23T23:08:01.412154413Z [2024-05-23T23:08:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1ee67ef-3130-4b4a-b825-4df19e52d09c 2024-05-23T23:08:02.775533738Z [2024-05-23T23:08:02.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:08:02.775679635Z [2024-05-23T23:08:02.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:07:00+00:00, run_id=scheduled__2024-05-23T23:07:00+00:00, run_start_date=2024-05-23 23:08:00.903982+00:00, run_end_date=2024-05-23 23:08:02.775433+00:00, run_duration=1.871451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:07:00+00:00, data_interval_end=2024-05-23 23:08:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:08:02.813447586Z [2024-05-23T23:08:02.808+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:08:00+00:00, run_after=2024-05-23T23:09:00+00:00 2024-05-23T23:08:02.928150297Z [2024-05-23T23:08:02.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:07:00+00:00 exited with status success for try_number 1 2024-05-23T23:08:02.945762868Z [2024-05-23T23:08:02.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:07:00+00:00, map_index=-1, run_start_date=2024-05-23 23:08:02.021484+00:00, run_end_date=2024-05-23 23:08:02.527808+00:00, run_duration=0.506324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:08:01.025824+00:00, queued_by_job_id=1, pid=2556 2024-05-23T23:08:04.053389259Z [2024-05-23T23:08:04.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:08:04.053820928Z [2024-05-23T23:08:04.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:06:00+00:00, run_id=scheduled__2024-05-23T23:06:00+00:00, run_start_date=2024-05-23 23:08:00.901939+00:00, run_end_date=2024-05-23 23:08:04.053517+00:00, run_duration=3.151578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:06:00+00:00, data_interval_end=2024-05-23 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:08:04.061148963Z [2024-05-23T23:08:04.060+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:08:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:08:04.111666499Z [2024-05-23T23:08:04.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:06:00+00:00 exited with status success for try_number 1 2024-05-23T23:08:04.117544688Z [2024-05-23T23:08:04.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:06:00+00:00, map_index=-1, run_start_date=2024-05-23 23:08:02.409649+00:00, run_end_date=2024-05-23 23:08:03.069184+00:00, run_duration=0.659535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:08:01.025824+00:00, queued_by_job_id=1, pid=2562 2024-05-23T23:08:06.265344803Z [2024-05-23T23:08:06.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:08:06.265603503Z [2024-05-23T23:08:06.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:07:00+00:00, run_id=scheduled__2024-05-23T23:07:00+00:00, run_start_date=2024-05-23 23:08:00.906841+00:00, run_end_date=2024-05-23 23:08:06.265283+00:00, run_duration=5.358442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:07:00+00:00, data_interval_end=2024-05-23 23:08:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:08:06.274868142Z [2024-05-23T23:08:06.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:08:00+00:00, run_after=2024-05-23T23:09:00+00:00 2024-05-23T23:08:06.282918577Z [2024-05-23T23:08:06.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:08:06.283116635Z [2024-05-23T23:08:06.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:07:00+00:00, run_id=scheduled__2024-05-23T23:07:00+00:00, run_start_date=2024-05-23 23:08:00.905555+00:00, run_end_date=2024-05-23 23:08:06.282859+00:00, run_duration=5.377304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:07:00+00:00, data_interval_end=2024-05-23 23:08:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:08:06.292978324Z [2024-05-23T23:08:06.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:08:00+00:00, run_after=2024-05-23T23:09:00+00:00 2024-05-23T23:08:06.327071598Z [2024-05-23T23:08:06.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:07:00+00:00 exited with status success for try_number 1 2024-05-23T23:08:06.327252354Z [2024-05-23T23:08:06.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:07:00+00:00 exited with status success for try_number 1 2024-05-23T23:08:06.335268003Z [2024-05-23T23:08:06.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:07:00+00:00, map_index=-1, run_start_date=2024-05-23 23:08:03.660678+00:00, run_end_date=2024-05-23 23:08:05.479195+00:00, run_duration=1.818517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:08:01.025824+00:00, queued_by_job_id=1, pid=2575 2024-05-23T23:08:06.335749846Z [2024-05-23T23:08:06.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:07:00+00:00, map_index=-1, run_start_date=2024-05-23 23:08:04.052948+00:00, run_end_date=2024-05-23 23:08:05.404297+00:00, run_duration=1.351349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:08:01.025824+00:00, queued_by_job_id=1, pid=2586 2024-05-23T23:09:00.965632277Z [2024-05-23T23:09:00.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:09:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:09:00.975119616Z [2024-05-23T23:09:00.974+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:09:00.992686461Z [2024-05-23T23:09:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:09:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:09:01.090670185Z [2024-05-23T23:09:01.090+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:09:01.090700584Z 2024-05-23T23:09:01.090706210Z 2024-05-23T23:09:01.090710804Z 2024-05-23T23:09:01.091043130Z [2024-05-23T23:09:01.090+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:09:01.091336117Z [2024-05-23T23:09:01.091+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:09:01.091605589Z [2024-05-23T23:09:01.091+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:09:01.092477526Z [2024-05-23T23:09:01.092+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:09:01.092493910Z 2024-05-23T23:09:01.092500266Z 2024-05-23T23:09:01.092505918Z 2024-05-23T23:09:01.104793954Z [2024-05-23T23:09:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:09:01.105465958Z [2024-05-23T23:09:01.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:09:01.105984120Z [2024-05-23T23:09:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:09:01.106268573Z [2024-05-23T23:09:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:09:01.106783454Z [2024-05-23T23:09:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:09:01.107270954Z [2024-05-23T23:09:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:09:01.344792415Z [2024-05-23T23:09:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status queued for try_number 1 2024-05-23T23:09:01.345149989Z [2024-05-23T23:09:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status queued for try_number 1 2024-05-23T23:09:01.345390036Z [2024-05-23T23:09:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status queued for try_number 1 2024-05-23T23:09:01.355054938Z [2024-05-23T23:09:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to cee49bd9-988c-475a-8476-bbbbf0bdfd1c 2024-05-23T23:09:01.355449181Z [2024-05-23T23:09:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 797a4990-a7c0-4709-b2fb-1f2fe18986d4 2024-05-23T23:09:01.355705978Z [2024-05-23T23:09:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0f91ea0-90bd-4bbf-9ac3-4f1cb9de47ab 2024-05-23T23:09:02.499541941Z [2024-05-23T23:09:02.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:09:02.500000429Z [2024-05-23T23:09:02.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:08:00+00:00, run_id=scheduled__2024-05-23T23:08:00+00:00, run_start_date=2024-05-23 23:09:01.008740+00:00, run_end_date=2024-05-23 23:09:02.499445+00:00, run_duration=1.490705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:08:00+00:00, data_interval_end=2024-05-23 23:09:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:09:02.509380196Z [2024-05-23T23:09:02.509+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:09:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:09:03.649340869Z [2024-05-23T23:09:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status success for try_number 1 2024-05-23T23:09:03.655820286Z [2024-05-23T23:09:03.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:08:00+00:00, map_index=-1, run_start_date=2024-05-23 23:09:02.012073+00:00, run_end_date=2024-05-23 23:09:02.423886+00:00, run_duration=0.411813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:09:01.093502+00:00, queued_by_job_id=1, pid=2614 2024-05-23T23:09:05.007531536Z [2024-05-23T23:09:05.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:09:05.008268204Z [2024-05-23T23:09:05.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:08:00+00:00, run_id=scheduled__2024-05-23T23:08:00+00:00, run_start_date=2024-05-23 23:09:01.010954+00:00, run_end_date=2024-05-23 23:09:05.007861+00:00, run_duration=3.996907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:08:00+00:00, data_interval_end=2024-05-23 23:09:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:09:05.020544983Z [2024-05-23T23:09:05.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:09:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:09:05.062758671Z [2024-05-23T23:09:05.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status success for try_number 1 2024-05-23T23:09:05.070710442Z [2024-05-23T23:09:05.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:08:00+00:00, map_index=-1, run_start_date=2024-05-23 23:09:02.974226+00:00, run_end_date=2024-05-23 23:09:04.670543+00:00, run_duration=1.696317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:09:01.093502+00:00, queued_by_job_id=1, pid=2632 2024-05-23T23:09:06.137238850Z [2024-05-23T23:09:06.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:09:06.137688054Z [2024-05-23T23:09:06.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:08:00+00:00, run_id=scheduled__2024-05-23T23:08:00+00:00, run_start_date=2024-05-23 23:09:01.014167+00:00, run_end_date=2024-05-23 23:09:06.137346+00:00, run_duration=5.123179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:08:00+00:00, data_interval_end=2024-05-23 23:09:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:09:06.148441989Z [2024-05-23T23:09:06.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:09:00+00:00, run_after=2024-05-23T23:10:00+00:00 2024-05-23T23:09:06.188922887Z [2024-05-23T23:09:06.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status success for try_number 1 2024-05-23T23:09:06.194451927Z [2024-05-23T23:09:06.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:08:00+00:00, map_index=-1, run_start_date=2024-05-23 23:09:03.087825+00:00, run_end_date=2024-05-23 23:09:05.634588+00:00, run_duration=2.546763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:09:01.093502+00:00, queued_by_job_id=1, pid=2633 2024-05-23T23:10:00.873092159Z [2024-05-23T23:10:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:11:00+00:00 2024-05-23T23:10:00.890833521Z [2024-05-23T23:10:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:11:00+00:00 2024-05-23T23:10:00.899923136Z [2024-05-23T23:10:00.899+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:10:00.909077683Z [2024-05-23T23:10:00.908+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:10:00.934675280Z [2024-05-23T23:10:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:15:00+00:00 2024-05-23T23:10:01.041230845Z [2024-05-23T23:10:01.040+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T23:10:01.041313494Z 2024-05-23T23:10:01.041331045Z 2024-05-23T23:10:01.041338252Z 2024-05-23T23:10:01.041343916Z 2024-05-23T23:10:01.041349676Z 2024-05-23T23:10:01.041382011Z [2024-05-23T23:10:01.040+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:10:01.041388734Z [2024-05-23T23:10:01.040+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:10:01.041394478Z [2024-05-23T23:10:01.040+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:10:01.041416020Z [2024-05-23T23:10:01.041+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:10:01.041439340Z [2024-05-23T23:10:01.041+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:10:01.041787112Z [2024-05-23T23:10:01.041+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:10:01.041800067Z 2024-05-23T23:10:01.041806700Z 2024-05-23T23:10:01.041819955Z 2024-05-23T23:10:01.041825823Z 2024-05-23T23:10:01.041831748Z 2024-05-23T23:10:01.046691561Z [2024-05-23T23:10:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:10:01.046746038Z [2024-05-23T23:10:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:10:01.046948499Z [2024-05-23T23:10:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:10:01.047017203Z [2024-05-23T23:10:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:10:01.047208899Z [2024-05-23T23:10:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:10:01.047221066Z [2024-05-23T23:10:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:10:01.047400810Z [2024-05-23T23:10:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:10:01.047445721Z [2024-05-23T23:10:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:10:01.047620412Z [2024-05-23T23:10:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:10:01.047640164Z [2024-05-23T23:10:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:10:01.713496193Z [2024-05-23T23:10:01.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:01.713668513Z [2024-05-23T23:10:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:01.713829069Z [2024-05-23T23:10:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:09:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:01.713953702Z [2024-05-23T23:10:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:09:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:01.714089912Z [2024-05-23T23:10:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:09:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:01.722294310Z [2024-05-23T23:10:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4445df7-693b-4140-8509-81ca671b620a 2024-05-23T23:10:01.722541707Z [2024-05-23T23:10:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05708b14-f1a6-457e-b683-5b97ecde1f19 2024-05-23T23:10:01.723010388Z [2024-05-23T23:10:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to cac92675-bbfc-483f-9058-59c2236cfee8 2024-05-23T23:10:01.723245590Z [2024-05-23T23:10:01.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to f09f6959-d3d1-4292-b08d-7398d2d112e1 2024-05-23T23:10:01.723443179Z [2024-05-23T23:10:01.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c64ca92-5852-41b3-913f-231812d3ed79 2024-05-23T23:10:02.892461731Z [2024-05-23T23:10:02.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:10:02.893073085Z [2024-05-23T23:10:02.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:09:00+00:00, run_id=scheduled__2024-05-23T23:09:00+00:00, run_start_date=2024-05-23 23:10:00.950767+00:00, run_end_date=2024-05-23 23:10:02.892431+00:00, run_duration=1.941664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:09:00+00:00, data_interval_end=2024-05-23 23:10:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:10:02.903028567Z [2024-05-23T23:10:02.902+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:11:00+00:00 2024-05-23T23:10:02.923229550Z [2024-05-23T23:10:02.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:10:02.924137726Z [2024-05-23T23:10:02.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:08:00+00:00, run_id=scheduled__2024-05-23T23:08:00+00:00, run_start_date=2024-05-23 23:10:00.949545+00:00, run_end_date=2024-05-23 23:10:02.923542+00:00, run_duration=1.973997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:08:00+00:00, data_interval_end=2024-05-23 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:10:02.937567969Z [2024-05-23T23:10:02.937+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:12:00+00:00 2024-05-23T23:10:03.035887330Z [2024-05-23T23:10:03.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:09:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:03.049159688Z [2024-05-23T23:10:03.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:09:00+00:00, map_index=-1, run_start_date=2024-05-23 23:10:01.948963+00:00, run_end_date=2024-05-23 23:10:02.510153+00:00, run_duration=0.56119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:01.042637+00:00, queued_by_job_id=1, pid=2667 2024-05-23T23:10:04.157434373Z [2024-05-23T23:10:04.157+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:10:04.157493597Z 2024-05-23T23:10:04.157631068Z [2024-05-23T23:10:04.157+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:10:04.158612446Z [2024-05-23T23:10:04.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:10:04.158641159Z 2024-05-23T23:10:04.161494624Z [2024-05-23T23:10:04.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:10:04.161833119Z [2024-05-23T23:10:04.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:10:04.227333946Z [2024-05-23T23:10:04.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:04.227541598Z [2024-05-23T23:10:04.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:04.227705324Z [2024-05-23T23:10:04.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:08:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:04.233830242Z [2024-05-23T23:10:04.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:05:00+00:00, map_index=-1, run_start_date=2024-05-23 23:10:03.194212+00:00, run_end_date=2024-05-23 23:10:03.584182+00:00, run_duration=0.38997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:01.042637+00:00, queued_by_job_id=1, pid=2687 2024-05-23T23:10:04.234106123Z [2024-05-23T23:10:04.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 386a3865-4c98-40f8-9526-aeeff4af149b 2024-05-23T23:10:04.234286160Z [2024-05-23T23:10:04.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:08:00+00:00, map_index=-1, run_start_date=2024-05-23 23:10:02.272627+00:00, run_end_date=2024-05-23 23:10:02.844974+00:00, run_duration=0.572347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:01.042637+00:00, queued_by_job_id=1, pid=2669 2024-05-23T23:10:04.875836029Z [2024-05-23T23:10:04.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:10:04.876430088Z [2024-05-23T23:10:04.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:09:00+00:00, run_id=scheduled__2024-05-23T23:09:00+00:00, run_start_date=2024-05-23 23:10:00.951875+00:00, run_end_date=2024-05-23 23:10:04.876084+00:00, run_duration=3.924209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:09:00+00:00, data_interval_end=2024-05-23 23:10:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:10:04.888132136Z [2024-05-23T23:10:04.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:11:00+00:00 2024-05-23T23:10:05.995359659Z [2024-05-23T23:10:05.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:10:05.995765675Z [2024-05-23T23:10:05.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:09:00+00:00, run_id=scheduled__2024-05-23T23:09:00+00:00, run_start_date=2024-05-23 23:10:00.953051+00:00, run_end_date=2024-05-23 23:10:05.995224+00:00, run_duration=5.042173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:09:00+00:00, data_interval_end=2024-05-23 23:10:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:10:06.005761387Z [2024-05-23T23:10:06.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:11:00+00:00 2024-05-23T23:10:06.065539515Z [2024-05-23T23:10:06.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:09:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:06.065992826Z [2024-05-23T23:10:06.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:09:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:06.077588872Z [2024-05-23T23:10:06.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:09:00+00:00, map_index=-1, run_start_date=2024-05-23 23:10:03.520746+00:00, run_end_date=2024-05-23 23:10:04.825904+00:00, run_duration=1.305158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:01.042637+00:00, queued_by_job_id=1, pid=2704 2024-05-23T23:10:06.077996795Z [2024-05-23T23:10:06.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:09:00+00:00, map_index=-1, run_start_date=2024-05-23 23:10:03.469599+00:00, run_end_date=2024-05-23 23:10:05.327415+00:00, run_duration=1.857816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:01.042637+00:00, queued_by_job_id=1, pid=2698 2024-05-23T23:10:07.149904564Z [2024-05-23T23:10:07.149+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:10:07.149932373Z 2024-05-23T23:10:07.149981014Z [2024-05-23T23:10:07.149+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:10:07.150628048Z [2024-05-23T23:10:07.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:10:07.150638390Z 2024-05-23T23:10:07.155374371Z [2024-05-23T23:10:07.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:10:07.156554411Z [2024-05-23T23:10:07.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:10:07.221948942Z [2024-05-23T23:10:07.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:07.222015515Z [2024-05-23T23:10:07.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:07.227466530Z [2024-05-23T23:10:07.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b21d110-ba59-408d-8357-61436c26fc04 2024-05-23T23:10:07.227631890Z [2024-05-23T23:10:07.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:05:00+00:00, map_index=-1, run_start_date=2024-05-23 23:10:05.873144+00:00, run_end_date=2024-05-23 23:10:06.283129+00:00, run_duration=0.409985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:04.159132+00:00, queued_by_job_id=1, pid=2722 2024-05-23T23:10:09.956084007Z [2024-05-23T23:10:09.955+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:10:09.956134844Z 2024-05-23T23:10:09.956146017Z [2024-05-23T23:10:09.955+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:10:09.956708175Z [2024-05-23T23:10:09.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:10:09.956723529Z 2024-05-23T23:10:09.958811873Z [2024-05-23T23:10:09.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:10:09.959017675Z [2024-05-23T23:10:09.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:10:10.026304492Z [2024-05-23T23:10:10.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status queued for try_number 1 2024-05-23T23:10:10.026719814Z [2024-05-23T23:10:10.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:10.033458225Z [2024-05-23T23:10:10.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96f36f00-1628-4328-8c14-389d81c318e0 2024-05-23T23:10:10.033918225Z [2024-05-23T23:10:10.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:05:00+00:00, map_index=0, run_start_date=2024-05-23 23:10:08.920090+00:00, run_end_date=2024-05-23 23:10:09.311439+00:00, run_duration=0.391349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:07.151460+00:00, queued_by_job_id=1, pid=2730 2024-05-23T23:10:12.303807702Z [2024-05-23T23:10:12.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:10:12.303884013Z [2024-05-23T23:10:12.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:05:00+00:00, run_id=scheduled__2024-05-23T23:05:00+00:00, run_start_date=2024-05-23 23:10:00.948071+00:00, run_end_date=2024-05-23 23:10:12.303537+00:00, run_duration=11.355466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:05:00+00:00, data_interval_end=2024-05-23 23:10:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:10:12.310228799Z [2024-05-23T23:10:12.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:10:00+00:00, run_after=2024-05-23T23:15:00+00:00 2024-05-23T23:10:12.357239912Z [2024-05-23T23:10:12.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:05:00+00:00 exited with status success for try_number 1 2024-05-23T23:10:12.367549983Z [2024-05-23T23:10:12.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:05:00+00:00, map_index=-1, run_start_date=2024-05-23 23:10:11.636992+00:00, run_end_date=2024-05-23 23:10:12.067587+00:00, run_duration=0.430595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:10:09.957072+00:00, queued_by_job_id=1, pid=2738 2024-05-23T23:11:00.195604653Z [2024-05-23T23:11:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:11:00+00:00, run_after=2024-05-23T23:12:00+00:00 2024-05-23T23:11:00.205478841Z [2024-05-23T23:11:00.205+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:11:00.219050986Z [2024-05-23T23:11:00.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:11:00+00:00, run_after=2024-05-23T23:12:00+00:00 2024-05-23T23:11:00.273447752Z [2024-05-23T23:11:00.272+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:11:00.273474683Z 2024-05-23T23:11:00.273478855Z 2024-05-23T23:11:00.273482422Z 2024-05-23T23:11:00.273631635Z [2024-05-23T23:11:00.273+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:11:00.273825480Z [2024-05-23T23:11:00.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:11:00.273955543Z [2024-05-23T23:11:00.273+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:11:00.274825455Z [2024-05-23T23:11:00.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:11:00.274839111Z 2024-05-23T23:11:00.274842930Z 2024-05-23T23:11:00.274846436Z 2024-05-23T23:11:00.278185051Z [2024-05-23T23:11:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:11:00.278402852Z [2024-05-23T23:11:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:11:00.278767338Z [2024-05-23T23:11:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:11:00.278911128Z [2024-05-23T23:11:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:11:00.279494004Z [2024-05-23T23:11:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:11:00.279633558Z [2024-05-23T23:11:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:11:00.507369850Z [2024-05-23T23:11:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:11:00.507408315Z [2024-05-23T23:11:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:11:00.507425517Z [2024-05-23T23:11:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:11:00.518137488Z [2024-05-23T23:11:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e7bea98-51c8-481b-a34f-93e0cfe367ba 2024-05-23T23:11:00.518220795Z [2024-05-23T23:11:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ae07f63-478c-47cc-a3a7-cb977d406195 2024-05-23T23:11:00.518225461Z [2024-05-23T23:11:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1eaa0deb-f08e-470b-bd98-32b8585f8c9b 2024-05-23T23:11:01.910972236Z [2024-05-23T23:11:01.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:11:01.911745227Z [2024-05-23T23:11:01.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:10:00+00:00, run_id=scheduled__2024-05-23T23:10:00+00:00, run_start_date=2024-05-23 23:11:00.228290+00:00, run_end_date=2024-05-23 23:11:01.910856+00:00, run_duration=1.682566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:10:00+00:00, data_interval_end=2024-05-23 23:11:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:11:01.925280196Z [2024-05-23T23:11:01.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:11:00+00:00, run_after=2024-05-23T23:12:00+00:00 2024-05-23T23:11:01.976027130Z [2024-05-23T23:11:01.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:11:01.982153706Z [2024-05-23T23:11:01.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=-1, run_start_date=2024-05-23 23:11:01.229240+00:00, run_end_date=2024-05-23 23:11:01.615282+00:00, run_duration=0.386042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:11:00.275511+00:00, queued_by_job_id=1, pid=2759 2024-05-23T23:11:04.164016566Z [2024-05-23T23:11:04.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:11:04.164352594Z [2024-05-23T23:11:04.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:10:00+00:00, run_id=scheduled__2024-05-23T23:10:00+00:00, run_start_date=2024-05-23 23:11:00.229571+00:00, run_end_date=2024-05-23 23:11:04.163816+00:00, run_duration=3.934245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:10:00+00:00, data_interval_end=2024-05-23 23:11:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:11:04.176685717Z [2024-05-23T23:11:04.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:11:00+00:00, run_after=2024-05-23T23:12:00+00:00 2024-05-23T23:11:04.184655372Z [2024-05-23T23:11:04.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:11:04.184772859Z [2024-05-23T23:11:04.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:10:00+00:00, run_id=scheduled__2024-05-23T23:10:00+00:00, run_start_date=2024-05-23 23:11:00.230645+00:00, run_end_date=2024-05-23 23:11:04.184423+00:00, run_duration=3.953778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:10:00+00:00, data_interval_end=2024-05-23 23:11:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:11:04.194064727Z [2024-05-23T23:11:04.193+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:11:00+00:00, run_after=2024-05-23T23:12:00+00:00 2024-05-23T23:11:04.235720613Z [2024-05-23T23:11:04.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:11:04.235982171Z [2024-05-23T23:11:04.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:11:04.249319959Z [2024-05-23T23:11:04.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=-1, run_start_date=2024-05-23 23:11:02.159920+00:00, run_end_date=2024-05-23 23:11:03.348034+00:00, run_duration=1.188114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:11:00.275511+00:00, queued_by_job_id=1, pid=2778 2024-05-23T23:11:04.249589485Z [2024-05-23T23:11:04.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=-1, run_start_date=2024-05-23 23:11:02.164983+00:00, run_end_date=2024-05-23 23:11:03.822374+00:00, run_duration=1.657391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:11:00.275511+00:00, queued_by_job_id=1, pid=2777 2024-05-23T23:11:39.217251060Z [2024-05-23T23:11:39.216+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:12:00.544282518Z [2024-05-23T23:12:00.543+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:12:00+00:00, run_after=2024-05-23T23:13:00+00:00 2024-05-23T23:12:00.560303951Z [2024-05-23T23:12:00.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:12:00+00:00, run_after=2024-05-23T23:13:00+00:00 2024-05-23T23:12:00.567768384Z [2024-05-23T23:12:00.567+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:12:00.574301706Z [2024-05-23T23:12:00.573+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:12:00.667642770Z [2024-05-23T23:12:00.667+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:12:00.667669223Z 2024-05-23T23:12:00.667675279Z 2024-05-23T23:12:00.667679638Z 2024-05-23T23:12:00.667684379Z 2024-05-23T23:12:00.668030809Z [2024-05-23T23:12:00.667+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:12:00.668232625Z [2024-05-23T23:12:00.668+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:12:00.668403783Z [2024-05-23T23:12:00.668+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:12:00.668603794Z [2024-05-23T23:12:00.668+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:12:00.669528735Z [2024-05-23T23:12:00.669+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:12:00.669537521Z 2024-05-23T23:12:00.669542234Z 2024-05-23T23:12:00.669546557Z 2024-05-23T23:12:00.669550651Z 2024-05-23T23:12:00.673934021Z [2024-05-23T23:12:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:12:00.674126266Z [2024-05-23T23:12:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:12:00.674535618Z [2024-05-23T23:12:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:12:00.674678521Z [2024-05-23T23:12:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:12:00.674902586Z [2024-05-23T23:12:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:12:00.675020451Z [2024-05-23T23:12:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:12:00.675222183Z [2024-05-23T23:12:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:12:00.675330810Z [2024-05-23T23:12:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:12:01.065141392Z [2024-05-23T23:12:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:12:01.067366226Z [2024-05-23T23:12:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:11:00+00:00 exited with status queued for try_number 1 2024-05-23T23:12:01.067624179Z [2024-05-23T23:12:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:11:00+00:00 exited with status queued for try_number 1 2024-05-23T23:12:01.067791765Z [2024-05-23T23:12:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:11:00+00:00 exited with status queued for try_number 1 2024-05-23T23:12:01.080746212Z [2024-05-23T23:12:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 481aac47-c749-42ca-8922-56e51b9aeaf7 2024-05-23T23:12:01.083369614Z [2024-05-23T23:12:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3363128-9af1-498c-8a53-dd1f636cc4ba 2024-05-23T23:12:01.084465147Z [2024-05-23T23:12:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to d10581f4-e5cd-45d9-af8f-3452ef90117e 2024-05-23T23:12:01.084951484Z [2024-05-23T23:12:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 214d695a-f4b4-4a81-877a-71d6fb91946d 2024-05-23T23:12:02.940371038Z [2024-05-23T23:12:02.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:12:02.941079597Z [2024-05-23T23:12:02.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:10:00+00:00, run_id=scheduled__2024-05-23T23:10:00+00:00, run_start_date=2024-05-23 23:12:00.586201+00:00, run_end_date=2024-05-23 23:12:02.940249+00:00, run_duration=2.354048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:10:00+00:00, data_interval_end=2024-05-23 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:12:02.950278249Z [2024-05-23T23:12:02.949+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:12:00+00:00, run_after=2024-05-23T23:14:00+00:00 2024-05-23T23:12:02.957251714Z [2024-05-23T23:12:02.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:12:02.957548494Z [2024-05-23T23:12:02.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:11:00+00:00, run_id=scheduled__2024-05-23T23:11:00+00:00, run_start_date=2024-05-23 23:12:00.589353+00:00, run_end_date=2024-05-23 23:12:02.957110+00:00, run_duration=2.367757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:11:00+00:00, data_interval_end=2024-05-23 23:12:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:12:02.967161525Z [2024-05-23T23:12:02.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:12:00+00:00, run_after=2024-05-23T23:13:00+00:00 2024-05-23T23:12:03.032347406Z [2024-05-23T23:12:03.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:12:03.034584620Z [2024-05-23T23:12:03.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:11:00+00:00 exited with status success for try_number 1 2024-05-23T23:12:03.041819181Z [2024-05-23T23:12:03.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=-1, run_start_date=2024-05-23 23:12:01.657433+00:00, run_end_date=2024-05-23 23:12:02.145695+00:00, run_duration=0.488262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:12:00.670785+00:00, queued_by_job_id=1, pid=2811 2024-05-23T23:12:03.042187035Z [2024-05-23T23:12:03.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:11:00+00:00, map_index=-1, run_start_date=2024-05-23 23:12:01.953171+00:00, run_end_date=2024-05-23 23:12:02.379429+00:00, run_duration=0.426258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:12:00.670785+00:00, queued_by_job_id=1, pid=2812 2024-05-23T23:12:05.231701801Z [2024-05-23T23:12:05.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:12:05.231802178Z [2024-05-23T23:12:05.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:11:00+00:00, run_id=scheduled__2024-05-23T23:11:00+00:00, run_start_date=2024-05-23 23:12:00.593232+00:00, run_end_date=2024-05-23 23:12:05.231577+00:00, run_duration=4.638345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:11:00+00:00, data_interval_end=2024-05-23 23:12:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:12:05.240232972Z [2024-05-23T23:12:05.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:12:00+00:00, run_after=2024-05-23T23:13:00+00:00 2024-05-23T23:12:05.246444325Z [2024-05-23T23:12:05.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:12:05.246619073Z [2024-05-23T23:12:05.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:11:00+00:00, run_id=scheduled__2024-05-23T23:11:00+00:00, run_start_date=2024-05-23 23:12:00.596905+00:00, run_end_date=2024-05-23 23:12:05.246380+00:00, run_duration=4.649475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:11:00+00:00, data_interval_end=2024-05-23 23:12:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:12:05.255443390Z [2024-05-23T23:12:05.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:12:00+00:00, run_after=2024-05-23T23:13:00+00:00 2024-05-23T23:12:05.287961611Z [2024-05-23T23:12:05.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:11:00+00:00 exited with status success for try_number 1 2024-05-23T23:12:05.288003077Z [2024-05-23T23:12:05.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:11:00+00:00 exited with status success for try_number 1 2024-05-23T23:12:05.294702994Z [2024-05-23T23:12:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:11:00+00:00, map_index=-1, run_start_date=2024-05-23 23:12:02.897025+00:00, run_end_date=2024-05-23 23:12:04.275676+00:00, run_duration=1.378651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:12:00.670785+00:00, queued_by_job_id=1, pid=2830 2024-05-23T23:12:05.295149049Z [2024-05-23T23:12:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:11:00+00:00, map_index=-1, run_start_date=2024-05-23 23:12:03.205814+00:00, run_end_date=2024-05-23 23:12:05.022637+00:00, run_duration=1.816823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:12:00.670785+00:00, queued_by_job_id=1, pid=2841 2024-05-23T23:13:00.913763661Z [2024-05-23T23:13:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:13:00+00:00, run_after=2024-05-23T23:14:00+00:00 2024-05-23T23:13:00.954615312Z [2024-05-23T23:13:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:13:00+00:00, run_after=2024-05-23T23:14:00+00:00 2024-05-23T23:13:00.954656412Z [2024-05-23T23:13:00.950+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:13:01.019412154Z [2024-05-23T23:13:01.018+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:13:01.019449389Z 2024-05-23T23:13:01.019453132Z 2024-05-23T23:13:01.019457585Z 2024-05-23T23:13:01.019614635Z [2024-05-23T23:13:01.019+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:13:01.019820561Z [2024-05-23T23:13:01.019+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:13:01.019988280Z [2024-05-23T23:13:01.019+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:13:01.020691107Z [2024-05-23T23:13:01.020+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:13:01.020702447Z 2024-05-23T23:13:01.020705870Z 2024-05-23T23:13:01.020709198Z 2024-05-23T23:13:01.026389360Z [2024-05-23T23:13:01.024+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:13:01.026407110Z [2024-05-23T23:13:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:13:01.026413179Z [2024-05-23T23:13:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:13:01.026428255Z [2024-05-23T23:13:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:13:01.026442355Z [2024-05-23T23:13:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:13:01.026448993Z [2024-05-23T23:13:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:13:01.273278439Z [2024-05-23T23:13:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status queued for try_number 1 2024-05-23T23:13:01.273316073Z [2024-05-23T23:13:01.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status queued for try_number 1 2024-05-23T23:13:01.273430971Z [2024-05-23T23:13:01.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status queued for try_number 1 2024-05-23T23:13:01.281149891Z [2024-05-23T23:13:01.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b394573-0a3c-4af3-9ea5-1f225de81e59 2024-05-23T23:13:01.281498057Z [2024-05-23T23:13:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe59f41c-9672-48e5-b0d3-2e45ff2db764 2024-05-23T23:13:01.281667874Z [2024-05-23T23:13:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74fb42f6-00b0-41c6-8a03-405879209de3 2024-05-23T23:13:02.418714128Z [2024-05-23T23:13:02.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:13:02.419359570Z [2024-05-23T23:13:02.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:12:00+00:00, run_id=scheduled__2024-05-23T23:12:00+00:00, run_start_date=2024-05-23 23:13:00.961342+00:00, run_end_date=2024-05-23 23:13:02.418918+00:00, run_duration=1.457576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:12:00+00:00, data_interval_end=2024-05-23 23:13:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:13:02.430460304Z [2024-05-23T23:13:02.430+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:13:00+00:00, run_after=2024-05-23T23:14:00+00:00 2024-05-23T23:13:02.883056099Z [2024-05-23T23:13:02.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status success for try_number 1 2024-05-23T23:13:02.889470803Z [2024-05-23T23:13:02.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:12:00+00:00, map_index=-1, run_start_date=2024-05-23 23:13:01.871682+00:00, run_end_date=2024-05-23 23:13:02.347282+00:00, run_duration=0.4756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:13:01.021478+00:00, queued_by_job_id=1, pid=2869 2024-05-23T23:13:05.061611622Z [2024-05-23T23:13:05.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:13:05.061679237Z [2024-05-23T23:13:05.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:12:00+00:00, run_id=scheduled__2024-05-23T23:12:00+00:00, run_start_date=2024-05-23 23:13:00.963075+00:00, run_end_date=2024-05-23 23:13:05.061203+00:00, run_duration=4.098128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:12:00+00:00, data_interval_end=2024-05-23 23:13:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:13:05.070791773Z [2024-05-23T23:13:05.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:13:00+00:00, run_after=2024-05-23T23:14:00+00:00 2024-05-23T23:13:05.077700987Z [2024-05-23T23:13:05.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:13:05.078143626Z [2024-05-23T23:13:05.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:12:00+00:00, run_id=scheduled__2024-05-23T23:12:00+00:00, run_start_date=2024-05-23 23:13:00.964102+00:00, run_end_date=2024-05-23 23:13:05.077804+00:00, run_duration=4.113702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:12:00+00:00, data_interval_end=2024-05-23 23:13:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:13:05.088888640Z [2024-05-23T23:13:05.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:13:00+00:00, run_after=2024-05-23T23:14:00+00:00 2024-05-23T23:13:05.128924978Z [2024-05-23T23:13:05.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status success for try_number 1 2024-05-23T23:13:05.141920266Z [2024-05-23T23:13:05.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:12:00+00:00, map_index=-1, run_start_date=2024-05-23 23:13:03.044111+00:00, run_end_date=2024-05-23 23:13:04.697054+00:00, run_duration=1.652943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:13:01.021478+00:00, queued_by_job_id=1, pid=2887 2024-05-23T23:13:06.235881927Z [2024-05-23T23:13:06.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status success for try_number 1 2024-05-23T23:13:06.245032160Z [2024-05-23T23:13:06.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:12:00+00:00, map_index=-1, run_start_date=2024-05-23 23:13:03.167522+00:00, run_end_date=2024-05-23 23:13:05.035585+00:00, run_duration=1.868063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:13:01.021478+00:00, queued_by_job_id=1, pid=2888 2024-05-23T23:14:00.271284234Z [2024-05-23T23:14:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:14:00+00:00, run_after=2024-05-23T23:15:00+00:00 2024-05-23T23:14:00.286720168Z [2024-05-23T23:14:00.286+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:14:00.311743690Z [2024-05-23T23:14:00.311+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:14:00+00:00, run_after=2024-05-23T23:15:00+00:00 2024-05-23T23:14:00.337375414Z [2024-05-23T23:14:00.336+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:14:00.453548368Z [2024-05-23T23:14:00.453+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:14:00.453595149Z 2024-05-23T23:14:00.453605982Z 2024-05-23T23:14:00.453614590Z 2024-05-23T23:14:00.453623413Z 2024-05-23T23:14:00.453801132Z [2024-05-23T23:14:00.453+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:14:00.454125556Z [2024-05-23T23:14:00.453+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:14:00.454425862Z [2024-05-23T23:14:00.454+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:14:00.454766143Z [2024-05-23T23:14:00.454+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:14:00.455774772Z [2024-05-23T23:14:00.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:14:00.455794115Z 2024-05-23T23:14:00.455800138Z 2024-05-23T23:14:00.455831805Z 2024-05-23T23:14:00.455837125Z 2024-05-23T23:14:00.461231319Z [2024-05-23T23:14:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:14:00.461504765Z [2024-05-23T23:14:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:14:00.461905708Z [2024-05-23T23:14:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:14:00.462151215Z [2024-05-23T23:14:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:14:00.462905028Z [2024-05-23T23:14:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:14:00.462918064Z [2024-05-23T23:14:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:14:00.462922106Z [2024-05-23T23:14:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:14:00.463557657Z [2024-05-23T23:14:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:14:00.891730044Z [2024-05-23T23:14:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status queued for try_number 1 2024-05-23T23:14:00.891872686Z [2024-05-23T23:14:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:13:00+00:00 exited with status queued for try_number 1 2024-05-23T23:14:00.891998811Z [2024-05-23T23:14:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:13:00+00:00 exited with status queued for try_number 1 2024-05-23T23:14:00.892150207Z [2024-05-23T23:14:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:13:00+00:00 exited with status queued for try_number 1 2024-05-23T23:14:00.903875714Z [2024-05-23T23:14:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70d87dd5-23e1-4a24-b957-1cdf7a3edd94 2024-05-23T23:14:00.904102994Z [2024-05-23T23:14:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23fbf584-c73f-4f92-a72b-a3ec0b6f3639 2024-05-23T23:14:00.904282121Z [2024-05-23T23:14:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f587d9f-38e6-4b2a-8279-2b9c624d6613 2024-05-23T23:14:00.904476015Z [2024-05-23T23:14:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 914d2cff-b12a-4c91-a617-561a9765a003 2024-05-23T23:14:02.118003714Z [2024-05-23T23:14:02.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:14:02.119028939Z [2024-05-23T23:14:02.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:12:00+00:00, run_id=scheduled__2024-05-23T23:12:00+00:00, run_start_date=2024-05-23 23:14:00.350727+00:00, run_end_date=2024-05-23 23:14:02.118218+00:00, run_duration=1.767491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:12:00+00:00, data_interval_end=2024-05-23 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:14:02.130619642Z [2024-05-23T23:14:02.130+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:14:00+00:00, run_after=2024-05-23T23:16:00+00:00 2024-05-23T23:14:02.140941143Z [2024-05-23T23:14:02.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:14:02.142040145Z [2024-05-23T23:14:02.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:13:00+00:00, run_id=scheduled__2024-05-23T23:13:00+00:00, run_start_date=2024-05-23 23:14:00.352178+00:00, run_end_date=2024-05-23 23:14:02.141548+00:00, run_duration=1.78937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:13:00+00:00, data_interval_end=2024-05-23 23:14:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:14:02.156909947Z [2024-05-23T23:14:02.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:14:00+00:00, run_after=2024-05-23T23:15:00+00:00 2024-05-23T23:14:02.213999734Z [2024-05-23T23:14:02.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:12:00+00:00 exited with status success for try_number 1 2024-05-23T23:14:02.214263258Z [2024-05-23T23:14:02.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:13:00+00:00 exited with status success for try_number 1 2024-05-23T23:14:02.236464134Z [2024-05-23T23:14:02.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:12:00+00:00, map_index=-1, run_start_date=2024-05-23 23:14:01.309388+00:00, run_end_date=2024-05-23 23:14:01.694598+00:00, run_duration=0.38521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:14:00.457206+00:00, queued_by_job_id=1, pid=2922 2024-05-23T23:14:02.236900117Z [2024-05-23T23:14:02.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:13:00+00:00, map_index=-1, run_start_date=2024-05-23 23:14:01.478781+00:00, run_end_date=2024-05-23 23:14:01.944518+00:00, run_duration=0.465737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:14:00.457206+00:00, queued_by_job_id=1, pid=2923 2024-05-23T23:14:04.953950339Z [2024-05-23T23:14:04.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:14:04.954428211Z [2024-05-23T23:14:04.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:13:00+00:00, run_id=scheduled__2024-05-23T23:13:00+00:00, run_start_date=2024-05-23 23:14:00.353533+00:00, run_end_date=2024-05-23 23:14:04.954056+00:00, run_duration=4.600523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:13:00+00:00, data_interval_end=2024-05-23 23:14:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:14:04.971481784Z [2024-05-23T23:14:04.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:14:00+00:00, run_after=2024-05-23T23:15:00+00:00 2024-05-23T23:14:04.986177886Z [2024-05-23T23:14:04.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:14:04.986442363Z [2024-05-23T23:14:04.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:13:00+00:00, run_id=scheduled__2024-05-23T23:13:00+00:00, run_start_date=2024-05-23 23:14:00.354730+00:00, run_end_date=2024-05-23 23:14:04.986029+00:00, run_duration=4.631299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:13:00+00:00, data_interval_end=2024-05-23 23:14:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:14:05.001878730Z [2024-05-23T23:14:05.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:14:00+00:00, run_after=2024-05-23T23:15:00+00:00 2024-05-23T23:14:05.053326861Z [2024-05-23T23:14:05.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:13:00+00:00 exited with status success for try_number 1 2024-05-23T23:14:05.053672277Z [2024-05-23T23:14:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:13:00+00:00 exited with status success for try_number 1 2024-05-23T23:14:05.064977884Z [2024-05-23T23:14:05.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:13:00+00:00, map_index=-1, run_start_date=2024-05-23 23:14:02.541885+00:00, run_end_date=2024-05-23 23:14:04.258869+00:00, run_duration=1.716984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:14:00.457206+00:00, queued_by_job_id=1, pid=2947 2024-05-23T23:14:05.065484870Z [2024-05-23T23:14:05.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:13:00+00:00, map_index=-1, run_start_date=2024-05-23 23:14:02.362523+00:00, run_end_date=2024-05-23 23:14:04.144404+00:00, run_duration=1.781881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:14:00.457206+00:00, queued_by_job_id=1, pid=2946 2024-05-23T23:15:00.806013595Z [2024-05-23T23:15:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:15:00+00:00, run_after=2024-05-23T23:16:00+00:00 2024-05-23T23:15:00.821341894Z [2024-05-23T23:15:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:15:00+00:00, run_after=2024-05-23T23:16:00+00:00 2024-05-23T23:15:00.834047588Z [2024-05-23T23:15:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:15:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:15:00.841520533Z [2024-05-23T23:15:00.841+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:15:00.956384561Z [2024-05-23T23:15:00.956+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:15:00.956408670Z 2024-05-23T23:15:00.956413127Z 2024-05-23T23:15:00.956416325Z 2024-05-23T23:15:00.956419963Z 2024-05-23T23:15:00.956430658Z [2024-05-23T23:15:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:15:00.956508634Z [2024-05-23T23:15:00.956+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:15:00.956578633Z [2024-05-23T23:15:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:15:00.956672559Z [2024-05-23T23:15:00.956+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:15:00.957211376Z [2024-05-23T23:15:00.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:15:00.957222814Z 2024-05-23T23:15:00.957227179Z 2024-05-23T23:15:00.957231174Z 2024-05-23T23:15:00.957235365Z 2024-05-23T23:15:00.960814569Z [2024-05-23T23:15:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:15:00.960890259Z [2024-05-23T23:15:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:15:00.961078319Z [2024-05-23T23:15:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:15:00.961164322Z [2024-05-23T23:15:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:15:00.961336347Z [2024-05-23T23:15:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:15:00.961415328Z [2024-05-23T23:15:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:15:00.961699028Z [2024-05-23T23:15:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:15:00.961879218Z [2024-05-23T23:15:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:15:01.367277743Z [2024-05-23T23:15:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:15:01.367345698Z [2024-05-23T23:15:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status queued for try_number 1 2024-05-23T23:15:01.367537816Z [2024-05-23T23:15:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status queued for try_number 1 2024-05-23T23:15:01.367645912Z [2024-05-23T23:15:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status queued for try_number 1 2024-05-23T23:15:01.382911230Z [2024-05-23T23:15:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32a374bc-614f-4149-940d-f0a887fb3e3b 2024-05-23T23:15:01.383548341Z [2024-05-23T23:15:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ba317e4-c5cb-4c9f-a97e-c4715aada9da 2024-05-23T23:15:01.383837586Z [2024-05-23T23:15:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d8a9b1f-8e9e-4bad-8b69-0ef6864db3f9 2024-05-23T23:15:01.384182402Z [2024-05-23T23:15:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0ad7a4a-fa76-4c03-afe2-2ff3508f37e0 2024-05-23T23:15:02.563924034Z [2024-05-23T23:15:02.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:15:02.564126512Z [2024-05-23T23:15:02.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:14:00+00:00, run_id=scheduled__2024-05-23T23:14:00+00:00, run_start_date=2024-05-23 23:15:00.862642+00:00, run_end_date=2024-05-23 23:15:02.563827+00:00, run_duration=1.701185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:14:00+00:00, data_interval_end=2024-05-23 23:15:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:15:02.585867192Z [2024-05-23T23:15:02.585+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:15:00+00:00, run_after=2024-05-23T23:16:00+00:00 2024-05-23T23:15:02.697148206Z [2024-05-23T23:15:02.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status success for try_number 1 2024-05-23T23:15:02.744933881Z [2024-05-23T23:15:02.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:14:00+00:00, map_index=-1, run_start_date=2024-05-23 23:15:01.852690+00:00, run_end_date=2024-05-23 23:15:02.362086+00:00, run_duration=0.509396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:15:00.957974+00:00, queued_by_job_id=1, pid=2980 2024-05-23T23:15:03.861023557Z [2024-05-23T23:15:03.860+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:15:03.861045859Z 2024-05-23T23:15:03.861220065Z [2024-05-23T23:15:03.861+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:15:03.861956666Z [2024-05-23T23:15:03.861+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:15:03.861961995Z 2024-05-23T23:15:03.864532323Z [2024-05-23T23:15:03.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:15:03.864548438Z [2024-05-23T23:15:03.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:15:03.938317856Z [2024-05-23T23:15:03.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:15:03.938683185Z [2024-05-23T23:15:03.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:15:03.947534698Z [2024-05-23T23:15:03.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to efca5d8e-c66b-420d-a9b7-267feb95e029 2024-05-23T23:15:03.947960746Z [2024-05-23T23:15:03.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=-1, run_start_date=2024-05-23 23:15:03.273550+00:00, run_end_date=2024-05-23 23:15:03.654671+00:00, run_duration=0.381121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:15:00.957974+00:00, queued_by_job_id=1, pid=3000 2024-05-23T23:15:05.938332349Z [2024-05-23T23:15:05.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:15:05.938644742Z [2024-05-23T23:15:05.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:14:00+00:00, run_id=scheduled__2024-05-23T23:14:00+00:00, run_start_date=2024-05-23 23:15:00.866989+00:00, run_end_date=2024-05-23 23:15:05.938269+00:00, run_duration=5.07128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:14:00+00:00, data_interval_end=2024-05-23 23:15:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:15:05.952509596Z [2024-05-23T23:15:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:15:00+00:00, run_after=2024-05-23T23:16:00+00:00 2024-05-23T23:15:05.964368056Z [2024-05-23T23:15:05.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:15:05.965037582Z [2024-05-23T23:15:05.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:14:00+00:00, run_id=scheduled__2024-05-23T23:14:00+00:00, run_start_date=2024-05-23 23:15:00.868790+00:00, run_end_date=2024-05-23 23:15:05.964723+00:00, run_duration=5.095933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:14:00+00:00, data_interval_end=2024-05-23 23:15:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:15:05.979779762Z [2024-05-23T23:15:05.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:15:00+00:00, run_after=2024-05-23T23:16:00+00:00 2024-05-23T23:15:06.021774857Z [2024-05-23T23:15:06.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status success for try_number 1 2024-05-23T23:15:06.024164075Z [2024-05-23T23:15:06.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status success for try_number 1 2024-05-23T23:15:06.030867741Z [2024-05-23T23:15:06.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:14:00+00:00, map_index=-1, run_start_date=2024-05-23 23:15:03.507670+00:00, run_end_date=2024-05-23 23:15:04.806470+00:00, run_duration=1.2988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:15:00.957974+00:00, queued_by_job_id=1, pid=3011 2024-05-23T23:15:06.031139133Z [2024-05-23T23:15:06.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:14:00+00:00, map_index=-1, run_start_date=2024-05-23 23:15:03.117277+00:00, run_end_date=2024-05-23 23:15:05.016949+00:00, run_duration=1.899672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:15:00.957974+00:00, queued_by_job_id=1, pid=2999 2024-05-23T23:15:07.091613612Z [2024-05-23T23:15:07.091+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:15:07.091645093Z 2024-05-23T23:15:07.091801700Z [2024-05-23T23:15:07.091+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:15:07.092521164Z [2024-05-23T23:15:07.092+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:15:07.092563392Z 2024-05-23T23:15:07.094772816Z [2024-05-23T23:15:07.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:15:07.094961548Z [2024-05-23T23:15:07.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:15:07.230173786Z [2024-05-23T23:15:07.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:15:07.230265888Z [2024-05-23T23:15:07.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:15:07.236853632Z [2024-05-23T23:15:07.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7618d89-d6e0-4336-9f18-771d68a96f1e 2024-05-23T23:15:07.236908337Z [2024-05-23T23:15:07.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=-1, run_start_date=2024-05-23 23:15:05.718046+00:00, run_end_date=2024-05-23 23:15:06.088228+00:00, run_duration=0.370182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:15:03.862404+00:00, queued_by_job_id=1, pid=3029 2024-05-23T23:15:09.509088276Z [2024-05-23T23:15:09.508+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:15:09.509108675Z 2024-05-23T23:15:09.509228959Z [2024-05-23T23:15:09.508+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:15:09.509799889Z [2024-05-23T23:15:09.509+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:15:09.509809867Z 2024-05-23T23:15:09.512056482Z [2024-05-23T23:15:09.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:15:09.512201309Z [2024-05-23T23:15:09.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:15:09.581617619Z [2024-05-23T23:15:09.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status queued for try_number 1 2024-05-23T23:15:09.581651390Z [2024-05-23T23:15:09.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:15:09.587162284Z [2024-05-23T23:15:09.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99ac8168-a201-4a26-aff1-b44f14f9b8cf 2024-05-23T23:15:09.587396623Z [2024-05-23T23:15:09.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=0, run_start_date=2024-05-23 23:15:08.735460+00:00, run_end_date=2024-05-23 23:15:09.182827+00:00, run_duration=0.447367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:15:07.092976+00:00, queued_by_job_id=1, pid=3037 2024-05-23T23:15:12.136513371Z [2024-05-23T23:15:12.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:15:12.136958037Z [2024-05-23T23:15:12.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:10:00+00:00, run_id=scheduled__2024-05-23T23:10:00+00:00, run_start_date=2024-05-23 23:15:00.855633+00:00, run_end_date=2024-05-23 23:15:12.136324+00:00, run_duration=11.280691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:10:00+00:00, data_interval_end=2024-05-23 23:15:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:15:12.143811723Z [2024-05-23T23:15:12.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:15:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:15:12.197460285Z [2024-05-23T23:15:12.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:10:00+00:00 exited with status success for try_number 1 2024-05-23T23:15:12.206967260Z [2024-05-23T23:15:12.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:10:00+00:00, map_index=-1, run_start_date=2024-05-23 23:15:11.365622+00:00, run_end_date=2024-05-23 23:15:11.764419+00:00, run_duration=0.398797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:15:09.510186+00:00, queued_by_job_id=1, pid=3045 2024-05-23T23:16:00.688074273Z [2024-05-23T23:16:00.687+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:16:00.695679884Z [2024-05-23T23:16:00.695+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:16:00.708138158Z [2024-05-23T23:16:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:16:00+00:00, run_after=2024-05-23T23:17:00+00:00 2024-05-23T23:16:00.719233051Z [2024-05-23T23:16:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:16:00+00:00, run_after=2024-05-23T23:17:00+00:00 2024-05-23T23:16:00.807393584Z [2024-05-23T23:16:00.807+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:16:00.807435744Z 2024-05-23T23:16:00.807440093Z 2024-05-23T23:16:00.807443362Z 2024-05-23T23:16:00.807446700Z 2024-05-23T23:16:00.807665965Z [2024-05-23T23:16:00.807+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:16:00.807881244Z [2024-05-23T23:16:00.807+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:16:00.808065021Z [2024-05-23T23:16:00.807+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:16:00.808278288Z [2024-05-23T23:16:00.808+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:16:00.808949302Z [2024-05-23T23:16:00.808+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:16:00.808959216Z 2024-05-23T23:16:00.808967204Z 2024-05-23T23:16:00.808971557Z 2024-05-23T23:16:00.808975508Z 2024-05-23T23:16:00.813058080Z [2024-05-23T23:16:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:16:00.813129605Z [2024-05-23T23:16:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:16:00.813142296Z [2024-05-23T23:16:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:16:00.813156004Z [2024-05-23T23:16:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:16:00.813201932Z [2024-05-23T23:16:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:16:00.813348288Z [2024-05-23T23:16:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:16:00.813690513Z [2024-05-23T23:16:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:16:00.813896400Z [2024-05-23T23:16:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:16:01.147067808Z [2024-05-23T23:16:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status queued for try_number 1 2024-05-23T23:16:01.147106428Z [2024-05-23T23:16:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status queued for try_number 1 2024-05-23T23:16:01.147234709Z [2024-05-23T23:16:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status queued for try_number 1 2024-05-23T23:16:01.147328230Z [2024-05-23T23:16:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status queued for try_number 1 2024-05-23T23:16:01.156109967Z [2024-05-23T23:16:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf210669-c634-4e7d-bae6-52ca82a1ca55 2024-05-23T23:16:01.156263670Z [2024-05-23T23:16:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b1897fe-3d13-4fe6-96e5-ea113d2da6a3 2024-05-23T23:16:01.156437710Z [2024-05-23T23:16:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to cca3fee1-c6bd-4c05-8c93-397c7fca4c2c 2024-05-23T23:16:01.156609753Z [2024-05-23T23:16:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 765ebc1f-db34-43bd-897d-e323d7b3fb6f 2024-05-23T23:16:02.449951219Z [2024-05-23T23:16:02.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:16:02.450549226Z [2024-05-23T23:16:02.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:14:00+00:00, run_id=scheduled__2024-05-23T23:14:00+00:00, run_start_date=2024-05-23 23:16:00.729284+00:00, run_end_date=2024-05-23 23:16:02.450066+00:00, run_duration=1.720782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:14:00+00:00, data_interval_end=2024-05-23 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:16:02.470415633Z [2024-05-23T23:16:02.470+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:16:00+00:00, run_after=2024-05-23T23:18:00+00:00 2024-05-23T23:16:02.546816575Z [2024-05-23T23:16:02.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:14:00+00:00 exited with status success for try_number 1 2024-05-23T23:16:02.552340202Z [2024-05-23T23:16:02.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:14:00+00:00, map_index=-1, run_start_date=2024-05-23 23:16:01.684522+00:00, run_end_date=2024-05-23 23:16:02.062096+00:00, run_duration=0.377574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:16:00.809751+00:00, queued_by_job_id=1, pid=3063 2024-05-23T23:16:03.605179293Z [2024-05-23T23:16:03.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:16:03.605963433Z [2024-05-23T23:16:03.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:15:00+00:00, run_id=scheduled__2024-05-23T23:15:00+00:00, run_start_date=2024-05-23 23:16:00.731361+00:00, run_end_date=2024-05-23 23:16:03.605639+00:00, run_duration=2.874278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:15:00+00:00, data_interval_end=2024-05-23 23:16:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:16:03.615534136Z [2024-05-23T23:16:03.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:16:00+00:00, run_after=2024-05-23T23:17:00+00:00 2024-05-23T23:16:03.682673866Z [2024-05-23T23:16:03.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status success for try_number 1 2024-05-23T23:16:03.702302975Z [2024-05-23T23:16:03.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:15:00+00:00, map_index=-1, run_start_date=2024-05-23 23:16:02.154135+00:00, run_end_date=2024-05-23 23:16:02.619473+00:00, run_duration=0.465338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:16:00.809751+00:00, queued_by_job_id=1, pid=3074 2024-05-23T23:16:04.756592860Z [2024-05-23T23:16:04.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:16:04.757017186Z [2024-05-23T23:16:04.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:15:00+00:00, run_id=scheduled__2024-05-23T23:15:00+00:00, run_start_date=2024-05-23 23:16:00.733889+00:00, run_end_date=2024-05-23 23:16:04.756606+00:00, run_duration=4.022717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:15:00+00:00, data_interval_end=2024-05-23 23:16:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:16:04.765729071Z [2024-05-23T23:16:04.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:16:00+00:00, run_after=2024-05-23T23:17:00+00:00 2024-05-23T23:16:04.814021898Z [2024-05-23T23:16:04.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status success for try_number 1 2024-05-23T23:16:04.825176193Z [2024-05-23T23:16:04.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:15:00+00:00, map_index=-1, run_start_date=2024-05-23 23:16:03.264282+00:00, run_end_date=2024-05-23 23:16:04.626084+00:00, run_duration=1.361802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:16:00.809751+00:00, queued_by_job_id=1, pid=3092 2024-05-23T23:16:05.885474744Z [2024-05-23T23:16:05.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:16:05.885676609Z [2024-05-23T23:16:05.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:15:00+00:00, run_id=scheduled__2024-05-23T23:15:00+00:00, run_start_date=2024-05-23 23:16:00.736523+00:00, run_end_date=2024-05-23 23:16:05.885263+00:00, run_duration=5.14874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:15:00+00:00, data_interval_end=2024-05-23 23:16:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:16:05.905367574Z [2024-05-23T23:16:05.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:16:00+00:00, run_after=2024-05-23T23:17:00+00:00 2024-05-23T23:16:05.947524204Z [2024-05-23T23:16:05.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status success for try_number 1 2024-05-23T23:16:05.956318855Z [2024-05-23T23:16:05.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:15:00+00:00, map_index=-1, run_start_date=2024-05-23 23:16:03.360484+00:00, run_end_date=2024-05-23 23:16:04.985449+00:00, run_duration=1.624965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:16:00.809751+00:00, queued_by_job_id=1, pid=3093 2024-05-23T23:16:39.279193350Z [2024-05-23T23:16:39.274+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:17:00.187963689Z [2024-05-23T23:17:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:17:00+00:00, run_after=2024-05-23T23:18:00+00:00 2024-05-23T23:17:00.215559530Z [2024-05-23T23:17:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:17:00+00:00, run_after=2024-05-23T23:18:00+00:00 2024-05-23T23:17:00.243376610Z [2024-05-23T23:17:00.242+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:17:00.332174666Z [2024-05-23T23:17:00.331+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:17:00.332209197Z 2024-05-23T23:17:00.332213326Z 2024-05-23T23:17:00.332217022Z 2024-05-23T23:17:00.332590364Z [2024-05-23T23:17:00.332+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:17:00.332865441Z [2024-05-23T23:17:00.332+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:17:00.333188649Z [2024-05-23T23:17:00.332+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:17:00.334230369Z [2024-05-23T23:17:00.333+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:17:00.334246121Z 2024-05-23T23:17:00.334281329Z 2024-05-23T23:17:00.334287192Z 2024-05-23T23:17:00.339526361Z [2024-05-23T23:17:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:17:00.339783759Z [2024-05-23T23:17:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:17:00.340135960Z [2024-05-23T23:17:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:17:00.340453531Z [2024-05-23T23:17:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:17:00.340941144Z [2024-05-23T23:17:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:17:00.341462474Z [2024-05-23T23:17:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:17:00.708855601Z [2024-05-23T23:17:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status queued for try_number 1 2024-05-23T23:17:00.708947995Z [2024-05-23T23:17:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status queued for try_number 1 2024-05-23T23:17:00.709041848Z [2024-05-23T23:17:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status queued for try_number 1 2024-05-23T23:17:00.717321813Z [2024-05-23T23:17:00.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to 536d8907-3526-4b4f-903c-a2e2a3385ad6 2024-05-23T23:17:00.717397267Z [2024-05-23T23:17:00.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to 588f0405-b7eb-4e4e-a9b8-c05becd781fc 2024-05-23T23:17:00.717532187Z [2024-05-23T23:17:00.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to b395d12c-3b72-4c64-b2ff-84ddf492e9fc 2024-05-23T23:17:01.903403561Z [2024-05-23T23:17:01.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:17:01.903785065Z [2024-05-23T23:17:01.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:16:00+00:00, run_id=scheduled__2024-05-23T23:16:00+00:00, run_start_date=2024-05-23 23:17:00.262430+00:00, run_end_date=2024-05-23 23:17:01.903322+00:00, run_duration=1.640892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:16:00+00:00, data_interval_end=2024-05-23 23:17:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:17:01.913917539Z [2024-05-23T23:17:01.913+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:17:00+00:00, run_after=2024-05-23T23:18:00+00:00 2024-05-23T23:17:01.999455327Z [2024-05-23T23:17:01.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status success for try_number 1 2024-05-23T23:17:02.013200836Z [2024-05-23T23:17:02.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:16:00+00:00, map_index=-1, run_start_date=2024-05-23 23:17:01.232117+00:00, run_end_date=2024-05-23 23:17:01.642944+00:00, run_duration=0.410827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:17:00.335662+00:00, queued_by_job_id=1, pid=3125 2024-05-23T23:17:04.184103214Z [2024-05-23T23:17:04.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:17:04.184839655Z [2024-05-23T23:17:04.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:16:00+00:00, run_id=scheduled__2024-05-23T23:16:00+00:00, run_start_date=2024-05-23 23:17:00.263724+00:00, run_end_date=2024-05-23 23:17:04.184291+00:00, run_duration=3.920567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:16:00+00:00, data_interval_end=2024-05-23 23:17:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:17:04.209382092Z [2024-05-23T23:17:04.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:17:00+00:00, run_after=2024-05-23T23:18:00+00:00 2024-05-23T23:17:04.221498348Z [2024-05-23T23:17:04.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:17:04.221734881Z [2024-05-23T23:17:04.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:16:00+00:00, run_id=scheduled__2024-05-23T23:16:00+00:00, run_start_date=2024-05-23 23:17:00.264848+00:00, run_end_date=2024-05-23 23:17:04.221403+00:00, run_duration=3.956555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:16:00+00:00, data_interval_end=2024-05-23 23:17:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:17:04.232054406Z [2024-05-23T23:17:04.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:17:00+00:00, run_after=2024-05-23T23:18:00+00:00 2024-05-23T23:17:04.288122708Z [2024-05-23T23:17:04.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status success for try_number 1 2024-05-23T23:17:04.300208478Z [2024-05-23T23:17:04.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:16:00+00:00, map_index=-1, run_start_date=2024-05-23 23:17:02.311630+00:00, run_end_date=2024-05-23 23:17:03.659073+00:00, run_duration=1.347443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:17:00.335662+00:00, queued_by_job_id=1, pid=3143 2024-05-23T23:17:05.392609186Z [2024-05-23T23:17:05.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status success for try_number 1 2024-05-23T23:17:05.401626164Z [2024-05-23T23:17:05.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:16:00+00:00, map_index=-1, run_start_date=2024-05-23 23:17:02.379282+00:00, run_end_date=2024-05-23 23:17:04.143073+00:00, run_duration=1.763791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:17:00.335662+00:00, queued_by_job_id=1, pid=3144 2024-05-23T23:18:01.087960822Z [2024-05-23T23:18:01.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:18:01.113326336Z [2024-05-23T23:18:01.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:18:00+00:00, run_after=2024-05-23T23:19:00+00:00 2024-05-23T23:18:01.138174692Z [2024-05-23T23:18:01.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:18:00+00:00, run_after=2024-05-23T23:19:00+00:00 2024-05-23T23:18:01.148154311Z [2024-05-23T23:18:01.147+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:18:01.231554833Z [2024-05-23T23:18:01.231+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:18:01.231598451Z 2024-05-23T23:18:01.231609333Z 2024-05-23T23:18:01.231619924Z 2024-05-23T23:18:01.231629474Z 2024-05-23T23:18:01.231670445Z [2024-05-23T23:18:01.231+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:18:01.231695043Z [2024-05-23T23:18:01.231+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:18:01.231703622Z [2024-05-23T23:18:01.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:18:01.231800674Z [2024-05-23T23:18:01.231+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:18:01.232557061Z [2024-05-23T23:18:01.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:18:01.232579256Z 2024-05-23T23:18:01.232589674Z 2024-05-23T23:18:01.232599072Z 2024-05-23T23:18:01.232608739Z 2024-05-23T23:18:01.237812990Z [2024-05-23T23:18:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:18:01.237914704Z [2024-05-23T23:18:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:18:01.238164329Z [2024-05-23T23:18:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:18:01.238306357Z [2024-05-23T23:18:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:18:01.238556895Z [2024-05-23T23:18:01.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:18:01.238712080Z [2024-05-23T23:18:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:18:01.238987060Z [2024-05-23T23:18:01.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:18:01.239177243Z [2024-05-23T23:18:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:18:01.828354490Z [2024-05-23T23:18:01.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status queued for try_number 1 2024-05-23T23:18:01.828475179Z [2024-05-23T23:18:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:17:00+00:00 exited with status queued for try_number 1 2024-05-23T23:18:01.828718764Z [2024-05-23T23:18:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:17:00+00:00 exited with status queued for try_number 1 2024-05-23T23:18:01.833479279Z [2024-05-23T23:18:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:17:00+00:00 exited with status queued for try_number 1 2024-05-23T23:18:01.855650260Z [2024-05-23T23:18:01.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d8ea196-0480-4585-a962-a5c4848dc8d6 2024-05-23T23:18:01.855851554Z [2024-05-23T23:18:01.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56998986-14fc-4ced-b020-d73d6340d272 2024-05-23T23:18:01.856036708Z [2024-05-23T23:18:01.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47b28212-bc6e-4e13-9885-bc18290cf5a4 2024-05-23T23:18:01.856203481Z [2024-05-23T23:18:01.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to c13c3e51-7cb5-490a-a404-808a4ee00684 2024-05-23T23:18:02.951125393Z [2024-05-23T23:18:02.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:18:02.951477110Z [2024-05-23T23:18:02.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:16:00+00:00, run_id=scheduled__2024-05-23T23:16:00+00:00, run_start_date=2024-05-23 23:18:01.158488+00:00, run_end_date=2024-05-23 23:18:02.951028+00:00, run_duration=1.79254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:16:00+00:00, data_interval_end=2024-05-23 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:18:02.964921020Z [2024-05-23T23:18:02.958+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:18:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:18:02.984019847Z [2024-05-23T23:18:02.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:18:02.984259916Z [2024-05-23T23:18:02.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:17:00+00:00, run_id=scheduled__2024-05-23T23:17:00+00:00, run_start_date=2024-05-23 23:18:01.159709+00:00, run_end_date=2024-05-23 23:18:02.983959+00:00, run_duration=1.82425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:17:00+00:00, data_interval_end=2024-05-23 23:18:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:18:03.006489276Z [2024-05-23T23:18:03.006+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:18:00+00:00, run_after=2024-05-23T23:19:00+00:00 2024-05-23T23:18:03.107622855Z [2024-05-23T23:18:03.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:16:00+00:00 exited with status success for try_number 1 2024-05-23T23:18:03.107921018Z [2024-05-23T23:18:03.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:17:00+00:00 exited with status success for try_number 1 2024-05-23T23:18:03.115301055Z [2024-05-23T23:18:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:17:00+00:00, map_index=-1, run_start_date=2024-05-23 23:18:02.096783+00:00, run_end_date=2024-05-23 23:18:02.603338+00:00, run_duration=0.506555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:18:01.233448+00:00, queued_by_job_id=1, pid=3177 2024-05-23T23:18:03.115638660Z [2024-05-23T23:18:03.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:16:00+00:00, map_index=-1, run_start_date=2024-05-23 23:18:02.100824+00:00, run_end_date=2024-05-23 23:18:02.613049+00:00, run_duration=0.512225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:18:01.233448+00:00, queued_by_job_id=1, pid=3178 2024-05-23T23:18:06.375601752Z [2024-05-23T23:18:06.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:18:06.376150984Z [2024-05-23T23:18:06.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:17:00+00:00, run_id=scheduled__2024-05-23T23:17:00+00:00, run_start_date=2024-05-23 23:18:01.160729+00:00, run_end_date=2024-05-23 23:18:06.375426+00:00, run_duration=5.214697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:17:00+00:00, data_interval_end=2024-05-23 23:18:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:18:06.396285065Z [2024-05-23T23:18:06.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:18:00+00:00, run_after=2024-05-23T23:19:00+00:00 2024-05-23T23:18:06.412396158Z [2024-05-23T23:18:06.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:18:06.413431952Z [2024-05-23T23:18:06.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:17:00+00:00, run_id=scheduled__2024-05-23T23:17:00+00:00, run_start_date=2024-05-23 23:18:01.161696+00:00, run_end_date=2024-05-23 23:18:06.412270+00:00, run_duration=5.250574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:17:00+00:00, data_interval_end=2024-05-23 23:18:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:18:06.430758006Z [2024-05-23T23:18:06.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:18:00+00:00, run_after=2024-05-23T23:19:00+00:00 2024-05-23T23:18:06.468613594Z [2024-05-23T23:18:06.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:17:00+00:00 exited with status success for try_number 1 2024-05-23T23:18:06.468946623Z [2024-05-23T23:18:06.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:17:00+00:00 exited with status success for try_number 1 2024-05-23T23:18:06.478763800Z [2024-05-23T23:18:06.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:17:00+00:00, map_index=-1, run_start_date=2024-05-23 23:18:03.615668+00:00, run_end_date=2024-05-23 23:18:05.280587+00:00, run_duration=1.664919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:18:01.233448+00:00, queued_by_job_id=1, pid=3201 2024-05-23T23:18:06.479213761Z [2024-05-23T23:18:06.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:17:00+00:00, map_index=-1, run_start_date=2024-05-23 23:18:03.655003+00:00, run_end_date=2024-05-23 23:18:05.920896+00:00, run_duration=2.265893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:18:01.233448+00:00, queued_by_job_id=1, pid=3202 2024-05-23T23:19:00.044208471Z [2024-05-23T23:19:00.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:19:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:19:00.053356397Z [2024-05-23T23:19:00.053+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:19:00.065267439Z [2024-05-23T23:19:00.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:19:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:19:00.132182020Z [2024-05-23T23:19:00.131+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:19:00.132204838Z 2024-05-23T23:19:00.132208213Z 2024-05-23T23:19:00.132211606Z 2024-05-23T23:19:00.132250350Z [2024-05-23T23:19:00.132+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:19:00.132471686Z [2024-05-23T23:19:00.132+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:19:00.132682018Z [2024-05-23T23:19:00.132+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:19:00.133391140Z [2024-05-23T23:19:00.133+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:19:00.133395378Z 2024-05-23T23:19:00.133398187Z 2024-05-23T23:19:00.133401184Z 2024-05-23T23:19:00.137416652Z [2024-05-23T23:19:00.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:19:00.137699209Z [2024-05-23T23:19:00.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:19:00.138079653Z [2024-05-23T23:19:00.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:19:00.138288872Z [2024-05-23T23:19:00.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:19:00.138722963Z [2024-05-23T23:19:00.138+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:19:00.138930197Z [2024-05-23T23:19:00.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:19:00.543106444Z [2024-05-23T23:19:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status queued for try_number 1 2024-05-23T23:19:00.543130338Z [2024-05-23T23:19:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status queued for try_number 1 2024-05-23T23:19:00.543133879Z [2024-05-23T23:19:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status queued for try_number 1 2024-05-23T23:19:00.548532307Z [2024-05-23T23:19:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9657799e-17f7-4188-b46b-66802dc59913 2024-05-23T23:19:00.548725296Z [2024-05-23T23:19:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3508ae5a-5ef1-4af7-8196-5867424a7842 2024-05-23T23:19:00.548898820Z [2024-05-23T23:19:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6663267-3574-47c3-a582-fda5fd25127f 2024-05-23T23:19:01.770163941Z [2024-05-23T23:19:01.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:19:01.770744545Z [2024-05-23T23:19:01.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:18:00+00:00, run_id=scheduled__2024-05-23T23:18:00+00:00, run_start_date=2024-05-23 23:19:00.076088+00:00, run_end_date=2024-05-23 23:19:01.770059+00:00, run_duration=1.693971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:18:00+00:00, data_interval_end=2024-05-23 23:19:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:19:01.784083303Z [2024-05-23T23:19:01.783+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:19:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:19:01.838718837Z [2024-05-23T23:19:01.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status success for try_number 1 2024-05-23T23:19:01.850475717Z [2024-05-23T23:19:01.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:18:00+00:00, map_index=-1, run_start_date=2024-05-23 23:19:01.041142+00:00, run_end_date=2024-05-23 23:19:01.492259+00:00, run_duration=0.451117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:19:00.134139+00:00, queued_by_job_id=1, pid=3234 2024-05-23T23:19:04.052701036Z [2024-05-23T23:19:04.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:19:04.053855066Z [2024-05-23T23:19:04.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:18:00+00:00, run_id=scheduled__2024-05-23T23:18:00+00:00, run_start_date=2024-05-23 23:19:00.078245+00:00, run_end_date=2024-05-23 23:19:04.052812+00:00, run_duration=3.974567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:18:00+00:00, data_interval_end=2024-05-23 23:19:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:19:04.082300299Z [2024-05-23T23:19:04.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:19:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:19:04.089235100Z [2024-05-23T23:19:04.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:19:04.089597775Z [2024-05-23T23:19:04.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:18:00+00:00, run_id=scheduled__2024-05-23T23:18:00+00:00, run_start_date=2024-05-23 23:19:00.077242+00:00, run_end_date=2024-05-23 23:19:04.089097+00:00, run_duration=4.011855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:18:00+00:00, data_interval_end=2024-05-23 23:19:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:19:04.103563585Z [2024-05-23T23:19:04.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:19:00+00:00, run_after=2024-05-23T23:20:00+00:00 2024-05-23T23:19:04.150784121Z [2024-05-23T23:19:04.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status success for try_number 1 2024-05-23T23:19:04.151285478Z [2024-05-23T23:19:04.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status success for try_number 1 2024-05-23T23:19:04.165298631Z [2024-05-23T23:19:04.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:18:00+00:00, map_index=-1, run_start_date=2024-05-23 23:19:02.220805+00:00, run_end_date=2024-05-23 23:19:03.619133+00:00, run_duration=1.398328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:19:00.134139+00:00, queued_by_job_id=1, pid=3253 2024-05-23T23:19:04.166245562Z [2024-05-23T23:19:04.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:18:00+00:00, map_index=-1, run_start_date=2024-05-23 23:19:02.080066+00:00, run_end_date=2024-05-23 23:19:03.720812+00:00, run_duration=1.640746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:19:00.134139+00:00, queued_by_job_id=1, pid=3252 2024-05-23T23:20:00.043821760Z [2024-05-23T23:20:00.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:25:00+00:00 2024-05-23T23:20:00.053347708Z [2024-05-23T23:20:00.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:20:00.067938496Z [2024-05-23T23:20:00.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:21:00+00:00 2024-05-23T23:20:00.082245177Z [2024-05-23T23:20:00.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:21:00+00:00 2024-05-23T23:20:00.090444888Z [2024-05-23T23:20:00.090+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:20:00.217333972Z [2024-05-23T23:20:00.216+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T23:20:00.217363581Z 2024-05-23T23:20:00.217367344Z 2024-05-23T23:20:00.217374291Z 2024-05-23T23:20:00.217377575Z 2024-05-23T23:20:00.217381022Z 2024-05-23T23:20:00.217485080Z [2024-05-23T23:20:00.217+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:20:00.217696471Z [2024-05-23T23:20:00.217+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:20:00.217842740Z [2024-05-23T23:20:00.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:20:00.217999907Z [2024-05-23T23:20:00.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:20:00.218152153Z [2024-05-23T23:20:00.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:20:00.219515022Z [2024-05-23T23:20:00.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:20:00.219525739Z 2024-05-23T23:20:00.219529206Z 2024-05-23T23:20:00.219533320Z 2024-05-23T23:20:00.219536619Z 2024-05-23T23:20:00.219539919Z 2024-05-23T23:20:00.227553519Z [2024-05-23T23:20:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:20:00.227720391Z [2024-05-23T23:20:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:20:00.227953294Z [2024-05-23T23:20:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:20:00.228092710Z [2024-05-23T23:20:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:20:00.228292197Z [2024-05-23T23:20:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:20:00.228397081Z [2024-05-23T23:20:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:20:00.228623773Z [2024-05-23T23:20:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:20:00.228722903Z [2024-05-23T23:20:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:20:00.228926917Z [2024-05-23T23:20:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:20:00.229032399Z [2024-05-23T23:20:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:20:00.861399273Z [2024-05-23T23:20:00.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:00.861485642Z [2024-05-23T23:20:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:00.861638267Z [2024-05-23T23:20:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:19:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:00.861718562Z [2024-05-23T23:20:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:19:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:00.861820366Z [2024-05-23T23:20:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:19:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:00.871312039Z [2024-05-23T23:20:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1cb6e07-8a94-49c3-9243-642c20a5e87a 2024-05-23T23:20:00.871414430Z [2024-05-23T23:20:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b95ad67-07d3-48d4-a0dd-529540538775 2024-05-23T23:20:00.871564808Z [2024-05-23T23:20:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to f73b7593-b386-4ecb-9cdc-ef5550105e08 2024-05-23T23:20:00.871714297Z [2024-05-23T23:20:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to adfb089f-15ee-4f51-a230-6d5b3597bff7 2024-05-23T23:20:00.871893220Z [2024-05-23T23:20:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c5ca548-bd8f-4c24-a8b2-444d63ffe840 2024-05-23T23:20:02.173146067Z [2024-05-23T23:20:02.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:20:02.173512594Z [2024-05-23T23:20:02.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:19:00+00:00, run_id=scheduled__2024-05-23T23:19:00+00:00, run_start_date=2024-05-23 23:20:00.115701+00:00, run_end_date=2024-05-23 23:20:02.173029+00:00, run_duration=2.057328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:19:00+00:00, data_interval_end=2024-05-23 23:20:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:20:02.193042882Z [2024-05-23T23:20:02.192+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:21:00+00:00 2024-05-23T23:20:02.809025188Z [2024-05-23T23:20:02.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:20:02.809306279Z [2024-05-23T23:20:02.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:18:00+00:00, run_id=scheduled__2024-05-23T23:18:00+00:00, run_start_date=2024-05-23 23:20:00.110066+00:00, run_end_date=2024-05-23 23:20:02.808970+00:00, run_duration=2.698904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:18:00+00:00, data_interval_end=2024-05-23 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:20:02.836649540Z [2024-05-23T23:20:02.836+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:22:00+00:00 2024-05-23T23:20:02.909488467Z [2024-05-23T23:20:02.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:18:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:02.911709817Z [2024-05-23T23:20:02.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:19:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:02.917447405Z [2024-05-23T23:20:02.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:19:00+00:00, map_index=-1, run_start_date=2024-05-23 23:20:01.411297+00:00, run_end_date=2024-05-23 23:20:02.107083+00:00, run_duration=0.695786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:00.222236+00:00, queued_by_job_id=1, pid=3286 2024-05-23T23:20:02.917693486Z [2024-05-23T23:20:02.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:18:00+00:00, map_index=-1, run_start_date=2024-05-23 23:20:01.655165+00:00, run_end_date=2024-05-23 23:20:02.296877+00:00, run_duration=0.641712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:00.222236+00:00, queued_by_job_id=1, pid=3287 2024-05-23T23:20:04.040694873Z [2024-05-23T23:20:04.040+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:20:04.040737857Z 2024-05-23T23:20:04.040767063Z [2024-05-23T23:20:04.040+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:20:04.041690111Z [2024-05-23T23:20:04.041+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:20:04.041707571Z 2024-05-23T23:20:04.047799284Z [2024-05-23T23:20:04.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:20:04.047829726Z [2024-05-23T23:20:04.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:20:04.130679288Z [2024-05-23T23:20:04.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:04.131188540Z [2024-05-23T23:20:04.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:04.140059133Z [2024-05-23T23:20:04.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30a47ca9-85ae-4c55-b558-fe3986608aa6 2024-05-23T23:20:04.140442442Z [2024-05-23T23:20:04.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:15:00+00:00, map_index=-1, run_start_date=2024-05-23 23:20:03.061680+00:00, run_end_date=2024-05-23 23:20:03.500951+00:00, run_duration=0.439271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:00.222236+00:00, queued_by_job_id=1, pid=3312 2024-05-23T23:20:05.321676058Z [2024-05-23T23:20:05.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:20:05.322103830Z [2024-05-23T23:20:05.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:19:00+00:00, run_id=scheduled__2024-05-23T23:19:00+00:00, run_start_date=2024-05-23 23:20:00.117174+00:00, run_end_date=2024-05-23 23:20:05.321595+00:00, run_duration=5.204421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:19:00+00:00, data_interval_end=2024-05-23 23:20:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:20:05.339265730Z [2024-05-23T23:20:05.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:21:00+00:00 2024-05-23T23:20:05.355208525Z [2024-05-23T23:20:05.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:20:05.355869673Z [2024-05-23T23:20:05.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:19:00+00:00, run_id=scheduled__2024-05-23T23:19:00+00:00, run_start_date=2024-05-23 23:20:00.118419+00:00, run_end_date=2024-05-23 23:20:05.355201+00:00, run_duration=5.236782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:19:00+00:00, data_interval_end=2024-05-23 23:20:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:20:05.371433936Z [2024-05-23T23:20:05.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:21:00+00:00 2024-05-23T23:20:05.430835502Z [2024-05-23T23:20:05.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:19:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:05.431042555Z [2024-05-23T23:20:05.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:19:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:05.439470321Z [2024-05-23T23:20:05.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:19:00+00:00, map_index=-1, run_start_date=2024-05-23 23:20:03.392117+00:00, run_end_date=2024-05-23 23:20:04.707682+00:00, run_duration=1.315565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:00.222236+00:00, queued_by_job_id=1, pid=3323 2024-05-23T23:20:05.439810714Z [2024-05-23T23:20:05.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:19:00+00:00, map_index=-1, run_start_date=2024-05-23 23:20:03.044455+00:00, run_end_date=2024-05-23 23:20:04.744895+00:00, run_duration=1.70044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:00.222236+00:00, queued_by_job_id=1, pid=3311 2024-05-23T23:20:07.100098250Z [2024-05-23T23:20:07.099+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:20:07.100125265Z 2024-05-23T23:20:07.100356786Z [2024-05-23T23:20:07.100+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:20:07.101088598Z [2024-05-23T23:20:07.100+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:20:07.101099670Z 2024-05-23T23:20:07.104582139Z [2024-05-23T23:20:07.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:20:07.104870879Z [2024-05-23T23:20:07.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:20:07.169512701Z [2024-05-23T23:20:07.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:07.169625005Z [2024-05-23T23:20:07.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:07.176685775Z [2024-05-23T23:20:07.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to b17e3684-8869-4b7c-a919-d9bba1bf61d8 2024-05-23T23:20:07.176822586Z [2024-05-23T23:20:07.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:15:00+00:00, map_index=-1, run_start_date=2024-05-23 23:20:05.807511+00:00, run_end_date=2024-05-23 23:20:06.278388+00:00, run_duration=0.470877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:04.042097+00:00, queued_by_job_id=1, pid=3341 2024-05-23T23:20:09.396942246Z [2024-05-23T23:20:09.396+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:20:09.396988778Z 2024-05-23T23:20:09.397017458Z [2024-05-23T23:20:09.396+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:20:09.397585483Z [2024-05-23T23:20:09.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:20:09.397599953Z 2024-05-23T23:20:09.399460557Z [2024-05-23T23:20:09.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:20:09.399639808Z [2024-05-23T23:20:09.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:20:09.449333237Z [2024-05-23T23:20:09.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status queued for try_number 1 2024-05-23T23:20:09.449471787Z [2024-05-23T23:20:09.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:09.454492940Z [2024-05-23T23:20:09.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51405cee-c7fd-4bdb-ab30-129134898350 2024-05-23T23:20:09.454731529Z [2024-05-23T23:20:09.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:15:00+00:00, map_index=0, run_start_date=2024-05-23 23:20:08.719273+00:00, run_end_date=2024-05-23 23:20:09.156718+00:00, run_duration=0.437445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:07.101498+00:00, queued_by_job_id=1, pid=3349 2024-05-23T23:20:12.158279861Z [2024-05-23T23:20:12.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:20:12.158373113Z [2024-05-23T23:20:12.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:15:00+00:00, run_id=scheduled__2024-05-23T23:15:00+00:00, run_start_date=2024-05-23 23:20:00.106119+00:00, run_end_date=2024-05-23 23:20:12.157926+00:00, run_duration=12.051807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:15:00+00:00, data_interval_end=2024-05-23 23:20:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:20:12.164819606Z [2024-05-23T23:20:12.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:20:00+00:00, run_after=2024-05-23T23:25:00+00:00 2024-05-23T23:20:12.224168190Z [2024-05-23T23:20:12.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:15:00+00:00 exited with status success for try_number 1 2024-05-23T23:20:12.235632080Z [2024-05-23T23:20:12.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:15:00+00:00, map_index=-1, run_start_date=2024-05-23 23:20:11.181525+00:00, run_end_date=2024-05-23 23:20:11.516582+00:00, run_duration=0.335057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:20:09.397875+00:00, queued_by_job_id=1, pid=3357 2024-05-23T23:21:01.023586855Z [2024-05-23T23:21:01.023+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:21:01.040027530Z [2024-05-23T23:21:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:21:00+00:00, run_after=2024-05-23T23:22:00+00:00 2024-05-23T23:21:01.058668057Z [2024-05-23T23:21:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:21:00+00:00, run_after=2024-05-23T23:22:00+00:00 2024-05-23T23:21:01.148469254Z [2024-05-23T23:21:01.147+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:21:01.148516175Z 2024-05-23T23:21:01.148523181Z 2024-05-23T23:21:01.148527846Z 2024-05-23T23:21:01.148532844Z [2024-05-23T23:21:01.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:21:01.149022534Z [2024-05-23T23:21:01.148+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:21:01.149360371Z [2024-05-23T23:21:01.148+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:21:01.150280061Z [2024-05-23T23:21:01.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:21:01.150295041Z 2024-05-23T23:21:01.150299987Z 2024-05-23T23:21:01.150305210Z 2024-05-23T23:21:01.155154966Z [2024-05-23T23:21:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:21:01.155861860Z [2024-05-23T23:21:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:21:01.156313400Z [2024-05-23T23:21:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:21:01.156644752Z [2024-05-23T23:21:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:21:01.157153830Z [2024-05-23T23:21:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:21:01.157622568Z [2024-05-23T23:21:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:21:01.372254963Z [2024-05-23T23:21:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:21:01.372375470Z [2024-05-23T23:21:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:21:01.372568244Z [2024-05-23T23:21:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:21:01.393901006Z [2024-05-23T23:21:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to e783a1dc-05dc-447f-b1da-b7614ba5f2b9 2024-05-23T23:21:01.394092689Z [2024-05-23T23:21:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f3f246e-3d62-4886-a923-b04a91e42a9b 2024-05-23T23:21:01.394269098Z [2024-05-23T23:21:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bd45aaf-027b-4ad6-a007-0bf6468e7394 2024-05-23T23:21:03.014908935Z [2024-05-23T23:21:03.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:21:03.015158919Z [2024-05-23T23:21:03.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:20:00+00:00, run_id=scheduled__2024-05-23T23:20:00+00:00, run_start_date=2024-05-23 23:21:01.072436+00:00, run_end_date=2024-05-23 23:21:03.014813+00:00, run_duration=1.942377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:20:00+00:00, data_interval_end=2024-05-23 23:21:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:21:03.024610737Z [2024-05-23T23:21:03.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:21:00+00:00, run_after=2024-05-23T23:22:00+00:00 2024-05-23T23:21:03.076162953Z [2024-05-23T23:21:03.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:21:03.083871341Z [2024-05-23T23:21:03.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=-1, run_start_date=2024-05-23 23:21:01.955177+00:00, run_end_date=2024-05-23 23:21:02.424914+00:00, run_duration=0.469737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:21:01.151411+00:00, queued_by_job_id=1, pid=3380 2024-05-23T23:21:05.600831939Z [2024-05-23T23:21:05.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:21:05.601189868Z [2024-05-23T23:21:05.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:20:00+00:00, run_id=scheduled__2024-05-23T23:20:00+00:00, run_start_date=2024-05-23 23:21:01.075436+00:00, run_end_date=2024-05-23 23:21:05.600568+00:00, run_duration=4.525132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:20:00+00:00, data_interval_end=2024-05-23 23:21:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:21:05.618401380Z [2024-05-23T23:21:05.617+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:21:00+00:00, run_after=2024-05-23T23:22:00+00:00 2024-05-23T23:21:05.629358973Z [2024-05-23T23:21:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:21:05.629626454Z [2024-05-23T23:21:05.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:20:00+00:00, run_id=scheduled__2024-05-23T23:20:00+00:00, run_start_date=2024-05-23 23:21:01.074115+00:00, run_end_date=2024-05-23 23:21:05.629186+00:00, run_duration=4.555071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:20:00+00:00, data_interval_end=2024-05-23 23:21:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:21:05.645368225Z [2024-05-23T23:21:05.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:21:00+00:00, run_after=2024-05-23T23:22:00+00:00 2024-05-23T23:21:05.691091721Z [2024-05-23T23:21:05.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:21:05.691249018Z [2024-05-23T23:21:05.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:21:05.703840493Z [2024-05-23T23:21:05.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=-1, run_start_date=2024-05-23 23:21:02.960414+00:00, run_end_date=2024-05-23 23:21:04.701575+00:00, run_duration=1.741161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:21:01.151411+00:00, queued_by_job_id=1, pid=3393 2024-05-23T23:21:05.704105488Z [2024-05-23T23:21:05.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=-1, run_start_date=2024-05-23 23:21:03.268788+00:00, run_end_date=2024-05-23 23:21:04.683570+00:00, run_duration=1.414782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:21:01.151411+00:00, queued_by_job_id=1, pid=3399 2024-05-23T23:21:39.370723260Z [2024-05-23T23:21:39.369+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:22:01.047299992Z [2024-05-23T23:22:01.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:22:00+00:00, run_after=2024-05-23T23:23:00+00:00 2024-05-23T23:22:01.055827123Z [2024-05-23T23:22:01.055+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:22:01.072296180Z [2024-05-23T23:22:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:22:00+00:00, run_after=2024-05-23T23:23:00+00:00 2024-05-23T23:22:01.084118610Z [2024-05-23T23:22:01.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:22:01.196685947Z [2024-05-23T23:22:01.196+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:22:01.196726139Z 2024-05-23T23:22:01.196735994Z 2024-05-23T23:22:01.196743845Z 2024-05-23T23:22:01.196749789Z 2024-05-23T23:22:01.197160004Z [2024-05-23T23:22:01.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:22:01.197515420Z [2024-05-23T23:22:01.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:22:01.197808381Z [2024-05-23T23:22:01.197+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:22:01.198140630Z [2024-05-23T23:22:01.197+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:22:01.199467910Z [2024-05-23T23:22:01.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:22:01.199489402Z 2024-05-23T23:22:01.199496113Z 2024-05-23T23:22:01.199514622Z 2024-05-23T23:22:01.199520373Z 2024-05-23T23:22:01.206776108Z [2024-05-23T23:22:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:22:01.207368681Z [2024-05-23T23:22:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:22:01.208139982Z [2024-05-23T23:22:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:22:01.208712050Z [2024-05-23T23:22:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:22:01.209429317Z [2024-05-23T23:22:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:22:01.209941335Z [2024-05-23T23:22:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:22:01.210551855Z [2024-05-23T23:22:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:22:01.210870980Z [2024-05-23T23:22:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:22:01.695758199Z [2024-05-23T23:22:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:22:01.695921282Z [2024-05-23T23:22:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:21:00+00:00 exited with status queued for try_number 1 2024-05-23T23:22:01.696028030Z [2024-05-23T23:22:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:21:00+00:00 exited with status queued for try_number 1 2024-05-23T23:22:01.696079340Z [2024-05-23T23:22:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:21:00+00:00 exited with status queued for try_number 1 2024-05-23T23:22:01.714621390Z [2024-05-23T23:22:01.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a6cb299-d32c-4a33-8da8-e7155e1e10a9 2024-05-23T23:22:01.714879507Z [2024-05-23T23:22:01.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 901462e2-387b-464f-a8d2-68c7dd1a691e 2024-05-23T23:22:01.715036580Z [2024-05-23T23:22:01.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69d6bc39-b4ae-427e-98b3-39c8630f3967 2024-05-23T23:22:01.715201173Z [2024-05-23T23:22:01.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bbcb8da-44af-4c7d-9a2d-2cb3767b0ab6 2024-05-23T23:22:02.919643299Z [2024-05-23T23:22:02.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:22:02.920043410Z [2024-05-23T23:22:02.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:20:00+00:00, run_id=scheduled__2024-05-23T23:20:00+00:00, run_start_date=2024-05-23 23:22:01.108030+00:00, run_end_date=2024-05-23 23:22:02.919553+00:00, run_duration=1.811523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:20:00+00:00, data_interval_end=2024-05-23 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:22:02.926747171Z [2024-05-23T23:22:02.926+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:22:00+00:00, run_after=2024-05-23T23:24:00+00:00 2024-05-23T23:22:02.932717150Z [2024-05-23T23:22:02.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:22:02.933118298Z [2024-05-23T23:22:02.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:21:00+00:00, run_id=scheduled__2024-05-23T23:21:00+00:00, run_start_date=2024-05-23 23:22:01.109726+00:00, run_end_date=2024-05-23 23:22:02.932653+00:00, run_duration=1.822927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:21:00+00:00, data_interval_end=2024-05-23 23:22:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:22:02.942166747Z [2024-05-23T23:22:02.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:22:00+00:00, run_after=2024-05-23T23:23:00+00:00 2024-05-23T23:22:03.027211371Z [2024-05-23T23:22:03.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:22:03.027261358Z [2024-05-23T23:22:03.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:21:00+00:00 exited with status success for try_number 1 2024-05-23T23:22:03.035755537Z [2024-05-23T23:22:03.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:21:00+00:00, map_index=-1, run_start_date=2024-05-23 23:22:02.137115+00:00, run_end_date=2024-05-23 23:22:02.539698+00:00, run_duration=0.402583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:22:01.201189+00:00, queued_by_job_id=1, pid=3432 2024-05-23T23:22:03.035904462Z [2024-05-23T23:22:03.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=-1, run_start_date=2024-05-23 23:22:02.178018+00:00, run_end_date=2024-05-23 23:22:02.656075+00:00, run_duration=0.478057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:22:01.201189+00:00, queued_by_job_id=1, pid=3433 2024-05-23T23:22:06.055024389Z [2024-05-23T23:22:06.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:22:06.055548341Z [2024-05-23T23:22:06.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:21:00+00:00, run_id=scheduled__2024-05-23T23:21:00+00:00, run_start_date=2024-05-23 23:22:01.111111+00:00, run_end_date=2024-05-23 23:22:06.054878+00:00, run_duration=4.943767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:21:00+00:00, data_interval_end=2024-05-23 23:22:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:22:06.066230766Z [2024-05-23T23:22:06.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:22:00+00:00, run_after=2024-05-23T23:23:00+00:00 2024-05-23T23:22:06.074487207Z [2024-05-23T23:22:06.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:22:06.074912717Z [2024-05-23T23:22:06.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:21:00+00:00, run_id=scheduled__2024-05-23T23:21:00+00:00, run_start_date=2024-05-23 23:22:01.112064+00:00, run_end_date=2024-05-23 23:22:06.074482+00:00, run_duration=4.962418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:21:00+00:00, data_interval_end=2024-05-23 23:22:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:22:06.084834832Z [2024-05-23T23:22:06.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:22:00+00:00, run_after=2024-05-23T23:23:00+00:00 2024-05-23T23:22:06.124593208Z [2024-05-23T23:22:06.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:21:00+00:00 exited with status success for try_number 1 2024-05-23T23:22:06.124694344Z [2024-05-23T23:22:06.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:21:00+00:00 exited with status success for try_number 1 2024-05-23T23:22:06.133649947Z [2024-05-23T23:22:06.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:21:00+00:00, map_index=-1, run_start_date=2024-05-23 23:22:03.540231+00:00, run_end_date=2024-05-23 23:22:05.476693+00:00, run_duration=1.936462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:22:01.201189+00:00, queued_by_job_id=1, pid=3457 2024-05-23T23:22:06.133791436Z [2024-05-23T23:22:06.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:21:00+00:00, map_index=-1, run_start_date=2024-05-23 23:22:03.410223+00:00, run_end_date=2024-05-23 23:22:05.642121+00:00, run_duration=2.231898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:22:01.201189+00:00, queued_by_job_id=1, pid=3456 2024-05-23T23:23:00.979874286Z [2024-05-23T23:23:00.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:23:00+00:00, run_after=2024-05-23T23:24:00+00:00 2024-05-23T23:23:00.990499428Z [2024-05-23T23:23:00.990+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:23:01.002808610Z [2024-05-23T23:23:01.002+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:23:00+00:00, run_after=2024-05-23T23:24:00+00:00 2024-05-23T23:23:01.084112303Z [2024-05-23T23:23:01.083+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:23:01.084140470Z 2024-05-23T23:23:01.084144707Z 2024-05-23T23:23:01.084148242Z 2024-05-23T23:23:01.084271788Z [2024-05-23T23:23:01.083+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:23:01.084534298Z [2024-05-23T23:23:01.084+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:23:01.084696429Z [2024-05-23T23:23:01.084+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:23:01.085397978Z [2024-05-23T23:23:01.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:23:01.085411005Z 2024-05-23T23:23:01.085415148Z 2024-05-23T23:23:01.085418983Z 2024-05-23T23:23:01.090755995Z [2024-05-23T23:23:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:23:01.090770871Z [2024-05-23T23:23:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:23:01.090784351Z [2024-05-23T23:23:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:23:01.090787266Z [2024-05-23T23:23:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:23:01.090790203Z [2024-05-23T23:23:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:23:01.090793042Z [2024-05-23T23:23:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:23:01.523725514Z [2024-05-23T23:23:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status queued for try_number 1 2024-05-23T23:23:01.526317619Z [2024-05-23T23:23:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status queued for try_number 1 2024-05-23T23:23:01.526631291Z [2024-05-23T23:23:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status queued for try_number 1 2024-05-23T23:23:01.536058760Z [2024-05-23T23:23:01.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 532a65d8-d9d6-4344-bd34-3f3153bc70f7 2024-05-23T23:23:01.536394757Z [2024-05-23T23:23:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17ae5925-d678-4dff-9937-ec1a5affcb36 2024-05-23T23:23:01.536879773Z [2024-05-23T23:23:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc6ce23f-8bc2-437c-8ff3-9c0916a9316a 2024-05-23T23:23:02.679835233Z [2024-05-23T23:23:02.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:23:02.680130985Z [2024-05-23T23:23:02.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:22:00+00:00, run_id=scheduled__2024-05-23T23:22:00+00:00, run_start_date=2024-05-23 23:23:01.017479+00:00, run_end_date=2024-05-23 23:23:02.679753+00:00, run_duration=1.662274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:22:00+00:00, data_interval_end=2024-05-23 23:23:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:23:02.694644920Z [2024-05-23T23:23:02.691+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:23:00+00:00, run_after=2024-05-23T23:24:00+00:00 2024-05-23T23:23:02.863319394Z [2024-05-23T23:23:02.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status success for try_number 1 2024-05-23T23:23:02.871249136Z [2024-05-23T23:23:02.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:22:00+00:00, map_index=-1, run_start_date=2024-05-23 23:23:01.989168+00:00, run_end_date=2024-05-23 23:23:02.429011+00:00, run_duration=0.439843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:23:01.086241+00:00, queued_by_job_id=1, pid=3489 2024-05-23T23:23:05.408854356Z [2024-05-23T23:23:05.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:23:05.409571384Z [2024-05-23T23:23:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:22:00+00:00, run_id=scheduled__2024-05-23T23:22:00+00:00, run_start_date=2024-05-23 23:23:01.018883+00:00, run_end_date=2024-05-23 23:23:05.409056+00:00, run_duration=4.390173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:22:00+00:00, data_interval_end=2024-05-23 23:23:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:23:05.422619332Z [2024-05-23T23:23:05.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:23:00+00:00, run_after=2024-05-23T23:24:00+00:00 2024-05-23T23:23:05.461912004Z [2024-05-23T23:23:05.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status success for try_number 1 2024-05-23T23:23:05.466945606Z [2024-05-23T23:23:05.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:22:00+00:00, map_index=-1, run_start_date=2024-05-23 23:23:03.016391+00:00, run_end_date=2024-05-23 23:23:04.511174+00:00, run_duration=1.494783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:23:01.086241+00:00, queued_by_job_id=1, pid=3502 2024-05-23T23:23:06.513415320Z [2024-05-23T23:23:06.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:23:06.513726442Z [2024-05-23T23:23:06.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:22:00+00:00, run_id=scheduled__2024-05-23T23:22:00+00:00, run_start_date=2024-05-23 23:23:01.020235+00:00, run_end_date=2024-05-23 23:23:06.513366+00:00, run_duration=5.493131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:22:00+00:00, data_interval_end=2024-05-23 23:23:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:23:06.522275539Z [2024-05-23T23:23:06.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:23:00+00:00, run_after=2024-05-23T23:24:00+00:00 2024-05-23T23:23:06.562011531Z [2024-05-23T23:23:06.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status success for try_number 1 2024-05-23T23:23:06.572622795Z [2024-05-23T23:23:06.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:22:00+00:00, map_index=-1, run_start_date=2024-05-23 23:23:03.283848+00:00, run_end_date=2024-05-23 23:23:05.422803+00:00, run_duration=2.138955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:23:01.086241+00:00, queued_by_job_id=1, pid=3513 2024-05-23T23:24:00.873664176Z [2024-05-23T23:24:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:24:00+00:00, run_after=2024-05-23T23:25:00+00:00 2024-05-23T23:24:00.888585065Z [2024-05-23T23:24:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:24:00+00:00, run_after=2024-05-23T23:25:00+00:00 2024-05-23T23:24:00.897268370Z [2024-05-23T23:24:00.896+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:24:00.904876300Z [2024-05-23T23:24:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:24:00.994184859Z [2024-05-23T23:24:00.993+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:24:00.994216425Z 2024-05-23T23:24:00.994227949Z 2024-05-23T23:24:00.994233616Z 2024-05-23T23:24:00.994238986Z 2024-05-23T23:24:00.994331320Z [2024-05-23T23:24:00.994+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:24:00.994408680Z [2024-05-23T23:24:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:24:00.994493037Z [2024-05-23T23:24:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:24:00.994566362Z [2024-05-23T23:24:00.994+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:24:00.995107004Z [2024-05-23T23:24:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:24:00.995117558Z 2024-05-23T23:24:00.995123313Z 2024-05-23T23:24:00.995147516Z 2024-05-23T23:24:00.995152827Z 2024-05-23T23:24:00.998846901Z [2024-05-23T23:24:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:24:00.998869116Z [2024-05-23T23:24:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:24:00.999038885Z [2024-05-23T23:24:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:24:00.999111091Z [2024-05-23T23:24:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:24:00.999211891Z [2024-05-23T23:24:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:24:00.999301072Z [2024-05-23T23:24:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:24:00.999505493Z [2024-05-23T23:24:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:24:00.999519587Z [2024-05-23T23:24:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:24:01.444000336Z [2024-05-23T23:24:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status queued for try_number 1 2024-05-23T23:24:01.444209948Z [2024-05-23T23:24:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:23:00+00:00 exited with status queued for try_number 1 2024-05-23T23:24:01.444378351Z [2024-05-23T23:24:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:23:00+00:00 exited with status queued for try_number 1 2024-05-23T23:24:01.444511081Z [2024-05-23T23:24:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:23:00+00:00 exited with status queued for try_number 1 2024-05-23T23:24:01.456592647Z [2024-05-23T23:24:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to daf1aec1-d3e4-4459-bc81-a999e747680b 2024-05-23T23:24:01.458851115Z [2024-05-23T23:24:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab17363c-c2d7-4bfd-8686-4a438bc6f55c 2024-05-23T23:24:01.459019824Z [2024-05-23T23:24:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc09bcbb-8df6-4436-b823-cecf2a5b7e82 2024-05-23T23:24:01.459162334Z [2024-05-23T23:24:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ce888d2-97ad-4447-8f7f-6fe539e765e7 2024-05-23T23:24:02.897575954Z [2024-05-23T23:24:02.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:24:02.899549286Z [2024-05-23T23:24:02.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:22:00+00:00, run_id=scheduled__2024-05-23T23:22:00+00:00, run_start_date=2024-05-23 23:24:00.916679+00:00, run_end_date=2024-05-23 23:24:02.899111+00:00, run_duration=1.982432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:22:00+00:00, data_interval_end=2024-05-23 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:24:02.938537347Z [2024-05-23T23:24:02.938+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:24:00+00:00, run_after=2024-05-23T23:26:00+00:00 2024-05-23T23:24:03.018327225Z [2024-05-23T23:24:03.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:22:00+00:00 exited with status success for try_number 1 2024-05-23T23:24:03.023919230Z [2024-05-23T23:24:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:22:00+00:00, map_index=-1, run_start_date=2024-05-23 23:24:01.844005+00:00, run_end_date=2024-05-23 23:24:02.308206+00:00, run_duration=0.464201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:24:00.995764+00:00, queued_by_job_id=1, pid=3536 2024-05-23T23:24:04.087212982Z [2024-05-23T23:24:04.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:24:04.087629231Z [2024-05-23T23:24:04.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:23:00+00:00, run_id=scheduled__2024-05-23T23:23:00+00:00, run_start_date=2024-05-23 23:24:00.920762+00:00, run_end_date=2024-05-23 23:24:04.087173+00:00, run_duration=3.166411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:23:00+00:00, data_interval_end=2024-05-23 23:24:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:24:04.101467507Z [2024-05-23T23:24:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:24:00+00:00, run_after=2024-05-23T23:25:00+00:00 2024-05-23T23:24:04.153748737Z [2024-05-23T23:24:04.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:23:00+00:00 exited with status success for try_number 1 2024-05-23T23:24:04.160166927Z [2024-05-23T23:24:04.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:23:00+00:00, map_index=-1, run_start_date=2024-05-23 23:24:02.369332+00:00, run_end_date=2024-05-23 23:24:03.018770+00:00, run_duration=0.649438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:24:00.995764+00:00, queued_by_job_id=1, pid=3548 2024-05-23T23:24:05.916968913Z [2024-05-23T23:24:05.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:24:05.917365757Z [2024-05-23T23:24:05.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:23:00+00:00, run_id=scheduled__2024-05-23T23:23:00+00:00, run_start_date=2024-05-23 23:24:00.923137+00:00, run_end_date=2024-05-23 23:24:05.916756+00:00, run_duration=4.993619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:23:00+00:00, data_interval_end=2024-05-23 23:24:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:24:05.932180734Z [2024-05-23T23:24:05.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:24:00+00:00, run_after=2024-05-23T23:25:00+00:00 2024-05-23T23:24:05.947341359Z [2024-05-23T23:24:05.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:24:05.947503859Z [2024-05-23T23:24:05.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:23:00+00:00, run_id=scheduled__2024-05-23T23:23:00+00:00, run_start_date=2024-05-23 23:24:00.924380+00:00, run_end_date=2024-05-23 23:24:05.945832+00:00, run_duration=5.021452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:23:00+00:00, data_interval_end=2024-05-23 23:24:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:24:05.968295904Z [2024-05-23T23:24:05.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:24:00+00:00, run_after=2024-05-23T23:25:00+00:00 2024-05-23T23:24:06.031298029Z [2024-05-23T23:24:06.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:23:00+00:00 exited with status success for try_number 1 2024-05-23T23:24:06.031615523Z [2024-05-23T23:24:06.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:23:00+00:00 exited with status success for try_number 1 2024-05-23T23:24:06.045021401Z [2024-05-23T23:24:06.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:23:00+00:00, map_index=-1, run_start_date=2024-05-23 23:24:03.576725+00:00, run_end_date=2024-05-23 23:24:04.942078+00:00, run_duration=1.365353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:24:00.995764+00:00, queued_by_job_id=1, pid=3565 2024-05-23T23:24:06.045439094Z [2024-05-23T23:24:06.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:23:00+00:00, map_index=-1, run_start_date=2024-05-23 23:24:03.806406+00:00, run_end_date=2024-05-23 23:24:05.395359+00:00, run_duration=1.588953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:24:00.995764+00:00, queued_by_job_id=1, pid=3566 2024-05-23T23:25:00.298139681Z [2024-05-23T23:25:00.297+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:25:00.309610543Z [2024-05-23T23:25:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:25:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:25:00.327066755Z [2024-05-23T23:25:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:25:00+00:00, run_after=2024-05-23T23:26:00+00:00 2024-05-23T23:25:00.341597895Z [2024-05-23T23:25:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:25:00+00:00, run_after=2024-05-23T23:26:00+00:00 2024-05-23T23:25:00.421017418Z [2024-05-23T23:25:00.420+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:25:00.421061206Z 2024-05-23T23:25:00.421148913Z 2024-05-23T23:25:00.421160084Z 2024-05-23T23:25:00.421168944Z 2024-05-23T23:25:00.421226996Z [2024-05-23T23:25:00.420+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:25:00.421437766Z [2024-05-23T23:25:00.421+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:25:00.421664570Z [2024-05-23T23:25:00.421+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:25:00.421917080Z [2024-05-23T23:25:00.421+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:25:00.423099951Z [2024-05-23T23:25:00.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:25:00.423137004Z 2024-05-23T23:25:00.423142909Z 2024-05-23T23:25:00.423147103Z 2024-05-23T23:25:00.423151851Z 2024-05-23T23:25:00.428181223Z [2024-05-23T23:25:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:25:00.428377260Z [2024-05-23T23:25:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:25:00.428729168Z [2024-05-23T23:25:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:25:00.428905054Z [2024-05-23T23:25:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:25:00.429209137Z [2024-05-23T23:25:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:25:00.429384157Z [2024-05-23T23:25:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:25:00.429705139Z [2024-05-23T23:25:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:25:00.429925377Z [2024-05-23T23:25:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:25:00.728987540Z [2024-05-23T23:25:00.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:25:00.729018400Z [2024-05-23T23:25:00.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status queued for try_number 1 2024-05-23T23:25:00.731083855Z [2024-05-23T23:25:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status queued for try_number 1 2024-05-23T23:25:00.731134321Z [2024-05-23T23:25:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status queued for try_number 1 2024-05-23T23:25:00.748977451Z [2024-05-23T23:25:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to f23a3641-39ee-4027-bafb-a481242d2592 2024-05-23T23:25:00.749168436Z [2024-05-23T23:25:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94e1ac81-926a-4a85-b820-2edd475d8fc9 2024-05-23T23:25:00.749368972Z [2024-05-23T23:25:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d0309da-fb6f-41eb-b285-250041c51c61 2024-05-23T23:25:00.749552543Z [2024-05-23T23:25:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to e59b458b-6e2d-4436-aeba-66bc6cec882b 2024-05-23T23:25:02.154608634Z [2024-05-23T23:25:02.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:25:02.155032748Z [2024-05-23T23:25:02.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:24:00+00:00, run_id=scheduled__2024-05-23T23:24:00+00:00, run_start_date=2024-05-23 23:25:00.354055+00:00, run_end_date=2024-05-23 23:25:02.154699+00:00, run_duration=1.800644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:24:00+00:00, data_interval_end=2024-05-23 23:25:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:25:02.163717418Z [2024-05-23T23:25:02.163+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:25:00+00:00, run_after=2024-05-23T23:26:00+00:00 2024-05-23T23:25:02.211878321Z [2024-05-23T23:25:02.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status success for try_number 1 2024-05-23T23:25:02.218673296Z [2024-05-23T23:25:02.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:24:00+00:00, map_index=-1, run_start_date=2024-05-23 23:25:01.335601+00:00, run_end_date=2024-05-23 23:25:01.776209+00:00, run_duration=0.440608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:25:00.424961+00:00, queued_by_job_id=1, pid=3599 2024-05-23T23:25:03.334429649Z [2024-05-23T23:25:03.334+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:25:03.334491772Z 2024-05-23T23:25:03.336239351Z [2024-05-23T23:25:03.335+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:25:03.337331044Z [2024-05-23T23:25:03.337+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:25:03.337352254Z 2024-05-23T23:25:03.343550073Z [2024-05-23T23:25:03.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:25:03.343903926Z [2024-05-23T23:25:03.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:25:03.394259314Z [2024-05-23T23:25:03.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:25:03.394408113Z [2024-05-23T23:25:03.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:25:03.399384334Z [2024-05-23T23:25:03.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1350bc4b-c4ee-49be-9154-323f695c5bec 2024-05-23T23:25:03.399919822Z [2024-05-23T23:25:03.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=-1, run_start_date=2024-05-23 23:25:02.593677+00:00, run_end_date=2024-05-23 23:25:03.043628+00:00, run_duration=0.449951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:25:00.424961+00:00, queued_by_job_id=1, pid=3625 2024-05-23T23:25:04.550552462Z [2024-05-23T23:25:04.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:25:04.550908327Z [2024-05-23T23:25:04.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:24:00+00:00, run_id=scheduled__2024-05-23T23:24:00+00:00, run_start_date=2024-05-23 23:25:00.355239+00:00, run_end_date=2024-05-23 23:25:04.550461+00:00, run_duration=4.195222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:24:00+00:00, data_interval_end=2024-05-23 23:25:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:25:04.561525254Z [2024-05-23T23:25:04.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:25:00+00:00, run_after=2024-05-23T23:26:00+00:00 2024-05-23T23:25:04.569030134Z [2024-05-23T23:25:04.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:25:04.569142855Z [2024-05-23T23:25:04.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:24:00+00:00, run_id=scheduled__2024-05-23T23:24:00+00:00, run_start_date=2024-05-23 23:25:00.356299+00:00, run_end_date=2024-05-23 23:25:04.568882+00:00, run_duration=4.212583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:24:00+00:00, data_interval_end=2024-05-23 23:25:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:25:04.578671817Z [2024-05-23T23:25:04.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:25:00+00:00, run_after=2024-05-23T23:26:00+00:00 2024-05-23T23:25:04.643753768Z [2024-05-23T23:25:04.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status success for try_number 1 2024-05-23T23:25:04.643822862Z [2024-05-23T23:25:04.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status success for try_number 1 2024-05-23T23:25:04.651576202Z [2024-05-23T23:25:04.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:24:00+00:00, map_index=-1, run_start_date=2024-05-23 23:25:02.465318+00:00, run_end_date=2024-05-23 23:25:03.891624+00:00, run_duration=1.426306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:25:00.424961+00:00, queued_by_job_id=1, pid=3623 2024-05-23T23:25:04.651756739Z [2024-05-23T23:25:04.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:24:00+00:00, map_index=-1, run_start_date=2024-05-23 23:25:02.527391+00:00, run_end_date=2024-05-23 23:25:04.217471+00:00, run_duration=1.69008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:25:00.424961+00:00, queued_by_job_id=1, pid=3624 2024-05-23T23:25:05.888848126Z [2024-05-23T23:25:05.888+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:25:05.888875472Z 2024-05-23T23:25:05.888971743Z [2024-05-23T23:25:05.888+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:25:05.889569786Z [2024-05-23T23:25:05.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:25:05.889581344Z 2024-05-23T23:25:05.893090030Z [2024-05-23T23:25:05.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:25:05.893214490Z [2024-05-23T23:25:05.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:25:05.948059167Z [2024-05-23T23:25:05.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:25:05.948458027Z [2024-05-23T23:25:05.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:25:05.957490132Z [2024-05-23T23:25:05.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a3c2a4f-fac3-4af2-b389-ea89e0b23532 2024-05-23T23:25:05.957854534Z [2024-05-23T23:25:05.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=-1, run_start_date=2024-05-23 23:25:05.194328+00:00, run_end_date=2024-05-23 23:25:05.629373+00:00, run_duration=0.435045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:25:03.338955+00:00, queued_by_job_id=1, pid=3648 2024-05-23T23:25:08.246478936Z [2024-05-23T23:25:08.246+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:25:08.246524966Z 2024-05-23T23:25:08.246595447Z [2024-05-23T23:25:08.246+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:25:08.247797399Z [2024-05-23T23:25:08.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:25:08.247811080Z 2024-05-23T23:25:08.252638771Z [2024-05-23T23:25:08.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:25:08.252906042Z [2024-05-23T23:25:08.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:25:08.341949898Z [2024-05-23T23:25:08.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status queued for try_number 1 2024-05-23T23:25:08.341974082Z [2024-05-23T23:25:08.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:25:08.351539724Z [2024-05-23T23:25:08.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb40ade5-d4bf-48db-8055-e09d0fbc3097 2024-05-23T23:25:08.351791055Z [2024-05-23T23:25:08.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=0, run_start_date=2024-05-23 23:25:07.683714+00:00, run_end_date=2024-05-23 23:25:08.041468+00:00, run_duration=0.357754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:25:05.889948+00:00, queued_by_job_id=1, pid=3656 2024-05-23T23:25:10.615318444Z [2024-05-23T23:25:10.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:25:10.615753141Z [2024-05-23T23:25:10.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:20:00+00:00, run_id=scheduled__2024-05-23T23:20:00+00:00, run_start_date=2024-05-23 23:25:00.352729+00:00, run_end_date=2024-05-23 23:25:10.615397+00:00, run_duration=10.262668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:20:00+00:00, data_interval_end=2024-05-23 23:25:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:25:10.621881830Z [2024-05-23T23:25:10.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:25:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:25:10.645275462Z [2024-05-23T23:25:10.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:20:00+00:00 exited with status success for try_number 1 2024-05-23T23:25:10.652754084Z [2024-05-23T23:25:10.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:20:00+00:00, map_index=-1, run_start_date=2024-05-23 23:25:10.017313+00:00, run_end_date=2024-05-23 23:25:10.352472+00:00, run_duration=0.335159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:25:08.248233+00:00, queued_by_job_id=1, pid=3664 2024-05-23T23:26:01.018743098Z [2024-05-23T23:26:01.018+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:26:01.036510957Z [2024-05-23T23:26:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:26:00+00:00, run_after=2024-05-23T23:27:00+00:00 2024-05-23T23:26:01.046765272Z [2024-05-23T23:26:01.046+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:26:01.060681195Z [2024-05-23T23:26:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:26:00+00:00, run_after=2024-05-23T23:27:00+00:00 2024-05-23T23:26:01.152806623Z [2024-05-23T23:26:01.152+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:26:01.152823614Z 2024-05-23T23:26:01.152827631Z 2024-05-23T23:26:01.152849485Z 2024-05-23T23:26:01.152852723Z 2024-05-23T23:26:01.153180743Z [2024-05-23T23:26:01.153+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:26:01.153428197Z [2024-05-23T23:26:01.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:26:01.154167166Z [2024-05-23T23:26:01.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:26:01.154196556Z [2024-05-23T23:26:01.153+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:26:01.155312172Z [2024-05-23T23:26:01.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:26:01.155352328Z 2024-05-23T23:26:01.155362748Z 2024-05-23T23:26:01.155371425Z 2024-05-23T23:26:01.155379890Z 2024-05-23T23:26:01.159324826Z [2024-05-23T23:26:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:26:01.159593455Z [2024-05-23T23:26:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:26:01.159954771Z [2024-05-23T23:26:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:26:01.160192534Z [2024-05-23T23:26:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:26:01.160574925Z [2024-05-23T23:26:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:26:01.160821512Z [2024-05-23T23:26:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:26:01.161169665Z [2024-05-23T23:26:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:26:01.161421306Z [2024-05-23T23:26:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:26:01.376891257Z [2024-05-23T23:26:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status queued for try_number 1 2024-05-23T23:26:01.377029090Z [2024-05-23T23:26:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status queued for try_number 1 2024-05-23T23:26:01.377035275Z [2024-05-23T23:26:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status queued for try_number 1 2024-05-23T23:26:01.377038705Z [2024-05-23T23:26:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status queued for try_number 1 2024-05-23T23:26:01.387954025Z [2024-05-23T23:26:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 919890a6-f6d9-44aa-a2dd-bfb4bc8a2896 2024-05-23T23:26:01.388032824Z [2024-05-23T23:26:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e940215-36f7-41cd-a7f9-0fa479165f2d 2024-05-23T23:26:01.388067120Z [2024-05-23T23:26:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6eff316-840f-408f-be92-3e7586344561 2024-05-23T23:26:01.388176489Z [2024-05-23T23:26:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40c46b58-a9be-4919-a81a-c3695eb73f0c 2024-05-23T23:26:03.076130270Z [2024-05-23T23:26:03.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:26:03.076638128Z [2024-05-23T23:26:03.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:24:00+00:00, run_id=scheduled__2024-05-23T23:24:00+00:00, run_start_date=2024-05-23 23:26:01.074919+00:00, run_end_date=2024-05-23 23:26:03.076035+00:00, run_duration=2.001116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:24:00+00:00, data_interval_end=2024-05-23 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:26:03.085716281Z [2024-05-23T23:26:03.085+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:26:00+00:00, run_after=2024-05-23T23:28:00+00:00 2024-05-23T23:26:03.096723712Z [2024-05-23T23:26:03.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:26:03.097322800Z [2024-05-23T23:26:03.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:25:00+00:00, run_id=scheduled__2024-05-23T23:25:00+00:00, run_start_date=2024-05-23 23:26:01.076240+00:00, run_end_date=2024-05-23 23:26:03.096635+00:00, run_duration=2.020395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:25:00+00:00, data_interval_end=2024-05-23 23:26:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:26:03.110475833Z [2024-05-23T23:26:03.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:26:00+00:00, run_after=2024-05-23T23:27:00+00:00 2024-05-23T23:26:03.169619775Z [2024-05-23T23:26:03.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:24:00+00:00 exited with status success for try_number 1 2024-05-23T23:26:03.169840667Z [2024-05-23T23:26:03.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status success for try_number 1 2024-05-23T23:26:03.179233057Z [2024-05-23T23:26:03.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:25:00+00:00, map_index=-1, run_start_date=2024-05-23 23:26:02.035738+00:00, run_end_date=2024-05-23 23:26:02.374973+00:00, run_duration=0.339235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:26:01.156423+00:00, queued_by_job_id=1, pid=3688 2024-05-23T23:26:03.179686481Z [2024-05-23T23:26:03.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:24:00+00:00, map_index=-1, run_start_date=2024-05-23 23:26:02.013111+00:00, run_end_date=2024-05-23 23:26:02.415722+00:00, run_duration=0.402611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:26:01.156423+00:00, queued_by_job_id=1, pid=3687 2024-05-23T23:26:05.326351731Z [2024-05-23T23:26:05.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:26:05.327374225Z [2024-05-23T23:26:05.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:25:00+00:00, run_id=scheduled__2024-05-23T23:25:00+00:00, run_start_date=2024-05-23 23:26:01.077403+00:00, run_end_date=2024-05-23 23:26:05.326176+00:00, run_duration=4.248773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:25:00+00:00, data_interval_end=2024-05-23 23:26:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:26:05.343068057Z [2024-05-23T23:26:05.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:26:00+00:00, run_after=2024-05-23T23:27:00+00:00 2024-05-23T23:26:05.350495655Z [2024-05-23T23:26:05.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:26:05.350760639Z [2024-05-23T23:26:05.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:25:00+00:00, run_id=scheduled__2024-05-23T23:25:00+00:00, run_start_date=2024-05-23 23:26:01.078454+00:00, run_end_date=2024-05-23 23:26:05.350473+00:00, run_duration=4.272019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:25:00+00:00, data_interval_end=2024-05-23 23:26:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:26:05.371934980Z [2024-05-23T23:26:05.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:26:00+00:00, run_after=2024-05-23T23:27:00+00:00 2024-05-23T23:26:05.414894588Z [2024-05-23T23:26:05.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status success for try_number 1 2024-05-23T23:26:05.415088068Z [2024-05-23T23:26:05.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status success for try_number 1 2024-05-23T23:26:05.425820864Z [2024-05-23T23:26:05.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:25:00+00:00, map_index=-1, run_start_date=2024-05-23 23:26:03.234793+00:00, run_end_date=2024-05-23 23:26:04.570259+00:00, run_duration=1.335466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:26:01.156423+00:00, queued_by_job_id=1, pid=3712 2024-05-23T23:26:05.426130174Z [2024-05-23T23:26:05.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:25:00+00:00, map_index=-1, run_start_date=2024-05-23 23:26:03.216149+00:00, run_end_date=2024-05-23 23:26:05.106749+00:00, run_duration=1.8906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:26:01.156423+00:00, queued_by_job_id=1, pid=3711 2024-05-23T23:26:39.450341375Z [2024-05-23T23:26:39.449+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:27:01.030772500Z [2024-05-23T23:27:01.030+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:27:00+00:00, run_after=2024-05-23T23:28:00+00:00 2024-05-23T23:27:01.038870551Z [2024-05-23T23:27:01.038+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:27:01.053010365Z [2024-05-23T23:27:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:27:00+00:00, run_after=2024-05-23T23:28:00+00:00 2024-05-23T23:27:01.147177952Z [2024-05-23T23:27:01.146+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:27:01.147220406Z 2024-05-23T23:27:01.147224610Z 2024-05-23T23:27:01.147242855Z 2024-05-23T23:27:01.147711601Z [2024-05-23T23:27:01.147+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:27:01.148186759Z [2024-05-23T23:27:01.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:27:01.148705368Z [2024-05-23T23:27:01.148+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:27:01.150222967Z [2024-05-23T23:27:01.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:27:01.150229941Z 2024-05-23T23:27:01.150233471Z 2024-05-23T23:27:01.150236890Z 2024-05-23T23:27:01.157056309Z [2024-05-23T23:27:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:27:01.157637299Z [2024-05-23T23:27:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:27:01.158434138Z [2024-05-23T23:27:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:27:01.158993733Z [2024-05-23T23:27:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:27:01.159534234Z [2024-05-23T23:27:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:27:01.159936635Z [2024-05-23T23:27:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:27:01.387623495Z [2024-05-23T23:27:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status queued for try_number 1 2024-05-23T23:27:01.387677486Z [2024-05-23T23:27:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status queued for try_number 1 2024-05-23T23:27:01.387700770Z [2024-05-23T23:27:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status queued for try_number 1 2024-05-23T23:27:01.398870580Z [2024-05-23T23:27:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52f99c0c-adac-41e5-8834-0a26baf662e6 2024-05-23T23:27:01.398917927Z [2024-05-23T23:27:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bc2aeff-aba2-4bcc-9b0b-2bf606fefbf0 2024-05-23T23:27:01.399016326Z [2024-05-23T23:27:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15db535b-360a-4c85-9e90-7da447aadcfd 2024-05-23T23:27:02.528375797Z [2024-05-23T23:27:02.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:27:02.528750701Z [2024-05-23T23:27:02.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:26:00+00:00, run_id=scheduled__2024-05-23T23:26:00+00:00, run_start_date=2024-05-23 23:27:01.068561+00:00, run_end_date=2024-05-23 23:27:02.528411+00:00, run_duration=1.45985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:26:00+00:00, data_interval_end=2024-05-23 23:27:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:27:02.539047041Z [2024-05-23T23:27:02.538+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:27:00+00:00, run_after=2024-05-23T23:28:00+00:00 2024-05-23T23:27:02.595273448Z [2024-05-23T23:27:02.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status success for try_number 1 2024-05-23T23:27:02.602880065Z [2024-05-23T23:27:02.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:26:00+00:00, map_index=-1, run_start_date=2024-05-23 23:27:01.948587+00:00, run_end_date=2024-05-23 23:27:02.360533+00:00, run_duration=0.411946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:27:01.152106+00:00, queued_by_job_id=1, pid=3744 2024-05-23T23:27:05.158974592Z [2024-05-23T23:27:05.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:27:05.159372334Z [2024-05-23T23:27:05.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:26:00+00:00, run_id=scheduled__2024-05-23T23:26:00+00:00, run_start_date=2024-05-23 23:27:01.069844+00:00, run_end_date=2024-05-23 23:27:05.158807+00:00, run_duration=4.088963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:26:00+00:00, data_interval_end=2024-05-23 23:27:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:27:05.169879094Z [2024-05-23T23:27:05.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:27:00+00:00, run_after=2024-05-23T23:28:00+00:00 2024-05-23T23:27:05.219142789Z [2024-05-23T23:27:05.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status success for try_number 1 2024-05-23T23:27:05.227562213Z [2024-05-23T23:27:05.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:26:00+00:00, map_index=-1, run_start_date=2024-05-23 23:27:03.088864+00:00, run_end_date=2024-05-23 23:27:04.597932+00:00, run_duration=1.509068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:27:01.152106+00:00, queued_by_job_id=1, pid=3762 2024-05-23T23:27:07.182069861Z [2024-05-23T23:27:07.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:27:07.182275266Z [2024-05-23T23:27:07.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:26:00+00:00, run_id=scheduled__2024-05-23T23:26:00+00:00, run_start_date=2024-05-23 23:27:01.070933+00:00, run_end_date=2024-05-23 23:27:07.181861+00:00, run_duration=6.110928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:26:00+00:00, data_interval_end=2024-05-23 23:27:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:27:07.190996592Z [2024-05-23T23:27:07.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:27:00+00:00, run_after=2024-05-23T23:28:00+00:00 2024-05-23T23:27:07.228108884Z [2024-05-23T23:27:07.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status success for try_number 1 2024-05-23T23:27:07.233653660Z [2024-05-23T23:27:07.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:26:00+00:00, map_index=-1, run_start_date=2024-05-23 23:27:03.095672+00:00, run_end_date=2024-05-23 23:27:06.150868+00:00, run_duration=3.055196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:27:01.152106+00:00, queued_by_job_id=1, pid=3763 2024-05-23T23:28:00.857795441Z [2024-05-23T23:28:00.856+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:28:00.878078530Z [2024-05-23T23:28:00.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:28:00+00:00, run_after=2024-05-23T23:29:00+00:00 2024-05-23T23:28:00.888588059Z [2024-05-23T23:28:00.888+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:28:00.903416779Z [2024-05-23T23:28:00.903+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:28:00+00:00, run_after=2024-05-23T23:29:00+00:00 2024-05-23T23:28:00.999269749Z [2024-05-23T23:28:00.998+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:28:00.999300023Z 2024-05-23T23:28:00.999309681Z 2024-05-23T23:28:00.999315190Z 2024-05-23T23:28:00.999320962Z 2024-05-23T23:28:00.999569696Z [2024-05-23T23:28:00.999+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:28:00.999836247Z [2024-05-23T23:28:00.999+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:28:01.000091664Z [2024-05-23T23:28:00.999+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:28:01.000311928Z [2024-05-23T23:28:01.000+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:28:01.001182036Z [2024-05-23T23:28:01.000+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:28:01.001196703Z 2024-05-23T23:28:01.001202839Z 2024-05-23T23:28:01.001208274Z 2024-05-23T23:28:01.001214010Z 2024-05-23T23:28:01.006583666Z [2024-05-23T23:28:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:28:01.006873304Z [2024-05-23T23:28:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:28:01.007294337Z [2024-05-23T23:28:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:28:01.007507577Z [2024-05-23T23:28:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:28:01.007860641Z [2024-05-23T23:28:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:28:01.008159830Z [2024-05-23T23:28:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:28:01.008984299Z [2024-05-23T23:28:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:28:01.009189305Z [2024-05-23T23:28:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:28:01.505819317Z [2024-05-23T23:28:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status queued for try_number 1 2024-05-23T23:28:01.505946994Z [2024-05-23T23:28:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:27:00+00:00 exited with status queued for try_number 1 2024-05-23T23:28:01.506057042Z [2024-05-23T23:28:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:27:00+00:00 exited with status queued for try_number 1 2024-05-23T23:28:01.506159920Z [2024-05-23T23:28:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:27:00+00:00 exited with status queued for try_number 1 2024-05-23T23:28:01.521986800Z [2024-05-23T23:28:01.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a3c4502-6e71-425e-9819-77c01ef310c0 2024-05-23T23:28:01.522017228Z [2024-05-23T23:28:01.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e8d68b3-19b1-4d68-8c9c-02d9d3f15bf6 2024-05-23T23:28:01.522143007Z [2024-05-23T23:28:01.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to e33384f9-c96e-4cd2-8430-9d0b947bf31f 2024-05-23T23:28:01.522219270Z [2024-05-23T23:28:01.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4460cbd5-2189-4420-8288-f1645ca8528a 2024-05-23T23:28:02.718669755Z [2024-05-23T23:28:02.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:28:02.718699207Z [2024-05-23T23:28:02.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:26:00+00:00, run_id=scheduled__2024-05-23T23:26:00+00:00, run_start_date=2024-05-23 23:28:00.920588+00:00, run_end_date=2024-05-23 23:28:02.716515+00:00, run_duration=1.795927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:26:00+00:00, data_interval_end=2024-05-23 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:28:02.726757438Z [2024-05-23T23:28:02.726+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:28:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:28:02.733925658Z [2024-05-23T23:28:02.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:28:02.734249819Z [2024-05-23T23:28:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:27:00+00:00, run_id=scheduled__2024-05-23T23:27:00+00:00, run_start_date=2024-05-23 23:28:00.922468+00:00, run_end_date=2024-05-23 23:28:02.733922+00:00, run_duration=1.811454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:27:00+00:00, data_interval_end=2024-05-23 23:28:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:28:02.747737479Z [2024-05-23T23:28:02.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:28:00+00:00, run_after=2024-05-23T23:29:00+00:00 2024-05-23T23:28:02.802796733Z [2024-05-23T23:28:02.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:26:00+00:00 exited with status success for try_number 1 2024-05-23T23:28:02.802878814Z [2024-05-23T23:28:02.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:27:00+00:00 exited with status success for try_number 1 2024-05-23T23:28:02.809300251Z [2024-05-23T23:28:02.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:27:00+00:00, map_index=-1, run_start_date=2024-05-23 23:28:01.967285+00:00, run_end_date=2024-05-23 23:28:02.439079+00:00, run_duration=0.471794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:28:01.002304+00:00, queued_by_job_id=1, pid=3796 2024-05-23T23:28:02.809443565Z [2024-05-23T23:28:02.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:26:00+00:00, map_index=-1, run_start_date=2024-05-23 23:28:01.961088+00:00, run_end_date=2024-05-23 23:28:02.280700+00:00, run_duration=0.319612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:28:01.002304+00:00, queued_by_job_id=1, pid=3797 2024-05-23T23:28:04.934083424Z [2024-05-23T23:28:04.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:28:04.934734414Z [2024-05-23T23:28:04.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:27:00+00:00, run_id=scheduled__2024-05-23T23:27:00+00:00, run_start_date=2024-05-23 23:28:00.923756+00:00, run_end_date=2024-05-23 23:28:04.933917+00:00, run_duration=4.010161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:27:00+00:00, data_interval_end=2024-05-23 23:28:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:28:04.943912428Z [2024-05-23T23:28:04.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:28:00+00:00, run_after=2024-05-23T23:29:00+00:00 2024-05-23T23:28:04.995797983Z [2024-05-23T23:28:04.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:27:00+00:00 exited with status success for try_number 1 2024-05-23T23:28:05.003041058Z [2024-05-23T23:28:05.002+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:27:00+00:00, map_index=-1, run_start_date=2024-05-23 23:28:03.030494+00:00, run_end_date=2024-05-23 23:28:04.314795+00:00, run_duration=1.284301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:28:01.002304+00:00, queued_by_job_id=1, pid=3820 2024-05-23T23:28:06.060885070Z [2024-05-23T23:28:06.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:28:06.061287461Z [2024-05-23T23:28:06.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:27:00+00:00, run_id=scheduled__2024-05-23T23:27:00+00:00, run_start_date=2024-05-23 23:28:00.924980+00:00, run_end_date=2024-05-23 23:28:06.060822+00:00, run_duration=5.135842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:27:00+00:00, data_interval_end=2024-05-23 23:28:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:28:06.072505216Z [2024-05-23T23:28:06.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:28:00+00:00, run_after=2024-05-23T23:29:00+00:00 2024-05-23T23:28:06.114270566Z [2024-05-23T23:28:06.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:27:00+00:00 exited with status success for try_number 1 2024-05-23T23:28:06.120519837Z [2024-05-23T23:28:06.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:27:00+00:00, map_index=-1, run_start_date=2024-05-23 23:28:03.056459+00:00, run_end_date=2024-05-23 23:28:04.930072+00:00, run_duration=1.873613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:28:01.002304+00:00, queued_by_job_id=1, pid=3821 2024-05-23T23:29:00.956718048Z [2024-05-23T23:29:00.955+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:29:00.970538245Z [2024-05-23T23:29:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:29:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:29:00.982793988Z [2024-05-23T23:29:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:29:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:29:01.051272954Z [2024-05-23T23:29:01.050+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:29:01.051297155Z 2024-05-23T23:29:01.051300864Z 2024-05-23T23:29:01.051304248Z 2024-05-23T23:29:01.051520196Z [2024-05-23T23:29:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:29:01.051775692Z [2024-05-23T23:29:01.051+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:29:01.052043240Z [2024-05-23T23:29:01.051+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:29:01.052927188Z [2024-05-23T23:29:01.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:29:01.052934161Z 2024-05-23T23:29:01.052937378Z 2024-05-23T23:29:01.052940659Z 2024-05-23T23:29:01.057374905Z [2024-05-23T23:29:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:29:01.057726173Z [2024-05-23T23:29:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:29:01.058120179Z [2024-05-23T23:29:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:29:01.058366355Z [2024-05-23T23:29:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:29:01.058806635Z [2024-05-23T23:29:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:29:01.059020699Z [2024-05-23T23:29:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:29:01.337103168Z [2024-05-23T23:29:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status queued for try_number 1 2024-05-23T23:29:01.337180977Z [2024-05-23T23:29:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status queued for try_number 1 2024-05-23T23:29:01.337254812Z [2024-05-23T23:29:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status queued for try_number 1 2024-05-23T23:29:01.344968512Z [2024-05-23T23:29:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22b432a6-2c3a-4ce2-afb9-c50ff9e6f672 2024-05-23T23:29:01.345152313Z [2024-05-23T23:29:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fe6270c-353d-4f22-ab03-4f5850ebe128 2024-05-23T23:29:01.345318623Z [2024-05-23T23:29:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3af1a81-b30f-46fe-9988-6ecad06b1bc7 2024-05-23T23:29:02.506427394Z [2024-05-23T23:29:02.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:29:02.506817773Z [2024-05-23T23:29:02.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:28:00+00:00, run_id=scheduled__2024-05-23T23:28:00+00:00, run_start_date=2024-05-23 23:29:00.993524+00:00, run_end_date=2024-05-23 23:29:02.506345+00:00, run_duration=1.512821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:28:00+00:00, data_interval_end=2024-05-23 23:29:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:29:02.519553646Z [2024-05-23T23:29:02.518+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:29:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:29:02.607017552Z [2024-05-23T23:29:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status success for try_number 1 2024-05-23T23:29:02.619954550Z [2024-05-23T23:29:02.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:28:00+00:00, map_index=-1, run_start_date=2024-05-23 23:29:01.857922+00:00, run_end_date=2024-05-23 23:29:02.366777+00:00, run_duration=0.508855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:29:01.054220+00:00, queued_by_job_id=1, pid=3853 2024-05-23T23:29:04.835338843Z [2024-05-23T23:29:04.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:29:04.836151279Z [2024-05-23T23:29:04.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:28:00+00:00, run_id=scheduled__2024-05-23T23:28:00+00:00, run_start_date=2024-05-23 23:29:00.994809+00:00, run_end_date=2024-05-23 23:29:04.835104+00:00, run_duration=3.840295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:28:00+00:00, data_interval_end=2024-05-23 23:29:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:29:04.855963493Z [2024-05-23T23:29:04.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:29:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:29:04.924193946Z [2024-05-23T23:29:04.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status success for try_number 1 2024-05-23T23:29:04.932491022Z [2024-05-23T23:29:04.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:28:00+00:00, map_index=-1, run_start_date=2024-05-23 23:29:03.106335+00:00, run_end_date=2024-05-23 23:29:04.384458+00:00, run_duration=1.278123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:29:01.054220+00:00, queued_by_job_id=1, pid=3871 2024-05-23T23:29:06.013435752Z [2024-05-23T23:29:06.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:29:06.013793589Z [2024-05-23T23:29:06.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:28:00+00:00, run_id=scheduled__2024-05-23T23:28:00+00:00, run_start_date=2024-05-23 23:29:00.995855+00:00, run_end_date=2024-05-23 23:29:06.013312+00:00, run_duration=5.017457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:28:00+00:00, data_interval_end=2024-05-23 23:29:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:29:06.023057312Z [2024-05-23T23:29:06.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:29:00+00:00, run_after=2024-05-23T23:30:00+00:00 2024-05-23T23:29:06.054704014Z [2024-05-23T23:29:06.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status success for try_number 1 2024-05-23T23:29:06.064062539Z [2024-05-23T23:29:06.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:28:00+00:00, map_index=-1, run_start_date=2024-05-23 23:29:03.240590+00:00, run_end_date=2024-05-23 23:29:05.036155+00:00, run_duration=1.795565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:29:01.054220+00:00, queued_by_job_id=1, pid=3872 2024-05-23T23:30:00.528163538Z [2024-05-23T23:30:00.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:35:00+00:00 2024-05-23T23:30:00.545088846Z [2024-05-23T23:30:00.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:31:00+00:00 2024-05-23T23:30:00.553103198Z [2024-05-23T23:30:00.552+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:30:00.564110065Z [2024-05-23T23:30:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:31:00+00:00 2024-05-23T23:30:00.570721936Z [2024-05-23T23:30:00.570+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:30:00.676679506Z [2024-05-23T23:30:00.676+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T23:30:00.676712920Z 2024-05-23T23:30:00.676719581Z 2024-05-23T23:30:00.676726215Z 2024-05-23T23:30:00.676732519Z 2024-05-23T23:30:00.676739037Z 2024-05-23T23:30:00.677009393Z [2024-05-23T23:30:00.676+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:30:00.677310711Z [2024-05-23T23:30:00.677+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:30:00.677546913Z [2024-05-23T23:30:00.677+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:30:00.677803013Z [2024-05-23T23:30:00.677+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:30:00.678037501Z [2024-05-23T23:30:00.677+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:30:00.679160779Z [2024-05-23T23:30:00.678+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:30:00.679180968Z 2024-05-23T23:30:00.679187491Z 2024-05-23T23:30:00.679194404Z 2024-05-23T23:30:00.679200145Z 2024-05-23T23:30:00.679206209Z 2024-05-23T23:30:00.685366818Z [2024-05-23T23:30:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:30:00.685683634Z [2024-05-23T23:30:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:30:00.686118653Z [2024-05-23T23:30:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:30:00.686371741Z [2024-05-23T23:30:00.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:30:00.686819122Z [2024-05-23T23:30:00.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:30:00.687066189Z [2024-05-23T23:30:00.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:30:00.687447991Z [2024-05-23T23:30:00.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:30:00.687680435Z [2024-05-23T23:30:00.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:30:00.688070389Z [2024-05-23T23:30:00.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:30:00.688316053Z [2024-05-23T23:30:00.688+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:30:01.357135606Z [2024-05-23T23:30:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:01.357194116Z [2024-05-23T23:30:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:01.357339425Z [2024-05-23T23:30:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:29:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:01.357416083Z [2024-05-23T23:30:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:29:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:01.357525517Z [2024-05-23T23:30:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:29:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:01.378596922Z [2024-05-23T23:30:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to adf0cb39-c78e-4c46-a301-b450c792e7c8 2024-05-23T23:30:01.378971906Z [2024-05-23T23:30:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to faae41df-d336-4cc7-9229-3e607666ea0c 2024-05-23T23:30:01.379172069Z [2024-05-23T23:30:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8784eebd-2253-474b-94b4-2b43a2a9db8a 2024-05-23T23:30:01.379309533Z [2024-05-23T23:30:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3314a59b-bfb5-4b0c-946c-12f0d9406444 2024-05-23T23:30:01.379464074Z [2024-05-23T23:30:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4877be6-2f3b-4895-b6b6-8a27616bc8bf 2024-05-23T23:30:02.657917004Z [2024-05-23T23:30:02.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:30:02.658425335Z [2024-05-23T23:30:02.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:28:00+00:00, run_id=scheduled__2024-05-23T23:28:00+00:00, run_start_date=2024-05-23 23:30:00.584190+00:00, run_end_date=2024-05-23 23:30:02.657870+00:00, run_duration=2.07368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:28:00+00:00, data_interval_end=2024-05-23 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:30:02.670102390Z [2024-05-23T23:30:02.669+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:32:00+00:00 2024-05-23T23:30:02.677054758Z [2024-05-23T23:30:02.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:30:02.677408405Z [2024-05-23T23:30:02.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:29:00+00:00, run_id=scheduled__2024-05-23T23:29:00+00:00, run_start_date=2024-05-23 23:30:00.585167+00:00, run_end_date=2024-05-23 23:30:02.676958+00:00, run_duration=2.091791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:29:00+00:00, data_interval_end=2024-05-23 23:30:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:30:02.691928071Z [2024-05-23T23:30:02.691+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:31:00+00:00 2024-05-23T23:30:02.819532741Z [2024-05-23T23:30:02.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:28:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:02.820114859Z [2024-05-23T23:30:02.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:29:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:02.829712371Z [2024-05-23T23:30:02.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:28:00+00:00, map_index=-1, run_start_date=2024-05-23 23:30:01.853003+00:00, run_end_date=2024-05-23 23:30:02.347528+00:00, run_duration=0.494525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:00.680943+00:00, queued_by_job_id=1, pid=3907 2024-05-23T23:30:02.830934664Z [2024-05-23T23:30:02.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:29:00+00:00, map_index=-1, run_start_date=2024-05-23 23:30:02.047237+00:00, run_end_date=2024-05-23 23:30:02.486919+00:00, run_duration=0.439682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:00.680943+00:00, queued_by_job_id=1, pid=3909 2024-05-23T23:30:03.936908558Z [2024-05-23T23:30:03.936+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:30:03.936979090Z 2024-05-23T23:30:03.938163146Z [2024-05-23T23:30:03.937+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:30:03.945351749Z [2024-05-23T23:30:03.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:30:03.945392191Z 2024-05-23T23:30:03.952885845Z [2024-05-23T23:30:03.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:30:03.953260223Z [2024-05-23T23:30:03.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:30:04.027353688Z [2024-05-23T23:30:04.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:04.028807851Z [2024-05-23T23:30:04.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:04.033780840Z [2024-05-23T23:30:04.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 089d0419-2035-4d66-a4c8-b850174a2b4f 2024-05-23T23:30:04.034061413Z [2024-05-23T23:30:04.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:25:00+00:00, map_index=-1, run_start_date=2024-05-23 23:30:03.184267+00:00, run_end_date=2024-05-23 23:30:03.575925+00:00, run_duration=0.391658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:00.680943+00:00, queued_by_job_id=1, pid=3938 2024-05-23T23:30:05.199229690Z [2024-05-23T23:30:05.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:30:05.199683575Z [2024-05-23T23:30:05.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:29:00+00:00, run_id=scheduled__2024-05-23T23:29:00+00:00, run_start_date=2024-05-23 23:30:00.586072+00:00, run_end_date=2024-05-23 23:30:05.199345+00:00, run_duration=4.613273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:29:00+00:00, data_interval_end=2024-05-23 23:30:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:30:05.211215130Z [2024-05-23T23:30:05.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:31:00+00:00 2024-05-23T23:30:05.222934457Z [2024-05-23T23:30:05.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:30:05.223277970Z [2024-05-23T23:30:05.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:29:00+00:00, run_id=scheduled__2024-05-23T23:29:00+00:00, run_start_date=2024-05-23 23:30:00.587003+00:00, run_end_date=2024-05-23 23:30:05.222903+00:00, run_duration=4.6359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:29:00+00:00, data_interval_end=2024-05-23 23:30:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:30:05.233661344Z [2024-05-23T23:30:05.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:31:00+00:00 2024-05-23T23:30:05.307501839Z [2024-05-23T23:30:05.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:29:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:05.307739873Z [2024-05-23T23:30:05.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:29:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:05.320069498Z [2024-05-23T23:30:05.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:29:00+00:00, map_index=-1, run_start_date=2024-05-23 23:30:03.015482+00:00, run_end_date=2024-05-23 23:30:04.784737+00:00, run_duration=1.769255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:00.680943+00:00, queued_by_job_id=1, pid=3937 2024-05-23T23:30:05.320651269Z [2024-05-23T23:30:05.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:29:00+00:00, map_index=-1, run_start_date=2024-05-23 23:30:02.938185+00:00, run_end_date=2024-05-23 23:30:04.352444+00:00, run_duration=1.414259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:00.680943+00:00, queued_by_job_id=1, pid=3931 2024-05-23T23:30:06.396148951Z [2024-05-23T23:30:06.395+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:30:06.396182466Z 2024-05-23T23:30:06.396610658Z [2024-05-23T23:30:06.396+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:30:06.397382405Z [2024-05-23T23:30:06.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:30:06.397396218Z 2024-05-23T23:30:06.400056790Z [2024-05-23T23:30:06.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:30:06.400429591Z [2024-05-23T23:30:06.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:30:06.469532010Z [2024-05-23T23:30:06.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:06.469877294Z [2024-05-23T23:30:06.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:06.476344187Z [2024-05-23T23:30:06.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to baf3ffde-71a2-4eb4-95a7-fe813f5709b2 2024-05-23T23:30:06.476710647Z [2024-05-23T23:30:06.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:25:00+00:00, map_index=-1, run_start_date=2024-05-23 23:30:05.625836+00:00, run_end_date=2024-05-23 23:30:06.041271+00:00, run_duration=0.415435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:03.946819+00:00, queued_by_job_id=1, pid=3961 2024-05-23T23:30:09.637355117Z [2024-05-23T23:30:09.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:30:09.637381659Z 2024-05-23T23:30:09.637464023Z [2024-05-23T23:30:09.637+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:30:09.637974708Z [2024-05-23T23:30:09.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:30:09.637990729Z 2024-05-23T23:30:09.640357673Z [2024-05-23T23:30:09.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:30:09.640502819Z [2024-05-23T23:30:09.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:30:09.748551594Z [2024-05-23T23:30:09.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status queued for try_number 1 2024-05-23T23:30:09.749228527Z [2024-05-23T23:30:09.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:09.760301177Z [2024-05-23T23:30:09.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14bcac06-9a60-4079-be02-c25133633f31 2024-05-23T23:30:09.760625603Z [2024-05-23T23:30:09.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:25:00+00:00, map_index=0, run_start_date=2024-05-23 23:30:08.112463+00:00, run_end_date=2024-05-23 23:30:08.550665+00:00, run_duration=0.438202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:06.397888+00:00, queued_by_job_id=1, pid=3969 2024-05-23T23:30:12.409656468Z [2024-05-23T23:30:12.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:30:12.410385379Z [2024-05-23T23:30:12.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:25:00+00:00, run_id=scheduled__2024-05-23T23:25:00+00:00, run_start_date=2024-05-23 23:30:00.582949+00:00, run_end_date=2024-05-23 23:30:12.409773+00:00, run_duration=11.826824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:25:00+00:00, data_interval_end=2024-05-23 23:30:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:30:12.418945502Z [2024-05-23T23:30:12.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:30:00+00:00, run_after=2024-05-23T23:35:00+00:00 2024-05-23T23:30:12.473994701Z [2024-05-23T23:30:12.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:25:00+00:00 exited with status success for try_number 1 2024-05-23T23:30:12.481872728Z [2024-05-23T23:30:12.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:25:00+00:00, map_index=-1, run_start_date=2024-05-23 23:30:11.364940+00:00, run_end_date=2024-05-23 23:30:11.747926+00:00, run_duration=0.382986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:30:09.638351+00:00, queued_by_job_id=1, pid=3977 2024-05-23T23:31:00.858982849Z [2024-05-23T23:31:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:31:00+00:00, run_after=2024-05-23T23:32:00+00:00 2024-05-23T23:31:00.873008270Z [2024-05-23T23:31:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:31:00+00:00, run_after=2024-05-23T23:32:00+00:00 2024-05-23T23:31:00.880358981Z [2024-05-23T23:31:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:31:00.967661857Z [2024-05-23T23:31:00.966+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:31:00.967689850Z 2024-05-23T23:31:00.967694702Z 2024-05-23T23:31:00.967699146Z 2024-05-23T23:31:00.967703510Z [2024-05-23T23:31:00.966+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:31:00.967707703Z [2024-05-23T23:31:00.966+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:31:00.967711839Z [2024-05-23T23:31:00.966+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:31:00.967717059Z [2024-05-23T23:31:00.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:31:00.967721510Z 2024-05-23T23:31:00.967725670Z 2024-05-23T23:31:00.967729805Z 2024-05-23T23:31:00.977684473Z [2024-05-23T23:31:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:31:00.977707742Z [2024-05-23T23:31:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:31:00.977725763Z [2024-05-23T23:31:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:31:00.977730381Z [2024-05-23T23:31:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:31:00.977735003Z [2024-05-23T23:31:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:31:00.977739469Z [2024-05-23T23:31:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:31:01.238172219Z [2024-05-23T23:31:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:31:01.238201236Z [2024-05-23T23:31:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:31:01.238208093Z [2024-05-23T23:31:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:31:01.249213780Z [2024-05-23T23:31:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99435f7d-a1c4-4770-9e20-fbc4055f6e3d 2024-05-23T23:31:01.249256619Z [2024-05-23T23:31:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to 735840be-38cd-4ffd-9c4f-653e908e8954 2024-05-23T23:31:01.249368513Z [2024-05-23T23:31:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to c90bae34-d284-47fe-863c-277d598d0bb2 2024-05-23T23:31:02.320195830Z [2024-05-23T23:31:02.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:31:02.320886178Z [2024-05-23T23:31:02.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:30:00+00:00, run_id=scheduled__2024-05-23T23:30:00+00:00, run_start_date=2024-05-23 23:31:00.893453+00:00, run_end_date=2024-05-23 23:31:02.320300+00:00, run_duration=1.426847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:30:00+00:00, data_interval_end=2024-05-23 23:31:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:31:02.331434377Z [2024-05-23T23:31:02.331+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:31:00+00:00, run_after=2024-05-23T23:32:00+00:00 2024-05-23T23:31:02.374311163Z [2024-05-23T23:31:02.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:31:02.378884939Z [2024-05-23T23:31:02.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=-1, run_start_date=2024-05-23 23:31:01.809344+00:00, run_end_date=2024-05-23 23:31:02.146696+00:00, run_duration=0.337352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:31:00.968434+00:00, queued_by_job_id=1, pid=4000 2024-05-23T23:31:04.528701712Z [2024-05-23T23:31:04.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:31:04.528732273Z [2024-05-23T23:31:04.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:30:00+00:00, run_id=scheduled__2024-05-23T23:30:00+00:00, run_start_date=2024-05-23 23:31:00.894920+00:00, run_end_date=2024-05-23 23:31:04.526989+00:00, run_duration=3.632069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:30:00+00:00, data_interval_end=2024-05-23 23:31:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:31:04.537044987Z [2024-05-23T23:31:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:31:00+00:00, run_after=2024-05-23T23:32:00+00:00 2024-05-23T23:31:04.554269504Z [2024-05-23T23:31:04.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:31:04.554711127Z [2024-05-23T23:31:04.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:30:00+00:00, run_id=scheduled__2024-05-23T23:30:00+00:00, run_start_date=2024-05-23 23:31:00.895998+00:00, run_end_date=2024-05-23 23:31:04.554140+00:00, run_duration=3.658142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:30:00+00:00, data_interval_end=2024-05-23 23:31:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:31:04.569188434Z [2024-05-23T23:31:04.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:31:00+00:00, run_after=2024-05-23T23:32:00+00:00 2024-05-23T23:31:04.621597135Z [2024-05-23T23:31:04.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:31:04.632868531Z [2024-05-23T23:31:04.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=-1, run_start_date=2024-05-23 23:31:02.788399+00:00, run_end_date=2024-05-23 23:31:04.411196+00:00, run_duration=1.622797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:31:00.968434+00:00, queued_by_job_id=1, pid=4018 2024-05-23T23:31:05.712801827Z [2024-05-23T23:31:05.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:31:05.724203588Z [2024-05-23T23:31:05.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=-1, run_start_date=2024-05-23 23:31:02.832477+00:00, run_end_date=2024-05-23 23:31:04.484294+00:00, run_duration=1.651817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:31:00.968434+00:00, queued_by_job_id=1, pid=4019 2024-05-23T23:31:39.518387532Z [2024-05-23T23:31:39.517+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:32:00.420869904Z [2024-05-23T23:32:00.420+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:32:00+00:00, run_after=2024-05-23T23:33:00+00:00 2024-05-23T23:32:00.432053676Z [2024-05-23T23:32:00.431+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:32:00.448992681Z [2024-05-23T23:32:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:32:00+00:00, run_after=2024-05-23T23:33:00+00:00 2024-05-23T23:32:00.460944745Z [2024-05-23T23:32:00.460+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:32:00.567914284Z [2024-05-23T23:32:00.567+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:32:00.567951298Z 2024-05-23T23:32:00.567965831Z 2024-05-23T23:32:00.567972150Z 2024-05-23T23:32:00.567978052Z 2024-05-23T23:32:00.568236331Z [2024-05-23T23:32:00.567+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:32:00.568351044Z [2024-05-23T23:32:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:32:00.568507976Z [2024-05-23T23:32:00.568+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:32:00.568661822Z [2024-05-23T23:32:00.568+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:32:00.570617783Z [2024-05-23T23:32:00.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:32:00.570643565Z 2024-05-23T23:32:00.570650192Z 2024-05-23T23:32:00.570655915Z 2024-05-23T23:32:00.570662031Z 2024-05-23T23:32:00.574663566Z [2024-05-23T23:32:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:32:00.574696332Z [2024-05-23T23:32:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:32:00.575711386Z [2024-05-23T23:32:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:32:00.575726343Z [2024-05-23T23:32:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:32:00.575734472Z [2024-05-23T23:32:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:32:00.575743033Z [2024-05-23T23:32:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:32:00.575750700Z [2024-05-23T23:32:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:32:00.575758577Z [2024-05-23T23:32:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:32:01.058533489Z [2024-05-23T23:32:01.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:32:01.058951015Z [2024-05-23T23:32:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:31:00+00:00 exited with status queued for try_number 1 2024-05-23T23:32:01.059283154Z [2024-05-23T23:32:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:31:00+00:00 exited with status queued for try_number 1 2024-05-23T23:32:01.059525071Z [2024-05-23T23:32:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:31:00+00:00 exited with status queued for try_number 1 2024-05-23T23:32:01.074438708Z [2024-05-23T23:32:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79b19b8f-8465-4e43-9ca6-a3c9d478bd59 2024-05-23T23:32:01.074762857Z [2024-05-23T23:32:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77e29994-3c40-482e-bdb7-5aca519acf9c 2024-05-23T23:32:01.075019428Z [2024-05-23T23:32:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d222c0b-61d8-43b5-88f0-fc449433147d 2024-05-23T23:32:01.075250660Z [2024-05-23T23:32:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to c89e15a1-4327-4816-af62-67be856151f8 2024-05-23T23:32:02.243955011Z [2024-05-23T23:32:02.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:32:02.244547084Z [2024-05-23T23:32:02.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:30:00+00:00, run_id=scheduled__2024-05-23T23:30:00+00:00, run_start_date=2024-05-23 23:32:00.478360+00:00, run_end_date=2024-05-23 23:32:02.243889+00:00, run_duration=1.765529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:30:00+00:00, data_interval_end=2024-05-23 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:32:02.258101421Z [2024-05-23T23:32:02.257+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:32:00+00:00, run_after=2024-05-23T23:34:00+00:00 2024-05-23T23:32:02.271822517Z [2024-05-23T23:32:02.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:32:02.272501486Z [2024-05-23T23:32:02.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:31:00+00:00, run_id=scheduled__2024-05-23T23:31:00+00:00, run_start_date=2024-05-23 23:32:00.480802+00:00, run_end_date=2024-05-23 23:32:02.271685+00:00, run_duration=1.790883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:31:00+00:00, data_interval_end=2024-05-23 23:32:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:32:02.287829586Z [2024-05-23T23:32:02.287+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:32:00+00:00, run_after=2024-05-23T23:33:00+00:00 2024-05-23T23:32:02.375745258Z [2024-05-23T23:32:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:32:02.375861241Z [2024-05-23T23:32:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:31:00+00:00 exited with status success for try_number 1 2024-05-23T23:32:02.387775023Z [2024-05-23T23:32:02.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=-1, run_start_date=2024-05-23 23:32:01.369456+00:00, run_end_date=2024-05-23 23:32:01.718189+00:00, run_duration=0.348733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:32:00.570467+00:00, queued_by_job_id=1, pid=4052 2024-05-23T23:32:02.388179444Z [2024-05-23T23:32:02.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:31:00+00:00, map_index=-1, run_start_date=2024-05-23 23:32:01.515983+00:00, run_end_date=2024-05-23 23:32:02.066660+00:00, run_duration=0.550677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:32:00.570467+00:00, queued_by_job_id=1, pid=4053 2024-05-23T23:32:04.495838481Z [2024-05-23T23:32:04.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:32:04.495952093Z [2024-05-23T23:32:04.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:31:00+00:00, run_id=scheduled__2024-05-23T23:31:00+00:00, run_start_date=2024-05-23 23:32:00.483385+00:00, run_end_date=2024-05-23 23:32:04.495713+00:00, run_duration=4.012328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:31:00+00:00, data_interval_end=2024-05-23 23:32:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:32:04.504419818Z [2024-05-23T23:32:04.504+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:32:00+00:00, run_after=2024-05-23T23:33:00+00:00 2024-05-23T23:32:04.587469756Z [2024-05-23T23:32:04.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:31:00+00:00 exited with status success for try_number 1 2024-05-23T23:32:04.596293073Z [2024-05-23T23:32:04.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:31:00+00:00, map_index=-1, run_start_date=2024-05-23 23:32:02.896378+00:00, run_end_date=2024-05-23 23:32:04.142179+00:00, run_duration=1.245801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:32:00.570467+00:00, queued_by_job_id=1, pid=4077 2024-05-23T23:32:05.672610821Z [2024-05-23T23:32:05.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:32:05.673061764Z [2024-05-23T23:32:05.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:31:00+00:00, run_id=scheduled__2024-05-23T23:31:00+00:00, run_start_date=2024-05-23 23:32:00.484828+00:00, run_end_date=2024-05-23 23:32:05.672595+00:00, run_duration=5.187767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:31:00+00:00, data_interval_end=2024-05-23 23:32:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:32:05.684917402Z [2024-05-23T23:32:05.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:32:00+00:00, run_after=2024-05-23T23:33:00+00:00 2024-05-23T23:32:05.721523615Z [2024-05-23T23:32:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:31:00+00:00 exited with status success for try_number 1 2024-05-23T23:32:05.727760630Z [2024-05-23T23:32:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:31:00+00:00, map_index=-1, run_start_date=2024-05-23 23:32:02.877765+00:00, run_end_date=2024-05-23 23:32:04.585682+00:00, run_duration=1.707917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:32:00.570467+00:00, queued_by_job_id=1, pid=4076 2024-05-23T23:33:00.446459604Z [2024-05-23T23:33:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:33:00+00:00, run_after=2024-05-23T23:34:00+00:00 2024-05-23T23:33:00.466059010Z [2024-05-23T23:33:00.465+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:33:00+00:00, run_after=2024-05-23T23:34:00+00:00 2024-05-23T23:33:00.477692020Z [2024-05-23T23:33:00.477+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:33:00.551754054Z [2024-05-23T23:33:00.551+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:33:00.551798163Z 2024-05-23T23:33:00.551805978Z 2024-05-23T23:33:00.551812785Z 2024-05-23T23:33:00.552239511Z [2024-05-23T23:33:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:33:00.552608168Z [2024-05-23T23:33:00.552+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:33:00.553035122Z [2024-05-23T23:33:00.552+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:33:00.554228707Z [2024-05-23T23:33:00.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:33:00.554279526Z 2024-05-23T23:33:00.554311878Z 2024-05-23T23:33:00.554319214Z 2024-05-23T23:33:00.559386012Z [2024-05-23T23:33:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:33:00.559816581Z [2024-05-23T23:33:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:33:00.560342655Z [2024-05-23T23:33:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:33:00.560638040Z [2024-05-23T23:33:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:33:00.561095785Z [2024-05-23T23:33:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:33:00.561395674Z [2024-05-23T23:33:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:33:00.844120561Z [2024-05-23T23:33:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status queued for try_number 1 2024-05-23T23:33:00.844295790Z [2024-05-23T23:33:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status queued for try_number 1 2024-05-23T23:33:00.844417427Z [2024-05-23T23:33:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status queued for try_number 1 2024-05-23T23:33:00.853387857Z [2024-05-23T23:33:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to dce677b7-7f60-4a1e-b7d7-f67ebeafa34d 2024-05-23T23:33:00.853976908Z [2024-05-23T23:33:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to a51d93d3-b7c7-45a8-a879-28b491f4c875 2024-05-23T23:33:00.854120691Z [2024-05-23T23:33:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to e984e63e-3012-4bdc-843d-7fa14b7921d7 2024-05-23T23:33:02.070719011Z [2024-05-23T23:33:02.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:33:02.071031366Z [2024-05-23T23:33:02.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:32:00+00:00, run_id=scheduled__2024-05-23T23:32:00+00:00, run_start_date=2024-05-23 23:33:00.493746+00:00, run_end_date=2024-05-23 23:33:02.070659+00:00, run_duration=1.576913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:32:00+00:00, data_interval_end=2024-05-23 23:33:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:33:02.083535558Z [2024-05-23T23:33:02.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:33:00+00:00, run_after=2024-05-23T23:34:00+00:00 2024-05-23T23:33:02.146473195Z [2024-05-23T23:33:02.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status success for try_number 1 2024-05-23T23:33:02.155914805Z [2024-05-23T23:33:02.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:32:00+00:00, map_index=-1, run_start_date=2024-05-23 23:33:01.430029+00:00, run_end_date=2024-05-23 23:33:01.890870+00:00, run_duration=0.460841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:33:00.555675+00:00, queued_by_job_id=1, pid=4109 2024-05-23T23:33:05.555971563Z [2024-05-23T23:33:05.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:33:05.556630514Z [2024-05-23T23:33:05.556+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:32:00+00:00, run_id=scheduled__2024-05-23T23:32:00+00:00, run_start_date=2024-05-23 23:33:00.495254+00:00, run_end_date=2024-05-23 23:33:05.555750+00:00, run_duration=5.060496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:32:00+00:00, data_interval_end=2024-05-23 23:33:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:33:05.584052873Z [2024-05-23T23:33:05.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:33:00+00:00, run_after=2024-05-23T23:34:00+00:00 2024-05-23T23:33:05.592957240Z [2024-05-23T23:33:05.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:33:05.593105630Z [2024-05-23T23:33:05.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:32:00+00:00, run_id=scheduled__2024-05-23T23:32:00+00:00, run_start_date=2024-05-23 23:33:00.496385+00:00, run_end_date=2024-05-23 23:33:05.592654+00:00, run_duration=5.096269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:32:00+00:00, data_interval_end=2024-05-23 23:33:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:33:05.606294747Z [2024-05-23T23:33:05.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:33:00+00:00, run_after=2024-05-23T23:34:00+00:00 2024-05-23T23:33:05.642478276Z [2024-05-23T23:33:05.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status success for try_number 1 2024-05-23T23:33:05.642623922Z [2024-05-23T23:33:05.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status success for try_number 1 2024-05-23T23:33:05.650987133Z [2024-05-23T23:33:05.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:32:00+00:00, map_index=-1, run_start_date=2024-05-23 23:33:02.596850+00:00, run_end_date=2024-05-23 23:33:04.648686+00:00, run_duration=2.051836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:33:00.555675+00:00, queued_by_job_id=1, pid=4127 2024-05-23T23:33:05.651117862Z [2024-05-23T23:33:05.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:32:00+00:00, map_index=-1, run_start_date=2024-05-23 23:33:02.657851+00:00, run_end_date=2024-05-23 23:33:05.049423+00:00, run_duration=2.391572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:33:00.555675+00:00, queued_by_job_id=1, pid=4128 2024-05-23T23:34:00.323510922Z [2024-05-23T23:34:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:34:00+00:00, run_after=2024-05-23T23:35:00+00:00 2024-05-23T23:34:00.330686699Z [2024-05-23T23:34:00.329+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:34:00.341527091Z [2024-05-23T23:34:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:34:00+00:00, run_after=2024-05-23T23:35:00+00:00 2024-05-23T23:34:00.348025048Z [2024-05-23T23:34:00.347+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:34:00.439021952Z [2024-05-23T23:34:00.438+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:34:00.439062941Z 2024-05-23T23:34:00.439069112Z 2024-05-23T23:34:00.439073730Z 2024-05-23T23:34:00.439078238Z 2024-05-23T23:34:00.439417608Z [2024-05-23T23:34:00.438+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:34:00.439709405Z [2024-05-23T23:34:00.439+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:34:00.439993736Z [2024-05-23T23:34:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:34:00.440233765Z [2024-05-23T23:34:00.440+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:34:00.441022357Z [2024-05-23T23:34:00.440+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:34:00.441036312Z 2024-05-23T23:34:00.441041124Z 2024-05-23T23:34:00.441045644Z 2024-05-23T23:34:00.441061099Z 2024-05-23T23:34:00.445499593Z [2024-05-23T23:34:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:34:00.445999266Z [2024-05-23T23:34:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:34:00.446020618Z [2024-05-23T23:34:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:34:00.446028705Z [2024-05-23T23:34:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:34:00.446278370Z [2024-05-23T23:34:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:34:00.446461523Z [2024-05-23T23:34:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:34:00.446787002Z [2024-05-23T23:34:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:34:00.446962579Z [2024-05-23T23:34:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:34:00.871657189Z [2024-05-23T23:34:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status queued for try_number 1 2024-05-23T23:34:00.871685315Z [2024-05-23T23:34:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:33:00+00:00 exited with status queued for try_number 1 2024-05-23T23:34:00.871724971Z [2024-05-23T23:34:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:33:00+00:00 exited with status queued for try_number 1 2024-05-23T23:34:00.871774902Z [2024-05-23T23:34:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:33:00+00:00 exited with status queued for try_number 1 2024-05-23T23:34:00.895848871Z [2024-05-23T23:34:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbd1d573-4b9c-45c7-8fa4-6947e7d0849b 2024-05-23T23:34:00.895931996Z [2024-05-23T23:34:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3ded4f5-6fb0-4391-af72-5a36e3a4361b 2024-05-23T23:34:00.895968515Z [2024-05-23T23:34:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cd47eeb-8f3f-44e2-a9ae-e4638739cf70 2024-05-23T23:34:00.896130853Z [2024-05-23T23:34:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68221ee2-1bff-4127-b50a-f79412799e2f 2024-05-23T23:34:02.231742651Z [2024-05-23T23:34:02.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:34:02.232086011Z [2024-05-23T23:34:02.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:32:00+00:00, run_id=scheduled__2024-05-23T23:32:00+00:00, run_start_date=2024-05-23 23:34:00.358131+00:00, run_end_date=2024-05-23 23:34:02.231509+00:00, run_duration=1.873378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:32:00+00:00, data_interval_end=2024-05-23 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:34:02.239912192Z [2024-05-23T23:34:02.239+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:34:00+00:00, run_after=2024-05-23T23:36:00+00:00 2024-05-23T23:34:02.249387330Z [2024-05-23T23:34:02.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:34:02.249786243Z [2024-05-23T23:34:02.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:33:00+00:00, run_id=scheduled__2024-05-23T23:33:00+00:00, run_start_date=2024-05-23 23:34:00.359373+00:00, run_end_date=2024-05-23 23:34:02.249272+00:00, run_duration=1.889899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:33:00+00:00, data_interval_end=2024-05-23 23:34:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:34:02.259898130Z [2024-05-23T23:34:02.259+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:34:00+00:00, run_after=2024-05-23T23:35:00+00:00 2024-05-23T23:34:02.306984737Z [2024-05-23T23:34:02.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:32:00+00:00 exited with status success for try_number 1 2024-05-23T23:34:02.307081950Z [2024-05-23T23:34:02.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:33:00+00:00 exited with status success for try_number 1 2024-05-23T23:34:02.316454169Z [2024-05-23T23:34:02.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:33:00+00:00, map_index=-1, run_start_date=2024-05-23 23:34:01.359555+00:00, run_end_date=2024-05-23 23:34:01.800074+00:00, run_duration=0.440519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:34:00.442075+00:00, queued_by_job_id=1, pid=4162 2024-05-23T23:34:02.316699545Z [2024-05-23T23:34:02.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:32:00+00:00, map_index=-1, run_start_date=2024-05-23 23:34:01.224614+00:00, run_end_date=2024-05-23 23:34:01.708327+00:00, run_duration=0.483713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:34:00.442075+00:00, queued_by_job_id=1, pid=4161 2024-05-23T23:34:04.480321634Z [2024-05-23T23:34:04.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:34:04.480796541Z [2024-05-23T23:34:04.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:33:00+00:00, run_id=scheduled__2024-05-23T23:33:00+00:00, run_start_date=2024-05-23 23:34:00.361355+00:00, run_end_date=2024-05-23 23:34:04.480113+00:00, run_duration=4.118758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:33:00+00:00, data_interval_end=2024-05-23 23:34:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:34:04.490811382Z [2024-05-23T23:34:04.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:34:00+00:00, run_after=2024-05-23T23:35:00+00:00 2024-05-23T23:34:05.602876697Z [2024-05-23T23:34:05.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:34:05.603247815Z [2024-05-23T23:34:05.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:33:00+00:00, run_id=scheduled__2024-05-23T23:33:00+00:00, run_start_date=2024-05-23 23:34:00.360398+00:00, run_end_date=2024-05-23 23:34:05.602748+00:00, run_duration=5.24235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:33:00+00:00, data_interval_end=2024-05-23 23:34:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:34:05.616491938Z [2024-05-23T23:34:05.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:34:00+00:00, run_after=2024-05-23T23:35:00+00:00 2024-05-23T23:34:05.656867571Z [2024-05-23T23:34:05.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:33:00+00:00 exited with status success for try_number 1 2024-05-23T23:34:05.657594408Z [2024-05-23T23:34:05.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:33:00+00:00 exited with status success for try_number 1 2024-05-23T23:34:05.670271355Z [2024-05-23T23:34:05.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:33:00+00:00, map_index=-1, run_start_date=2024-05-23 23:34:02.610061+00:00, run_end_date=2024-05-23 23:34:04.330073+00:00, run_duration=1.720012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:34:00.442075+00:00, queued_by_job_id=1, pid=4185 2024-05-23T23:34:05.670444249Z [2024-05-23T23:34:05.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:33:00+00:00, map_index=-1, run_start_date=2024-05-23 23:34:02.639211+00:00, run_end_date=2024-05-23 23:34:05.281614+00:00, run_duration=2.642403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:34:00.442075+00:00, queued_by_job_id=1, pid=4186 2024-05-23T23:35:00.439814220Z [2024-05-23T23:35:00.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:35:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:35:00.454629381Z [2024-05-23T23:35:00.452+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:35:00+00:00, run_after=2024-05-23T23:36:00+00:00 2024-05-23T23:35:00.461244442Z [2024-05-23T23:35:00.460+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:35:00.474791816Z [2024-05-23T23:35:00.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:35:00+00:00, run_after=2024-05-23T23:36:00+00:00 2024-05-23T23:35:00.568591632Z [2024-05-23T23:35:00.566+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:35:00.568619895Z 2024-05-23T23:35:00.568625288Z 2024-05-23T23:35:00.568629581Z 2024-05-23T23:35:00.568649546Z 2024-05-23T23:35:00.568653063Z [2024-05-23T23:35:00.566+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:35:00.568656310Z [2024-05-23T23:35:00.566+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:35:00.568659497Z [2024-05-23T23:35:00.566+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:35:00.568662567Z [2024-05-23T23:35:00.566+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:35:00.568667219Z [2024-05-23T23:35:00.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:35:00.568670443Z 2024-05-23T23:35:00.568673421Z 2024-05-23T23:35:00.568676544Z 2024-05-23T23:35:00.568679579Z 2024-05-23T23:35:00.585468127Z [2024-05-23T23:35:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:35:00.585496242Z [2024-05-23T23:35:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:35:00.586545334Z [2024-05-23T23:35:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:35:00.586567359Z [2024-05-23T23:35:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:35:00.586574107Z [2024-05-23T23:35:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:35:00.586580370Z [2024-05-23T23:35:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:35:00.586586537Z [2024-05-23T23:35:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:35:00.586614024Z [2024-05-23T23:35:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:35:01.086852412Z [2024-05-23T23:35:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:35:01.087003783Z [2024-05-23T23:35:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status queued for try_number 1 2024-05-23T23:35:01.087108944Z [2024-05-23T23:35:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status queued for try_number 1 2024-05-23T23:35:01.087202721Z [2024-05-23T23:35:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status queued for try_number 1 2024-05-23T23:35:01.100649114Z [2024-05-23T23:35:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f6947ef-62a8-4248-b1d7-bf54ae0d3966 2024-05-23T23:35:01.100807289Z [2024-05-23T23:35:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad004034-9b2c-4abe-b5ec-53a2ab787321 2024-05-23T23:35:01.100945833Z [2024-05-23T23:35:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a6c90d6-34bc-437d-923c-9894f0517c8f 2024-05-23T23:35:01.101106669Z [2024-05-23T23:35:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4f2d965-7ea4-4261-be10-65310d6041f1 2024-05-23T23:35:03.145423013Z [2024-05-23T23:35:03.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:35:03.146112055Z [2024-05-23T23:35:03.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:34:00+00:00, run_id=scheduled__2024-05-23T23:34:00+00:00, run_start_date=2024-05-23 23:35:00.486789+00:00, run_end_date=2024-05-23 23:35:03.145304+00:00, run_duration=2.658515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:34:00+00:00, data_interval_end=2024-05-23 23:35:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:35:03.156706564Z [2024-05-23T23:35:03.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:35:00+00:00, run_after=2024-05-23T23:36:00+00:00 2024-05-23T23:35:03.227300005Z [2024-05-23T23:35:03.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status success for try_number 1 2024-05-23T23:35:03.234554999Z [2024-05-23T23:35:03.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:34:00+00:00, map_index=-1, run_start_date=2024-05-23 23:35:02.295893+00:00, run_end_date=2024-05-23 23:35:02.637113+00:00, run_duration=0.34122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:35:00.573002+00:00, queued_by_job_id=1, pid=4222 2024-05-23T23:35:04.330190896Z [2024-05-23T23:35:04.329+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:35:04.330220331Z 2024-05-23T23:35:04.330229468Z [2024-05-23T23:35:04.329+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:35:04.330879202Z [2024-05-23T23:35:04.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:35:04.330925843Z 2024-05-23T23:35:04.333439011Z [2024-05-23T23:35:04.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:35:04.333452456Z [2024-05-23T23:35:04.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:35:04.410023756Z [2024-05-23T23:35:04.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:35:04.410063207Z [2024-05-23T23:35:04.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:35:04.417006449Z [2024-05-23T23:35:04.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fe07f09-a3e5-4473-8583-7eb02885cf97 2024-05-23T23:35:04.417096738Z [2024-05-23T23:35:04.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=-1, run_start_date=2024-05-23 23:35:03.053902+00:00, run_end_date=2024-05-23 23:35:03.409789+00:00, run_duration=0.355887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:35:00.573002+00:00, queued_by_job_id=1, pid=4239 2024-05-23T23:35:04.460605276Z [2024-05-23T23:35:04.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:35:04.461013673Z [2024-05-23T23:35:04.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:34:00+00:00, run_id=scheduled__2024-05-23T23:34:00+00:00, run_start_date=2024-05-23 23:35:00.487713+00:00, run_end_date=2024-05-23 23:35:04.460466+00:00, run_duration=3.972753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:34:00+00:00, data_interval_end=2024-05-23 23:35:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:35:04.469617323Z [2024-05-23T23:35:04.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:35:00+00:00, run_after=2024-05-23T23:36:00+00:00 2024-05-23T23:35:04.538978013Z [2024-05-23T23:35:04.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status success for try_number 1 2024-05-23T23:35:04.550979184Z [2024-05-23T23:35:04.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:34:00+00:00, map_index=-1, run_start_date=2024-05-23 23:35:03.011284+00:00, run_end_date=2024-05-23 23:35:04.312278+00:00, run_duration=1.300994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:35:00.573002+00:00, queued_by_job_id=1, pid=4238 2024-05-23T23:35:05.602336108Z [2024-05-23T23:35:05.601+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:35:05.602674915Z [2024-05-23T23:35:05.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:34:00+00:00, run_id=scheduled__2024-05-23T23:34:00+00:00, run_start_date=2024-05-23 23:35:00.488679+00:00, run_end_date=2024-05-23 23:35:05.602232+00:00, run_duration=5.113553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:34:00+00:00, data_interval_end=2024-05-23 23:35:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:35:05.615402726Z [2024-05-23T23:35:05.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:35:00+00:00, run_after=2024-05-23T23:36:00+00:00 2024-05-23T23:35:05.662562649Z [2024-05-23T23:35:05.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status success for try_number 1 2024-05-23T23:35:05.668856352Z [2024-05-23T23:35:05.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:34:00+00:00, map_index=-1, run_start_date=2024-05-23 23:35:03.367364+00:00, run_end_date=2024-05-23 23:35:05.032833+00:00, run_duration=1.665469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:35:00.573002+00:00, queued_by_job_id=1, pid=4255 2024-05-23T23:35:06.726830078Z [2024-05-23T23:35:06.726+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:35:06.726857418Z 2024-05-23T23:35:06.726866256Z [2024-05-23T23:35:06.726+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:35:06.727350232Z [2024-05-23T23:35:06.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:35:06.727359976Z 2024-05-23T23:35:06.729529277Z [2024-05-23T23:35:06.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:35:06.729568407Z [2024-05-23T23:35:06.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:35:06.783491487Z [2024-05-23T23:35:06.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:35:06.783653688Z [2024-05-23T23:35:06.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:35:06.789942180Z [2024-05-23T23:35:06.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83cc50de-488a-41a7-bb96-8552c9c09bf8 2024-05-23T23:35:06.790046616Z [2024-05-23T23:35:06.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=-1, run_start_date=2024-05-23 23:35:06.034808+00:00, run_end_date=2024-05-23 23:35:06.426828+00:00, run_duration=0.39202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:35:04.331286+00:00, queued_by_job_id=1, pid=4268 2024-05-23T23:35:09.402067268Z [2024-05-23T23:35:09.401+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:35:09.402100813Z 2024-05-23T23:35:09.402105679Z [2024-05-23T23:35:09.401+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:35:09.402706151Z [2024-05-23T23:35:09.402+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:35:09.402718709Z 2024-05-23T23:35:09.405205236Z [2024-05-23T23:35:09.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:35:09.405319467Z [2024-05-23T23:35:09.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:35:09.476244353Z [2024-05-23T23:35:09.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status queued for try_number 1 2024-05-23T23:35:09.476346363Z [2024-05-23T23:35:09.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:35:09.487823885Z [2024-05-23T23:35:09.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ad97cbf-6b02-4e4f-9405-bee1a919d2d9 2024-05-23T23:35:09.487889440Z [2024-05-23T23:35:09.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=0, run_start_date=2024-05-23 23:35:08.401923+00:00, run_end_date=2024-05-23 23:35:08.776500+00:00, run_duration=0.374577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:35:06.727556+00:00, queued_by_job_id=1, pid=4276 2024-05-23T23:35:12.293153001Z [2024-05-23T23:35:12.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:35:12.293669956Z [2024-05-23T23:35:12.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:30:00+00:00, run_id=scheduled__2024-05-23T23:30:00+00:00, run_start_date=2024-05-23 23:35:00.485584+00:00, run_end_date=2024-05-23 23:35:12.292974+00:00, run_duration=11.80739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:30:00+00:00, data_interval_end=2024-05-23 23:35:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:35:12.301549570Z [2024-05-23T23:35:12.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:35:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:35:12.337800364Z [2024-05-23T23:35:12.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:30:00+00:00 exited with status success for try_number 1 2024-05-23T23:35:12.345795663Z [2024-05-23T23:35:12.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:30:00+00:00, map_index=-1, run_start_date=2024-05-23 23:35:11.495500+00:00, run_end_date=2024-05-23 23:35:11.923676+00:00, run_duration=0.428176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:35:09.403041+00:00, queued_by_job_id=1, pid=4284 2024-05-23T23:36:00.896286574Z [2024-05-23T23:36:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:36:00+00:00, run_after=2024-05-23T23:37:00+00:00 2024-05-23T23:36:00.913924955Z [2024-05-23T23:36:00.913+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:36:00.927288963Z [2024-05-23T23:36:00.926+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:36:00.969570458Z [2024-05-23T23:36:00.969+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:36:00+00:00, run_after=2024-05-23T23:37:00+00:00 2024-05-23T23:36:01.055685152Z [2024-05-23T23:36:01.055+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:36:01.055743364Z 2024-05-23T23:36:01.055755487Z 2024-05-23T23:36:01.055765295Z 2024-05-23T23:36:01.055774881Z 2024-05-23T23:36:01.055803244Z [2024-05-23T23:36:01.055+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:36:01.055814603Z [2024-05-23T23:36:01.055+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:36:01.056059303Z [2024-05-23T23:36:01.055+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:36:01.056211331Z [2024-05-23T23:36:01.056+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:36:01.056874811Z [2024-05-23T23:36:01.056+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:36:01.056892307Z 2024-05-23T23:36:01.056902559Z 2024-05-23T23:36:01.056912232Z 2024-05-23T23:36:01.056921739Z 2024-05-23T23:36:01.060773155Z [2024-05-23T23:36:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:36:01.060848752Z [2024-05-23T23:36:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:36:01.061180112Z [2024-05-23T23:36:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:36:01.061321359Z [2024-05-23T23:36:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:36:01.061616873Z [2024-05-23T23:36:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:36:01.061789776Z [2024-05-23T23:36:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:36:01.062071882Z [2024-05-23T23:36:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:36:01.062228903Z [2024-05-23T23:36:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:36:01.463555636Z [2024-05-23T23:36:01.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status queued for try_number 1 2024-05-23T23:36:01.466937423Z [2024-05-23T23:36:01.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status queued for try_number 1 2024-05-23T23:36:01.467081134Z [2024-05-23T23:36:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status queued for try_number 1 2024-05-23T23:36:01.467208521Z [2024-05-23T23:36:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status queued for try_number 1 2024-05-23T23:36:01.484029146Z [2024-05-23T23:36:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1c63b97-2222-45e3-a235-67866cfdcfcb 2024-05-23T23:36:01.484229944Z [2024-05-23T23:36:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ce16c22-ce2a-4abe-bb2f-1e8bb2846a1c 2024-05-23T23:36:01.484511552Z [2024-05-23T23:36:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22012913-786e-462e-afe8-8856b0d81e07 2024-05-23T23:36:01.484702802Z [2024-05-23T23:36:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fe0aa8a-ac68-47c4-b167-ff0901a5d1df 2024-05-23T23:36:02.672464232Z [2024-05-23T23:36:02.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:36:02.672919337Z [2024-05-23T23:36:02.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:34:00+00:00, run_id=scheduled__2024-05-23T23:34:00+00:00, run_start_date=2024-05-23 23:36:00.992552+00:00, run_end_date=2024-05-23 23:36:02.672306+00:00, run_duration=1.679754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:34:00+00:00, data_interval_end=2024-05-23 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:36:02.683161011Z [2024-05-23T23:36:02.682+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:36:00+00:00, run_after=2024-05-23T23:38:00+00:00 2024-05-23T23:36:02.710608387Z [2024-05-23T23:36:02.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:36:02.710633044Z [2024-05-23T23:36:02.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:35:00+00:00, run_id=scheduled__2024-05-23T23:35:00+00:00, run_start_date=2024-05-23 23:36:00.993975+00:00, run_end_date=2024-05-23 23:36:02.708577+00:00, run_duration=1.714602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:35:00+00:00, data_interval_end=2024-05-23 23:36:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:36:02.727872577Z [2024-05-23T23:36:02.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:36:00+00:00, run_after=2024-05-23T23:37:00+00:00 2024-05-23T23:36:02.814691098Z [2024-05-23T23:36:02.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:34:00+00:00 exited with status success for try_number 1 2024-05-23T23:36:02.814725425Z [2024-05-23T23:36:02.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status success for try_number 1 2024-05-23T23:36:02.822593896Z [2024-05-23T23:36:02.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:35:00+00:00, map_index=-1, run_start_date=2024-05-23 23:36:01.959321+00:00, run_end_date=2024-05-23 23:36:02.392714+00:00, run_duration=0.433393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:36:01.057747+00:00, queued_by_job_id=1, pid=4307 2024-05-23T23:36:02.822615934Z [2024-05-23T23:36:02.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:34:00+00:00, map_index=-1, run_start_date=2024-05-23 23:36:01.952802+00:00, run_end_date=2024-05-23 23:36:02.457123+00:00, run_duration=0.504321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:36:01.057747+00:00, queued_by_job_id=1, pid=4308 2024-05-23T23:36:05.431781715Z [2024-05-23T23:36:05.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:36:05.432335516Z [2024-05-23T23:36:05.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:35:00+00:00, run_id=scheduled__2024-05-23T23:35:00+00:00, run_start_date=2024-05-23 23:36:00.996196+00:00, run_end_date=2024-05-23 23:36:05.431594+00:00, run_duration=4.435398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:35:00+00:00, data_interval_end=2024-05-23 23:36:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:36:05.444448115Z [2024-05-23T23:36:05.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:36:00+00:00, run_after=2024-05-23T23:37:00+00:00 2024-05-23T23:36:05.455007915Z [2024-05-23T23:36:05.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:36:05.455375972Z [2024-05-23T23:36:05.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:35:00+00:00, run_id=scheduled__2024-05-23T23:35:00+00:00, run_start_date=2024-05-23 23:36:00.995147+00:00, run_end_date=2024-05-23 23:36:05.454909+00:00, run_duration=4.459762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:35:00+00:00, data_interval_end=2024-05-23 23:36:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:36:05.465419333Z [2024-05-23T23:36:05.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:36:00+00:00, run_after=2024-05-23T23:37:00+00:00 2024-05-23T23:36:05.517506569Z [2024-05-23T23:36:05.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status success for try_number 1 2024-05-23T23:36:05.517977226Z [2024-05-23T23:36:05.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status success for try_number 1 2024-05-23T23:36:05.533899770Z [2024-05-23T23:36:05.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:35:00+00:00, map_index=-1, run_start_date=2024-05-23 23:36:03.449261+00:00, run_end_date=2024-05-23 23:36:04.733089+00:00, run_duration=1.283828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:36:01.057747+00:00, queued_by_job_id=1, pid=4332 2024-05-23T23:36:05.534566340Z [2024-05-23T23:36:05.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:35:00+00:00, map_index=-1, run_start_date=2024-05-23 23:36:03.269647+00:00, run_end_date=2024-05-23 23:36:04.928295+00:00, run_duration=1.658648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:36:01.057747+00:00, queued_by_job_id=1, pid=4331 2024-05-23T23:36:39.591765478Z [2024-05-23T23:36:39.591+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:37:00.258207954Z [2024-05-23T23:37:00.257+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:37:00.281404287Z [2024-05-23T23:37:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:37:00+00:00, run_after=2024-05-23T23:38:00+00:00 2024-05-23T23:37:00.295318198Z [2024-05-23T23:37:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:37:00+00:00, run_after=2024-05-23T23:38:00+00:00 2024-05-23T23:37:00.357208334Z [2024-05-23T23:37:00.356+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:37:00.357298052Z 2024-05-23T23:37:00.357312362Z 2024-05-23T23:37:00.357321156Z 2024-05-23T23:37:00.357329801Z [2024-05-23T23:37:00.357+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:37:00.357398423Z [2024-05-23T23:37:00.357+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:37:00.357507727Z [2024-05-23T23:37:00.357+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:37:00.358169232Z [2024-05-23T23:37:00.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:37:00.358179823Z 2024-05-23T23:37:00.358183420Z 2024-05-23T23:37:00.358186770Z 2024-05-23T23:37:00.362850342Z [2024-05-23T23:37:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:37:00.363035303Z [2024-05-23T23:37:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:37:00.363273225Z [2024-05-23T23:37:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:37:00.363361801Z [2024-05-23T23:37:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:37:00.363579932Z [2024-05-23T23:37:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:37:00.363630383Z [2024-05-23T23:37:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:37:00.592356209Z [2024-05-23T23:37:00.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status queued for try_number 1 2024-05-23T23:37:00.592648802Z [2024-05-23T23:37:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status queued for try_number 1 2024-05-23T23:37:00.592953237Z [2024-05-23T23:37:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status queued for try_number 1 2024-05-23T23:37:00.611726583Z [2024-05-23T23:37:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2162675-466f-471d-8d6c-ba2e41c062c3 2024-05-23T23:37:00.611822243Z [2024-05-23T23:37:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to de690784-8155-48da-80b1-47a08d78757c 2024-05-23T23:37:00.611987042Z [2024-05-23T23:37:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to f82baca0-032b-421f-8ae0-b67c0167f3c9 2024-05-23T23:37:01.847140929Z [2024-05-23T23:37:01.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status success for try_number 1 2024-05-23T23:37:01.851671812Z [2024-05-23T23:37:01.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:36:00+00:00, map_index=-1, run_start_date=2024-05-23 23:37:01.230700+00:00, run_end_date=2024-05-23 23:37:01.678721+00:00, run_duration=0.448021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:37:00.358978+00:00, queued_by_job_id=1, pid=4364 2024-05-23T23:37:02.893730940Z [2024-05-23T23:37:02.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:37:02.893834337Z [2024-05-23T23:37:02.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:36:00+00:00, run_id=scheduled__2024-05-23T23:36:00+00:00, run_start_date=2024-05-23 23:37:00.305902+00:00, run_end_date=2024-05-23 23:37:02.893465+00:00, run_duration=2.587563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:36:00+00:00, data_interval_end=2024-05-23 23:37:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:37:02.904905252Z [2024-05-23T23:37:02.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:37:00+00:00, run_after=2024-05-23T23:38:00+00:00 2024-05-23T23:37:04.026363779Z [2024-05-23T23:37:04.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:37:04.026730721Z [2024-05-23T23:37:04.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:36:00+00:00, run_id=scheduled__2024-05-23T23:36:00+00:00, run_start_date=2024-05-23 23:37:00.308251+00:00, run_end_date=2024-05-23 23:37:04.026273+00:00, run_duration=3.718022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:36:00+00:00, data_interval_end=2024-05-23 23:37:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:37:04.036097535Z [2024-05-23T23:37:04.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:37:00+00:00, run_after=2024-05-23T23:38:00+00:00 2024-05-23T23:37:04.044672465Z [2024-05-23T23:37:04.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:37:04.045053510Z [2024-05-23T23:37:04.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:36:00+00:00, run_id=scheduled__2024-05-23T23:36:00+00:00, run_start_date=2024-05-23 23:37:00.307193+00:00, run_end_date=2024-05-23 23:37:04.044577+00:00, run_duration=3.737384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:36:00+00:00, data_interval_end=2024-05-23 23:37:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:37:04.056191790Z [2024-05-23T23:37:04.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:37:00+00:00, run_after=2024-05-23T23:38:00+00:00 2024-05-23T23:37:04.092486746Z [2024-05-23T23:37:04.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status success for try_number 1 2024-05-23T23:37:04.106740311Z [2024-05-23T23:37:04.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:36:00+00:00, map_index=-1, run_start_date=2024-05-23 23:37:02.226307+00:00, run_end_date=2024-05-23 23:37:03.462241+00:00, run_duration=1.235934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:37:00.358978+00:00, queued_by_job_id=1, pid=4382 2024-05-23T23:37:04.268392014Z [2024-05-23T23:37:04.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status success for try_number 1 2024-05-23T23:37:04.286089330Z [2024-05-23T23:37:04.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:36:00+00:00, map_index=-1, run_start_date=2024-05-23 23:37:02.414821+00:00, run_end_date=2024-05-23 23:37:03.979848+00:00, run_duration=1.565027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:37:00.358978+00:00, queued_by_job_id=1, pid=4383 2024-05-23T23:38:00.127263265Z [2024-05-23T23:38:00.126+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:38:00.143096052Z [2024-05-23T23:38:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:38:00+00:00, run_after=2024-05-23T23:39:00+00:00 2024-05-23T23:38:00.158379005Z [2024-05-23T23:38:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:38:00+00:00, run_after=2024-05-23T23:39:00+00:00 2024-05-23T23:38:00.167078268Z [2024-05-23T23:38:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:38:00.276937194Z [2024-05-23T23:38:00.276+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:38:00.276963554Z 2024-05-23T23:38:00.276969639Z 2024-05-23T23:38:00.276973296Z 2024-05-23T23:38:00.276976877Z 2024-05-23T23:38:00.277056330Z [2024-05-23T23:38:00.276+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:38:00.277231784Z [2024-05-23T23:38:00.277+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:38:00.277345848Z [2024-05-23T23:38:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:38:00.277459737Z [2024-05-23T23:38:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:38:00.278135226Z [2024-05-23T23:38:00.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:38:00.278140673Z 2024-05-23T23:38:00.278143954Z 2024-05-23T23:38:00.278146762Z 2024-05-23T23:38:00.278149707Z 2024-05-23T23:38:00.282595913Z [2024-05-23T23:38:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:38:00.282850886Z [2024-05-23T23:38:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:38:00.283201416Z [2024-05-23T23:38:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:38:00.283394584Z [2024-05-23T23:38:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:38:00.283747213Z [2024-05-23T23:38:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:38:00.283914325Z [2024-05-23T23:38:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:38:00.284257564Z [2024-05-23T23:38:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:38:00.284417901Z [2024-05-23T23:38:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:38:00.635435047Z [2024-05-23T23:38:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status queued for try_number 1 2024-05-23T23:38:00.636139605Z [2024-05-23T23:38:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:37:00+00:00 exited with status queued for try_number 1 2024-05-23T23:38:00.636180141Z [2024-05-23T23:38:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:37:00+00:00 exited with status queued for try_number 1 2024-05-23T23:38:00.636185557Z [2024-05-23T23:38:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:37:00+00:00 exited with status queued for try_number 1 2024-05-23T23:38:00.660534486Z [2024-05-23T23:38:00.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee110790-8bd0-496f-926d-dffdc1454e97 2024-05-23T23:38:00.660557972Z [2024-05-23T23:38:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3af7f639-098f-46ca-b629-a7f354dacaec 2024-05-23T23:38:00.660575174Z [2024-05-23T23:38:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9aa72b68-eae7-4fc5-a248-f8014ac33d55 2024-05-23T23:38:00.660578663Z [2024-05-23T23:38:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to c94b9f10-bdea-48c6-90bd-c95412ac5ccd 2024-05-23T23:38:02.313199529Z [2024-05-23T23:38:02.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:38:02.313532317Z [2024-05-23T23:38:02.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:36:00+00:00, run_id=scheduled__2024-05-23T23:36:00+00:00, run_start_date=2024-05-23 23:38:00.179942+00:00, run_end_date=2024-05-23 23:38:02.313188+00:00, run_duration=2.133246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:36:00+00:00, data_interval_end=2024-05-23 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:38:02.321591654Z [2024-05-23T23:38:02.321+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:38:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:38:02.328474506Z [2024-05-23T23:38:02.328+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:38:02.328750442Z [2024-05-23T23:38:02.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:37:00+00:00, run_id=scheduled__2024-05-23T23:37:00+00:00, run_start_date=2024-05-23 23:38:00.181258+00:00, run_end_date=2024-05-23 23:38:02.328401+00:00, run_duration=2.147143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:37:00+00:00, data_interval_end=2024-05-23 23:38:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:38:02.339213788Z [2024-05-23T23:38:02.338+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:38:00+00:00, run_after=2024-05-23T23:39:00+00:00 2024-05-23T23:38:02.393908843Z [2024-05-23T23:38:02.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:36:00+00:00 exited with status success for try_number 1 2024-05-23T23:38:02.394200818Z [2024-05-23T23:38:02.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:37:00+00:00 exited with status success for try_number 1 2024-05-23T23:38:02.403504432Z [2024-05-23T23:38:02.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:36:00+00:00, map_index=-1, run_start_date=2024-05-23 23:38:01.253663+00:00, run_end_date=2024-05-23 23:38:01.714041+00:00, run_duration=0.460378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:38:00.279291+00:00, queued_by_job_id=1, pid=4416 2024-05-23T23:38:02.403777773Z [2024-05-23T23:38:02.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:37:00+00:00, map_index=-1, run_start_date=2024-05-23 23:38:01.347703+00:00, run_end_date=2024-05-23 23:38:01.793569+00:00, run_duration=0.445866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:38:00.279291+00:00, queued_by_job_id=1, pid=4417 2024-05-23T23:38:04.537524027Z [2024-05-23T23:38:04.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:38:04.537969416Z [2024-05-23T23:38:04.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:37:00+00:00, run_id=scheduled__2024-05-23T23:37:00+00:00, run_start_date=2024-05-23 23:38:00.183705+00:00, run_end_date=2024-05-23 23:38:04.537463+00:00, run_duration=4.353758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:37:00+00:00, data_interval_end=2024-05-23 23:38:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:38:04.547521939Z [2024-05-23T23:38:04.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:38:00+00:00, run_after=2024-05-23T23:39:00+00:00 2024-05-23T23:38:04.553385261Z [2024-05-23T23:38:04.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:38:04.553560664Z [2024-05-23T23:38:04.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:37:00+00:00, run_id=scheduled__2024-05-23T23:37:00+00:00, run_start_date=2024-05-23 23:38:00.182537+00:00, run_end_date=2024-05-23 23:38:04.553311+00:00, run_duration=4.370774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:37:00+00:00, data_interval_end=2024-05-23 23:38:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:38:04.562464146Z [2024-05-23T23:38:04.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:38:00+00:00, run_after=2024-05-23T23:39:00+00:00 2024-05-23T23:38:04.596339063Z [2024-05-23T23:38:04.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:37:00+00:00 exited with status success for try_number 1 2024-05-23T23:38:04.596408116Z [2024-05-23T23:38:04.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:37:00+00:00 exited with status success for try_number 1 2024-05-23T23:38:04.604139026Z [2024-05-23T23:38:04.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:37:00+00:00, map_index=-1, run_start_date=2024-05-23 23:38:02.654301+00:00, run_end_date=2024-05-23 23:38:04.238833+00:00, run_duration=1.584532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:38:00.279291+00:00, queued_by_job_id=1, pid=4446 2024-05-23T23:38:04.604259433Z [2024-05-23T23:38:04.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:37:00+00:00, map_index=-1, run_start_date=2024-05-23 23:38:02.382449+00:00, run_end_date=2024-05-23 23:38:03.920285+00:00, run_duration=1.537836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:38:00.279291+00:00, queued_by_job_id=1, pid=4435 2024-05-23T23:39:00.868818846Z [2024-05-23T23:39:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:39:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:39:00.877973479Z [2024-05-23T23:39:00.877+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:39:00.896103069Z [2024-05-23T23:39:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:39:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:39:01.000272885Z [2024-05-23T23:39:00.999+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:39:01.000315536Z 2024-05-23T23:39:01.000322009Z 2024-05-23T23:39:01.000327900Z 2024-05-23T23:39:01.000490600Z [2024-05-23T23:39:01.000+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:39:01.000722067Z [2024-05-23T23:39:01.000+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:39:01.000953852Z [2024-05-23T23:39:01.000+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:39:01.002962145Z [2024-05-23T23:39:01.001+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:39:01.002980317Z 2024-05-23T23:39:01.002990804Z 2024-05-23T23:39:01.002995330Z 2024-05-23T23:39:01.009524422Z [2024-05-23T23:39:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:39:01.009855811Z [2024-05-23T23:39:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:39:01.010359656Z [2024-05-23T23:39:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:39:01.010745686Z [2024-05-23T23:39:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:39:01.011308111Z [2024-05-23T23:39:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:39:01.011534547Z [2024-05-23T23:39:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:39:01.257243321Z [2024-05-23T23:39:01.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status queued for try_number 1 2024-05-23T23:39:01.257458377Z [2024-05-23T23:39:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status queued for try_number 1 2024-05-23T23:39:01.257613113Z [2024-05-23T23:39:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status queued for try_number 1 2024-05-23T23:39:01.266527896Z [2024-05-23T23:39:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 511e6c61-d632-4b13-b6cb-f631a6db5927 2024-05-23T23:39:01.266765700Z [2024-05-23T23:39:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to e092fc72-23a4-439e-81eb-45f29bb2ac81 2024-05-23T23:39:01.266956303Z [2024-05-23T23:39:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4453118e-ae69-4fb5-9d33-602228d1ffe6 2024-05-23T23:39:02.747061470Z [2024-05-23T23:39:02.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:39:02.747086554Z [2024-05-23T23:39:02.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:38:00+00:00, run_id=scheduled__2024-05-23T23:38:00+00:00, run_start_date=2024-05-23 23:39:00.904943+00:00, run_end_date=2024-05-23 23:39:02.739297+00:00, run_duration=1.834354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:38:00+00:00, data_interval_end=2024-05-23 23:39:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:39:02.748249842Z [2024-05-23T23:39:02.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:39:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:39:02.855077885Z [2024-05-23T23:39:02.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status success for try_number 1 2024-05-23T23:39:02.869711143Z [2024-05-23T23:39:02.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:38:00+00:00, map_index=-1, run_start_date=2024-05-23 23:39:01.872955+00:00, run_end_date=2024-05-23 23:39:02.303546+00:00, run_duration=0.430591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:39:01.004545+00:00, queued_by_job_id=1, pid=4473 2024-05-23T23:39:05.015142521Z [2024-05-23T23:39:05.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:39:05.015472980Z [2024-05-23T23:39:05.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:38:00+00:00, run_id=scheduled__2024-05-23T23:38:00+00:00, run_start_date=2024-05-23 23:39:00.907050+00:00, run_end_date=2024-05-23 23:39:05.015065+00:00, run_duration=4.108015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:38:00+00:00, data_interval_end=2024-05-23 23:39:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:39:05.029183148Z [2024-05-23T23:39:05.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:39:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:39:05.037425501Z [2024-05-23T23:39:05.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:39:05.037549663Z [2024-05-23T23:39:05.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:38:00+00:00, run_id=scheduled__2024-05-23T23:38:00+00:00, run_start_date=2024-05-23 23:39:00.906121+00:00, run_end_date=2024-05-23 23:39:05.037306+00:00, run_duration=4.131185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:38:00+00:00, data_interval_end=2024-05-23 23:39:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:39:05.048106647Z [2024-05-23T23:39:05.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:39:00+00:00, run_after=2024-05-23T23:40:00+00:00 2024-05-23T23:39:05.084289588Z [2024-05-23T23:39:05.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status success for try_number 1 2024-05-23T23:39:05.084312821Z [2024-05-23T23:39:05.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status success for try_number 1 2024-05-23T23:39:05.094875372Z [2024-05-23T23:39:05.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:38:00+00:00, map_index=-1, run_start_date=2024-05-23 23:39:03.087970+00:00, run_end_date=2024-05-23 23:39:04.773771+00:00, run_duration=1.685801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:39:01.004545+00:00, queued_by_job_id=1, pid=4492 2024-05-23T23:39:05.101787772Z [2024-05-23T23:39:05.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:38:00+00:00, map_index=-1, run_start_date=2024-05-23 23:39:03.102408+00:00, run_end_date=2024-05-23 23:39:04.842715+00:00, run_duration=1.740307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:39:01.004545+00:00, queued_by_job_id=1, pid=4491 2024-05-23T23:40:00.092126011Z [2024-05-23T23:40:00.091+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:40:00.114324139Z [2024-05-23T23:40:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:41:00+00:00 2024-05-23T23:40:00.130422991Z [2024-05-23T23:40:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:45:00+00:00 2024-05-23T23:40:00.138493255Z [2024-05-23T23:40:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:40:00.162891746Z [2024-05-23T23:40:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:41:00+00:00 2024-05-23T23:40:00.272896643Z [2024-05-23T23:40:00.272+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T23:40:00.272938052Z 2024-05-23T23:40:00.272952870Z 2024-05-23T23:40:00.272958704Z 2024-05-23T23:40:00.272963134Z 2024-05-23T23:40:00.272968230Z 2024-05-23T23:40:00.273131172Z [2024-05-23T23:40:00.272+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:40:00.273500354Z [2024-05-23T23:40:00.273+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:40:00.273850212Z [2024-05-23T23:40:00.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:40:00.274275170Z [2024-05-23T23:40:00.274+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:40:00.274677098Z [2024-05-23T23:40:00.274+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:40:00.276038229Z [2024-05-23T23:40:00.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:40:00.276060298Z 2024-05-23T23:40:00.276069962Z 2024-05-23T23:40:00.276080586Z 2024-05-23T23:40:00.276090685Z 2024-05-23T23:40:00.276102215Z 2024-05-23T23:40:00.283280171Z [2024-05-23T23:40:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:40:00.283535521Z [2024-05-23T23:40:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:40:00.283955728Z [2024-05-23T23:40:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:40:00.284190647Z [2024-05-23T23:40:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:40:00.284564787Z [2024-05-23T23:40:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:40:00.284710963Z [2024-05-23T23:40:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:40:00.285035340Z [2024-05-23T23:40:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:40:00.285164878Z [2024-05-23T23:40:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:40:00.285526677Z [2024-05-23T23:40:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:40:00.285691843Z [2024-05-23T23:40:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:40:00.836813187Z [2024-05-23T23:40:00.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:00.837100262Z [2024-05-23T23:40:00.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:00.837248067Z [2024-05-23T23:40:00.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:39:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:00.837381599Z [2024-05-23T23:40:00.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:39:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:00.837463298Z [2024-05-23T23:40:00.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:39:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:00.856496592Z [2024-05-23T23:40:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffb17d78-1db8-41b7-a7d3-e6070bc25f23 2024-05-23T23:40:00.856698891Z [2024-05-23T23:40:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to a035f6d5-c874-4441-b1f7-0dd85d6e7273 2024-05-23T23:40:00.856836446Z [2024-05-23T23:40:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6693bb19-3ef7-40f3-b7cb-d41ee150e6d1 2024-05-23T23:40:00.857031443Z [2024-05-23T23:40:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to f31b31b0-e8e6-492e-a779-092aff8d1802 2024-05-23T23:40:00.857297788Z [2024-05-23T23:40:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6dfec73-af57-4192-ac26-ad1b33e1b9f4 2024-05-23T23:40:02.305267302Z [2024-05-23T23:40:02.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:38:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:02.315240488Z [2024-05-23T23:40:02.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:38:00+00:00, map_index=-1, run_start_date=2024-05-23 23:40:01.582136+00:00, run_end_date=2024-05-23 23:40:02.074904+00:00, run_duration=0.492768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:00.278238+00:00, queued_by_job_id=1, pid=4527 2024-05-23T23:40:02.626600577Z [2024-05-23T23:40:02.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:40:02.627186097Z [2024-05-23T23:40:02.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:38:00+00:00, run_id=scheduled__2024-05-23T23:38:00+00:00, run_start_date=2024-05-23 23:40:00.182376+00:00, run_end_date=2024-05-23 23:40:02.626656+00:00, run_duration=2.44428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:38:00+00:00, data_interval_end=2024-05-23 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:40:02.637040412Z [2024-05-23T23:40:02.636+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:42:00+00:00 2024-05-23T23:40:02.645000799Z [2024-05-23T23:40:02.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:40:02.645276381Z [2024-05-23T23:40:02.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:39:00+00:00, run_id=scheduled__2024-05-23T23:39:00+00:00, run_start_date=2024-05-23 23:40:00.183597+00:00, run_end_date=2024-05-23 23:40:02.644976+00:00, run_duration=2.461379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:39:00+00:00, data_interval_end=2024-05-23 23:40:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:40:02.657266440Z [2024-05-23T23:40:02.656+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:41:00+00:00 2024-05-23T23:40:02.833563643Z [2024-05-23T23:40:02.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:39:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:02.854600115Z [2024-05-23T23:40:02.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:39:00+00:00, map_index=-1, run_start_date=2024-05-23 23:40:01.719422+00:00, run_end_date=2024-05-23 23:40:02.428756+00:00, run_duration=0.709334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:00.278238+00:00, queued_by_job_id=1, pid=4528 2024-05-23T23:40:03.999645950Z [2024-05-23T23:40:03.999+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:40:03.999680041Z 2024-05-23T23:40:03.999742452Z [2024-05-23T23:40:03.999+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:40:04.001330449Z [2024-05-23T23:40:04.000+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:40:04.001384942Z 2024-05-23T23:40:04.008442288Z [2024-05-23T23:40:04.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:40:04.008928608Z [2024-05-23T23:40:04.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:40:04.084413571Z [2024-05-23T23:40:04.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:04.084733877Z [2024-05-23T23:40:04.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:04.092798159Z [2024-05-23T23:40:04.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to da667a34-9bbd-4084-8ed3-0759509e0171 2024-05-23T23:40:04.093313815Z [2024-05-23T23:40:04.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:35:00+00:00, map_index=-1, run_start_date=2024-05-23 23:40:03.064723+00:00, run_end_date=2024-05-23 23:40:03.442722+00:00, run_duration=0.377999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:00.278238+00:00, queued_by_job_id=1, pid=4552 2024-05-23T23:40:05.307429379Z [2024-05-23T23:40:05.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:40:05.307860181Z [2024-05-23T23:40:05.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:39:00+00:00, run_id=scheduled__2024-05-23T23:39:00+00:00, run_start_date=2024-05-23 23:40:00.184639+00:00, run_end_date=2024-05-23 23:40:05.307487+00:00, run_duration=5.122848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:39:00+00:00, data_interval_end=2024-05-23 23:40:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:40:05.317837135Z [2024-05-23T23:40:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:41:00+00:00 2024-05-23T23:40:05.404431967Z [2024-05-23T23:40:05.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:39:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:05.409726816Z [2024-05-23T23:40:05.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:39:00+00:00, map_index=-1, run_start_date=2024-05-23 23:40:02.913094+00:00, run_end_date=2024-05-23 23:40:04.408214+00:00, run_duration=1.49512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:00.278238+00:00, queued_by_job_id=1, pid=4551 2024-05-23T23:40:06.457927677Z [2024-05-23T23:40:06.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:40:06.458239274Z [2024-05-23T23:40:06.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:39:00+00:00, run_id=scheduled__2024-05-23T23:39:00+00:00, run_start_date=2024-05-23 23:40:00.185667+00:00, run_end_date=2024-05-23 23:40:06.457811+00:00, run_duration=6.272144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:39:00+00:00, data_interval_end=2024-05-23 23:40:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:40:06.467874988Z [2024-05-23T23:40:06.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:41:00+00:00 2024-05-23T23:40:06.519611931Z [2024-05-23T23:40:06.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:39:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:06.525123908Z [2024-05-23T23:40:06.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:39:00+00:00, map_index=-1, run_start_date=2024-05-23 23:40:03.463317+00:00, run_end_date=2024-05-23 23:40:05.396901+00:00, run_duration=1.933584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:00.278238+00:00, queued_by_job_id=1, pid=4568 2024-05-23T23:40:07.625060842Z [2024-05-23T23:40:07.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:40:07.625113274Z 2024-05-23T23:40:07.625123158Z [2024-05-23T23:40:07.624+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:40:07.626100370Z [2024-05-23T23:40:07.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:40:07.626123754Z 2024-05-23T23:40:07.629274394Z [2024-05-23T23:40:07.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:40:07.629437301Z [2024-05-23T23:40:07.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:40:07.719844954Z [2024-05-23T23:40:07.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:07.720032922Z [2024-05-23T23:40:07.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:07.726643874Z [2024-05-23T23:40:07.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to df08c0a8-bed5-492e-984e-dca93bba0b71 2024-05-23T23:40:07.727222326Z [2024-05-23T23:40:07.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:35:00+00:00, map_index=-1, run_start_date=2024-05-23 23:40:05.847560+00:00, run_end_date=2024-05-23 23:40:06.286230+00:00, run_duration=0.43867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:04.003471+00:00, queued_by_job_id=1, pid=4581 2024-05-23T23:40:10.177671948Z [2024-05-23T23:40:10.177+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:40:10.177701608Z 2024-05-23T23:40:10.177706102Z [2024-05-23T23:40:10.177+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:40:10.178082771Z [2024-05-23T23:40:10.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:40:10.178093316Z 2024-05-23T23:40:10.179893127Z [2024-05-23T23:40:10.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:40:10.179981679Z [2024-05-23T23:40:10.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:40:10.281153174Z [2024-05-23T23:40:10.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status queued for try_number 1 2024-05-23T23:40:10.285912261Z [2024-05-23T23:40:10.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fe12334-928d-48d9-892e-3a3d151a231d 2024-05-23T23:40:10.386896143Z [2024-05-23T23:40:10.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:10.392821284Z [2024-05-23T23:40:10.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:35:00+00:00, map_index=0, run_start_date=2024-05-23 23:40:09.650471+00:00, run_end_date=2024-05-23 23:40:10.051744+00:00, run_duration=0.401273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:07.626378+00:00, queued_by_job_id=1, pid=4589 2024-05-23T23:40:13.066753132Z [2024-05-23T23:40:13.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:40:13.066964305Z [2024-05-23T23:40:13.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:35:00+00:00, run_id=scheduled__2024-05-23T23:35:00+00:00, run_start_date=2024-05-23 23:40:00.181026+00:00, run_end_date=2024-05-23 23:40:13.066537+00:00, run_duration=12.885511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:35:00+00:00, data_interval_end=2024-05-23 23:40:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:40:13.072711644Z [2024-05-23T23:40:13.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:40:00+00:00, run_after=2024-05-23T23:45:00+00:00 2024-05-23T23:40:13.125376505Z [2024-05-23T23:40:13.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:35:00+00:00 exited with status success for try_number 1 2024-05-23T23:40:13.131206214Z [2024-05-23T23:40:13.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:35:00+00:00, map_index=-1, run_start_date=2024-05-23 23:40:12.039704+00:00, run_end_date=2024-05-23 23:40:12.462476+00:00, run_duration=0.422772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:40:10.178309+00:00, queued_by_job_id=1, pid=4597 2024-05-23T23:41:01.013930662Z [2024-05-23T23:41:01.013+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:41:01.026243988Z [2024-05-23T23:41:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:41:00+00:00, run_after=2024-05-23T23:42:00+00:00 2024-05-23T23:41:01.041236912Z [2024-05-23T23:41:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:41:00+00:00, run_after=2024-05-23T23:42:00+00:00 2024-05-23T23:41:01.140976516Z [2024-05-23T23:41:01.140+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:41:01.141024812Z 2024-05-23T23:41:01.141035111Z 2024-05-23T23:41:01.141045392Z 2024-05-23T23:41:01.141388072Z [2024-05-23T23:41:01.140+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:41:01.141772034Z [2024-05-23T23:41:01.141+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:41:01.142067427Z [2024-05-23T23:41:01.141+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:41:01.143472366Z [2024-05-23T23:41:01.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:41:01.143498996Z 2024-05-23T23:41:01.143507894Z 2024-05-23T23:41:01.143516280Z 2024-05-23T23:41:01.149892294Z [2024-05-23T23:41:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:41:01.150239429Z [2024-05-23T23:41:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:41:01.151329930Z [2024-05-23T23:41:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:41:01.152912736Z [2024-05-23T23:41:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:41:01.153354913Z [2024-05-23T23:41:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:41:01.153596467Z [2024-05-23T23:41:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:41:01.442745155Z [2024-05-23T23:41:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:41:01.442836020Z [2024-05-23T23:41:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:41:01.442854467Z [2024-05-23T23:41:01.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:41:01.457058367Z [2024-05-23T23:41:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cb2b242-0872-4ac4-b61a-a7be3d7487c6 2024-05-23T23:41:01.457128748Z [2024-05-23T23:41:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to f26a5929-3601-4de9-b456-a9baf9ea9b7a 2024-05-23T23:41:01.457188633Z [2024-05-23T23:41:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 939f5ad2-2f63-4b0f-ba77-f2fe2311d227 2024-05-23T23:41:02.612321368Z [2024-05-23T23:41:02.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:41:02.612498246Z [2024-05-23T23:41:02.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:40:00+00:00, run_id=scheduled__2024-05-23T23:40:00+00:00, run_start_date=2024-05-23 23:41:01.056064+00:00, run_end_date=2024-05-23 23:41:02.611928+00:00, run_duration=1.555864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:40:00+00:00, data_interval_end=2024-05-23 23:41:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:41:02.627728698Z [2024-05-23T23:41:02.627+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:41:00+00:00, run_after=2024-05-23T23:42:00+00:00 2024-05-23T23:41:02.664337009Z [2024-05-23T23:41:02.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:41:02.675355033Z [2024-05-23T23:41:02.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=-1, run_start_date=2024-05-23 23:41:01.948441+00:00, run_end_date=2024-05-23 23:41:02.279328+00:00, run_duration=0.330887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:41:01.145027+00:00, queued_by_job_id=1, pid=4619 2024-05-23T23:41:05.071208704Z [2024-05-23T23:41:05.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:41:05.071375995Z [2024-05-23T23:41:05.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:40:00+00:00, run_id=scheduled__2024-05-23T23:40:00+00:00, run_start_date=2024-05-23 23:41:01.057472+00:00, run_end_date=2024-05-23 23:41:05.070969+00:00, run_duration=4.013497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:40:00+00:00, data_interval_end=2024-05-23 23:41:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:41:05.082949069Z [2024-05-23T23:41:05.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:41:00+00:00, run_after=2024-05-23T23:42:00+00:00 2024-05-23T23:41:05.137953816Z [2024-05-23T23:41:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:41:05.146613520Z [2024-05-23T23:41:05.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=-1, run_start_date=2024-05-23 23:41:03.038443+00:00, run_end_date=2024-05-23 23:41:04.688028+00:00, run_duration=1.649585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:41:01.145027+00:00, queued_by_job_id=1, pid=4637 2024-05-23T23:41:06.213406811Z [2024-05-23T23:41:06.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:41:06.213857627Z [2024-05-23T23:41:06.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:40:00+00:00, run_id=scheduled__2024-05-23T23:40:00+00:00, run_start_date=2024-05-23 23:41:01.058704+00:00, run_end_date=2024-05-23 23:41:06.213312+00:00, run_duration=5.154608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:40:00+00:00, data_interval_end=2024-05-23 23:41:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:41:06.226609496Z [2024-05-23T23:41:06.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:41:00+00:00, run_after=2024-05-23T23:42:00+00:00 2024-05-23T23:41:06.274049600Z [2024-05-23T23:41:06.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:41:06.285311102Z [2024-05-23T23:41:06.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=-1, run_start_date=2024-05-23 23:41:03.141704+00:00, run_end_date=2024-05-23 23:41:05.805466+00:00, run_duration=2.663762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:41:01.145027+00:00, queued_by_job_id=1, pid=4638 2024-05-23T23:41:39.651634714Z [2024-05-23T23:41:39.651+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:42:00.892725249Z [2024-05-23T23:42:00.892+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:42:00.907346203Z [2024-05-23T23:42:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:42:00+00:00, run_after=2024-05-23T23:43:00+00:00 2024-05-23T23:42:00.926663060Z [2024-05-23T23:42:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:42:00+00:00, run_after=2024-05-23T23:43:00+00:00 2024-05-23T23:42:00.960480798Z [2024-05-23T23:42:00.952+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:42:01.030005793Z [2024-05-23T23:42:01.029+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:42:01.030028564Z 2024-05-23T23:42:01.030046870Z 2024-05-23T23:42:01.030051675Z 2024-05-23T23:42:01.030055724Z 2024-05-23T23:42:01.030259375Z [2024-05-23T23:42:01.030+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:42:01.030459155Z [2024-05-23T23:42:01.030+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:42:01.030695300Z [2024-05-23T23:42:01.030+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:42:01.030841819Z [2024-05-23T23:42:01.030+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:42:01.031561520Z [2024-05-23T23:42:01.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:42:01.031574798Z 2024-05-23T23:42:01.031579985Z 2024-05-23T23:42:01.031583982Z 2024-05-23T23:42:01.031588071Z 2024-05-23T23:42:01.037386793Z [2024-05-23T23:42:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:42:01.037636926Z [2024-05-23T23:42:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:42:01.037990655Z [2024-05-23T23:42:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:42:01.038169046Z [2024-05-23T23:42:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:42:01.038430718Z [2024-05-23T23:42:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:42:01.038908669Z [2024-05-23T23:42:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:42:01.039242291Z [2024-05-23T23:42:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:42:01.039486847Z [2024-05-23T23:42:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:42:01.480857118Z [2024-05-23T23:42:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:42:01.480884541Z [2024-05-23T23:42:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:41:00+00:00 exited with status queued for try_number 1 2024-05-23T23:42:01.480933353Z [2024-05-23T23:42:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:41:00+00:00 exited with status queued for try_number 1 2024-05-23T23:42:01.480994845Z [2024-05-23T23:42:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:41:00+00:00 exited with status queued for try_number 1 2024-05-23T23:42:01.504024608Z [2024-05-23T23:42:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39eca413-04fc-4de4-abf2-bfd1f0d2a943 2024-05-23T23:42:01.504431175Z [2024-05-23T23:42:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbe49d15-df57-4c11-b1e6-b8cba5cf46a7 2024-05-23T23:42:01.504543207Z [2024-05-23T23:42:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3beb29e5-57de-4a3e-91b0-9a95d50458f5 2024-05-23T23:42:01.504644001Z [2024-05-23T23:42:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51b27d21-4f02-4608-8847-fe1534148cb2 2024-05-23T23:42:02.839095783Z [2024-05-23T23:42:02.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:42:02.839610306Z [2024-05-23T23:42:02.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:40:00+00:00, run_id=scheduled__2024-05-23T23:40:00+00:00, run_start_date=2024-05-23 23:42:00.967235+00:00, run_end_date=2024-05-23 23:42:02.839226+00:00, run_duration=1.871991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:40:00+00:00, data_interval_end=2024-05-23 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:42:02.852856985Z [2024-05-23T23:42:02.852+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:42:00+00:00, run_after=2024-05-23T23:44:00+00:00 2024-05-23T23:42:03.191655853Z [2024-05-23T23:42:03.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:42:03.199732471Z [2024-05-23T23:42:03.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=-1, run_start_date=2024-05-23 23:42:02.271064+00:00, run_end_date=2024-05-23 23:42:02.787532+00:00, run_duration=0.516468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:42:01.033411+00:00, queued_by_job_id=1, pid=4671 2024-05-23T23:42:03.447106212Z [2024-05-23T23:42:03.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:41:00+00:00 exited with status success for try_number 1 2024-05-23T23:42:03.462956186Z [2024-05-23T23:42:03.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:41:00+00:00, map_index=-1, run_start_date=2024-05-23 23:42:02.404993+00:00, run_end_date=2024-05-23 23:42:03.235083+00:00, run_duration=0.83009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:42:01.033411+00:00, queued_by_job_id=1, pid=4672 2024-05-23T23:42:04.600005577Z [2024-05-23T23:42:04.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:42:04.600274287Z [2024-05-23T23:42:04.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:41:00+00:00, run_id=scheduled__2024-05-23T23:41:00+00:00, run_start_date=2024-05-23 23:42:00.968500+00:00, run_end_date=2024-05-23 23:42:04.599868+00:00, run_duration=3.631368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:41:00+00:00, data_interval_end=2024-05-23 23:42:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:42:04.621243169Z [2024-05-23T23:42:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:42:00+00:00, run_after=2024-05-23T23:43:00+00:00 2024-05-23T23:42:06.067664616Z [2024-05-23T23:42:06.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:42:06.068204190Z [2024-05-23T23:42:06.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:41:00+00:00, run_id=scheduled__2024-05-23T23:41:00+00:00, run_start_date=2024-05-23 23:42:00.970670+00:00, run_end_date=2024-05-23 23:42:06.067740+00:00, run_duration=5.09707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:41:00+00:00, data_interval_end=2024-05-23 23:42:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:42:06.079759357Z [2024-05-23T23:42:06.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:42:00+00:00, run_after=2024-05-23T23:43:00+00:00 2024-05-23T23:42:06.089977317Z [2024-05-23T23:42:06.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:42:06.090351563Z [2024-05-23T23:42:06.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:41:00+00:00, run_id=scheduled__2024-05-23T23:41:00+00:00, run_start_date=2024-05-23 23:42:00.969541+00:00, run_end_date=2024-05-23 23:42:06.089992+00:00, run_duration=5.120451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:41:00+00:00, data_interval_end=2024-05-23 23:42:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:42:06.107298549Z [2024-05-23T23:42:06.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:42:00+00:00, run_after=2024-05-23T23:43:00+00:00 2024-05-23T23:42:06.139951847Z [2024-05-23T23:42:06.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:41:00+00:00 exited with status success for try_number 1 2024-05-23T23:42:06.140009612Z [2024-05-23T23:42:06.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:41:00+00:00 exited with status success for try_number 1 2024-05-23T23:42:06.154056320Z [2024-05-23T23:42:06.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:41:00+00:00, map_index=-1, run_start_date=2024-05-23 23:42:03.727780+00:00, run_end_date=2024-05-23 23:42:05.699219+00:00, run_duration=1.971439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:42:01.033411+00:00, queued_by_job_id=1, pid=4690 2024-05-23T23:42:06.160288330Z [2024-05-23T23:42:06.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:41:00+00:00, map_index=-1, run_start_date=2024-05-23 23:42:04.285030+00:00, run_end_date=2024-05-23 23:42:05.700907+00:00, run_duration=1.415877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:42:01.033411+00:00, queued_by_job_id=1, pid=4701 2024-05-23T23:43:00.824704285Z [2024-05-23T23:43:00.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:43:00+00:00, run_after=2024-05-23T23:44:00+00:00 2024-05-23T23:43:00.833383809Z [2024-05-23T23:43:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:43:00.918633556Z [2024-05-23T23:43:00.918+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-23T23:43:00.918681204Z 2024-05-23T23:43:00.918691124Z 2024-05-23T23:43:00.918817429Z [2024-05-23T23:43:00.918+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:43:00.918988490Z [2024-05-23T23:43:00.918+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:43:00.921942406Z [2024-05-23T23:43:00.921+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:43:00.921957177Z 2024-05-23T23:43:00.921961763Z 2024-05-23T23:43:00.926344773Z [2024-05-23T23:43:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:43:00.926361409Z [2024-05-23T23:43:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:43:00.926366301Z [2024-05-23T23:43:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:43:00.926370566Z [2024-05-23T23:43:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:43:01.112832899Z [2024-05-23T23:43:01.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status queued for try_number 1 2024-05-23T23:43:01.112987242Z [2024-05-23T23:43:01.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status queued for try_number 1 2024-05-23T23:43:01.121587463Z [2024-05-23T23:43:01.121+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e9b4bcc-d525-4aad-ab1d-540152d7293d 2024-05-23T23:43:01.121751388Z [2024-05-23T23:43:01.121+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e564978-7918-4c17-9f77-46fb61d37f98 2024-05-23T23:43:01.191895893Z [2024-05-23T23:43:01.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:43:00+00:00, run_after=2024-05-23T23:44:00+00:00 2024-05-23T23:43:01.280252239Z [2024-05-23T23:43:01.279+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:43:01.280283924Z 2024-05-23T23:43:01.280608125Z [2024-05-23T23:43:01.280+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:43:01.281851771Z [2024-05-23T23:43:01.281+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:43:01.281862898Z 2024-05-23T23:43:01.286678191Z [2024-05-23T23:43:01.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:43:01.286979693Z [2024-05-23T23:43:01.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:43:01.338271244Z [2024-05-23T23:43:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status queued for try_number 1 2024-05-23T23:43:01.347041412Z [2024-05-23T23:43:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04412e19-3eab-4e98-ae23-3093068ffedf 2024-05-23T23:43:03.186037968Z [2024-05-23T23:43:03.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:43:03.186890026Z [2024-05-23T23:43:03.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:42:00+00:00, run_id=scheduled__2024-05-23T23:42:00+00:00, run_start_date=2024-05-23 23:43:01.209918+00:00, run_end_date=2024-05-23 23:43:03.185945+00:00, run_duration=1.976027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:42:00+00:00, data_interval_end=2024-05-23 23:43:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:43:03.199847044Z [2024-05-23T23:43:03.199+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:43:00+00:00, run_after=2024-05-23T23:44:00+00:00 2024-05-23T23:43:03.259543817Z [2024-05-23T23:43:03.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status success for try_number 1 2024-05-23T23:43:03.267101535Z [2024-05-23T23:43:03.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:42:00+00:00, map_index=-1, run_start_date=2024-05-23 23:43:01.946837+00:00, run_end_date=2024-05-23 23:43:02.358807+00:00, run_duration=0.41197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:43:01.282631+00:00, queued_by_job_id=1, pid=4730 2024-05-23T23:43:04.997991684Z [2024-05-23T23:43:04.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:43:04.998871871Z [2024-05-23T23:43:04.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:42:00+00:00, run_id=scheduled__2024-05-23T23:42:00+00:00, run_start_date=2024-05-23 23:43:00.843203+00:00, run_end_date=2024-05-23 23:43:04.998215+00:00, run_duration=4.155012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:42:00+00:00, data_interval_end=2024-05-23 23:43:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:43:05.026669216Z [2024-05-23T23:43:05.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:43:00+00:00, run_after=2024-05-23T23:44:00+00:00 2024-05-23T23:43:05.038873288Z [2024-05-23T23:43:05.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:43:05.039442772Z [2024-05-23T23:43:05.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:42:00+00:00, run_id=scheduled__2024-05-23T23:42:00+00:00, run_start_date=2024-05-23 23:43:00.844901+00:00, run_end_date=2024-05-23 23:43:05.038820+00:00, run_duration=4.193919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:42:00+00:00, data_interval_end=2024-05-23 23:43:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:43:05.052360399Z [2024-05-23T23:43:05.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:43:00+00:00, run_after=2024-05-23T23:44:00+00:00 2024-05-23T23:43:05.098381590Z [2024-05-23T23:43:05.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status success for try_number 1 2024-05-23T23:43:05.098874464Z [2024-05-23T23:43:05.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status success for try_number 1 2024-05-23T23:43:05.109520689Z [2024-05-23T23:43:05.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:42:00+00:00, map_index=-1, run_start_date=2024-05-23 23:43:02.731462+00:00, run_end_date=2024-05-23 23:43:04.085256+00:00, run_duration=1.353794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:43:00.922529+00:00, queued_by_job_id=1, pid=4747 2024-05-23T23:43:05.110408854Z [2024-05-23T23:43:05.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:42:00+00:00, map_index=-1, run_start_date=2024-05-23 23:43:02.689917+00:00, run_end_date=2024-05-23 23:43:04.390058+00:00, run_duration=1.700141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:43:00.922529+00:00, queued_by_job_id=1, pid=4746 2024-05-23T23:44:00.145668438Z [2024-05-23T23:44:00.144+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:44:00.161733942Z [2024-05-23T23:44:00.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:44:00+00:00, run_after=2024-05-23T23:45:00+00:00 2024-05-23T23:44:00.177247923Z [2024-05-23T23:44:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:44:00+00:00, run_after=2024-05-23T23:45:00+00:00 2024-05-23T23:44:00.185788568Z [2024-05-23T23:44:00.185+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:44:00.290711128Z [2024-05-23T23:44:00.290+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:44:00.290733073Z 2024-05-23T23:44:00.290738393Z 2024-05-23T23:44:00.290742288Z 2024-05-23T23:44:00.290745918Z 2024-05-23T23:44:00.291004139Z [2024-05-23T23:44:00.290+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:44:00.291285137Z [2024-05-23T23:44:00.291+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:44:00.291617593Z [2024-05-23T23:44:00.291+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:44:00.291818533Z [2024-05-23T23:44:00.291+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:44:00.292714050Z [2024-05-23T23:44:00.292+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:44:00.292741298Z 2024-05-23T23:44:00.292753573Z 2024-05-23T23:44:00.292764763Z 2024-05-23T23:44:00.292776220Z 2024-05-23T23:44:00.296914447Z [2024-05-23T23:44:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:44:00.297261957Z [2024-05-23T23:44:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:44:00.297627476Z [2024-05-23T23:44:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:44:00.297860353Z [2024-05-23T23:44:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:44:00.298261912Z [2024-05-23T23:44:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:44:00.298704334Z [2024-05-23T23:44:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:44:00.299176349Z [2024-05-23T23:44:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:44:00.299548804Z [2024-05-23T23:44:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:44:00.858792208Z [2024-05-23T23:44:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status queued for try_number 1 2024-05-23T23:44:00.858827060Z [2024-05-23T23:44:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:43:00+00:00 exited with status queued for try_number 1 2024-05-23T23:44:00.858831293Z [2024-05-23T23:44:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:43:00+00:00 exited with status queued for try_number 1 2024-05-23T23:44:00.858834553Z [2024-05-23T23:44:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:43:00+00:00 exited with status queued for try_number 1 2024-05-23T23:44:00.892384774Z [2024-05-23T23:44:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47c051e2-f833-44a3-85a6-e733b0bdac0d 2024-05-23T23:44:00.892402094Z [2024-05-23T23:44:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 193ae486-3ee4-4d7e-8989-e07b4072fad3 2024-05-23T23:44:00.892405959Z [2024-05-23T23:44:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc5daa16-0e92-43f5-a65a-1ac93be38ac4 2024-05-23T23:44:00.892409182Z [2024-05-23T23:44:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2128093-6c90-4a47-9a59-0441b111598c 2024-05-23T23:44:02.119193370Z [2024-05-23T23:44:02.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:44:02.119918152Z [2024-05-23T23:44:02.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:43:00+00:00, run_id=scheduled__2024-05-23T23:43:00+00:00, run_start_date=2024-05-23 23:44:00.203479+00:00, run_end_date=2024-05-23 23:44:02.119134+00:00, run_duration=1.915655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:43:00+00:00, data_interval_end=2024-05-23 23:44:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:44:02.151216714Z [2024-05-23T23:44:02.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:44:00+00:00, run_after=2024-05-23T23:45:00+00:00 2024-05-23T23:44:02.264867634Z [2024-05-23T23:44:02.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:43:00+00:00 exited with status success for try_number 1 2024-05-23T23:44:02.293847292Z [2024-05-23T23:44:02.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:43:00+00:00, map_index=-1, run_start_date=2024-05-23 23:44:01.572210+00:00, run_end_date=2024-05-23 23:44:02.058042+00:00, run_duration=0.485832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:44:00.293925+00:00, queued_by_job_id=1, pid=4779 2024-05-23T23:44:03.403334775Z [2024-05-23T23:44:03.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:44:03.403485408Z [2024-05-23T23:44:03.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:42:00+00:00, run_id=scheduled__2024-05-23T23:42:00+00:00, run_start_date=2024-05-23 23:44:00.201145+00:00, run_end_date=2024-05-23 23:44:03.403231+00:00, run_duration=3.202086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:42:00+00:00, data_interval_end=2024-05-23 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:44:03.410558855Z [2024-05-23T23:44:03.410+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:44:00+00:00, run_after=2024-05-23T23:46:00+00:00 2024-05-23T23:44:03.458036497Z [2024-05-23T23:44:03.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:42:00+00:00 exited with status success for try_number 1 2024-05-23T23:44:03.466246559Z [2024-05-23T23:44:03.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:42:00+00:00, map_index=-1, run_start_date=2024-05-23 23:44:01.813418+00:00, run_end_date=2024-05-23 23:44:02.578997+00:00, run_duration=0.765579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:44:00.293925+00:00, queued_by_job_id=1, pid=4780 2024-05-23T23:44:05.554281137Z [2024-05-23T23:44:05.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:44:05.554431769Z [2024-05-23T23:44:05.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:43:00+00:00, run_id=scheduled__2024-05-23T23:43:00+00:00, run_start_date=2024-05-23 23:44:00.206962+00:00, run_end_date=2024-05-23 23:44:05.554119+00:00, run_duration=5.347157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:43:00+00:00, data_interval_end=2024-05-23 23:44:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:44:05.567646124Z [2024-05-23T23:44:05.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:44:00+00:00, run_after=2024-05-23T23:45:00+00:00 2024-05-23T23:44:05.576371182Z [2024-05-23T23:44:05.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:44:05.576488145Z [2024-05-23T23:44:05.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:43:00+00:00, run_id=scheduled__2024-05-23T23:43:00+00:00, run_start_date=2024-05-23 23:44:00.205169+00:00, run_end_date=2024-05-23 23:44:05.576194+00:00, run_duration=5.371025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:43:00+00:00, data_interval_end=2024-05-23 23:44:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:44:05.600815395Z [2024-05-23T23:44:05.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:44:00+00:00, run_after=2024-05-23T23:45:00+00:00 2024-05-23T23:44:05.655584844Z [2024-05-23T23:44:05.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:43:00+00:00 exited with status success for try_number 1 2024-05-23T23:44:05.655818554Z [2024-05-23T23:44:05.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:43:00+00:00 exited with status success for try_number 1 2024-05-23T23:44:05.667198861Z [2024-05-23T23:44:05.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:43:00+00:00, map_index=-1, run_start_date=2024-05-23 23:44:02.983374+00:00, run_end_date=2024-05-23 23:44:05.182003+00:00, run_duration=2.198629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:44:00.293925+00:00, queued_by_job_id=1, pid=4798 2024-05-23T23:44:05.667613326Z [2024-05-23T23:44:05.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:43:00+00:00, map_index=-1, run_start_date=2024-05-23 23:44:03.367563+00:00, run_end_date=2024-05-23 23:44:05.250203+00:00, run_duration=1.88264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:44:00.293925+00:00, queued_by_job_id=1, pid=4809 2024-05-23T23:45:00.407075270Z [2024-05-23T23:45:00.406+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:45:00.423551073Z [2024-05-23T23:45:00.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:45:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:45:00.439272778Z [2024-05-23T23:45:00.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:45:00+00:00, run_after=2024-05-23T23:46:00+00:00 2024-05-23T23:45:00.455252834Z [2024-05-23T23:45:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:45:00+00:00, run_after=2024-05-23T23:46:00+00:00 2024-05-23T23:45:00.543405362Z [2024-05-23T23:45:00.542+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:45:00.543428265Z 2024-05-23T23:45:00.543432860Z 2024-05-23T23:45:00.543436678Z 2024-05-23T23:45:00.543440641Z 2024-05-23T23:45:00.543506497Z [2024-05-23T23:45:00.543+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:45:00.543687039Z [2024-05-23T23:45:00.543+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:45:00.544160310Z [2024-05-23T23:45:00.543+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:45:00.544496989Z [2024-05-23T23:45:00.544+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:45:00.545550096Z [2024-05-23T23:45:00.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:45:00.545561402Z 2024-05-23T23:45:00.545565658Z 2024-05-23T23:45:00.545569321Z 2024-05-23T23:45:00.545573063Z 2024-05-23T23:45:00.549749254Z [2024-05-23T23:45:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:45:00.549961942Z [2024-05-23T23:45:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:45:00.550220171Z [2024-05-23T23:45:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:45:00.550360076Z [2024-05-23T23:45:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:45:00.550634258Z [2024-05-23T23:45:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:45:00.550745330Z [2024-05-23T23:45:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:45:00.551030821Z [2024-05-23T23:45:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:45:00.551149983Z [2024-05-23T23:45:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:45:01.062449425Z [2024-05-23T23:45:01.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:45:01.062481549Z [2024-05-23T23:45:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status queued for try_number 1 2024-05-23T23:45:01.062548730Z [2024-05-23T23:45:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status queued for try_number 1 2024-05-23T23:45:01.062606071Z [2024-05-23T23:45:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status queued for try_number 1 2024-05-23T23:45:01.075413702Z [2024-05-23T23:45:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5561df5b-5bbb-49e6-97e5-28781af591bc 2024-05-23T23:45:01.075477248Z [2024-05-23T23:45:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 783e539a-3f6f-4bd4-aae4-881e5ce4d5fa 2024-05-23T23:45:01.075561752Z [2024-05-23T23:45:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to bba48828-4a3b-4186-9292-dcc9b642abfa 2024-05-23T23:45:01.075651510Z [2024-05-23T23:45:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to e43a9656-9bad-4921-baee-50bb073bf3f7 2024-05-23T23:45:02.506686360Z [2024-05-23T23:45:02.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status success for try_number 1 2024-05-23T23:45:02.513509084Z [2024-05-23T23:45:02.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:44:00+00:00, map_index=-1, run_start_date=2024-05-23 23:45:01.659736+00:00, run_end_date=2024-05-23 23:45:02.217094+00:00, run_duration=0.557358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:45:00.546619+00:00, queued_by_job_id=1, pid=4837 2024-05-23T23:45:02.600743601Z [2024-05-23T23:45:02.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:45:02.601049065Z [2024-05-23T23:45:02.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:44:00+00:00, run_id=scheduled__2024-05-23T23:44:00+00:00, run_start_date=2024-05-23 23:45:00.470310+00:00, run_end_date=2024-05-23 23:45:02.600659+00:00, run_duration=2.130349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:44:00+00:00, data_interval_end=2024-05-23 23:45:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:45:02.617882320Z [2024-05-23T23:45:02.617+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:45:00+00:00, run_after=2024-05-23T23:46:00+00:00 2024-05-23T23:45:04.555591910Z [2024-05-23T23:45:04.555+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:45:04.555652837Z 2024-05-23T23:45:04.555696334Z [2024-05-23T23:45:04.555+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:45:04.556311781Z [2024-05-23T23:45:04.556+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:45:04.556358839Z 2024-05-23T23:45:04.559062327Z [2024-05-23T23:45:04.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:45:04.559216057Z [2024-05-23T23:45:04.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:45:04.621697574Z [2024-05-23T23:45:04.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:45:04.621805899Z [2024-05-23T23:45:04.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:45:04.627381410Z [2024-05-23T23:45:04.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f4bffcb-0899-4bdb-a23e-f66a330a7204 2024-05-23T23:45:04.627661274Z [2024-05-23T23:45:04.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=-1, run_start_date=2024-05-23 23:45:03.004107+00:00, run_end_date=2024-05-23 23:45:03.429206+00:00, run_duration=0.425099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:45:00.546619+00:00, queued_by_job_id=1, pid=4861 2024-05-23T23:45:06.031408740Z [2024-05-23T23:45:06.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:45:06.031873165Z [2024-05-23T23:45:06.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:44:00+00:00, run_id=scheduled__2024-05-23T23:44:00+00:00, run_start_date=2024-05-23 23:45:00.472782+00:00, run_end_date=2024-05-23 23:45:06.031465+00:00, run_duration=5.558683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:44:00+00:00, data_interval_end=2024-05-23 23:45:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:45:06.043087511Z [2024-05-23T23:45:06.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:45:00+00:00, run_after=2024-05-23T23:46:00+00:00 2024-05-23T23:45:06.049722614Z [2024-05-23T23:45:06.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:45:06.050161621Z [2024-05-23T23:45:06.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:44:00+00:00, run_id=scheduled__2024-05-23T23:44:00+00:00, run_start_date=2024-05-23 23:45:00.471495+00:00, run_end_date=2024-05-23 23:45:06.049831+00:00, run_duration=5.578336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:44:00+00:00, data_interval_end=2024-05-23 23:45:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:45:06.061097189Z [2024-05-23T23:45:06.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:45:00+00:00, run_after=2024-05-23T23:46:00+00:00 2024-05-23T23:45:06.113860427Z [2024-05-23T23:45:06.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status success for try_number 1 2024-05-23T23:45:06.114134337Z [2024-05-23T23:45:06.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status success for try_number 1 2024-05-23T23:45:06.121559522Z [2024-05-23T23:45:06.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:44:00+00:00, map_index=-1, run_start_date=2024-05-23 23:45:03.281440+00:00, run_end_date=2024-05-23 23:45:05.155638+00:00, run_duration=1.874198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:45:00.546619+00:00, queued_by_job_id=1, pid=4862 2024-05-23T23:45:06.122049723Z [2024-05-23T23:45:06.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:44:00+00:00, map_index=-1, run_start_date=2024-05-23 23:45:03.003678+00:00, run_end_date=2024-05-23 23:45:05.445729+00:00, run_duration=2.442051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:45:00.546619+00:00, queued_by_job_id=1, pid=4860 2024-05-23T23:45:07.196071175Z [2024-05-23T23:45:07.195+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:45:07.196111472Z 2024-05-23T23:45:07.196174559Z [2024-05-23T23:45:07.195+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:45:07.196750203Z [2024-05-23T23:45:07.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:45:07.196758756Z 2024-05-23T23:45:07.198849091Z [2024-05-23T23:45:07.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:45:07.198976807Z [2024-05-23T23:45:07.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:45:07.260661069Z [2024-05-23T23:45:07.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:45:07.260877453Z [2024-05-23T23:45:07.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:45:07.270932183Z [2024-05-23T23:45:07.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to e53a6fcb-1ee4-4e17-9bbf-388092689027 2024-05-23T23:45:07.270955732Z [2024-05-23T23:45:07.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=-1, run_start_date=2024-05-23 23:45:06.317986+00:00, run_end_date=2024-05-23 23:45:06.673882+00:00, run_duration=0.355896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:45:04.556603+00:00, queued_by_job_id=1, pid=4885 2024-05-23T23:45:10.806844414Z [2024-05-23T23:45:10.806+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:45:10.806889619Z 2024-05-23T23:45:10.807150114Z [2024-05-23T23:45:10.806+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:45:10.807658581Z [2024-05-23T23:45:10.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:45:10.807682920Z 2024-05-23T23:45:10.809905566Z [2024-05-23T23:45:10.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:45:10.810128799Z [2024-05-23T23:45:10.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:45:10.905718236Z [2024-05-23T23:45:10.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status queued for try_number 1 2024-05-23T23:45:10.905745215Z [2024-05-23T23:45:10.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:45:10.915003582Z [2024-05-23T23:45:10.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d66db26-1827-439a-a2d0-598441dbdd3c 2024-05-23T23:45:10.915209638Z [2024-05-23T23:45:10.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=0, run_start_date=2024-05-23 23:45:09.066479+00:00, run_end_date=2024-05-23 23:45:09.650145+00:00, run_duration=0.583666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:45:07.197047+00:00, queued_by_job_id=1, pid=4893 2024-05-23T23:45:13.579771774Z [2024-05-23T23:45:13.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:45:13.580041615Z [2024-05-23T23:45:13.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:40:00+00:00, run_id=scheduled__2024-05-23T23:40:00+00:00, run_start_date=2024-05-23 23:45:00.468739+00:00, run_end_date=2024-05-23 23:45:13.579641+00:00, run_duration=13.110902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:40:00+00:00, data_interval_end=2024-05-23 23:45:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:45:13.590597743Z [2024-05-23T23:45:13.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:45:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:45:13.624404031Z [2024-05-23T23:45:13.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:40:00+00:00 exited with status success for try_number 1 2024-05-23T23:45:13.630979587Z [2024-05-23T23:45:13.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:40:00+00:00, map_index=-1, run_start_date=2024-05-23 23:45:12.962317+00:00, run_end_date=2024-05-23 23:45:13.354055+00:00, run_duration=0.391738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:45:10.808078+00:00, queued_by_job_id=1, pid=4901 2024-05-23T23:46:00.342018834Z [2024-05-23T23:46:00.341+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:46:00.351066351Z [2024-05-23T23:46:00.349+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:46:00.365451319Z [2024-05-23T23:46:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:46:00+00:00, run_after=2024-05-23T23:47:00+00:00 2024-05-23T23:46:00.378413405Z [2024-05-23T23:46:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:46:00+00:00, run_after=2024-05-23T23:47:00+00:00 2024-05-23T23:46:00.449392303Z [2024-05-23T23:46:00.449+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:46:00.449420539Z 2024-05-23T23:46:00.449428652Z 2024-05-23T23:46:00.449431799Z 2024-05-23T23:46:00.449434633Z 2024-05-23T23:46:00.449784398Z [2024-05-23T23:46:00.449+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:46:00.450755068Z [2024-05-23T23:46:00.450+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:46:00.450887824Z [2024-05-23T23:46:00.450+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:46:00.450997964Z [2024-05-23T23:46:00.450+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:46:00.451578334Z [2024-05-23T23:46:00.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:46:00.451591369Z 2024-05-23T23:46:00.451595080Z 2024-05-23T23:46:00.451613791Z 2024-05-23T23:46:00.451617072Z 2024-05-23T23:46:00.455309419Z [2024-05-23T23:46:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:46:00.455633522Z [2024-05-23T23:46:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:46:00.457589660Z [2024-05-23T23:46:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:46:00.457732256Z [2024-05-23T23:46:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:46:00.458000105Z [2024-05-23T23:46:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:46:00.458133432Z [2024-05-23T23:46:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:46:00.458367215Z [2024-05-23T23:46:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:46:00.458537764Z [2024-05-23T23:46:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:46:00.821725022Z [2024-05-23T23:46:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status queued for try_number 1 2024-05-23T23:46:00.821755303Z [2024-05-23T23:46:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status queued for try_number 1 2024-05-23T23:46:00.821760031Z [2024-05-23T23:46:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status queued for try_number 1 2024-05-23T23:46:00.821763715Z [2024-05-23T23:46:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status queued for try_number 1 2024-05-23T23:46:00.829356581Z [2024-05-23T23:46:00.828+0000] {scheduler_job.py:635} INFO - Setting external_id for to c28854df-453f-42ab-84d8-499256c092ce 2024-05-23T23:46:00.829674978Z [2024-05-23T23:46:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9d7c956-6966-4d02-bcda-2f1bc8b3078f 2024-05-23T23:46:00.829918311Z [2024-05-23T23:46:00.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01d66798-caf9-40a7-b6a8-e1b2a168e618 2024-05-23T23:46:00.830149990Z [2024-05-23T23:46:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb505bf7-407c-4599-927c-d8e8eda3cb7d 2024-05-23T23:46:02.052451913Z [2024-05-23T23:46:02.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:46:02.052676865Z [2024-05-23T23:46:02.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:45:00+00:00, run_id=scheduled__2024-05-23T23:45:00+00:00, run_start_date=2024-05-23 23:46:00.392372+00:00, run_end_date=2024-05-23 23:46:02.052368+00:00, run_duration=1.659996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:45:00+00:00, data_interval_end=2024-05-23 23:46:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:46:02.074695325Z [2024-05-23T23:46:02.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:46:00+00:00, run_after=2024-05-23T23:47:00+00:00 2024-05-23T23:46:02.988015674Z [2024-05-23T23:46:02.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:46:02.988056224Z [2024-05-23T23:46:02.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:44:00+00:00, run_id=scheduled__2024-05-23T23:44:00+00:00, run_start_date=2024-05-23 23:46:00.391169+00:00, run_end_date=2024-05-23 23:46:02.987399+00:00, run_duration=2.59623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:44:00+00:00, data_interval_end=2024-05-23 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:46:02.999841999Z [2024-05-23T23:46:02.998+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:46:00+00:00, run_after=2024-05-23T23:48:00+00:00 2024-05-23T23:46:03.100903587Z [2024-05-23T23:46:03.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:44:00+00:00 exited with status success for try_number 1 2024-05-23T23:46:03.102775427Z [2024-05-23T23:46:03.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status success for try_number 1 2024-05-23T23:46:03.110286363Z [2024-05-23T23:46:03.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:45:00+00:00, map_index=-1, run_start_date=2024-05-23 23:46:01.510278+00:00, run_end_date=2024-05-23 23:46:01.972377+00:00, run_duration=0.462099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:46:00.452330+00:00, queued_by_job_id=1, pid=4924 2024-05-23T23:46:03.110787792Z [2024-05-23T23:46:03.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:44:00+00:00, map_index=-1, run_start_date=2024-05-23 23:46:01.544750+00:00, run_end_date=2024-05-23 23:46:02.038624+00:00, run_duration=0.493874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:46:00.452330+00:00, queued_by_job_id=1, pid=4925 2024-05-23T23:46:04.192655996Z [2024-05-23T23:46:04.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:46:04.192971194Z [2024-05-23T23:46:04.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:45:00+00:00, run_id=scheduled__2024-05-23T23:45:00+00:00, run_start_date=2024-05-23 23:46:00.393296+00:00, run_end_date=2024-05-23 23:46:04.192656+00:00, run_duration=3.79936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:45:00+00:00, data_interval_end=2024-05-23 23:46:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:46:04.210029582Z [2024-05-23T23:46:04.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:46:00+00:00, run_after=2024-05-23T23:47:00+00:00 2024-05-23T23:46:04.411565601Z [2024-05-23T23:46:04.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status success for try_number 1 2024-05-23T23:46:04.419004230Z [2024-05-23T23:46:04.418+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:45:00+00:00, map_index=-1, run_start_date=2024-05-23 23:46:02.750718+00:00, run_end_date=2024-05-23 23:46:04.083936+00:00, run_duration=1.333218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:46:00.452330+00:00, queued_by_job_id=1, pid=4949 2024-05-23T23:46:05.372939515Z [2024-05-23T23:46:05.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:46:05.373596446Z [2024-05-23T23:46:05.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:45:00+00:00, run_id=scheduled__2024-05-23T23:45:00+00:00, run_start_date=2024-05-23 23:46:00.394390+00:00, run_end_date=2024-05-23 23:46:05.372795+00:00, run_duration=4.978405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:45:00+00:00, data_interval_end=2024-05-23 23:46:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:46:05.387821146Z [2024-05-23T23:46:05.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:46:00+00:00, run_after=2024-05-23T23:47:00+00:00 2024-05-23T23:46:05.432132933Z [2024-05-23T23:46:05.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status success for try_number 1 2024-05-23T23:46:05.439481579Z [2024-05-23T23:46:05.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:45:00+00:00, map_index=-1, run_start_date=2024-05-23 23:46:02.654456+00:00, run_end_date=2024-05-23 23:46:04.761232+00:00, run_duration=2.106776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:46:00.452330+00:00, queued_by_job_id=1, pid=4948 2024-05-23T23:46:39.738596901Z [2024-05-23T23:46:39.737+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:47:00.109630116Z [2024-05-23T23:47:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:47:00.138271890Z [2024-05-23T23:47:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:47:00+00:00, run_after=2024-05-23T23:48:00+00:00 2024-05-23T23:47:00.152064000Z [2024-05-23T23:47:00.151+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:47:00+00:00, run_after=2024-05-23T23:48:00+00:00 2024-05-23T23:47:00.241449551Z [2024-05-23T23:47:00.240+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:47:00.241508559Z 2024-05-23T23:47:00.241519459Z 2024-05-23T23:47:00.241528023Z 2024-05-23T23:47:00.242410069Z [2024-05-23T23:47:00.241+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:47:00.242883954Z [2024-05-23T23:47:00.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:47:00.243892358Z [2024-05-23T23:47:00.243+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:47:00.245676349Z [2024-05-23T23:47:00.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:47:00.245688917Z 2024-05-23T23:47:00.245692653Z 2024-05-23T23:47:00.245696022Z 2024-05-23T23:47:00.251973295Z [2024-05-23T23:47:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:47:00.252223291Z [2024-05-23T23:47:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:47:00.252537505Z [2024-05-23T23:47:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:47:00.252644204Z [2024-05-23T23:47:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:47:00.252981161Z [2024-05-23T23:47:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:47:00.253133956Z [2024-05-23T23:47:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:47:00.577030616Z [2024-05-23T23:47:00.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status queued for try_number 1 2024-05-23T23:47:00.577068867Z [2024-05-23T23:47:00.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status queued for try_number 1 2024-05-23T23:47:00.577073160Z [2024-05-23T23:47:00.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status queued for try_number 1 2024-05-23T23:47:00.592848288Z [2024-05-23T23:47:00.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6386153-d007-433b-b623-342397958a53 2024-05-23T23:47:00.592868671Z [2024-05-23T23:47:00.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8280421-c03a-4d3e-8cff-e17f2d556c7e 2024-05-23T23:47:00.592888656Z [2024-05-23T23:47:00.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8b70946-728d-4226-864c-b4c6bf82a35a 2024-05-23T23:47:01.831915534Z [2024-05-23T23:47:01.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:47:01.832509255Z [2024-05-23T23:47:01.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:46:00+00:00, run_id=scheduled__2024-05-23T23:46:00+00:00, run_start_date=2024-05-23 23:47:00.162161+00:00, run_end_date=2024-05-23 23:47:01.831813+00:00, run_duration=1.669652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:46:00+00:00, data_interval_end=2024-05-23 23:47:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:47:01.849245789Z [2024-05-23T23:47:01.848+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:47:00+00:00, run_after=2024-05-23T23:48:00+00:00 2024-05-23T23:47:03.007537209Z [2024-05-23T23:47:03.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status success for try_number 1 2024-05-23T23:47:03.017495190Z [2024-05-23T23:47:03.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:46:00+00:00, map_index=-1, run_start_date=2024-05-23 23:47:01.343242+00:00, run_end_date=2024-05-23 23:47:01.753349+00:00, run_duration=0.410107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:47:00.246912+00:00, queued_by_job_id=1, pid=4981 2024-05-23T23:47:04.470564385Z [2024-05-23T23:47:04.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:47:04.470965450Z [2024-05-23T23:47:04.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:46:00+00:00, run_id=scheduled__2024-05-23T23:46:00+00:00, run_start_date=2024-05-23 23:47:00.164607+00:00, run_end_date=2024-05-23 23:47:04.470328+00:00, run_duration=4.305721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:46:00+00:00, data_interval_end=2024-05-23 23:47:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:47:04.480716037Z [2024-05-23T23:47:04.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:47:00+00:00, run_after=2024-05-23T23:48:00+00:00 2024-05-23T23:47:04.488380060Z [2024-05-23T23:47:04.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:47:04.488498874Z [2024-05-23T23:47:04.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:46:00+00:00, run_id=scheduled__2024-05-23T23:46:00+00:00, run_start_date=2024-05-23 23:47:00.163527+00:00, run_end_date=2024-05-23 23:47:04.488220+00:00, run_duration=4.324693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:46:00+00:00, data_interval_end=2024-05-23 23:47:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:47:04.498135007Z [2024-05-23T23:47:04.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:47:00+00:00, run_after=2024-05-23T23:48:00+00:00 2024-05-23T23:47:04.550724011Z [2024-05-23T23:47:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status success for try_number 1 2024-05-23T23:47:04.551106376Z [2024-05-23T23:47:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status success for try_number 1 2024-05-23T23:47:04.560086065Z [2024-05-23T23:47:04.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:46:00+00:00, map_index=-1, run_start_date=2024-05-23 23:47:02.146297+00:00, run_end_date=2024-05-23 23:47:03.852551+00:00, run_duration=1.706254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:47:00.246912+00:00, queued_by_job_id=1, pid=4999 2024-05-23T23:47:04.560453661Z [2024-05-23T23:47:04.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:46:00+00:00, map_index=-1, run_start_date=2024-05-23 23:47:02.201865+00:00, run_end_date=2024-05-23 23:47:03.531011+00:00, run_duration=1.329146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:47:00.246912+00:00, queued_by_job_id=1, pid=5000 2024-05-23T23:48:00.766454680Z [2024-05-23T23:48:00.765+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:48:00.786179838Z [2024-05-23T23:48:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:48:00+00:00, run_after=2024-05-23T23:49:00+00:00 2024-05-23T23:48:00.797369437Z [2024-05-23T23:48:00.796+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:48:00.825077967Z [2024-05-23T23:48:00.824+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:48:00+00:00, run_after=2024-05-23T23:49:00+00:00 2024-05-23T23:48:00.930733695Z [2024-05-23T23:48:00.928+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:48:00.930771168Z 2024-05-23T23:48:00.930783884Z 2024-05-23T23:48:00.930791260Z 2024-05-23T23:48:00.930798896Z 2024-05-23T23:48:00.930806739Z [2024-05-23T23:48:00.928+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:48:00.930813735Z [2024-05-23T23:48:00.929+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:48:00.930838213Z [2024-05-23T23:48:00.929+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:48:00.930845215Z [2024-05-23T23:48:00.929+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:48:00.930852178Z [2024-05-23T23:48:00.929+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:48:00.930859104Z 2024-05-23T23:48:00.930866209Z 2024-05-23T23:48:00.930873163Z 2024-05-23T23:48:00.930880240Z 2024-05-23T23:48:00.934265528Z [2024-05-23T23:48:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:48:00.934413408Z [2024-05-23T23:48:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:48:00.935111504Z [2024-05-23T23:48:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:48:00.935123604Z [2024-05-23T23:48:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:48:00.935127237Z [2024-05-23T23:48:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:48:00.935130389Z [2024-05-23T23:48:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:48:00.935652328Z [2024-05-23T23:48:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:48:00.935663051Z [2024-05-23T23:48:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:48:01.574665356Z [2024-05-23T23:48:01.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status queued for try_number 1 2024-05-23T23:48:01.576408880Z [2024-05-23T23:48:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:47:00+00:00 exited with status queued for try_number 1 2024-05-23T23:48:01.576482233Z [2024-05-23T23:48:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:47:00+00:00 exited with status queued for try_number 1 2024-05-23T23:48:01.576577990Z [2024-05-23T23:48:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:47:00+00:00 exited with status queued for try_number 1 2024-05-23T23:48:01.596330393Z [2024-05-23T23:48:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2389f367-251b-426e-8853-ccded5af479d 2024-05-23T23:48:01.597004494Z [2024-05-23T23:48:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to edf361ef-113b-4674-863b-6c65cd0b61d1 2024-05-23T23:48:01.597181145Z [2024-05-23T23:48:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ef3a18e-b305-469c-aa10-cd1b0aa24ed1 2024-05-23T23:48:01.597327623Z [2024-05-23T23:48:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe72fe0-3804-4931-b190-1c5f72e288e8 2024-05-23T23:48:02.862634789Z [2024-05-23T23:48:02.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:48:02.862984277Z [2024-05-23T23:48:02.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:47:00+00:00, run_id=scheduled__2024-05-23T23:47:00+00:00, run_start_date=2024-05-23 23:48:00.838044+00:00, run_end_date=2024-05-23 23:48:02.862612+00:00, run_duration=2.024568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:47:00+00:00, data_interval_end=2024-05-23 23:48:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:48:02.873650104Z [2024-05-23T23:48:02.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:48:00+00:00, run_after=2024-05-23T23:49:00+00:00 2024-05-23T23:48:02.886302195Z [2024-05-23T23:48:02.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:48:02.886661709Z [2024-05-23T23:48:02.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:46:00+00:00, run_id=scheduled__2024-05-23T23:46:00+00:00, run_start_date=2024-05-23 23:48:00.836607+00:00, run_end_date=2024-05-23 23:48:02.886246+00:00, run_duration=2.049639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:46:00+00:00, data_interval_end=2024-05-23 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:48:02.901345114Z [2024-05-23T23:48:02.901+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:48:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:48:03.014675669Z [2024-05-23T23:48:03.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:46:00+00:00 exited with status success for try_number 1 2024-05-23T23:48:03.014710461Z [2024-05-23T23:48:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:47:00+00:00 exited with status success for try_number 1 2024-05-23T23:48:03.027671921Z [2024-05-23T23:48:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:47:00+00:00, map_index=-1, run_start_date=2024-05-23 23:48:01.788644+00:00, run_end_date=2024-05-23 23:48:02.194407+00:00, run_duration=0.405763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:48:00.931043+00:00, queued_by_job_id=1, pid=5033 2024-05-23T23:48:03.034651297Z [2024-05-23T23:48:03.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:46:00+00:00, map_index=-1, run_start_date=2024-05-23 23:48:01.727050+00:00, run_end_date=2024-05-23 23:48:02.080269+00:00, run_duration=0.353219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:48:00.931043+00:00, queued_by_job_id=1, pid=5032 2024-05-23T23:48:04.767712314Z [2024-05-23T23:48:04.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:48:04.768176993Z [2024-05-23T23:48:04.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:47:00+00:00, run_id=scheduled__2024-05-23T23:47:00+00:00, run_start_date=2024-05-23 23:48:00.840359+00:00, run_end_date=2024-05-23 23:48:04.767621+00:00, run_duration=3.927262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:47:00+00:00, data_interval_end=2024-05-23 23:48:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:48:04.780204073Z [2024-05-23T23:48:04.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:48:00+00:00, run_after=2024-05-23T23:49:00+00:00 2024-05-23T23:48:04.792062978Z [2024-05-23T23:48:04.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:48:04.797115984Z [2024-05-23T23:48:04.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:47:00+00:00, run_id=scheduled__2024-05-23T23:47:00+00:00, run_start_date=2024-05-23 23:48:00.839331+00:00, run_end_date=2024-05-23 23:48:04.791824+00:00, run_duration=3.952493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:47:00+00:00, data_interval_end=2024-05-23 23:48:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:48:04.812438645Z [2024-05-23T23:48:04.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:48:00+00:00, run_after=2024-05-23T23:49:00+00:00 2024-05-23T23:48:04.870108551Z [2024-05-23T23:48:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:47:00+00:00 exited with status success for try_number 1 2024-05-23T23:48:04.870133042Z [2024-05-23T23:48:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:47:00+00:00 exited with status success for try_number 1 2024-05-23T23:48:04.875170103Z [2024-05-23T23:48:04.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:47:00+00:00, map_index=-1, run_start_date=2024-05-23 23:48:02.826925+00:00, run_end_date=2024-05-23 23:48:04.432000+00:00, run_duration=1.605075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:48:00.931043+00:00, queued_by_job_id=1, pid=5056 2024-05-23T23:48:04.875758751Z [2024-05-23T23:48:04.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:47:00+00:00, map_index=-1, run_start_date=2024-05-23 23:48:02.864730+00:00, run_end_date=2024-05-23 23:48:04.196857+00:00, run_duration=1.332127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:48:00.931043+00:00, queued_by_job_id=1, pid=5057 2024-05-23T23:49:00.714376829Z [2024-05-23T23:49:00.713+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:49:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:49:00.724407711Z [2024-05-23T23:49:00.724+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:49:00.742145851Z [2024-05-23T23:49:00.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:49:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:49:00.828379106Z [2024-05-23T23:49:00.828+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:49:00.828410002Z 2024-05-23T23:49:00.828413991Z 2024-05-23T23:49:00.828417530Z 2024-05-23T23:49:00.828659324Z [2024-05-23T23:49:00.828+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:49:00.828710401Z [2024-05-23T23:49:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:49:00.829008547Z [2024-05-23T23:49:00.828+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:49:00.829520689Z [2024-05-23T23:49:00.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:49:00.829553727Z 2024-05-23T23:49:00.829562587Z 2024-05-23T23:49:00.829570172Z 2024-05-23T23:49:00.833526120Z [2024-05-23T23:49:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:49:00.833560739Z [2024-05-23T23:49:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:49:00.833752622Z [2024-05-23T23:49:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:49:00.833765021Z [2024-05-23T23:49:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:49:00.833912481Z [2024-05-23T23:49:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:49:00.833931262Z [2024-05-23T23:49:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:49:01.137172113Z [2024-05-23T23:49:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status queued for try_number 1 2024-05-23T23:49:01.137662435Z [2024-05-23T23:49:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status queued for try_number 1 2024-05-23T23:49:01.137883853Z [2024-05-23T23:49:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status queued for try_number 1 2024-05-23T23:49:01.150144195Z [2024-05-23T23:49:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48eef71b-292e-45d9-b6dd-f55a95dbfa54 2024-05-23T23:49:01.150486589Z [2024-05-23T23:49:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c4e14c6-6194-43ff-895b-7057d17e78ef 2024-05-23T23:49:01.150892734Z [2024-05-23T23:49:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10579707-3a0a-456e-bd8f-c35ae83c204b 2024-05-23T23:49:02.319410784Z [2024-05-23T23:49:02.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:49:02.320198546Z [2024-05-23T23:49:02.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:48:00+00:00, run_id=scheduled__2024-05-23T23:48:00+00:00, run_start_date=2024-05-23 23:49:00.755907+00:00, run_end_date=2024-05-23 23:49:02.319304+00:00, run_duration=1.563397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:48:00+00:00, data_interval_end=2024-05-23 23:49:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:49:02.343602280Z [2024-05-23T23:49:02.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:49:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:49:02.394182007Z [2024-05-23T23:49:02.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status success for try_number 1 2024-05-23T23:49:02.401358248Z [2024-05-23T23:49:02.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:48:00+00:00, map_index=-1, run_start_date=2024-05-23 23:49:01.686634+00:00, run_end_date=2024-05-23 23:49:02.088312+00:00, run_duration=0.401678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:49:00.830117+00:00, queued_by_job_id=1, pid=5089 2024-05-23T23:49:05.173101009Z [2024-05-23T23:49:05.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:49:05.173487650Z [2024-05-23T23:49:05.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:48:00+00:00, run_id=scheduled__2024-05-23T23:48:00+00:00, run_start_date=2024-05-23 23:49:00.758586+00:00, run_end_date=2024-05-23 23:49:05.172933+00:00, run_duration=4.414347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:48:00+00:00, data_interval_end=2024-05-23 23:49:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:49:05.187256742Z [2024-05-23T23:49:05.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:49:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:49:05.194620050Z [2024-05-23T23:49:05.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:49:05.195035400Z [2024-05-23T23:49:05.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:48:00+00:00, run_id=scheduled__2024-05-23T23:48:00+00:00, run_start_date=2024-05-23 23:49:00.757255+00:00, run_end_date=2024-05-23 23:49:05.194731+00:00, run_duration=4.437476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:48:00+00:00, data_interval_end=2024-05-23 23:49:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:49:05.203769233Z [2024-05-23T23:49:05.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:49:00+00:00, run_after=2024-05-23T23:50:00+00:00 2024-05-23T23:49:05.243005576Z [2024-05-23T23:49:05.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status success for try_number 1 2024-05-23T23:49:05.243048036Z [2024-05-23T23:49:05.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status success for try_number 1 2024-05-23T23:49:05.253128609Z [2024-05-23T23:49:05.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:48:00+00:00, map_index=-1, run_start_date=2024-05-23 23:49:02.651433+00:00, run_end_date=2024-05-23 23:49:04.829823+00:00, run_duration=2.17839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:49:00.830117+00:00, queued_by_job_id=1, pid=5107 2024-05-23T23:49:05.253343378Z [2024-05-23T23:49:05.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:48:00+00:00, map_index=-1, run_start_date=2024-05-23 23:49:02.776447+00:00, run_end_date=2024-05-23 23:49:04.402811+00:00, run_duration=1.626364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:49:00.830117+00:00, queued_by_job_id=1, pid=5108 2024-05-23T23:50:00.711538393Z [2024-05-23T23:50:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:51:00+00:00 2024-05-23T23:50:00.722365686Z [2024-05-23T23:50:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:55:00+00:00 2024-05-23T23:50:00.729018371Z [2024-05-23T23:50:00.728+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:50:00.740220624Z [2024-05-23T23:50:00.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:51:00+00:00 2024-05-23T23:50:00.746096406Z [2024-05-23T23:50:00.745+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:50:00.826566260Z [2024-05-23T23:50:00.826+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-23T23:50:00.826590570Z 2024-05-23T23:50:00.826606295Z 2024-05-23T23:50:00.826609949Z 2024-05-23T23:50:00.826612874Z 2024-05-23T23:50:00.826615734Z 2024-05-23T23:50:00.827172315Z [2024-05-23T23:50:00.826+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:50:00.827560529Z [2024-05-23T23:50:00.827+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:50:00.827910476Z [2024-05-23T23:50:00.827+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:50:00.828358025Z [2024-05-23T23:50:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:50:00.828963249Z [2024-05-23T23:50:00.828+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:50:00.830868924Z [2024-05-23T23:50:00.830+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:50:00.830877079Z 2024-05-23T23:50:00.830880650Z 2024-05-23T23:50:00.830883922Z 2024-05-23T23:50:00.830887263Z 2024-05-23T23:50:00.830890408Z 2024-05-23T23:50:00.839018289Z [2024-05-23T23:50:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:50:00.839474472Z [2024-05-23T23:50:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:50:00.839848267Z [2024-05-23T23:50:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:50:00.840087777Z [2024-05-23T23:50:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:50:00.840500204Z [2024-05-23T23:50:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:50:00.840825513Z [2024-05-23T23:50:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:50:00.841353973Z [2024-05-23T23:50:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:50:00.841553404Z [2024-05-23T23:50:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:50:00.841991279Z [2024-05-23T23:50:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:50:00.842308964Z [2024-05-23T23:50:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:50:01.294243125Z [2024-05-23T23:50:01.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:01.296378337Z [2024-05-23T23:50:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:01.296479034Z [2024-05-23T23:50:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:49:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:01.296595214Z [2024-05-23T23:50:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:49:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:01.296683954Z [2024-05-23T23:50:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:49:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:01.304889770Z [2024-05-23T23:50:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5551c92-e257-4183-99bf-2f36cc40697a 2024-05-23T23:50:01.305033714Z [2024-05-23T23:50:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23ceaeda-75f8-493e-865c-b74d0272558b 2024-05-23T23:50:01.305176499Z [2024-05-23T23:50:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8766c4e9-a53b-450a-937e-f6b1d1d1bd74 2024-05-23T23:50:01.305309349Z [2024-05-23T23:50:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b981ce7-aa00-47ed-b400-b2da49ff7619 2024-05-23T23:50:01.305430054Z [2024-05-23T23:50:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5d0cb59-1708-428c-add0-835d3a5a7411 2024-05-23T23:50:02.660231394Z [2024-05-23T23:50:02.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:50:02.660443179Z [2024-05-23T23:50:02.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:49:00+00:00, run_id=scheduled__2024-05-23T23:49:00+00:00, run_start_date=2024-05-23 23:50:00.759154+00:00, run_end_date=2024-05-23 23:50:02.660140+00:00, run_duration=1.900986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:49:00+00:00, data_interval_end=2024-05-23 23:50:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:50:02.681740733Z [2024-05-23T23:50:02.681+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:51:00+00:00 2024-05-23T23:50:02.819513978Z [2024-05-23T23:50:02.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:49:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:02.831494146Z [2024-05-23T23:50:02.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:49:00+00:00, map_index=-1, run_start_date=2024-05-23 23:50:01.977869+00:00, run_end_date=2024-05-23 23:50:02.343262+00:00, run_duration=0.365393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:00.833764+00:00, queued_by_job_id=1, pid=5142 2024-05-23T23:50:03.648759690Z [2024-05-23T23:50:03.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:50:03.649057143Z [2024-05-23T23:50:03.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:48:00+00:00, run_id=scheduled__2024-05-23T23:48:00+00:00, run_start_date=2024-05-23 23:50:00.758162+00:00, run_end_date=2024-05-23 23:50:03.648661+00:00, run_duration=2.890499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:48:00+00:00, data_interval_end=2024-05-23 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:50:03.656970519Z [2024-05-23T23:50:03.656+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:52:00+00:00 2024-05-23T23:50:03.803581013Z [2024-05-23T23:50:03.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:48:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:03.813502424Z [2024-05-23T23:50:03.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:48:00+00:00, map_index=-1, run_start_date=2024-05-23 23:50:02.420426+00:00, run_end_date=2024-05-23 23:50:02.913217+00:00, run_duration=0.492791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:00.833764+00:00, queued_by_job_id=1, pid=5149 2024-05-23T23:50:04.427932753Z [2024-05-23T23:50:04.427+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:50:04.427991271Z 2024-05-23T23:50:04.428112504Z [2024-05-23T23:50:04.427+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:50:04.429042908Z [2024-05-23T23:50:04.428+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:50:04.429062115Z 2024-05-23T23:50:04.433917187Z [2024-05-23T23:50:04.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:50:04.434659771Z [2024-05-23T23:50:04.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:50:04.530882869Z [2024-05-23T23:50:04.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:04.531054800Z [2024-05-23T23:50:04.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:04.538744158Z [2024-05-23T23:50:04.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8c895ff-d695-4cd6-8339-f2838c3dab96 2024-05-23T23:50:04.539058279Z [2024-05-23T23:50:04.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:45:00+00:00, map_index=-1, run_start_date=2024-05-23 23:50:03.320682+00:00, run_end_date=2024-05-23 23:50:03.851622+00:00, run_duration=0.53094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:00.833764+00:00, queued_by_job_id=1, pid=5166 2024-05-23T23:50:05.727258868Z [2024-05-23T23:50:05.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:50:05.727433484Z [2024-05-23T23:50:05.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:49:00+00:00, run_id=scheduled__2024-05-23T23:49:00+00:00, run_start_date=2024-05-23 23:50:00.760353+00:00, run_end_date=2024-05-23 23:50:05.727117+00:00, run_duration=4.966764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:49:00+00:00, data_interval_end=2024-05-23 23:50:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:50:05.740098701Z [2024-05-23T23:50:05.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:51:00+00:00 2024-05-23T23:50:05.814414775Z [2024-05-23T23:50:05.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:49:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:05.823777325Z [2024-05-23T23:50:05.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:49:00+00:00, map_index=-1, run_start_date=2024-05-23 23:50:03.731523+00:00, run_end_date=2024-05-23 23:50:05.227717+00:00, run_duration=1.496194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:00.833764+00:00, queued_by_job_id=1, pid=5178 2024-05-23T23:50:06.877603321Z [2024-05-23T23:50:06.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:50:06.877831618Z [2024-05-23T23:50:06.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:49:00+00:00, run_id=scheduled__2024-05-23T23:49:00+00:00, run_start_date=2024-05-23 23:50:00.761334+00:00, run_end_date=2024-05-23 23:50:06.877371+00:00, run_duration=6.116037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:49:00+00:00, data_interval_end=2024-05-23 23:50:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:50:06.890916148Z [2024-05-23T23:50:06.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:51:00+00:00 2024-05-23T23:50:06.928295661Z [2024-05-23T23:50:06.927+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:50:06.928348726Z 2024-05-23T23:50:06.928653189Z [2024-05-23T23:50:06.928+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:50:06.929892041Z [2024-05-23T23:50:06.929+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:50:06.929909410Z 2024-05-23T23:50:06.933224465Z [2024-05-23T23:50:06.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:50:06.933404206Z [2024-05-23T23:50:06.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:50:06.975745632Z [2024-05-23T23:50:06.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:06.975801098Z [2024-05-23T23:50:06.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:49:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:06.975843414Z [2024-05-23T23:50:06.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:06.983394598Z [2024-05-23T23:50:06.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:45:00+00:00, map_index=-1, run_start_date=2024-05-23 23:50:06.007043+00:00, run_end_date=2024-05-23 23:50:06.425672+00:00, run_duration=0.418629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:04.429579+00:00, queued_by_job_id=1, pid=5197 2024-05-23T23:50:06.983520847Z [2024-05-23T23:50:06.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:49:00+00:00, map_index=-1, run_start_date=2024-05-23 23:50:03.641690+00:00, run_end_date=2024-05-23 23:50:06.598467+00:00, run_duration=2.956777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:00.833764+00:00, queued_by_job_id=1, pid=5173 2024-05-23T23:50:06.983654981Z [2024-05-23T23:50:06.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdd71ca4-38bc-4ed4-ae1c-f469ea346bdb 2024-05-23T23:50:10.044186692Z [2024-05-23T23:50:10.043+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:50:10.044231914Z 2024-05-23T23:50:10.044591874Z [2024-05-23T23:50:10.044+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:50:10.045395955Z [2024-05-23T23:50:10.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:50:10.045409843Z 2024-05-23T23:50:10.048431069Z [2024-05-23T23:50:10.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:50:10.048744731Z [2024-05-23T23:50:10.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:50:10.121630404Z [2024-05-23T23:50:10.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status queued for try_number 1 2024-05-23T23:50:10.121790513Z [2024-05-23T23:50:10.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:10.127611703Z [2024-05-23T23:50:10.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0169b891-9a54-4ce9-b581-2086ca5fab2d 2024-05-23T23:50:10.127965062Z [2024-05-23T23:50:10.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:45:00+00:00, map_index=0, run_start_date=2024-05-23 23:50:08.601987+00:00, run_end_date=2024-05-23 23:50:08.942014+00:00, run_duration=0.340027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:06.931146+00:00, queued_by_job_id=1, pid=5205 2024-05-23T23:50:12.468529838Z [2024-05-23T23:50:12.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:50:12.469096248Z [2024-05-23T23:50:12.468+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:45:00+00:00, run_id=scheduled__2024-05-23T23:45:00+00:00, run_start_date=2024-05-23 23:50:00.756864+00:00, run_end_date=2024-05-23 23:50:12.468416+00:00, run_duration=11.711552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:45:00+00:00, data_interval_end=2024-05-23 23:50:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:50:12.477395225Z [2024-05-23T23:50:12.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:50:00+00:00, run_after=2024-05-23T23:55:00+00:00 2024-05-23T23:50:12.518371223Z [2024-05-23T23:50:12.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:45:00+00:00 exited with status success for try_number 1 2024-05-23T23:50:12.526583525Z [2024-05-23T23:50:12.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:45:00+00:00, map_index=-1, run_start_date=2024-05-23 23:50:11.728081+00:00, run_end_date=2024-05-23 23:50:12.163433+00:00, run_duration=0.435352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:50:10.046000+00:00, queued_by_job_id=1, pid=5213 2024-05-23T23:51:00.822089054Z [2024-05-23T23:51:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:51:00+00:00, run_after=2024-05-23T23:52:00+00:00 2024-05-23T23:51:00.850096757Z [2024-05-23T23:51:00.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:51:00+00:00, run_after=2024-05-23T23:52:00+00:00 2024-05-23T23:51:00.861377362Z [2024-05-23T23:51:00.860+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:51:00.946676148Z [2024-05-23T23:51:00.945+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:51:00.946705584Z 2024-05-23T23:51:00.946709068Z 2024-05-23T23:51:00.946712423Z 2024-05-23T23:51:00.946715516Z [2024-05-23T23:51:00.945+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:51:00.946718783Z [2024-05-23T23:51:00.946+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:51:00.946721713Z [2024-05-23T23:51:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:51:00.947787055Z [2024-05-23T23:51:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:51:00.947793251Z 2024-05-23T23:51:00.947796563Z 2024-05-23T23:51:00.947800050Z 2024-05-23T23:51:00.953124485Z [2024-05-23T23:51:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:51:00.953430913Z [2024-05-23T23:51:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:51:00.953948599Z [2024-05-23T23:51:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:51:00.954131561Z [2024-05-23T23:51:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:51:00.954542897Z [2024-05-23T23:51:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:51:00.954951756Z [2024-05-23T23:51:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:51:01.315488609Z [2024-05-23T23:51:01.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:51:01.315520442Z [2024-05-23T23:51:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:51:01.315524333Z [2024-05-23T23:51:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:51:01.331952826Z [2024-05-23T23:51:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a5066ba-e6e7-415d-a3b4-662e63d13563 2024-05-23T23:51:01.331980853Z [2024-05-23T23:51:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to f49ee2a4-b934-4754-89bc-763855e17509 2024-05-23T23:51:01.332113742Z [2024-05-23T23:51:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3799606f-ec92-436f-b29f-7a9ec12abebd 2024-05-23T23:51:02.539933637Z [2024-05-23T23:51:02.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:51:02.540305029Z [2024-05-23T23:51:02.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:50:00+00:00, run_id=scheduled__2024-05-23T23:50:00+00:00, run_start_date=2024-05-23 23:51:00.877966+00:00, run_end_date=2024-05-23 23:51:02.539839+00:00, run_duration=1.661873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:50:00+00:00, data_interval_end=2024-05-23 23:51:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:51:02.549842446Z [2024-05-23T23:51:02.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:51:00+00:00, run_after=2024-05-23T23:52:00+00:00 2024-05-23T23:51:02.594059243Z [2024-05-23T23:51:02.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:51:02.601347160Z [2024-05-23T23:51:02.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=-1, run_start_date=2024-05-23 23:51:01.831535+00:00, run_end_date=2024-05-23 23:51:02.244044+00:00, run_duration=0.412509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:51:00.949508+00:00, queued_by_job_id=1, pid=5235 2024-05-23T23:51:05.893603803Z [2024-05-23T23:51:05.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:51:05.893953460Z [2024-05-23T23:51:05.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:50:00+00:00, run_id=scheduled__2024-05-23T23:50:00+00:00, run_start_date=2024-05-23 23:51:00.880054+00:00, run_end_date=2024-05-23 23:51:05.893430+00:00, run_duration=5.013376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:50:00+00:00, data_interval_end=2024-05-23 23:51:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:51:05.906868341Z [2024-05-23T23:51:05.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:51:00+00:00, run_after=2024-05-23T23:52:00+00:00 2024-05-23T23:51:05.918350146Z [2024-05-23T23:51:05.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:51:05.918391503Z [2024-05-23T23:51:05.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:50:00+00:00, run_id=scheduled__2024-05-23T23:50:00+00:00, run_start_date=2024-05-23 23:51:00.881577+00:00, run_end_date=2024-05-23 23:51:05.918020+00:00, run_duration=5.036443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:50:00+00:00, data_interval_end=2024-05-23 23:51:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:51:05.928578908Z [2024-05-23T23:51:05.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:51:00+00:00, run_after=2024-05-23T23:52:00+00:00 2024-05-23T23:51:05.979720688Z [2024-05-23T23:51:05.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:51:05.980143184Z [2024-05-23T23:51:05.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:51:05.994499418Z [2024-05-23T23:51:05.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=-1, run_start_date=2024-05-23 23:51:02.862877+00:00, run_end_date=2024-05-23 23:51:04.751495+00:00, run_duration=1.888618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:51:00.949508+00:00, queued_by_job_id=1, pid=5253 2024-05-23T23:51:05.995028727Z [2024-05-23T23:51:05.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=-1, run_start_date=2024-05-23 23:51:02.878289+00:00, run_end_date=2024-05-23 23:51:05.353592+00:00, run_duration=2.475303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:51:00.949508+00:00, queued_by_job_id=1, pid=5254 2024-05-23T23:51:39.830825847Z [2024-05-23T23:51:39.829+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:52:00.147222241Z [2024-05-23T23:52:00.146+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:52:00.158881187Z [2024-05-23T23:52:00.158+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:52:00.175597808Z [2024-05-23T23:52:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:52:00+00:00, run_after=2024-05-23T23:53:00+00:00 2024-05-23T23:52:00.192720582Z [2024-05-23T23:52:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:52:00+00:00, run_after=2024-05-23T23:53:00+00:00 2024-05-23T23:52:00.301238134Z [2024-05-23T23:52:00.300+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:52:00.301256942Z 2024-05-23T23:52:00.301261993Z 2024-05-23T23:52:00.301265375Z 2024-05-23T23:52:00.301268737Z 2024-05-23T23:52:00.301279896Z [2024-05-23T23:52:00.301+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:52:00.301501489Z [2024-05-23T23:52:00.301+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:52:00.301508151Z [2024-05-23T23:52:00.301+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:52:00.301511314Z [2024-05-23T23:52:00.301+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:52:00.302234436Z [2024-05-23T23:52:00.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:52:00.302249690Z 2024-05-23T23:52:00.302254848Z 2024-05-23T23:52:00.302259307Z 2024-05-23T23:52:00.302263621Z 2024-05-23T23:52:00.306085691Z [2024-05-23T23:52:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:52:00.307881935Z [2024-05-23T23:52:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:52:00.307905487Z [2024-05-23T23:52:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:52:00.307910920Z [2024-05-23T23:52:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:52:00.307914114Z [2024-05-23T23:52:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:52:00.307952039Z [2024-05-23T23:52:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:52:00.307955591Z [2024-05-23T23:52:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:52:00.307958637Z [2024-05-23T23:52:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:52:00.772058326Z [2024-05-23T23:52:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:52:00.774620150Z [2024-05-23T23:52:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:51:00+00:00 exited with status queued for try_number 1 2024-05-23T23:52:00.775038961Z [2024-05-23T23:52:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:51:00+00:00 exited with status queued for try_number 1 2024-05-23T23:52:00.775367248Z [2024-05-23T23:52:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:51:00+00:00 exited with status queued for try_number 1 2024-05-23T23:52:00.790908034Z [2024-05-23T23:52:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc322aa2-0709-4231-b0b0-51a2f16588c9 2024-05-23T23:52:00.794450123Z [2024-05-23T23:52:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31613be3-d35b-47f5-a719-e199b903895b 2024-05-23T23:52:00.794788295Z [2024-05-23T23:52:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe1d4cc7-65bb-4f2c-9283-b1315b285867 2024-05-23T23:52:00.795057800Z [2024-05-23T23:52:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae118cf7-cb4f-45ba-ae74-386bcde89748 2024-05-23T23:52:03.296044543Z [2024-05-23T23:52:03.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:52:03.296945597Z [2024-05-23T23:52:03.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:50:00+00:00, run_id=scheduled__2024-05-23T23:50:00+00:00, run_start_date=2024-05-23 23:52:00.232807+00:00, run_end_date=2024-05-23 23:52:03.296024+00:00, run_duration=3.063217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:50:00+00:00, data_interval_end=2024-05-23 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:52:03.316243042Z [2024-05-23T23:52:03.315+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:52:00+00:00, run_after=2024-05-23T23:54:00+00:00 2024-05-23T23:52:03.327020825Z [2024-05-23T23:52:03.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:52:03.327279975Z [2024-05-23T23:52:03.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:51:00+00:00, run_id=scheduled__2024-05-23T23:51:00+00:00, run_start_date=2024-05-23 23:52:00.236306+00:00, run_end_date=2024-05-23 23:52:03.326988+00:00, run_duration=3.090682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:51:00+00:00, data_interval_end=2024-05-23 23:52:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:52:03.338634850Z [2024-05-23T23:52:03.338+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:52:00+00:00, run_after=2024-05-23T23:53:00+00:00 2024-05-23T23:52:03.426687258Z [2024-05-23T23:52:03.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:52:03.426718292Z [2024-05-23T23:52:03.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:51:00+00:00 exited with status success for try_number 1 2024-05-23T23:52:03.435281933Z [2024-05-23T23:52:03.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:51:00+00:00, map_index=-1, run_start_date=2024-05-23 23:52:01.838841+00:00, run_end_date=2024-05-23 23:52:02.359952+00:00, run_duration=0.521111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:52:00.303016+00:00, queued_by_job_id=1, pid=5290 2024-05-23T23:52:03.435454759Z [2024-05-23T23:52:03.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=-1, run_start_date=2024-05-23 23:52:01.811845+00:00, run_end_date=2024-05-23 23:52:02.358718+00:00, run_duration=0.546873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:52:00.303016+00:00, queued_by_job_id=1, pid=5289 2024-05-23T23:52:04.483363674Z [2024-05-23T23:52:04.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:52:04.483743104Z [2024-05-23T23:52:04.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:51:00+00:00, run_id=scheduled__2024-05-23T23:51:00+00:00, run_start_date=2024-05-23 23:52:00.239171+00:00, run_end_date=2024-05-23 23:52:04.483385+00:00, run_duration=4.244214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:51:00+00:00, data_interval_end=2024-05-23 23:52:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:52:04.497601051Z [2024-05-23T23:52:04.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:52:00+00:00, run_after=2024-05-23T23:53:00+00:00 2024-05-23T23:52:04.507431943Z [2024-05-23T23:52:04.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:52:04.507953477Z [2024-05-23T23:52:04.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:51:00+00:00, run_id=scheduled__2024-05-23T23:51:00+00:00, run_start_date=2024-05-23 23:52:00.237916+00:00, run_end_date=2024-05-23 23:52:04.507597+00:00, run_duration=4.269681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:51:00+00:00, data_interval_end=2024-05-23 23:52:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:52:04.522832012Z [2024-05-23T23:52:04.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:52:00+00:00, run_after=2024-05-23T23:53:00+00:00 2024-05-23T23:52:04.559819632Z [2024-05-23T23:52:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:51:00+00:00 exited with status success for try_number 1 2024-05-23T23:52:04.566693256Z [2024-05-23T23:52:04.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:51:00+00:00, map_index=-1, run_start_date=2024-05-23 23:52:02.548646+00:00, run_end_date=2024-05-23 23:52:03.980432+00:00, run_duration=1.431786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:52:00.303016+00:00, queued_by_job_id=1, pid=5311 2024-05-23T23:52:05.186384493Z [2024-05-23T23:52:05.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:51:00+00:00 exited with status success for try_number 1 2024-05-23T23:52:05.197121037Z [2024-05-23T23:52:05.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:51:00+00:00, map_index=-1, run_start_date=2024-05-23 23:52:02.585266+00:00, run_end_date=2024-05-23 23:52:04.412033+00:00, run_duration=1.826767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:52:00.303016+00:00, queued_by_job_id=1, pid=5312 2024-05-23T23:53:00.513467520Z [2024-05-23T23:53:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:53:00.526552259Z [2024-05-23T23:53:00.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:53:00+00:00, run_after=2024-05-23T23:54:00+00:00 2024-05-23T23:53:00.542183219Z [2024-05-23T23:53:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:53:00+00:00, run_after=2024-05-23T23:54:00+00:00 2024-05-23T23:53:00.628742830Z [2024-05-23T23:53:00.627+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:53:00.628764656Z 2024-05-23T23:53:00.628771178Z 2024-05-23T23:53:00.628777758Z 2024-05-23T23:53:00.628783549Z [2024-05-23T23:53:00.628+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:53:00.628789846Z [2024-05-23T23:53:00.628+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:53:00.628796096Z [2024-05-23T23:53:00.628+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:53:00.629356726Z [2024-05-23T23:53:00.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:53:00.629376623Z 2024-05-23T23:53:00.629380725Z 2024-05-23T23:53:00.629384283Z 2024-05-23T23:53:00.639885292Z [2024-05-23T23:53:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:53:00.639907168Z [2024-05-23T23:53:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:53:00.640968710Z [2024-05-23T23:53:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:53:00.640981116Z [2024-05-23T23:53:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:53:00.640996927Z [2024-05-23T23:53:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:53:00.640999809Z [2024-05-23T23:53:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:53:00.888894190Z [2024-05-23T23:53:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status queued for try_number 1 2024-05-23T23:53:00.888921302Z [2024-05-23T23:53:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status queued for try_number 1 2024-05-23T23:53:00.888959338Z [2024-05-23T23:53:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status queued for try_number 1 2024-05-23T23:53:00.900330734Z [2024-05-23T23:53:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to b46bf3a8-8579-42e1-b4dd-dd389d0b9e85 2024-05-23T23:53:00.900393798Z [2024-05-23T23:53:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04752741-4e88-493d-88a6-5abe6d259cb7 2024-05-23T23:53:00.900486725Z [2024-05-23T23:53:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f764650-b8d8-4f9a-959e-a2f5d210fecc 2024-05-23T23:53:02.871231496Z [2024-05-23T23:53:02.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:53:02.871664858Z [2024-05-23T23:53:02.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:52:00+00:00, run_id=scheduled__2024-05-23T23:52:00+00:00, run_start_date=2024-05-23 23:53:00.552344+00:00, run_end_date=2024-05-23 23:53:02.871293+00:00, run_duration=2.318949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:52:00+00:00, data_interval_end=2024-05-23 23:53:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:53:02.893430639Z [2024-05-23T23:53:02.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:53:00+00:00, run_after=2024-05-23T23:54:00+00:00 2024-05-23T23:53:02.998449322Z [2024-05-23T23:53:02.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status success for try_number 1 2024-05-23T23:53:03.016737373Z [2024-05-23T23:53:03.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:52:00+00:00, map_index=-1, run_start_date=2024-05-23 23:53:01.544149+00:00, run_end_date=2024-05-23 23:53:02.238780+00:00, run_duration=0.694631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:53:00.630162+00:00, queued_by_job_id=1, pid=5344 2024-05-23T23:53:05.402373370Z [2024-05-23T23:53:05.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:53:05.402792355Z [2024-05-23T23:53:05.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:52:00+00:00, run_id=scheduled__2024-05-23T23:52:00+00:00, run_start_date=2024-05-23 23:53:00.553651+00:00, run_end_date=2024-05-23 23:53:05.402201+00:00, run_duration=4.84855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:52:00+00:00, data_interval_end=2024-05-23 23:53:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:53:05.411994579Z [2024-05-23T23:53:05.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:53:00+00:00, run_after=2024-05-23T23:54:00+00:00 2024-05-23T23:53:06.532669426Z [2024-05-23T23:53:06.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:53:06.532776957Z [2024-05-23T23:53:06.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:52:00+00:00, run_id=scheduled__2024-05-23T23:52:00+00:00, run_start_date=2024-05-23 23:53:00.554668+00:00, run_end_date=2024-05-23 23:53:06.532440+00:00, run_duration=5.977772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:52:00+00:00, data_interval_end=2024-05-23 23:53:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:53:06.541762735Z [2024-05-23T23:53:06.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:53:00+00:00, run_after=2024-05-23T23:54:00+00:00 2024-05-23T23:53:06.580649417Z [2024-05-23T23:53:06.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status success for try_number 1 2024-05-23T23:53:06.580695570Z [2024-05-23T23:53:06.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status success for try_number 1 2024-05-23T23:53:06.589427266Z [2024-05-23T23:53:06.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:52:00+00:00, map_index=-1, run_start_date=2024-05-23 23:53:03.621021+00:00, run_end_date=2024-05-23 23:53:05.948572+00:00, run_duration=2.327551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:53:00.630162+00:00, queued_by_job_id=1, pid=5363 2024-05-23T23:53:06.589657497Z [2024-05-23T23:53:06.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:52:00+00:00, map_index=-1, run_start_date=2024-05-23 23:53:03.461447+00:00, run_end_date=2024-05-23 23:53:05.330105+00:00, run_duration=1.868658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:53:00.630162+00:00, queued_by_job_id=1, pid=5362 2024-05-23T23:54:01.033457122Z [2024-05-23T23:54:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:54:00+00:00, run_after=2024-05-23T23:55:00+00:00 2024-05-23T23:54:01.042839521Z [2024-05-23T23:54:01.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:54:01.064925513Z [2024-05-23T23:54:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:54:00+00:00, run_after=2024-05-23T23:55:00+00:00 2024-05-23T23:54:01.076549804Z [2024-05-23T23:54:01.076+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:54:01.196493581Z [2024-05-23T23:54:01.196+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:54:01.196518617Z 2024-05-23T23:54:01.196524523Z 2024-05-23T23:54:01.196528943Z 2024-05-23T23:54:01.196533312Z 2024-05-23T23:54:01.196657584Z [2024-05-23T23:54:01.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:54:01.197981425Z [2024-05-23T23:54:01.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:54:01.198321363Z [2024-05-23T23:54:01.197+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:54:01.198369294Z [2024-05-23T23:54:01.198+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:54:01.199667765Z [2024-05-23T23:54:01.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:54:01.199683875Z 2024-05-23T23:54:01.199723137Z 2024-05-23T23:54:01.199732652Z 2024-05-23T23:54:01.199739919Z 2024-05-23T23:54:01.207963934Z [2024-05-23T23:54:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:54:01.208217927Z [2024-05-23T23:54:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:54:01.208604479Z [2024-05-23T23:54:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:54:01.208820897Z [2024-05-23T23:54:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:54:01.209046357Z [2024-05-23T23:54:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:54:01.209205263Z [2024-05-23T23:54:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:54:01.209531997Z [2024-05-23T23:54:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:54:01.209692542Z [2024-05-23T23:54:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:54:01.656099383Z [2024-05-23T23:54:01.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status queued for try_number 1 2024-05-23T23:54:01.658628561Z [2024-05-23T23:54:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:53:00+00:00 exited with status queued for try_number 1 2024-05-23T23:54:01.660103339Z [2024-05-23T23:54:01.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:53:00+00:00 exited with status queued for try_number 1 2024-05-23T23:54:01.663213218Z [2024-05-23T23:54:01.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:53:00+00:00 exited with status queued for try_number 1 2024-05-23T23:54:01.696802425Z [2024-05-23T23:54:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca89926c-1c0d-45c8-a13b-be61a79c1b08 2024-05-23T23:54:01.698355830Z [2024-05-23T23:54:01.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74cf8f50-00dd-47a6-ab60-08912a5267a8 2024-05-23T23:54:01.698578715Z [2024-05-23T23:54:01.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5651e719-fc64-4615-9db3-53818acba363 2024-05-23T23:54:01.698908322Z [2024-05-23T23:54:01.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0966df4-f62b-47b9-acb9-ab899f136814 2024-05-23T23:54:02.738706913Z [2024-05-23T23:54:02.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:54:02.738733846Z [2024-05-23T23:54:02.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:52:00+00:00, run_id=scheduled__2024-05-23T23:52:00+00:00, run_start_date=2024-05-23 23:54:01.093884+00:00, run_end_date=2024-05-23 23:54:02.737958+00:00, run_duration=1.644074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:52:00+00:00, data_interval_end=2024-05-23 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:54:02.746194030Z [2024-05-23T23:54:02.745+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:54:00+00:00, run_after=2024-05-23T23:56:00+00:00 2024-05-23T23:54:03.934916799Z [2024-05-23T23:54:03.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:54:03.935360513Z [2024-05-23T23:54:03.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:53:00+00:00, run_id=scheduled__2024-05-23T23:53:00+00:00, run_start_date=2024-05-23 23:54:01.099224+00:00, run_end_date=2024-05-23 23:54:03.934833+00:00, run_duration=2.835609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:53:00+00:00, data_interval_end=2024-05-23 23:54:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:54:03.945581841Z [2024-05-23T23:54:03.945+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:54:00+00:00, run_after=2024-05-23T23:55:00+00:00 2024-05-23T23:54:03.993446229Z [2024-05-23T23:54:03.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:52:00+00:00 exited with status success for try_number 1 2024-05-23T23:54:03.993678817Z [2024-05-23T23:54:03.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:53:00+00:00 exited with status success for try_number 1 2024-05-23T23:54:03.999119990Z [2024-05-23T23:54:03.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:52:00+00:00, map_index=-1, run_start_date=2024-05-23 23:54:02.353943+00:00, run_end_date=2024-05-23 23:54:02.714474+00:00, run_duration=0.360531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:54:01.203205+00:00, queued_by_job_id=1, pid=5397 2024-05-23T23:54:03.999575054Z [2024-05-23T23:54:03.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:53:00+00:00, map_index=-1, run_start_date=2024-05-23 23:54:02.343031+00:00, run_end_date=2024-05-23 23:54:02.886519+00:00, run_duration=0.543488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:54:01.203205+00:00, queued_by_job_id=1, pid=5396 2024-05-23T23:54:05.050204740Z [2024-05-23T23:54:05.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:54:05.050596546Z [2024-05-23T23:54:05.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:53:00+00:00, run_id=scheduled__2024-05-23T23:53:00+00:00, run_start_date=2024-05-23 23:54:01.102346+00:00, run_end_date=2024-05-23 23:54:05.050020+00:00, run_duration=3.947674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:53:00+00:00, data_interval_end=2024-05-23 23:54:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:54:05.070153939Z [2024-05-23T23:54:05.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:54:00+00:00, run_after=2024-05-23T23:55:00+00:00 2024-05-23T23:54:05.725131331Z [2024-05-23T23:54:05.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:54:05.725440156Z [2024-05-23T23:54:05.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:53:00+00:00, run_id=scheduled__2024-05-23T23:53:00+00:00, run_start_date=2024-05-23 23:54:01.105980+00:00, run_end_date=2024-05-23 23:54:05.725054+00:00, run_duration=4.619074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:53:00+00:00, data_interval_end=2024-05-23 23:54:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:54:05.736474560Z [2024-05-23T23:54:05.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:54:00+00:00, run_after=2024-05-23T23:55:00+00:00 2024-05-23T23:54:05.783233781Z [2024-05-23T23:54:05.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:53:00+00:00 exited with status success for try_number 1 2024-05-23T23:54:05.783575640Z [2024-05-23T23:54:05.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:53:00+00:00 exited with status success for try_number 1 2024-05-23T23:54:05.791975972Z [2024-05-23T23:54:05.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:53:00+00:00, map_index=-1, run_start_date=2024-05-23 23:54:03.589790+00:00, run_end_date=2024-05-23 23:54:04.982407+00:00, run_duration=1.392617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:54:01.203205+00:00, queued_by_job_id=1, pid=5420 2024-05-23T23:54:05.792468649Z [2024-05-23T23:54:05.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:53:00+00:00, map_index=-1, run_start_date=2024-05-23 23:54:03.620222+00:00, run_end_date=2024-05-23 23:54:05.411354+00:00, run_duration=1.791132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:54:01.203205+00:00, queued_by_job_id=1, pid=5421 2024-05-23T23:55:00.348785533Z [2024-05-23T23:55:00.348+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:55:00.363798449Z [2024-05-23T23:55:00.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:55:00+00:00, run_after=2024-05-23T23:56:00+00:00 2024-05-23T23:55:00.375193005Z [2024-05-23T23:55:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:55:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:55:00.385454238Z [2024-05-23T23:55:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:55:00+00:00, run_after=2024-05-23T23:56:00+00:00 2024-05-23T23:55:00.467698392Z [2024-05-23T23:55:00.466+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:55:00.467747450Z 2024-05-23T23:55:00.467759363Z 2024-05-23T23:55:00.467768315Z 2024-05-23T23:55:00.467777161Z 2024-05-23T23:55:00.467786387Z [2024-05-23T23:55:00.467+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:55:00.467794864Z [2024-05-23T23:55:00.467+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:55:00.467803445Z [2024-05-23T23:55:00.467+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:55:00.467812341Z [2024-05-23T23:55:00.467+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:55:00.468114918Z [2024-05-23T23:55:00.467+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:55:00.468125955Z 2024-05-23T23:55:00.468134713Z 2024-05-23T23:55:00.468168670Z 2024-05-23T23:55:00.468177773Z 2024-05-23T23:55:00.471985638Z [2024-05-23T23:55:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-23T23:55:00.472104277Z [2024-05-23T23:55:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:55:00.472345978Z [2024-05-23T23:55:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:55:00.472453419Z [2024-05-23T23:55:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:55:00.472700223Z [2024-05-23T23:55:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:55:00.472793755Z [2024-05-23T23:55:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:55:00.472994015Z [2024-05-23T23:55:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:55:00.473091085Z [2024-05-23T23:55:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:55:00.841221143Z [2024-05-23T23:55:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:55:00.841321418Z [2024-05-23T23:55:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status queued for try_number 1 2024-05-23T23:55:00.841443508Z [2024-05-23T23:55:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status queued for try_number 1 2024-05-23T23:55:00.841562992Z [2024-05-23T23:55:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status queued for try_number 1 2024-05-23T23:55:00.852611574Z [2024-05-23T23:55:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cdacee5-11fe-4930-80f2-223286312e81 2024-05-23T23:55:00.852743250Z [2024-05-23T23:55:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3eb3d2e1-0147-4db7-a98c-01f7bcd5bbf8 2024-05-23T23:55:00.852911194Z [2024-05-23T23:55:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31c828d5-6740-4939-8cd3-3ad5c9ee7742 2024-05-23T23:55:00.853139201Z [2024-05-23T23:55:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 143d2d6c-cd69-4056-9ebc-bf4fdd2fbd17 2024-05-23T23:55:02.064092722Z [2024-05-23T23:55:02.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:55:02.064415888Z [2024-05-23T23:55:02.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:54:00+00:00, run_id=scheduled__2024-05-23T23:54:00+00:00, run_start_date=2024-05-23 23:55:00.396832+00:00, run_end_date=2024-05-23 23:55:02.064051+00:00, run_duration=1.667219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:54:00+00:00, data_interval_end=2024-05-23 23:55:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:55:02.075614547Z [2024-05-23T23:55:02.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:55:00+00:00, run_after=2024-05-23T23:56:00+00:00 2024-05-23T23:55:02.121058943Z [2024-05-23T23:55:02.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status success for try_number 1 2024-05-23T23:55:02.126767702Z [2024-05-23T23:55:02.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:54:00+00:00, map_index=-1, run_start_date=2024-05-23 23:55:01.411220+00:00, run_end_date=2024-05-23 23:55:01.837747+00:00, run_duration=0.426527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:55:00.468983+00:00, queued_by_job_id=1, pid=5454 2024-05-23T23:55:03.881947834Z [2024-05-23T23:55:03.881+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:55:03.881986659Z 2024-05-23T23:55:03.882425736Z [2024-05-23T23:55:03.882+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:55:03.883670739Z [2024-05-23T23:55:03.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:55:03.883705218Z 2024-05-23T23:55:03.888170716Z [2024-05-23T23:55:03.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-23T23:55:03.888618984Z [2024-05-23T23:55:03.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:55:03.946411764Z [2024-05-23T23:55:03.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:55:03.946443422Z [2024-05-23T23:55:03.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:55:03.955424990Z [2024-05-23T23:55:03.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dadc011-4189-4ee8-8413-aa6172f84a08 2024-05-23T23:55:03.955665765Z [2024-05-23T23:55:03.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=-1, run_start_date=2024-05-23 23:55:02.549835+00:00, run_end_date=2024-05-23 23:55:03.271876+00:00, run_duration=0.722041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:55:00.468983+00:00, queued_by_job_id=1, pid=5468 2024-05-23T23:55:05.146131512Z [2024-05-23T23:55:05.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:55:05.146401534Z [2024-05-23T23:55:05.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:54:00+00:00, run_id=scheduled__2024-05-23T23:54:00+00:00, run_start_date=2024-05-23 23:55:00.397821+00:00, run_end_date=2024-05-23 23:55:05.146011+00:00, run_duration=4.74819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:54:00+00:00, data_interval_end=2024-05-23 23:55:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:55:05.157320397Z [2024-05-23T23:55:05.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:55:00+00:00, run_after=2024-05-23T23:56:00+00:00 2024-05-23T23:55:05.164797433Z [2024-05-23T23:55:05.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:55:05.165284868Z [2024-05-23T23:55:05.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:54:00+00:00, run_id=scheduled__2024-05-23T23:54:00+00:00, run_start_date=2024-05-23 23:55:00.398822+00:00, run_end_date=2024-05-23 23:55:05.164960+00:00, run_duration=4.766138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:54:00+00:00, data_interval_end=2024-05-23 23:55:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:55:05.177163228Z [2024-05-23T23:55:05.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:55:00+00:00, run_after=2024-05-23T23:56:00+00:00 2024-05-23T23:55:05.233104227Z [2024-05-23T23:55:05.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status success for try_number 1 2024-05-23T23:55:05.233733644Z [2024-05-23T23:55:05.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status success for try_number 1 2024-05-23T23:55:05.241438284Z [2024-05-23T23:55:05.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:54:00+00:00, map_index=-1, run_start_date=2024-05-23 23:55:02.995964+00:00, run_end_date=2024-05-23 23:55:04.377811+00:00, run_duration=1.381847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:55:00.468983+00:00, queued_by_job_id=1, pid=5479 2024-05-23T23:55:05.241913602Z [2024-05-23T23:55:05.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:54:00+00:00, map_index=-1, run_start_date=2024-05-23 23:55:03.117210+00:00, run_end_date=2024-05-23 23:55:04.924423+00:00, run_duration=1.807213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:55:00.468983+00:00, queued_by_job_id=1, pid=5483 2024-05-23T23:55:07.232451660Z [2024-05-23T23:55:07.231+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:55:07.232482173Z 2024-05-23T23:55:07.233159422Z [2024-05-23T23:55:07.232+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:55:07.234633844Z [2024-05-23T23:55:07.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:55:07.234649529Z 2024-05-23T23:55:07.238236641Z [2024-05-23T23:55:07.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-23T23:55:07.238701684Z [2024-05-23T23:55:07.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-23T23:55:07.308847381Z [2024-05-23T23:55:07.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:55:07.309207329Z [2024-05-23T23:55:07.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:55:07.318405157Z [2024-05-23T23:55:07.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to f268c6bb-0037-4046-a32f-83dfcfb0d584 2024-05-23T23:55:07.319210028Z [2024-05-23T23:55:07.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=-1, run_start_date=2024-05-23 23:55:05.689842+00:00, run_end_date=2024-05-23 23:55:06.074615+00:00, run_duration=0.384773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:55:03.884383+00:00, queued_by_job_id=1, pid=5503 2024-05-23T23:55:09.371185479Z [2024-05-23T23:55:09.368+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-23T23:55:09.371211969Z 2024-05-23T23:55:09.371480437Z [2024-05-23T23:55:09.371+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:55:09.372309857Z [2024-05-23T23:55:09.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:55:09.372322999Z 2024-05-23T23:55:09.375675732Z [2024-05-23T23:55:09.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:55:09.375818987Z [2024-05-23T23:55:09.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-23T23:55:09.462532469Z [2024-05-23T23:55:09.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status queued for try_number 1 2024-05-23T23:55:09.475799907Z [2024-05-23T23:55:09.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3cc0a8f-04d3-49e1-b347-ffb447203398 2024-05-23T23:55:09.600900544Z [2024-05-23T23:55:09.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:55:09.605458029Z [2024-05-23T23:55:09.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=0, run_start_date=2024-05-23 23:55:08.882203+00:00, run_end_date=2024-05-23 23:55:09.293551+00:00, run_duration=0.411348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:55:07.235516+00:00, queued_by_job_id=1, pid=5511 2024-05-23T23:55:11.776045174Z [2024-05-23T23:55:11.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:55:11.776506826Z [2024-05-23T23:55:11.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:50:00+00:00, run_id=scheduled__2024-05-23T23:50:00+00:00, run_start_date=2024-05-23 23:55:00.395517+00:00, run_end_date=2024-05-23 23:55:11.775924+00:00, run_duration=11.380407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:50:00+00:00, data_interval_end=2024-05-23 23:55:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-23T23:55:11.784569751Z [2024-05-23T23:55:11.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:55:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:55:11.834843865Z [2024-05-23T23:55:11.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:50:00+00:00 exited with status success for try_number 1 2024-05-23T23:55:11.842014735Z [2024-05-23T23:55:11.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:50:00+00:00, map_index=-1, run_start_date=2024-05-23 23:55:11.158726+00:00, run_end_date=2024-05-23 23:55:11.475437+00:00, run_duration=0.316711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:55:09.372695+00:00, queued_by_job_id=1, pid=5519 2024-05-23T23:56:01.124246365Z [2024-05-23T23:56:01.123+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:56:01.144073885Z [2024-05-23T23:56:01.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:56:00+00:00, run_after=2024-05-23T23:57:00+00:00 2024-05-23T23:56:01.154939218Z [2024-05-23T23:56:01.154+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:56:01.169585065Z [2024-05-23T23:56:01.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:56:00+00:00, run_after=2024-05-23T23:57:00+00:00 2024-05-23T23:56:01.276706938Z [2024-05-23T23:56:01.276+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:56:01.276748540Z 2024-05-23T23:56:01.276762861Z 2024-05-23T23:56:01.276768839Z 2024-05-23T23:56:01.276775483Z 2024-05-23T23:56:01.277148117Z [2024-05-23T23:56:01.276+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:56:01.277425954Z [2024-05-23T23:56:01.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:56:01.277605441Z [2024-05-23T23:56:01.277+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:56:01.277822867Z [2024-05-23T23:56:01.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:56:01.278937962Z [2024-05-23T23:56:01.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:56:01.278959795Z 2024-05-23T23:56:01.278966954Z 2024-05-23T23:56:01.278972981Z 2024-05-23T23:56:01.278979207Z 2024-05-23T23:56:01.284981097Z [2024-05-23T23:56:01.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:56:01.285190001Z [2024-05-23T23:56:01.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:56:01.285512960Z [2024-05-23T23:56:01.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:56:01.285564158Z [2024-05-23T23:56:01.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:56:01.285865450Z [2024-05-23T23:56:01.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:56:01.285969489Z [2024-05-23T23:56:01.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:56:01.286204133Z [2024-05-23T23:56:01.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:56:01.286303819Z [2024-05-23T23:56:01.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:56:01.678144514Z [2024-05-23T23:56:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status queued for try_number 1 2024-05-23T23:56:01.678484241Z [2024-05-23T23:56:01.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status queued for try_number 1 2024-05-23T23:56:01.678949638Z [2024-05-23T23:56:01.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status queued for try_number 1 2024-05-23T23:56:01.679214092Z [2024-05-23T23:56:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status queued for try_number 1 2024-05-23T23:56:01.706830448Z [2024-05-23T23:56:01.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64b54056-76ba-4a70-8f28-81e20a413aea 2024-05-23T23:56:01.707193722Z [2024-05-23T23:56:01.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57cd2ba0-6ed8-4e9b-961a-8ee5f3632925 2024-05-23T23:56:01.707472300Z [2024-05-23T23:56:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7753af4-9d7b-4680-b6d1-a4236e4767f3 2024-05-23T23:56:01.707768203Z [2024-05-23T23:56:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cdd9549-5a58-46cc-bf83-54329838c4a3 2024-05-23T23:56:04.075355299Z [2024-05-23T23:56:04.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:56:04.075657078Z [2024-05-23T23:56:04.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:54:00+00:00, run_id=scheduled__2024-05-23T23:54:00+00:00, run_start_date=2024-05-23 23:56:01.184629+00:00, run_end_date=2024-05-23 23:56:04.075329+00:00, run_duration=2.8907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:54:00+00:00, data_interval_end=2024-05-23 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:56:04.083245697Z [2024-05-23T23:56:04.082+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:56:00+00:00, run_after=2024-05-23T23:58:00+00:00 2024-05-23T23:56:04.089710381Z [2024-05-23T23:56:04.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:56:04.090017601Z [2024-05-23T23:56:04.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:55:00+00:00, run_id=scheduled__2024-05-23T23:55:00+00:00, run_start_date=2024-05-23 23:56:01.186106+00:00, run_end_date=2024-05-23 23:56:04.089723+00:00, run_duration=2.903617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:55:00+00:00, data_interval_end=2024-05-23 23:56:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:56:04.104669525Z [2024-05-23T23:56:04.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:56:00+00:00, run_after=2024-05-23T23:57:00+00:00 2024-05-23T23:56:04.181316547Z [2024-05-23T23:56:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:54:00+00:00 exited with status success for try_number 1 2024-05-23T23:56:04.182686926Z [2024-05-23T23:56:04.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status success for try_number 1 2024-05-23T23:56:04.196759042Z [2024-05-23T23:56:04.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:55:00+00:00, map_index=-1, run_start_date=2024-05-23 23:56:02.324966+00:00, run_end_date=2024-05-23 23:56:02.994833+00:00, run_duration=0.669867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:56:01.280464+00:00, queued_by_job_id=1, pid=5542 2024-05-23T23:56:04.197238402Z [2024-05-23T23:56:04.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:54:00+00:00, map_index=-1, run_start_date=2024-05-23 23:56:02.647545+00:00, run_end_date=2024-05-23 23:56:03.214456+00:00, run_duration=0.566911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:56:01.280464+00:00, queued_by_job_id=1, pid=5544 2024-05-23T23:56:06.291751285Z [2024-05-23T23:56:06.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:56:06.291923429Z [2024-05-23T23:56:06.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:55:00+00:00, run_id=scheduled__2024-05-23T23:55:00+00:00, run_start_date=2024-05-23 23:56:01.188507+00:00, run_end_date=2024-05-23 23:56:06.291643+00:00, run_duration=5.103136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:55:00+00:00, data_interval_end=2024-05-23 23:56:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:56:06.302857883Z [2024-05-23T23:56:06.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:56:00+00:00, run_after=2024-05-23T23:57:00+00:00 2024-05-23T23:56:06.312607134Z [2024-05-23T23:56:06.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:56:06.312749871Z [2024-05-23T23:56:06.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:55:00+00:00, run_id=scheduled__2024-05-23T23:55:00+00:00, run_start_date=2024-05-23 23:56:01.187375+00:00, run_end_date=2024-05-23 23:56:06.312495+00:00, run_duration=5.12512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:55:00+00:00, data_interval_end=2024-05-23 23:56:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:56:06.324127654Z [2024-05-23T23:56:06.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:56:00+00:00, run_after=2024-05-23T23:57:00+00:00 2024-05-23T23:56:06.364986549Z [2024-05-23T23:56:06.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status success for try_number 1 2024-05-23T23:56:06.365018668Z [2024-05-23T23:56:06.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status success for try_number 1 2024-05-23T23:56:06.372524608Z [2024-05-23T23:56:06.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:55:00+00:00, map_index=-1, run_start_date=2024-05-23 23:56:03.664768+00:00, run_end_date=2024-05-23 23:56:05.517232+00:00, run_duration=1.852464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:56:01.280464+00:00, queued_by_job_id=1, pid=5566 2024-05-23T23:56:06.372591088Z [2024-05-23T23:56:06.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:55:00+00:00, map_index=-1, run_start_date=2024-05-23 23:56:03.743799+00:00, run_end_date=2024-05-23 23:56:05.815262+00:00, run_duration=2.071463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:56:01.280464+00:00, queued_by_job_id=1, pid=5567 2024-05-23T23:56:39.895699909Z [2024-05-23T23:56:39.892+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-23T23:57:00.149655621Z [2024-05-23T23:57:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:57:00+00:00, run_after=2024-05-23T23:58:00+00:00 2024-05-23T23:57:00.163885269Z [2024-05-23T23:57:00.163+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:57:00+00:00, run_after=2024-05-23T23:58:00+00:00 2024-05-23T23:57:00.171699502Z [2024-05-23T23:57:00.171+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:57:00.252746082Z [2024-05-23T23:57:00.252+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:57:00.252783010Z 2024-05-23T23:57:00.252792750Z 2024-05-23T23:57:00.252801623Z 2024-05-23T23:57:00.253035265Z [2024-05-23T23:57:00.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:57:00.253311535Z [2024-05-23T23:57:00.253+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:57:00.253500788Z [2024-05-23T23:57:00.253+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:57:00.255317668Z [2024-05-23T23:57:00.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:57:00.255339211Z 2024-05-23T23:57:00.255347902Z 2024-05-23T23:57:00.255356674Z 2024-05-23T23:57:00.262955673Z [2024-05-23T23:57:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:57:00.263168520Z [2024-05-23T23:57:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:57:00.266671135Z [2024-05-23T23:57:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:57:00.266704406Z [2024-05-23T23:57:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:57:00.266733511Z [2024-05-23T23:57:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:57:00.266742858Z [2024-05-23T23:57:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:57:00.689564345Z [2024-05-23T23:57:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status queued for try_number 1 2024-05-23T23:57:00.689872558Z [2024-05-23T23:57:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status queued for try_number 1 2024-05-23T23:57:00.690171685Z [2024-05-23T23:57:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status queued for try_number 1 2024-05-23T23:57:00.700838149Z [2024-05-23T23:57:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 066df8b2-9fe2-43ce-80f3-93c057af28fd 2024-05-23T23:57:00.700995687Z [2024-05-23T23:57:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1647d034-e9e9-4c81-8df0-5e14c87856ea 2024-05-23T23:57:00.701361456Z [2024-05-23T23:57:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 577ba1df-660d-411d-bed9-f62b1e2659d8 2024-05-23T23:57:02.168182109Z [2024-05-23T23:57:02.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:57:02.168732405Z [2024-05-23T23:57:02.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:56:00+00:00, run_id=scheduled__2024-05-23T23:56:00+00:00, run_start_date=2024-05-23 23:57:00.180966+00:00, run_end_date=2024-05-23 23:57:02.168283+00:00, run_duration=1.987317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:56:00+00:00, data_interval_end=2024-05-23 23:57:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:57:02.181231897Z [2024-05-23T23:57:02.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:57:00+00:00, run_after=2024-05-23T23:58:00+00:00 2024-05-23T23:57:02.217752670Z [2024-05-23T23:57:02.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status success for try_number 1 2024-05-23T23:57:02.225490908Z [2024-05-23T23:57:02.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:56:00+00:00, map_index=-1, run_start_date=2024-05-23 23:57:01.202604+00:00, run_end_date=2024-05-23 23:57:01.536874+00:00, run_duration=0.33427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:57:00.257040+00:00, queued_by_job_id=1, pid=5598 2024-05-23T23:57:04.383625235Z [2024-05-23T23:57:04.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:57:04.383829690Z [2024-05-23T23:57:04.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:56:00+00:00, run_id=scheduled__2024-05-23T23:56:00+00:00, run_start_date=2024-05-23 23:57:00.182145+00:00, run_end_date=2024-05-23 23:57:04.383490+00:00, run_duration=4.201345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:56:00+00:00, data_interval_end=2024-05-23 23:57:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:57:04.398607114Z [2024-05-23T23:57:04.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:57:00+00:00, run_after=2024-05-23T23:58:00+00:00 2024-05-23T23:57:04.411379513Z [2024-05-23T23:57:04.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:57:04.411535971Z [2024-05-23T23:57:04.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:56:00+00:00, run_id=scheduled__2024-05-23T23:56:00+00:00, run_start_date=2024-05-23 23:57:00.183219+00:00, run_end_date=2024-05-23 23:57:04.411151+00:00, run_duration=4.227932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:56:00+00:00, data_interval_end=2024-05-23 23:57:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:57:04.422668234Z [2024-05-23T23:57:04.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:57:00+00:00, run_after=2024-05-23T23:58:00+00:00 2024-05-23T23:57:04.467714441Z [2024-05-23T23:57:04.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status success for try_number 1 2024-05-23T23:57:04.467770978Z [2024-05-23T23:57:04.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status success for try_number 1 2024-05-23T23:57:04.481274229Z [2024-05-23T23:57:04.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:56:00+00:00, map_index=-1, run_start_date=2024-05-23 23:57:02.203705+00:00, run_end_date=2024-05-23 23:57:03.421641+00:00, run_duration=1.217936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:57:00.257040+00:00, queued_by_job_id=1, pid=5616 2024-05-23T23:57:04.481415598Z [2024-05-23T23:57:04.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:56:00+00:00, map_index=-1, run_start_date=2024-05-23 23:57:02.301818+00:00, run_end_date=2024-05-23 23:57:03.970370+00:00, run_duration=1.668552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:57:00.257040+00:00, queued_by_job_id=1, pid=5617 2024-05-23T23:58:00.140544666Z [2024-05-23T23:58:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:58:00+00:00, run_after=2024-05-23T23:59:00+00:00 2024-05-23T23:58:00.151486993Z [2024-05-23T23:58:00.151+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:58:00.158639503Z [2024-05-23T23:58:00.158+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:58:00.172426062Z [2024-05-23T23:58:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:58:00+00:00, run_after=2024-05-23T23:59:00+00:00 2024-05-23T23:58:00.252183348Z [2024-05-23T23:58:00.251+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-23T23:58:00.252222530Z 2024-05-23T23:58:00.252239567Z 2024-05-23T23:58:00.252249688Z 2024-05-23T23:58:00.252259855Z 2024-05-23T23:58:00.252270564Z [2024-05-23T23:58:00.252+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-23T23:58:00.252304781Z [2024-05-23T23:58:00.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:58:00.252358585Z [2024-05-23T23:58:00.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:58:00.252375726Z [2024-05-23T23:58:00.252+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:58:00.252871790Z [2024-05-23T23:58:00.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:58:00.252877939Z 2024-05-23T23:58:00.252881675Z 2024-05-23T23:58:00.252884871Z 2024-05-23T23:58:00.252887757Z 2024-05-23T23:58:00.255990918Z [2024-05-23T23:58:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:58:00.256057323Z [2024-05-23T23:58:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-23T23:58:00.256276851Z [2024-05-23T23:58:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:58:00.256323908Z [2024-05-23T23:58:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:58:00.256441391Z [2024-05-23T23:58:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:58:00.256519713Z [2024-05-23T23:58:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:58:00.256635926Z [2024-05-23T23:58:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:58:00.256711132Z [2024-05-23T23:58:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:58:00.569519682Z [2024-05-23T23:58:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status queued for try_number 1 2024-05-23T23:58:00.569546515Z [2024-05-23T23:58:00.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:57:00+00:00 exited with status queued for try_number 1 2024-05-23T23:58:00.569550633Z [2024-05-23T23:58:00.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:57:00+00:00 exited with status queued for try_number 1 2024-05-23T23:58:00.569554071Z [2024-05-23T23:58:00.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:57:00+00:00 exited with status queued for try_number 1 2024-05-23T23:58:00.586688248Z [2024-05-23T23:58:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38dff73e-c30e-4a5a-9f9e-0f2c4ef71a90 2024-05-23T23:58:00.587428130Z [2024-05-23T23:58:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fe620ed-2b3a-4a18-9927-90b26f6be376 2024-05-23T23:58:00.588122811Z [2024-05-23T23:58:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64197dbf-68a9-4c24-9943-46f4c07062c5 2024-05-23T23:58:00.588619182Z [2024-05-23T23:58:00.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 591ca67b-3aba-40d1-9f44-2843c370730e 2024-05-23T23:58:02.043987723Z [2024-05-23T23:58:02.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:58:02.044840746Z [2024-05-23T23:58:02.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:56:00+00:00, run_id=scheduled__2024-05-23T23:56:00+00:00, run_start_date=2024-05-23 23:58:00.183431+00:00, run_end_date=2024-05-23 23:58:02.044314+00:00, run_duration=1.860883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:56:00+00:00, data_interval_end=2024-05-23 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-23T23:58:02.054797054Z [2024-05-23T23:58:02.054+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-23T23:58:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:58:02.081034838Z [2024-05-23T23:58:02.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:58:02.081817013Z [2024-05-23T23:58:02.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:57:00+00:00, run_id=scheduled__2024-05-23T23:57:00+00:00, run_start_date=2024-05-23 23:58:00.184585+00:00, run_end_date=2024-05-23 23:58:02.081380+00:00, run_duration=1.896795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:57:00+00:00, data_interval_end=2024-05-23 23:58:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:58:02.102277025Z [2024-05-23T23:58:02.101+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:58:00+00:00, run_after=2024-05-23T23:59:00+00:00 2024-05-23T23:58:02.179202893Z [2024-05-23T23:58:02.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:56:00+00:00 exited with status success for try_number 1 2024-05-23T23:58:02.179301642Z [2024-05-23T23:58:02.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:57:00+00:00 exited with status success for try_number 1 2024-05-23T23:58:02.186459747Z [2024-05-23T23:58:02.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:57:00+00:00, map_index=-1, run_start_date=2024-05-23 23:58:01.359872+00:00, run_end_date=2024-05-23 23:58:01.785411+00:00, run_duration=0.425539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:58:00.253612+00:00, queued_by_job_id=1, pid=5652 2024-05-23T23:58:02.186699955Z [2024-05-23T23:58:02.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:56:00+00:00, map_index=-1, run_start_date=2024-05-23 23:58:01.183875+00:00, run_end_date=2024-05-23 23:58:01.564639+00:00, run_duration=0.380764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:58:00.253612+00:00, queued_by_job_id=1, pid=5650 2024-05-23T23:58:04.391467255Z [2024-05-23T23:58:04.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:58:04.393113402Z [2024-05-23T23:58:04.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:57:00+00:00, run_id=scheduled__2024-05-23T23:57:00+00:00, run_start_date=2024-05-23 23:58:00.185531+00:00, run_end_date=2024-05-23 23:58:04.392095+00:00, run_duration=4.206564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:57:00+00:00, data_interval_end=2024-05-23 23:58:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:58:04.416518438Z [2024-05-23T23:58:04.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:58:00+00:00, run_after=2024-05-23T23:59:00+00:00 2024-05-23T23:58:04.462413037Z [2024-05-23T23:58:04.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:57:00+00:00 exited with status success for try_number 1 2024-05-23T23:58:04.470546829Z [2024-05-23T23:58:04.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:57:00+00:00, map_index=-1, run_start_date=2024-05-23 23:58:02.069773+00:00, run_end_date=2024-05-23 23:58:03.316344+00:00, run_duration=1.246571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:58:00.253612+00:00, queued_by_job_id=1, pid=5669 2024-05-23T23:58:06.610961695Z [2024-05-23T23:58:06.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:58:06.611516775Z [2024-05-23T23:58:06.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:57:00+00:00, run_id=scheduled__2024-05-23T23:57:00+00:00, run_start_date=2024-05-23 23:58:00.186530+00:00, run_end_date=2024-05-23 23:58:06.610805+00:00, run_duration=6.424275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:57:00+00:00, data_interval_end=2024-05-23 23:58:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:58:06.623261046Z [2024-05-23T23:58:06.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:58:00+00:00, run_after=2024-05-23T23:59:00+00:00 2024-05-23T23:58:06.683368722Z [2024-05-23T23:58:06.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:57:00+00:00 exited with status success for try_number 1 2024-05-23T23:58:06.691377120Z [2024-05-23T23:58:06.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:57:00+00:00, map_index=-1, run_start_date=2024-05-23 23:58:02.429516+00:00, run_end_date=2024-05-23 23:58:05.679334+00:00, run_duration=3.249818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:58:00.253612+00:00, queued_by_job_id=1, pid=5680 2024-05-23T23:59:00.100439274Z [2024-05-23T23:59:00.099+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-23T23:59:00.132857714Z [2024-05-23T23:59:00.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:59:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:59:00.147216576Z [2024-05-23T23:59:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:59:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:59:00.225386834Z [2024-05-23T23:59:00.225+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-23T23:59:00.225445856Z 2024-05-23T23:59:00.225451748Z 2024-05-23T23:59:00.225456699Z 2024-05-23T23:59:00.225505194Z [2024-05-23T23:59:00.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-23T23:59:00.225785852Z [2024-05-23T23:59:00.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:59:00.226014928Z [2024-05-23T23:59:00.225+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-23T23:59:00.227219687Z [2024-05-23T23:59:00.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-23T23:59:00.227235165Z 2024-05-23T23:59:00.227240405Z 2024-05-23T23:59:00.227244768Z 2024-05-23T23:59:00.230046126Z [2024-05-23T23:59:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:59:00.230239031Z [2024-05-23T23:59:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-23T23:59:00.230610480Z [2024-05-23T23:59:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:59:00.230738221Z [2024-05-23T23:59:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-23T23:59:00.235033848Z [2024-05-23T23:59:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-23T23:59:00.235061032Z [2024-05-23T23:59:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-23T23:59:00.469862135Z [2024-05-23T23:59:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status queued for try_number 1 2024-05-23T23:59:00.469924910Z [2024-05-23T23:59:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status queued for try_number 1 2024-05-23T23:59:00.469929096Z [2024-05-23T23:59:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status queued for try_number 1 2024-05-23T23:59:00.478133450Z [2024-05-23T23:59:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 692334d5-9d85-4636-b25e-4acc907890c8 2024-05-23T23:59:00.478190104Z [2024-05-23T23:59:00.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a9eefab-83d2-4936-a25a-c1080570c30c 2024-05-23T23:59:00.478667554Z [2024-05-23T23:59:00.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d4aa528-6f23-490e-b849-3f5ee98ef389 2024-05-23T23:59:02.756296253Z [2024-05-23T23:59:02.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:59:02.756544648Z [2024-05-23T23:59:02.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:58:00+00:00, run_id=scheduled__2024-05-23T23:58:00+00:00, run_start_date=2024-05-23 23:59:00.161407+00:00, run_end_date=2024-05-23 23:59:02.756234+00:00, run_duration=2.594827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:58:00+00:00, data_interval_end=2024-05-23 23:59:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-23T23:59:02.768872015Z [2024-05-23T23:59:02.768+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-23T23:59:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:59:02.824908578Z [2024-05-23T23:59:02.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status success for try_number 1 2024-05-23T23:59:02.831795096Z [2024-05-23T23:59:02.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:58:00+00:00, map_index=-1, run_start_date=2024-05-23 23:59:01.237955+00:00, run_end_date=2024-05-23 23:59:01.651862+00:00, run_duration=0.413907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:59:00.227723+00:00, queued_by_job_id=1, pid=5708 2024-05-23T23:59:05.334370689Z [2024-05-23T23:59:05.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:59:05.335143196Z [2024-05-23T23:59:05.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:58:00+00:00, run_id=scheduled__2024-05-23T23:58:00+00:00, run_start_date=2024-05-23 23:59:00.165343+00:00, run_end_date=2024-05-23 23:59:05.334269+00:00, run_duration=5.168926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:58:00+00:00, data_interval_end=2024-05-23 23:59:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-23T23:59:05.347849374Z [2024-05-23T23:59:05.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:59:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:59:05.355713978Z [2024-05-23T23:59:05.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-23T23:59:05.355891595Z [2024-05-23T23:59:05.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:58:00+00:00, run_id=scheduled__2024-05-23T23:58:00+00:00, run_start_date=2024-05-23 23:59:00.163616+00:00, run_end_date=2024-05-23 23:59:05.355618+00:00, run_duration=5.192002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:58:00+00:00, data_interval_end=2024-05-23 23:59:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-23T23:59:05.367989870Z [2024-05-23T23:59:05.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-23T23:59:00+00:00, run_after=2024-05-24T00:00:00+00:00 2024-05-23T23:59:05.412312897Z [2024-05-23T23:59:05.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status success for try_number 1 2024-05-23T23:59:05.412440918Z [2024-05-23T23:59:05.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status success for try_number 1 2024-05-23T23:59:05.422281839Z [2024-05-23T23:59:05.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:58:00+00:00, map_index=-1, run_start_date=2024-05-23 23:59:02.362193+00:00, run_end_date=2024-05-23 23:59:04.371223+00:00, run_duration=2.00903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:59:00.227723+00:00, queued_by_job_id=1, pid=5727 2024-05-23T23:59:05.422382244Z [2024-05-23T23:59:05.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:58:00+00:00, map_index=-1, run_start_date=2024-05-23 23:59:02.255606+00:00, run_end_date=2024-05-23 23:59:04.550365+00:00, run_duration=2.294759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-23 23:59:00.227723+00:00, queued_by_job_id=1, pid=5726 2024-05-24T00:00:01.032325728Z [2024-05-24T00:00:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:05:00+00:00 2024-05-24T00:00:01.041084458Z [2024-05-24T00:00:01.040+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:00:01.056349766Z [2024-05-24T00:00:01.055+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:00:01.070888714Z [2024-05-24T00:00:01.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:01:00+00:00 2024-05-24T00:00:01.084724979Z [2024-05-24T00:00:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:01:00+00:00 2024-05-24T00:00:01.206353160Z [2024-05-24T00:00:01.205+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T00:00:01.206382276Z 2024-05-24T00:00:01.206387573Z 2024-05-24T00:00:01.206409316Z 2024-05-24T00:00:01.206413854Z 2024-05-24T00:00:01.206417915Z 2024-05-24T00:00:01.206744865Z [2024-05-24T00:00:01.206+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:00:01.207165275Z [2024-05-24T00:00:01.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:00:01.207424055Z [2024-05-24T00:00:01.207+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:00:01.207669315Z [2024-05-24T00:00:01.207+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:00:01.207893953Z [2024-05-24T00:00:01.207+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:00:01.208749512Z [2024-05-24T00:00:01.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:00:01.208763607Z 2024-05-24T00:00:01.208768709Z 2024-05-24T00:00:01.208773232Z 2024-05-24T00:00:01.208777293Z 2024-05-24T00:00:01.208781566Z 2024-05-24T00:00:01.214454260Z [2024-05-24T00:00:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:00:01.214965009Z [2024-05-24T00:00:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:00:01.215382870Z [2024-05-24T00:00:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:00:01.215645462Z [2024-05-24T00:00:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:00:01.215984545Z [2024-05-24T00:00:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:00:01.216228828Z [2024-05-24T00:00:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:00:01.216585396Z [2024-05-24T00:00:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:00:01.216829320Z [2024-05-24T00:00:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:00:01.217208804Z [2024-05-24T00:00:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:00:01.217448097Z [2024-05-24T00:00:01.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:00:01.999990648Z [2024-05-24T00:00:01.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:02.000032813Z [2024-05-24T00:00:01.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:02.000167210Z [2024-05-24T00:00:02.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:59:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:02.000216570Z [2024-05-24T00:00:02.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:59:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:02.000285055Z [2024-05-24T00:00:02.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:59:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:02.021190385Z [2024-05-24T00:00:02.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to c478fd6c-d40e-4488-a87b-08b8d385fd5b 2024-05-24T00:00:02.021274014Z [2024-05-24T00:00:02.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a85206c-3ef5-4d5f-b4cd-258cdca01880 2024-05-24T00:00:02.021356889Z [2024-05-24T00:00:02.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61f724a4-da62-4b9c-aaca-15a125a734f6 2024-05-24T00:00:02.021443486Z [2024-05-24T00:00:02.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 611b1d9d-2a34-476c-8421-ecb9f21beba7 2024-05-24T00:00:02.021536003Z [2024-05-24T00:00:02.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06207cce-4066-42e2-9d07-a839066ad054 2024-05-24T00:00:03.226587741Z [2024-05-24T00:00:03.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:00:03.227115389Z [2024-05-24T00:00:03.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-23 23:59:00+00:00, run_id=scheduled__2024-05-23T23:59:00+00:00, run_start_date=2024-05-24 00:00:01.112203+00:00, run_end_date=2024-05-24 00:00:03.226453+00:00, run_duration=2.11425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:59:00+00:00, data_interval_end=2024-05-24 00:00:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:00:03.237072518Z [2024-05-24T00:00:03.236+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:01:00+00:00 2024-05-24T00:00:03.265265708Z [2024-05-24T00:00:03.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:00:03.265630266Z [2024-05-24T00:00:03.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-23 23:58:00+00:00, run_id=scheduled__2024-05-23T23:58:00+00:00, run_start_date=2024-05-24 00:00:01.106291+00:00, run_end_date=2024-05-24 00:00:03.265171+00:00, run_duration=2.15888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:58:00+00:00, data_interval_end=2024-05-24 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:00:03.274878691Z [2024-05-24T00:00:03.274+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:02:00+00:00 2024-05-24T00:00:03.364364080Z [2024-05-24T00:00:03.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:59:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:03.371428835Z [2024-05-24T00:00:03.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:59:00+00:00, map_index=-1, run_start_date=2024-05-24 00:00:02.378143+00:00, run_end_date=2024-05-24 00:00:02.883510+00:00, run_duration=0.505367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:01.210039+00:00, queued_by_job_id=1, pid=5762 2024-05-24T00:00:04.031589284Z [2024-05-24T00:00:04.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-23T23:58:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:04.036554532Z [2024-05-24T00:00:04.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-23T23:58:00+00:00, map_index=-1, run_start_date=2024-05-24 00:00:02.618114+00:00, run_end_date=2024-05-24 00:00:03.233132+00:00, run_duration=0.615018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:01.210039+00:00, queued_by_job_id=1, pid=5763 2024-05-24T00:00:05.160157566Z [2024-05-24T00:00:05.159+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:00:05.160192921Z 2024-05-24T00:00:05.160201113Z [2024-05-24T00:00:05.159+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:00:05.162674489Z [2024-05-24T00:00:05.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:00:05.162692333Z 2024-05-24T00:00:05.166800229Z [2024-05-24T00:00:05.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:00:05.167023373Z [2024-05-24T00:00:05.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:00:05.268245581Z [2024-05-24T00:00:05.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:05.271226082Z [2024-05-24T00:00:05.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:05.289096209Z [2024-05-24T00:00:05.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to dda59636-a6ad-4f4d-80d3-72ff7ca1c203 2024-05-24T00:00:05.289498111Z [2024-05-24T00:00:05.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-23T23:55:00+00:00, map_index=-1, run_start_date=2024-05-24 00:00:03.836463+00:00, run_end_date=2024-05-24 00:00:04.328517+00:00, run_duration=0.492054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:01.210039+00:00, queued_by_job_id=1, pid=5793 2024-05-24T00:00:06.477630742Z [2024-05-24T00:00:06.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:00:06.477920617Z [2024-05-24T00:00:06.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:59:00+00:00, run_id=scheduled__2024-05-23T23:59:00+00:00, run_start_date=2024-05-24 00:00:01.118920+00:00, run_end_date=2024-05-24 00:00:06.477521+00:00, run_duration=5.358601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:59:00+00:00, data_interval_end=2024-05-24 00:00:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:00:06.492626919Z [2024-05-24T00:00:06.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:01:00+00:00 2024-05-24T00:00:06.503544060Z [2024-05-24T00:00:06.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:00:06.503862566Z [2024-05-24T00:00:06.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:59:00+00:00, run_id=scheduled__2024-05-23T23:59:00+00:00, run_start_date=2024-05-24 00:00:01.116075+00:00, run_end_date=2024-05-24 00:00:06.503459+00:00, run_duration=5.387384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:59:00+00:00, data_interval_end=2024-05-24 00:00:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:00:06.516526638Z [2024-05-24T00:00:06.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:01:00+00:00 2024-05-24T00:00:06.599483784Z [2024-05-24T00:00:06.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:59:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:06.599603948Z [2024-05-24T00:00:06.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-23T23:59:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:06.607591139Z [2024-05-24T00:00:06.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:59:00+00:00, map_index=-1, run_start_date=2024-05-24 00:00:03.503444+00:00, run_end_date=2024-05-24 00:00:05.245045+00:00, run_duration=1.741601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:01.210039+00:00, queued_by_job_id=1, pid=5786 2024-05-24T00:00:06.608084841Z [2024-05-24T00:00:06.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-23T23:59:00+00:00, map_index=-1, run_start_date=2024-05-24 00:00:03.653372+00:00, run_end_date=2024-05-24 00:00:06.329687+00:00, run_duration=2.676315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:01.210039+00:00, queued_by_job_id=1, pid=5792 2024-05-24T00:00:08.663480387Z [2024-05-24T00:00:08.662+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:00:08.663561908Z 2024-05-24T00:00:08.663621608Z [2024-05-24T00:00:08.663+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:00:08.664497613Z [2024-05-24T00:00:08.664+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:00:08.664516675Z 2024-05-24T00:00:08.667802849Z [2024-05-24T00:00:08.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-23T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:00:08.667984100Z [2024-05-24T00:00:08.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:00:08.739794319Z [2024-05-24T00:00:08.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:08.740078935Z [2024-05-24T00:00:08.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:08.748056529Z [2024-05-24T00:00:08.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7274d02-ce7f-448b-8990-58d22b5653bf 2024-05-24T00:00:08.748639890Z [2024-05-24T00:00:08.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-23T23:55:00+00:00, map_index=-1, run_start_date=2024-05-24 00:00:06.904230+00:00, run_end_date=2024-05-24 00:00:07.306744+00:00, run_duration=0.402514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:05.163288+00:00, queued_by_job_id=1, pid=5816 2024-05-24T00:00:11.469141725Z [2024-05-24T00:00:11.468+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:00:11.469194036Z 2024-05-24T00:00:11.469258418Z [2024-05-24T00:00:11.468+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:00:11.469778821Z [2024-05-24T00:00:11.469+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:00:11.469806988Z 2024-05-24T00:00:11.472909987Z [2024-05-24T00:00:11.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:00:11.473141658Z [2024-05-24T00:00:11.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:00:11.536757731Z [2024-05-24T00:00:11.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status queued for try_number 1 2024-05-24T00:00:11.536836919Z [2024-05-24T00:00:11.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:11.546810399Z [2024-05-24T00:00:11.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27cb5011-1760-4bed-ab54-ce4670b96af7 2024-05-24T00:00:11.547204112Z [2024-05-24T00:00:11.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-23T23:55:00+00:00, map_index=0, run_start_date=2024-05-24 00:00:10.516755+00:00, run_end_date=2024-05-24 00:00:10.997527+00:00, run_duration=0.480772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:08.664922+00:00, queued_by_job_id=1, pid=5824 2024-05-24T00:00:14.317472010Z [2024-05-24T00:00:14.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:00:14.318254643Z [2024-05-24T00:00:14.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-23 23:55:00+00:00, run_id=scheduled__2024-05-23T23:55:00+00:00, run_start_date=2024-05-24 00:00:01.104828+00:00, run_end_date=2024-05-24 00:00:14.317726+00:00, run_duration=13.212898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-23 23:55:00+00:00, data_interval_end=2024-05-24 00:00:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:00:14.329050293Z [2024-05-24T00:00:14.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:00:00+00:00, run_after=2024-05-24T00:05:00+00:00 2024-05-24T00:00:14.377878095Z [2024-05-24T00:00:14.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-23T23:55:00+00:00 exited with status success for try_number 1 2024-05-24T00:00:14.390778481Z [2024-05-24T00:00:14.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-23T23:55:00+00:00, map_index=-1, run_start_date=2024-05-24 00:00:13.155172+00:00, run_end_date=2024-05-24 00:00:13.586093+00:00, run_duration=0.430921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:00:11.470169+00:00, queued_by_job_id=1, pid=5832 2024-05-24T00:01:00.086087319Z [2024-05-24T00:01:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:01:00+00:00, run_after=2024-05-24T00:02:00+00:00 2024-05-24T00:01:00.103135020Z [2024-05-24T00:01:00.102+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:01:00.119825401Z [2024-05-24T00:01:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:01:00+00:00, run_after=2024-05-24T00:02:00+00:00 2024-05-24T00:01:00.200708922Z [2024-05-24T00:01:00.200+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:01:00.200722757Z 2024-05-24T00:01:00.200725987Z 2024-05-24T00:01:00.200728966Z 2024-05-24T00:01:00.200919054Z [2024-05-24T00:01:00.200+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:01:00.201089403Z [2024-05-24T00:01:00.200+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:01:00.201270988Z [2024-05-24T00:01:00.201+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:01:00.206575755Z [2024-05-24T00:01:00.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:01:00.206582290Z 2024-05-24T00:01:00.206585462Z 2024-05-24T00:01:00.206588736Z 2024-05-24T00:01:00.223407256Z [2024-05-24T00:01:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:01:00.223459566Z [2024-05-24T00:01:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:01:00.231106597Z [2024-05-24T00:01:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:01:00.231277553Z [2024-05-24T00:01:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:01:00.231623132Z [2024-05-24T00:01:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:01:00.231808160Z [2024-05-24T00:01:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:01:00.522347340Z [2024-05-24T00:01:00.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:01:00.522557206Z [2024-05-24T00:01:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:01:00.522721347Z [2024-05-24T00:01:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:01:00.530409014Z [2024-05-24T00:01:00.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0903f24e-4121-418f-96a1-a01959261d59 2024-05-24T00:01:00.530585416Z [2024-05-24T00:01:00.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68fca300-a00b-4bc5-be7b-1287b8ee9283 2024-05-24T00:01:00.530765539Z [2024-05-24T00:01:00.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to a01fe964-07de-4bda-9557-4855852d6fdd 2024-05-24T00:01:01.718053311Z [2024-05-24T00:01:01.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:01:01.718323222Z [2024-05-24T00:01:01.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:00:00+00:00, run_id=scheduled__2024-05-24T00:00:00+00:00, run_start_date=2024-05-24 00:01:00.130676+00:00, run_end_date=2024-05-24 00:01:01.717940+00:00, run_duration=1.587264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:00:00+00:00, data_interval_end=2024-05-24 00:01:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:01:01.727512159Z [2024-05-24T00:01:01.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:01:00+00:00, run_after=2024-05-24T00:02:00+00:00 2024-05-24T00:01:02.588087364Z [2024-05-24T00:01:02.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:01:02.595785876Z [2024-05-24T00:01:02.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=-1, run_start_date=2024-05-24 00:01:01.228280+00:00, run_end_date=2024-05-24 00:01:01.669190+00:00, run_duration=0.44091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:01:00.216412+00:00, queued_by_job_id=1, pid=5854 2024-05-24T00:01:04.814638646Z [2024-05-24T00:01:04.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:01:04.815164090Z [2024-05-24T00:01:04.814+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:00:00+00:00, run_id=scheduled__2024-05-24T00:00:00+00:00, run_start_date=2024-05-24 00:01:00.131845+00:00, run_end_date=2024-05-24 00:01:04.814451+00:00, run_duration=4.682606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:00:00+00:00, data_interval_end=2024-05-24 00:01:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:01:04.830862023Z [2024-05-24T00:01:04.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:01:00+00:00, run_after=2024-05-24T00:02:00+00:00 2024-05-24T00:01:04.841582049Z [2024-05-24T00:01:04.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:01:04.842110796Z [2024-05-24T00:01:04.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:00:00+00:00, run_id=scheduled__2024-05-24T00:00:00+00:00, run_start_date=2024-05-24 00:01:00.132853+00:00, run_end_date=2024-05-24 00:01:04.841416+00:00, run_duration=4.708563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:00:00+00:00, data_interval_end=2024-05-24 00:01:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:01:04.856580527Z [2024-05-24T00:01:04.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:01:00+00:00, run_after=2024-05-24T00:02:00+00:00 2024-05-24T00:01:04.910296918Z [2024-05-24T00:01:04.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:01:04.910353432Z [2024-05-24T00:01:04.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:01:04.921027835Z [2024-05-24T00:01:04.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=-1, run_start_date=2024-05-24 00:01:02.590262+00:00, run_end_date=2024-05-24 00:01:04.123230+00:00, run_duration=1.532968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:01:00.216412+00:00, queued_by_job_id=1, pid=5873 2024-05-24T00:01:04.921508082Z [2024-05-24T00:01:04.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=-1, run_start_date=2024-05-24 00:01:02.525279+00:00, run_end_date=2024-05-24 00:01:04.466572+00:00, run_duration=1.941293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:01:00.216412+00:00, queued_by_job_id=1, pid=5872 2024-05-24T00:01:39.980161506Z [2024-05-24T00:01:39.979+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:02:00.846585755Z [2024-05-24T00:02:00.845+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:02:00.865304830Z [2024-05-24T00:02:00.864+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:02:00.889983850Z [2024-05-24T00:02:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:02:00+00:00, run_after=2024-05-24T00:03:00+00:00 2024-05-24T00:02:00.907890373Z [2024-05-24T00:02:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:02:00+00:00, run_after=2024-05-24T00:03:00+00:00 2024-05-24T00:02:01.006154681Z [2024-05-24T00:02:01.005+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:02:01.006180654Z 2024-05-24T00:02:01.006187381Z 2024-05-24T00:02:01.006191693Z 2024-05-24T00:02:01.006208773Z 2024-05-24T00:02:01.006710271Z [2024-05-24T00:02:01.006+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:02:01.006816952Z [2024-05-24T00:02:01.006+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:02:01.007040955Z [2024-05-24T00:02:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:02:01.007338119Z [2024-05-24T00:02:01.007+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:02:01.008032846Z [2024-05-24T00:02:01.007+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:02:01.008045246Z 2024-05-24T00:02:01.008068716Z 2024-05-24T00:02:01.008073985Z 2024-05-24T00:02:01.008078810Z 2024-05-24T00:02:01.012849857Z [2024-05-24T00:02:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:02:01.013017552Z [2024-05-24T00:02:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:02:01.013301475Z [2024-05-24T00:02:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:02:01.013438497Z [2024-05-24T00:02:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:02:01.013739736Z [2024-05-24T00:02:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:02:01.013877193Z [2024-05-24T00:02:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:02:01.014134535Z [2024-05-24T00:02:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:02:01.014264901Z [2024-05-24T00:02:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:02:01.456984499Z [2024-05-24T00:02:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:02:01.457406272Z [2024-05-24T00:02:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:01:00+00:00 exited with status queued for try_number 1 2024-05-24T00:02:01.457424354Z [2024-05-24T00:02:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:01:00+00:00 exited with status queued for try_number 1 2024-05-24T00:02:01.457497134Z [2024-05-24T00:02:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:01:00+00:00 exited with status queued for try_number 1 2024-05-24T00:02:01.468068645Z [2024-05-24T00:02:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 383fa1bb-5f71-4c69-a80e-e2efc1ce6e96 2024-05-24T00:02:01.468105080Z [2024-05-24T00:02:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6516c72-2931-4af6-9244-cee80b869b29 2024-05-24T00:02:01.468257024Z [2024-05-24T00:02:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0754d597-aa86-4acd-b0d1-3acaa24d5b57 2024-05-24T00:02:01.468344054Z [2024-05-24T00:02:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 817d0b22-e9bb-4974-867d-856592078a36 2024-05-24T00:02:03.005097990Z [2024-05-24T00:02:03.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:02:03.005389622Z [2024-05-24T00:02:03.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:00:00+00:00, run_id=scheduled__2024-05-24T00:00:00+00:00, run_start_date=2024-05-24 00:02:00.935706+00:00, run_end_date=2024-05-24 00:02:03.005007+00:00, run_duration=2.069301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:00:00+00:00, data_interval_end=2024-05-24 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:02:03.015965796Z [2024-05-24T00:02:03.015+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:02:00+00:00, run_after=2024-05-24T00:04:00+00:00 2024-05-24T00:02:03.081962271Z [2024-05-24T00:02:03.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:02:03.086773990Z [2024-05-24T00:02:03.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=-1, run_start_date=2024-05-24 00:02:01.944959+00:00, run_end_date=2024-05-24 00:02:02.849379+00:00, run_duration=0.90442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:02:01.009407+00:00, queued_by_job_id=1, pid=5900 2024-05-24T00:02:04.179393557Z [2024-05-24T00:02:04.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:02:04.187334811Z [2024-05-24T00:02:04.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:01:00+00:00, run_id=scheduled__2024-05-24T00:01:00+00:00, run_start_date=2024-05-24 00:02:00.937486+00:00, run_end_date=2024-05-24 00:02:04.186817+00:00, run_duration=3.249331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:01:00+00:00, data_interval_end=2024-05-24 00:02:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:02:04.212976769Z [2024-05-24T00:02:04.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:02:00+00:00, run_after=2024-05-24T00:03:00+00:00 2024-05-24T00:02:04.380210200Z [2024-05-24T00:02:04.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:01:00+00:00 exited with status success for try_number 1 2024-05-24T00:02:04.391315312Z [2024-05-24T00:02:04.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:01:00+00:00, map_index=-1, run_start_date=2024-05-24 00:02:02.663234+00:00, run_end_date=2024-05-24 00:02:03.398974+00:00, run_duration=0.73574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:02:01.009407+00:00, queued_by_job_id=1, pid=5911 2024-05-24T00:02:06.552351030Z [2024-05-24T00:02:06.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:02:06.552840269Z [2024-05-24T00:02:06.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:01:00+00:00, run_id=scheduled__2024-05-24T00:01:00+00:00, run_start_date=2024-05-24 00:02:00.940027+00:00, run_end_date=2024-05-24 00:02:06.552211+00:00, run_duration=5.612184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:01:00+00:00, data_interval_end=2024-05-24 00:02:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:02:06.561194168Z [2024-05-24T00:02:06.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:02:00+00:00, run_after=2024-05-24T00:03:00+00:00 2024-05-24T00:02:06.573056914Z [2024-05-24T00:02:06.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:02:06.574390988Z [2024-05-24T00:02:06.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:01:00+00:00, run_id=scheduled__2024-05-24T00:01:00+00:00, run_start_date=2024-05-24 00:02:00.938787+00:00, run_end_date=2024-05-24 00:02:06.573488+00:00, run_duration=5.634701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:01:00+00:00, data_interval_end=2024-05-24 00:02:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:02:06.597030722Z [2024-05-24T00:02:06.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:02:00+00:00, run_after=2024-05-24T00:03:00+00:00 2024-05-24T00:02:06.641073749Z [2024-05-24T00:02:06.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:01:00+00:00 exited with status success for try_number 1 2024-05-24T00:02:06.641524901Z [2024-05-24T00:02:06.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:01:00+00:00 exited with status success for try_number 1 2024-05-24T00:02:06.657860856Z [2024-05-24T00:02:06.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:01:00+00:00, map_index=-1, run_start_date=2024-05-24 00:02:04.843110+00:00, run_end_date=2024-05-24 00:02:06.001524+00:00, run_duration=1.158414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:02:01.009407+00:00, queued_by_job_id=1, pid=5930 2024-05-24T00:02:06.658166950Z [2024-05-24T00:02:06.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:01:00+00:00, map_index=-1, run_start_date=2024-05-24 00:02:04.653300+00:00, run_end_date=2024-05-24 00:02:06.306755+00:00, run_duration=1.653455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:02:01.009407+00:00, queued_by_job_id=1, pid=5929 2024-05-24T00:03:00.741611485Z [2024-05-24T00:03:00.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:03:00+00:00, run_after=2024-05-24T00:04:00+00:00 2024-05-24T00:03:00.753777617Z [2024-05-24T00:03:00.753+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:03:00.767741443Z [2024-05-24T00:03:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:03:00+00:00, run_after=2024-05-24T00:04:00+00:00 2024-05-24T00:03:00.886756552Z [2024-05-24T00:03:00.886+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:03:00.886818736Z 2024-05-24T00:03:00.886824356Z 2024-05-24T00:03:00.886828538Z 2024-05-24T00:03:00.886847813Z [2024-05-24T00:03:00.886+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:03:00.886987141Z [2024-05-24T00:03:00.886+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:03:00.887202925Z [2024-05-24T00:03:00.887+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:03:00.887866436Z [2024-05-24T00:03:00.887+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:03:00.887875764Z 2024-05-24T00:03:00.887880518Z 2024-05-24T00:03:00.887884614Z 2024-05-24T00:03:00.891467926Z [2024-05-24T00:03:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:03:00.891604979Z [2024-05-24T00:03:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:03:00.891830832Z [2024-05-24T00:03:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:03:00.891862876Z [2024-05-24T00:03:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:03:00.892098422Z [2024-05-24T00:03:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:03:00.892118959Z [2024-05-24T00:03:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:03:01.225662348Z [2024-05-24T00:03:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status queued for try_number 1 2024-05-24T00:03:01.225924713Z [2024-05-24T00:03:01.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status queued for try_number 1 2024-05-24T00:03:01.226092615Z [2024-05-24T00:03:01.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status queued for try_number 1 2024-05-24T00:03:01.246605416Z [2024-05-24T00:03:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6767c96-f138-4ca5-891c-24079cadb8fc 2024-05-24T00:03:01.246855910Z [2024-05-24T00:03:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91d13d10-380f-4d7a-a34c-1cb311d5d1a5 2024-05-24T00:03:01.247053132Z [2024-05-24T00:03:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4efc9c4-fa71-46ae-b262-45b419f0c302 2024-05-24T00:03:02.473962968Z [2024-05-24T00:03:02.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:03:02.474557076Z [2024-05-24T00:03:02.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:02:00+00:00, run_id=scheduled__2024-05-24T00:02:00+00:00, run_start_date=2024-05-24 00:03:00.778924+00:00, run_end_date=2024-05-24 00:03:02.474146+00:00, run_duration=1.695222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:02:00+00:00, data_interval_end=2024-05-24 00:03:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:03:02.488061371Z [2024-05-24T00:03:02.487+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:03:00+00:00, run_after=2024-05-24T00:04:00+00:00 2024-05-24T00:03:02.546469024Z [2024-05-24T00:03:02.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status success for try_number 1 2024-05-24T00:03:02.560823168Z [2024-05-24T00:03:02.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:02:00+00:00, map_index=-1, run_start_date=2024-05-24 00:03:01.758040+00:00, run_end_date=2024-05-24 00:03:02.160657+00:00, run_duration=0.402617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:03:00.888585+00:00, queued_by_job_id=1, pid=5962 2024-05-24T00:03:04.617901615Z [2024-05-24T00:03:04.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:03:04.618085539Z [2024-05-24T00:03:04.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:02:00+00:00, run_id=scheduled__2024-05-24T00:02:00+00:00, run_start_date=2024-05-24 00:03:00.781192+00:00, run_end_date=2024-05-24 00:03:04.617836+00:00, run_duration=3.836644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:02:00+00:00, data_interval_end=2024-05-24 00:03:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:03:04.634919981Z [2024-05-24T00:03:04.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:03:00+00:00, run_after=2024-05-24T00:04:00+00:00 2024-05-24T00:03:04.679538051Z [2024-05-24T00:03:04.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status success for try_number 1 2024-05-24T00:03:04.686297590Z [2024-05-24T00:03:04.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:02:00+00:00, map_index=-1, run_start_date=2024-05-24 00:03:02.977983+00:00, run_end_date=2024-05-24 00:03:04.499918+00:00, run_duration=1.521935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:03:00.888585+00:00, queued_by_job_id=1, pid=5981 2024-05-24T00:03:05.748054130Z [2024-05-24T00:03:05.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:03:05.748432884Z [2024-05-24T00:03:05.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:02:00+00:00, run_id=scheduled__2024-05-24T00:02:00+00:00, run_start_date=2024-05-24 00:03:00.783231+00:00, run_end_date=2024-05-24 00:03:05.747870+00:00, run_duration=4.964639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:02:00+00:00, data_interval_end=2024-05-24 00:03:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:03:05.765776864Z [2024-05-24T00:03:05.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:03:00+00:00, run_after=2024-05-24T00:04:00+00:00 2024-05-24T00:03:05.811294291Z [2024-05-24T00:03:05.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status success for try_number 1 2024-05-24T00:03:05.817901624Z [2024-05-24T00:03:05.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:02:00+00:00, map_index=-1, run_start_date=2024-05-24 00:03:02.880509+00:00, run_end_date=2024-05-24 00:03:04.735736+00:00, run_duration=1.855227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:03:00.888585+00:00, queued_by_job_id=1, pid=5980 2024-05-24T00:04:00.616893841Z [2024-05-24T00:04:00.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:04:00+00:00, run_after=2024-05-24T00:05:00+00:00 2024-05-24T00:04:00.633264185Z [2024-05-24T00:04:00.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:04:00+00:00, run_after=2024-05-24T00:05:00+00:00 2024-05-24T00:04:00.639841857Z [2024-05-24T00:04:00.639+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:04:00.646252445Z [2024-05-24T00:04:00.645+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:04:00.737567267Z [2024-05-24T00:04:00.736+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:04:00.737592905Z 2024-05-24T00:04:00.737598056Z 2024-05-24T00:04:00.737601454Z 2024-05-24T00:04:00.737604767Z 2024-05-24T00:04:00.737884730Z [2024-05-24T00:04:00.737+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:04:00.738305873Z [2024-05-24T00:04:00.738+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:04:00.738770211Z [2024-05-24T00:04:00.738+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:04:00.739088201Z [2024-05-24T00:04:00.738+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:04:00.740257469Z [2024-05-24T00:04:00.739+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:04:00.740281647Z 2024-05-24T00:04:00.740290848Z 2024-05-24T00:04:00.740297757Z 2024-05-24T00:04:00.740303230Z 2024-05-24T00:04:00.746834939Z [2024-05-24T00:04:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:04:00.747128045Z [2024-05-24T00:04:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:04:00.747461529Z [2024-05-24T00:04:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:04:00.747599933Z [2024-05-24T00:04:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:04:00.747979787Z [2024-05-24T00:04:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:04:00.748222839Z [2024-05-24T00:04:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:04:00.748830586Z [2024-05-24T00:04:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:04:00.749171877Z [2024-05-24T00:04:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:04:01.390655057Z [2024-05-24T00:04:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status queued for try_number 1 2024-05-24T00:04:01.390869453Z [2024-05-24T00:04:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:03:00+00:00 exited with status queued for try_number 1 2024-05-24T00:04:01.391098763Z [2024-05-24T00:04:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:03:00+00:00 exited with status queued for try_number 1 2024-05-24T00:04:01.391289807Z [2024-05-24T00:04:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:03:00+00:00 exited with status queued for try_number 1 2024-05-24T00:04:01.401905916Z [2024-05-24T00:04:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to f037aeb1-eb4f-44cf-b050-f1648e8a822e 2024-05-24T00:04:01.401942492Z [2024-05-24T00:04:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5a83bd9-64f4-40f7-b1c9-0509e4363fe6 2024-05-24T00:04:01.402146448Z [2024-05-24T00:04:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to e75c933d-0de5-4dab-85de-1436e8ab30c2 2024-05-24T00:04:01.402303342Z [2024-05-24T00:04:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3d8fa77-4217-424d-9a43-b1bccae2ee1d 2024-05-24T00:04:02.551625741Z [2024-05-24T00:04:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:04:02.552460712Z [2024-05-24T00:04:02.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:03:00+00:00, run_id=scheduled__2024-05-24T00:03:00+00:00, run_start_date=2024-05-24 00:04:00.658110+00:00, run_end_date=2024-05-24 00:04:02.551914+00:00, run_duration=1.893804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:03:00+00:00, data_interval_end=2024-05-24 00:04:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:04:02.565509065Z [2024-05-24T00:04:02.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:04:00+00:00, run_after=2024-05-24T00:05:00+00:00 2024-05-24T00:04:02.574950321Z [2024-05-24T00:04:02.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:04:02.575545541Z [2024-05-24T00:04:02.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:02:00+00:00, run_id=scheduled__2024-05-24T00:02:00+00:00, run_start_date=2024-05-24 00:04:00.656770+00:00, run_end_date=2024-05-24 00:04:02.575090+00:00, run_duration=1.91832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:02:00+00:00, data_interval_end=2024-05-24 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:04:02.586310547Z [2024-05-24T00:04:02.585+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:04:00+00:00, run_after=2024-05-24T00:06:00+00:00 2024-05-24T00:04:02.661402391Z [2024-05-24T00:04:02.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:02:00+00:00 exited with status success for try_number 1 2024-05-24T00:04:02.661424996Z [2024-05-24T00:04:02.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:03:00+00:00 exited with status success for try_number 1 2024-05-24T00:04:02.666714033Z [2024-05-24T00:04:02.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:02:00+00:00, map_index=-1, run_start_date=2024-05-24 00:04:01.636301+00:00, run_end_date=2024-05-24 00:04:02.193361+00:00, run_duration=0.55706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:04:00.742546+00:00, queued_by_job_id=1, pid=6014 2024-05-24T00:04:02.666864279Z [2024-05-24T00:04:02.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:03:00+00:00, map_index=-1, run_start_date=2024-05-24 00:04:01.722403+00:00, run_end_date=2024-05-24 00:04:02.154162+00:00, run_duration=0.431759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:04:00.742546+00:00, queued_by_job_id=1, pid=6015 2024-05-24T00:04:06.283875053Z [2024-05-24T00:04:06.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:04:06.284552245Z [2024-05-24T00:04:06.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:03:00+00:00, run_id=scheduled__2024-05-24T00:03:00+00:00, run_start_date=2024-05-24 00:04:00.659189+00:00, run_end_date=2024-05-24 00:04:06.284067+00:00, run_duration=5.624878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:03:00+00:00, data_interval_end=2024-05-24 00:04:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:04:06.302627275Z [2024-05-24T00:04:06.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:04:00+00:00, run_after=2024-05-24T00:05:00+00:00 2024-05-24T00:04:06.311795520Z [2024-05-24T00:04:06.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:04:06.312690916Z [2024-05-24T00:04:06.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:03:00+00:00, run_id=scheduled__2024-05-24T00:03:00+00:00, run_start_date=2024-05-24 00:04:00.660248+00:00, run_end_date=2024-05-24 00:04:06.312100+00:00, run_duration=5.651852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:03:00+00:00, data_interval_end=2024-05-24 00:04:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:04:06.327318503Z [2024-05-24T00:04:06.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:04:00+00:00, run_after=2024-05-24T00:05:00+00:00 2024-05-24T00:04:06.368263674Z [2024-05-24T00:04:06.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:03:00+00:00 exited with status success for try_number 1 2024-05-24T00:04:06.368319796Z [2024-05-24T00:04:06.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:03:00+00:00 exited with status success for try_number 1 2024-05-24T00:04:06.378640900Z [2024-05-24T00:04:06.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:03:00+00:00, map_index=-1, run_start_date=2024-05-24 00:04:02.877407+00:00, run_end_date=2024-05-24 00:04:05.155851+00:00, run_duration=2.278444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:04:00.742546+00:00, queued_by_job_id=1, pid=6039 2024-05-24T00:04:06.379337322Z [2024-05-24T00:04:06.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:03:00+00:00, map_index=-1, run_start_date=2024-05-24 00:04:02.848155+00:00, run_end_date=2024-05-24 00:04:05.510277+00:00, run_duration=2.662122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:04:00.742546+00:00, queued_by_job_id=1, pid=6038 2024-05-24T00:05:00.579629103Z [2024-05-24T00:05:00.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:05:00+00:00, run_after=2024-05-24T00:06:00+00:00 2024-05-24T00:05:00.596642153Z [2024-05-24T00:05:00.596+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:05:00+00:00, run_after=2024-05-24T00:06:00+00:00 2024-05-24T00:05:00.615464930Z [2024-05-24T00:05:00.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:05:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:05:00.631990999Z [2024-05-24T00:05:00.631+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:05:00.791993286Z [2024-05-24T00:05:00.791+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:05:00.792059809Z 2024-05-24T00:05:00.792072541Z 2024-05-24T00:05:00.792078857Z 2024-05-24T00:05:00.792085026Z 2024-05-24T00:05:00.792547182Z [2024-05-24T00:05:00.792+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:05:00.792996165Z [2024-05-24T00:05:00.792+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:05:00.793440788Z [2024-05-24T00:05:00.793+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:05:00.793856134Z [2024-05-24T00:05:00.793+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:05:00.795132728Z [2024-05-24T00:05:00.794+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:05:00.795220483Z 2024-05-24T00:05:00.795230900Z 2024-05-24T00:05:00.795238407Z 2024-05-24T00:05:00.795245611Z 2024-05-24T00:05:00.801071930Z [2024-05-24T00:05:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:05:00.801520153Z [2024-05-24T00:05:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:05:00.802010348Z [2024-05-24T00:05:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:05:00.802319192Z [2024-05-24T00:05:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:05:00.802765948Z [2024-05-24T00:05:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:05:00.803172374Z [2024-05-24T00:05:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:05:00.803664646Z [2024-05-24T00:05:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:05:00.803889544Z [2024-05-24T00:05:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:05:01.229902789Z [2024-05-24T00:05:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:05:01.229960013Z [2024-05-24T00:05:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status queued for try_number 1 2024-05-24T00:05:01.229966385Z [2024-05-24T00:05:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status queued for try_number 1 2024-05-24T00:05:01.230012368Z [2024-05-24T00:05:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status queued for try_number 1 2024-05-24T00:05:01.252034620Z [2024-05-24T00:05:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c761220-4d24-48b5-b0ad-570e6dc905ee 2024-05-24T00:05:01.252072077Z [2024-05-24T00:05:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2921eb4-5486-4c2b-9f5a-5b59017ef2ed 2024-05-24T00:05:01.252144774Z [2024-05-24T00:05:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 736f94cd-d348-4c0b-9595-4dcde566a6a7 2024-05-24T00:05:01.252265507Z [2024-05-24T00:05:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c7d6226-5942-454f-aa18-70da92c08ca3 2024-05-24T00:05:02.441729269Z [2024-05-24T00:05:02.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:05:02.441996288Z [2024-05-24T00:05:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:04:00+00:00, run_id=scheduled__2024-05-24T00:04:00+00:00, run_start_date=2024-05-24 00:05:00.656793+00:00, run_end_date=2024-05-24 00:05:02.441679+00:00, run_duration=1.784886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:04:00+00:00, data_interval_end=2024-05-24 00:05:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:05:02.453468355Z [2024-05-24T00:05:02.453+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:05:00+00:00, run_after=2024-05-24T00:06:00+00:00 2024-05-24T00:05:02.493625894Z [2024-05-24T00:05:02.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status success for try_number 1 2024-05-24T00:05:02.499316823Z [2024-05-24T00:05:02.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:04:00+00:00, map_index=-1, run_start_date=2024-05-24 00:05:01.669420+00:00, run_end_date=2024-05-24 00:05:02.085915+00:00, run_duration=0.416495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:05:00.796809+00:00, queued_by_job_id=1, pid=6072 2024-05-24T00:05:03.603451177Z [2024-05-24T00:05:03.602+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:05:03.603520153Z 2024-05-24T00:05:03.603674448Z [2024-05-24T00:05:03.603+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:05:03.604466725Z [2024-05-24T00:05:03.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:05:03.604477753Z 2024-05-24T00:05:03.608098261Z [2024-05-24T00:05:03.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:05:03.608372681Z [2024-05-24T00:05:03.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:05:03.722495026Z [2024-05-24T00:05:03.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:05:03.722627855Z [2024-05-24T00:05:03.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:05:03.730157737Z [2024-05-24T00:05:03.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4244c7d3-ab3e-482c-b24f-0d02c7f4066d 2024-05-24T00:05:03.730186864Z [2024-05-24T00:05:03.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=-1, run_start_date=2024-05-24 00:05:03.084820+00:00, run_end_date=2024-05-24 00:05:03.488751+00:00, run_duration=0.403931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:05:00.796809+00:00, queued_by_job_id=1, pid=6097 2024-05-24T00:05:05.879086523Z [2024-05-24T00:05:05.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:05:05.879464908Z [2024-05-24T00:05:05.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:04:00+00:00, run_id=scheduled__2024-05-24T00:04:00+00:00, run_start_date=2024-05-24 00:05:00.659109+00:00, run_end_date=2024-05-24 00:05:05.878958+00:00, run_duration=5.219849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:04:00+00:00, data_interval_end=2024-05-24 00:05:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:05:05.893895644Z [2024-05-24T00:05:05.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:05:00+00:00, run_after=2024-05-24T00:06:00+00:00 2024-05-24T00:05:05.901950405Z [2024-05-24T00:05:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:05:05.902193734Z [2024-05-24T00:05:05.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:04:00+00:00, run_id=scheduled__2024-05-24T00:04:00+00:00, run_start_date=2024-05-24 00:05:00.661312+00:00, run_end_date=2024-05-24 00:05:05.901822+00:00, run_duration=5.24051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:04:00+00:00, data_interval_end=2024-05-24 00:05:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:05:05.912710154Z [2024-05-24T00:05:05.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:05:00+00:00, run_after=2024-05-24T00:06:00+00:00 2024-05-24T00:05:05.966481883Z [2024-05-24T00:05:05.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status success for try_number 1 2024-05-24T00:05:05.966769558Z [2024-05-24T00:05:05.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status success for try_number 1 2024-05-24T00:05:05.973617687Z [2024-05-24T00:05:05.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:04:00+00:00, map_index=-1, run_start_date=2024-05-24 00:05:02.864223+00:00, run_end_date=2024-05-24 00:05:04.473201+00:00, run_duration=1.608978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:05:00.796809+00:00, queued_by_job_id=1, pid=6091 2024-05-24T00:05:05.973965478Z [2024-05-24T00:05:05.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:04:00+00:00, map_index=-1, run_start_date=2024-05-24 00:05:03.230779+00:00, run_end_date=2024-05-24 00:05:04.546468+00:00, run_duration=1.315689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:05:00.796809+00:00, queued_by_job_id=1, pid=6103 2024-05-24T00:05:07.055059985Z [2024-05-24T00:05:07.054+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:05:07.055092823Z 2024-05-24T00:05:07.056029752Z [2024-05-24T00:05:07.055+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:05:07.058013033Z [2024-05-24T00:05:07.057+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:05:07.058074254Z 2024-05-24T00:05:07.063376499Z [2024-05-24T00:05:07.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:05:07.063927437Z [2024-05-24T00:05:07.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:05:07.134445508Z [2024-05-24T00:05:07.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:05:07.134853692Z [2024-05-24T00:05:07.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:05:07.143693709Z [2024-05-24T00:05:07.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to d174c6c8-6b00-43b6-8195-f1cf9c2b9e77 2024-05-24T00:05:07.144003784Z [2024-05-24T00:05:07.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=-1, run_start_date=2024-05-24 00:05:05.409871+00:00, run_end_date=2024-05-24 00:05:05.777855+00:00, run_duration=0.367984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:05:03.605025+00:00, queued_by_job_id=1, pid=6121 2024-05-24T00:05:09.888711436Z [2024-05-24T00:05:09.888+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:05:09.888737037Z 2024-05-24T00:05:09.888880652Z [2024-05-24T00:05:09.888+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:05:09.889453780Z [2024-05-24T00:05:09.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:05:09.889465496Z 2024-05-24T00:05:09.892264018Z [2024-05-24T00:05:09.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:05:09.892398023Z [2024-05-24T00:05:09.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:05:09.950334359Z [2024-05-24T00:05:09.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status queued for try_number 1 2024-05-24T00:05:09.950382632Z [2024-05-24T00:05:09.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:05:09.960871590Z [2024-05-24T00:05:09.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 575ec2c7-2f21-4777-b0bf-180081f3be04 2024-05-24T00:05:09.961209148Z [2024-05-24T00:05:09.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=0, run_start_date=2024-05-24 00:05:08.761697+00:00, run_end_date=2024-05-24 00:05:09.121971+00:00, run_duration=0.360274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:05:07.059542+00:00, queued_by_job_id=1, pid=6129 2024-05-24T00:05:12.230438494Z [2024-05-24T00:05:12.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:05:12.231058576Z [2024-05-24T00:05:12.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:00:00+00:00, run_id=scheduled__2024-05-24T00:00:00+00:00, run_start_date=2024-05-24 00:05:00.654073+00:00, run_end_date=2024-05-24 00:05:12.230575+00:00, run_duration=11.576502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:00:00+00:00, data_interval_end=2024-05-24 00:05:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:05:12.239185482Z [2024-05-24T00:05:12.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:05:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:05:12.285692973Z [2024-05-24T00:05:12.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:00:00+00:00 exited with status success for try_number 1 2024-05-24T00:05:12.294012452Z [2024-05-24T00:05:12.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:00:00+00:00, map_index=-1, run_start_date=2024-05-24 00:05:11.547116+00:00, run_end_date=2024-05-24 00:05:11.962211+00:00, run_duration=0.415095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:05:09.889823+00:00, queued_by_job_id=1, pid=6137 2024-05-24T00:06:00.743703545Z [2024-05-24T00:06:00.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:06:00+00:00, run_after=2024-05-24T00:07:00+00:00 2024-05-24T00:06:00.758761687Z [2024-05-24T00:06:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:06:00+00:00, run_after=2024-05-24T00:07:00+00:00 2024-05-24T00:06:00.766878490Z [2024-05-24T00:06:00.766+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:06:00.775860972Z [2024-05-24T00:06:00.775+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:06:00.879641664Z [2024-05-24T00:06:00.878+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:06:00.879690146Z 2024-05-24T00:06:00.879701166Z 2024-05-24T00:06:00.879709685Z 2024-05-24T00:06:00.879719274Z 2024-05-24T00:06:00.879881745Z [2024-05-24T00:06:00.879+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:06:00.880450542Z [2024-05-24T00:06:00.880+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:06:00.880889497Z [2024-05-24T00:06:00.880+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:06:00.881551244Z [2024-05-24T00:06:00.881+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:06:00.882996768Z [2024-05-24T00:06:00.882+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:06:00.883005831Z 2024-05-24T00:06:00.883009400Z 2024-05-24T00:06:00.883012964Z 2024-05-24T00:06:00.883016327Z 2024-05-24T00:06:00.890535841Z [2024-05-24T00:06:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:06:00.890995249Z [2024-05-24T00:06:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:06:00.891991760Z [2024-05-24T00:06:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:06:00.892322114Z [2024-05-24T00:06:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:06:00.892781250Z [2024-05-24T00:06:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:06:00.893073486Z [2024-05-24T00:06:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:06:00.893603692Z [2024-05-24T00:06:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:06:00.893812541Z [2024-05-24T00:06:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:06:01.290312434Z [2024-05-24T00:06:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status queued for try_number 1 2024-05-24T00:06:01.290538305Z [2024-05-24T00:06:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status queued for try_number 1 2024-05-24T00:06:01.290662888Z [2024-05-24T00:06:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status queued for try_number 1 2024-05-24T00:06:01.290773655Z [2024-05-24T00:06:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status queued for try_number 1 2024-05-24T00:06:01.301037340Z [2024-05-24T00:06:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2960ea2-bc26-4c7e-b69a-2ac0b0d73bea 2024-05-24T00:06:01.301197891Z [2024-05-24T00:06:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3cc13db-3930-491d-a298-cb390fa85d9c 2024-05-24T00:06:01.301488749Z [2024-05-24T00:06:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 376f91e1-b2ab-40f1-a69c-20e2cc6eccc9 2024-05-24T00:06:01.301686036Z [2024-05-24T00:06:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c382de0-8564-44e0-8a50-ba59a7aee4a2 2024-05-24T00:06:02.486564250Z [2024-05-24T00:06:02.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:06:02.487120209Z [2024-05-24T00:06:02.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:04:00+00:00, run_id=scheduled__2024-05-24T00:04:00+00:00, run_start_date=2024-05-24 00:06:00.789811+00:00, run_end_date=2024-05-24 00:06:02.486602+00:00, run_duration=1.696791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:04:00+00:00, data_interval_end=2024-05-24 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:06:02.496564724Z [2024-05-24T00:06:02.496+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:06:00+00:00, run_after=2024-05-24T00:08:00+00:00 2024-05-24T00:06:02.513450116Z [2024-05-24T00:06:02.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:06:02.513734590Z [2024-05-24T00:06:02.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:05:00+00:00, run_id=scheduled__2024-05-24T00:05:00+00:00, run_start_date=2024-05-24 00:06:00.791254+00:00, run_end_date=2024-05-24 00:06:02.513436+00:00, run_duration=1.722182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:05:00+00:00, data_interval_end=2024-05-24 00:06:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:06:02.526055041Z [2024-05-24T00:06:02.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:06:00+00:00, run_after=2024-05-24T00:07:00+00:00 2024-05-24T00:06:02.591585105Z [2024-05-24T00:06:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:04:00+00:00 exited with status success for try_number 1 2024-05-24T00:06:02.591939474Z [2024-05-24T00:06:02.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status success for try_number 1 2024-05-24T00:06:02.605004014Z [2024-05-24T00:06:02.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:04:00+00:00, map_index=-1, run_start_date=2024-05-24 00:06:01.768197+00:00, run_end_date=2024-05-24 00:06:02.206045+00:00, run_duration=0.437848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:06:00.885003+00:00, queued_by_job_id=1, pid=6160 2024-05-24T00:06:02.605987272Z [2024-05-24T00:06:02.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:05:00+00:00, map_index=-1, run_start_date=2024-05-24 00:06:01.877955+00:00, run_end_date=2024-05-24 00:06:02.261553+00:00, run_duration=0.383598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:06:00.885003+00:00, queued_by_job_id=1, pid=6161 2024-05-24T00:06:05.190013001Z [2024-05-24T00:06:05.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:06:05.190407025Z [2024-05-24T00:06:05.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:05:00+00:00, run_id=scheduled__2024-05-24T00:05:00+00:00, run_start_date=2024-05-24 00:06:00.792459+00:00, run_end_date=2024-05-24 00:06:05.190002+00:00, run_duration=4.397543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:05:00+00:00, data_interval_end=2024-05-24 00:06:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:06:05.208970798Z [2024-05-24T00:06:05.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:06:00+00:00, run_after=2024-05-24T00:07:00+00:00 2024-05-24T00:06:05.263680852Z [2024-05-24T00:06:05.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status success for try_number 1 2024-05-24T00:06:05.274291331Z [2024-05-24T00:06:05.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:05:00+00:00, map_index=-1, run_start_date=2024-05-24 00:06:03.135909+00:00, run_end_date=2024-05-24 00:06:04.658677+00:00, run_duration=1.522768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:06:00.885003+00:00, queued_by_job_id=1, pid=6185 2024-05-24T00:06:07.426985257Z [2024-05-24T00:06:07.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:06:07.427425107Z [2024-05-24T00:06:07.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:05:00+00:00, run_id=scheduled__2024-05-24T00:05:00+00:00, run_start_date=2024-05-24 00:06:00.793629+00:00, run_end_date=2024-05-24 00:06:07.427048+00:00, run_duration=6.633419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:05:00+00:00, data_interval_end=2024-05-24 00:06:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:06:07.436067660Z [2024-05-24T00:06:07.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:06:00+00:00, run_after=2024-05-24T00:07:00+00:00 2024-05-24T00:06:07.470179825Z [2024-05-24T00:06:07.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status success for try_number 1 2024-05-24T00:06:07.478788531Z [2024-05-24T00:06:07.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:05:00+00:00, map_index=-1, run_start_date=2024-05-24 00:06:03.044857+00:00, run_end_date=2024-05-24 00:06:06.228031+00:00, run_duration=3.183174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:06:00.885003+00:00, queued_by_job_id=1, pid=6184 2024-05-24T00:06:40.050254708Z [2024-05-24T00:06:40.049+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:07:00.374676824Z [2024-05-24T00:07:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:07:00+00:00, run_after=2024-05-24T00:08:00+00:00 2024-05-24T00:07:00.381215049Z [2024-05-24T00:07:00.380+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:07:00.394694779Z [2024-05-24T00:07:00.393+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:07:00+00:00, run_after=2024-05-24T00:08:00+00:00 2024-05-24T00:07:00.460395437Z [2024-05-24T00:07:00.460+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:07:00.460430196Z 2024-05-24T00:07:00.460435462Z 2024-05-24T00:07:00.460440789Z 2024-05-24T00:07:00.460455588Z [2024-05-24T00:07:00.460+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:07:00.460578405Z [2024-05-24T00:07:00.460+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:07:00.460663004Z [2024-05-24T00:07:00.460+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:07:00.461666550Z [2024-05-24T00:07:00.461+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:07:00.461680801Z 2024-05-24T00:07:00.461685957Z 2024-05-24T00:07:00.461690370Z 2024-05-24T00:07:00.482894498Z [2024-05-24T00:07:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:07:00.483860004Z [2024-05-24T00:07:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:07:00.484614378Z [2024-05-24T00:07:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:07:00.485152996Z [2024-05-24T00:07:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:07:00.485948761Z [2024-05-24T00:07:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:07:00.486260631Z [2024-05-24T00:07:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:07:00.732642969Z [2024-05-24T00:07:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status queued for try_number 1 2024-05-24T00:07:00.732757585Z [2024-05-24T00:07:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status queued for try_number 1 2024-05-24T00:07:00.732839875Z [2024-05-24T00:07:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status queued for try_number 1 2024-05-24T00:07:00.750536523Z [2024-05-24T00:07:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 812474b2-bae4-48c6-8fcd-336f3484848c 2024-05-24T00:07:00.750796888Z [2024-05-24T00:07:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99d19095-1bcb-4de3-8254-89b8a804ea89 2024-05-24T00:07:00.751022509Z [2024-05-24T00:07:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to c68f40cb-c277-4a0e-9629-b14492d25d2b 2024-05-24T00:07:01.943582168Z [2024-05-24T00:07:01.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:07:01.943894842Z [2024-05-24T00:07:01.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:06:00+00:00, run_id=scheduled__2024-05-24T00:06:00+00:00, run_start_date=2024-05-24 00:07:00.409353+00:00, run_end_date=2024-05-24 00:07:01.943415+00:00, run_duration=1.534062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:06:00+00:00, data_interval_end=2024-05-24 00:07:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:07:01.956124234Z [2024-05-24T00:07:01.955+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:07:00+00:00, run_after=2024-05-24T00:08:00+00:00 2024-05-24T00:07:02.300591052Z [2024-05-24T00:07:02.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status success for try_number 1 2024-05-24T00:07:02.306259534Z [2024-05-24T00:07:02.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:06:00+00:00, map_index=-1, run_start_date=2024-05-24 00:07:01.440005+00:00, run_end_date=2024-05-24 00:07:01.891637+00:00, run_duration=0.451632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:07:00.475793+00:00, queued_by_job_id=1, pid=6217 2024-05-24T00:07:04.467921133Z [2024-05-24T00:07:04.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:07:04.468013680Z [2024-05-24T00:07:04.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:06:00+00:00, run_id=scheduled__2024-05-24T00:06:00+00:00, run_start_date=2024-05-24 00:07:00.411189+00:00, run_end_date=2024-05-24 00:07:04.467622+00:00, run_duration=4.056433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:06:00+00:00, data_interval_end=2024-05-24 00:07:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:07:04.476952490Z [2024-05-24T00:07:04.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:07:00+00:00, run_after=2024-05-24T00:08:00+00:00 2024-05-24T00:07:04.484237405Z [2024-05-24T00:07:04.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:07:04.484276242Z [2024-05-24T00:07:04.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:06:00+00:00, run_id=scheduled__2024-05-24T00:06:00+00:00, run_start_date=2024-05-24 00:07:00.412282+00:00, run_end_date=2024-05-24 00:07:04.483833+00:00, run_duration=4.071551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:06:00+00:00, data_interval_end=2024-05-24 00:07:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:07:04.493316330Z [2024-05-24T00:07:04.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:07:00+00:00, run_after=2024-05-24T00:08:00+00:00 2024-05-24T00:07:04.534854388Z [2024-05-24T00:07:04.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status success for try_number 1 2024-05-24T00:07:04.534928286Z [2024-05-24T00:07:04.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status success for try_number 1 2024-05-24T00:07:04.551546192Z [2024-05-24T00:07:04.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:06:00+00:00, map_index=-1, run_start_date=2024-05-24 00:07:02.359606+00:00, run_end_date=2024-05-24 00:07:04.052620+00:00, run_duration=1.693014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:07:00.475793+00:00, queued_by_job_id=1, pid=6236 2024-05-24T00:07:04.552517091Z [2024-05-24T00:07:04.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:06:00+00:00, map_index=-1, run_start_date=2024-05-24 00:07:02.329937+00:00, run_end_date=2024-05-24 00:07:03.627857+00:00, run_duration=1.29792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:07:00.475793+00:00, queued_by_job_id=1, pid=6235 2024-05-24T00:08:00.324209560Z [2024-05-24T00:08:00.323+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:08:00.330889268Z [2024-05-24T00:08:00.330+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:08:00.342260485Z [2024-05-24T00:08:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:08:00+00:00, run_after=2024-05-24T00:09:00+00:00 2024-05-24T00:08:00.355124483Z [2024-05-24T00:08:00.354+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:08:00+00:00, run_after=2024-05-24T00:09:00+00:00 2024-05-24T00:08:00.453884282Z [2024-05-24T00:08:00.453+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:08:00.453909913Z 2024-05-24T00:08:00.453915690Z 2024-05-24T00:08:00.453918876Z 2024-05-24T00:08:00.453921879Z 2024-05-24T00:08:00.453963603Z [2024-05-24T00:08:00.453+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:08:00.454011106Z [2024-05-24T00:08:00.453+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:08:00.454098728Z [2024-05-24T00:08:00.454+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:08:00.454160846Z [2024-05-24T00:08:00.454+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:08:00.454719345Z [2024-05-24T00:08:00.454+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:08:00.454726332Z 2024-05-24T00:08:00.454729571Z 2024-05-24T00:08:00.454732800Z 2024-05-24T00:08:00.454735894Z 2024-05-24T00:08:00.458082834Z [2024-05-24T00:08:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:08:00.458184704Z [2024-05-24T00:08:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:08:00.458369488Z [2024-05-24T00:08:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:08:00.458455345Z [2024-05-24T00:08:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:08:00.458676069Z [2024-05-24T00:08:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:08:00.458756595Z [2024-05-24T00:08:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:08:00.458923039Z [2024-05-24T00:08:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:08:00.458996666Z [2024-05-24T00:08:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:08:00.977064640Z [2024-05-24T00:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status queued for try_number 1 2024-05-24T00:08:00.979615539Z [2024-05-24T00:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:07:00+00:00 exited with status queued for try_number 1 2024-05-24T00:08:00.979760351Z [2024-05-24T00:08:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:07:00+00:00 exited with status queued for try_number 1 2024-05-24T00:08:00.979883738Z [2024-05-24T00:08:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:07:00+00:00 exited with status queued for try_number 1 2024-05-24T00:08:01.004056838Z [2024-05-24T00:08:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to 528ae051-d955-4bfb-af08-addae679e15e 2024-05-24T00:08:01.006839621Z [2024-05-24T00:08:01.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to c84b4111-f1c4-4b3a-a109-dd419cfdb76c 2024-05-24T00:08:01.007120127Z [2024-05-24T00:08:01.006+0000] {scheduler_job.py:635} INFO - Setting external_id for to b06ab1fb-dd6d-41e4-b56c-d7e56b83b483 2024-05-24T00:08:01.007405654Z [2024-05-24T00:08:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2d5555b-2c8b-42c6-bb0e-55d5f8bfe21b 2024-05-24T00:08:02.269477981Z [2024-05-24T00:08:02.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:08:02.270040162Z [2024-05-24T00:08:02.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:06:00+00:00, run_id=scheduled__2024-05-24T00:06:00+00:00, run_start_date=2024-05-24 00:08:00.369317+00:00, run_end_date=2024-05-24 00:08:02.269601+00:00, run_duration=1.900284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:06:00+00:00, data_interval_end=2024-05-24 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:08:02.278651891Z [2024-05-24T00:08:02.278+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:08:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:08:02.299495941Z [2024-05-24T00:08:02.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:08:02.299814371Z [2024-05-24T00:08:02.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:07:00+00:00, run_id=scheduled__2024-05-24T00:07:00+00:00, run_start_date=2024-05-24 00:08:00.371400+00:00, run_end_date=2024-05-24 00:08:02.299518+00:00, run_duration=1.928118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:07:00+00:00, data_interval_end=2024-05-24 00:08:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:08:02.313567780Z [2024-05-24T00:08:02.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:08:00+00:00, run_after=2024-05-24T00:09:00+00:00 2024-05-24T00:08:02.350332079Z [2024-05-24T00:08:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:06:00+00:00 exited with status success for try_number 1 2024-05-24T00:08:02.350494185Z [2024-05-24T00:08:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:07:00+00:00 exited with status success for try_number 1 2024-05-24T00:08:02.356804123Z [2024-05-24T00:08:02.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:07:00+00:00, map_index=-1, run_start_date=2024-05-24 00:08:01.475816+00:00, run_end_date=2024-05-24 00:08:02.125290+00:00, run_duration=0.649474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:08:00.455536+00:00, queued_by_job_id=1, pid=6270 2024-05-24T00:08:02.357081904Z [2024-05-24T00:08:02.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:06:00+00:00, map_index=-1, run_start_date=2024-05-24 00:08:01.514370+00:00, run_end_date=2024-05-24 00:08:01.979036+00:00, run_duration=0.464666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:08:00.455536+00:00, queued_by_job_id=1, pid=6271 2024-05-24T00:08:04.379156282Z [2024-05-24T00:08:04.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:08:04.379864548Z [2024-05-24T00:08:04.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:07:00+00:00, run_id=scheduled__2024-05-24T00:07:00+00:00, run_start_date=2024-05-24 00:08:00.372930+00:00, run_end_date=2024-05-24 00:08:04.378981+00:00, run_duration=4.006051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:07:00+00:00, data_interval_end=2024-05-24 00:08:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:08:04.394302796Z [2024-05-24T00:08:04.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:08:00+00:00, run_after=2024-05-24T00:09:00+00:00 2024-05-24T00:08:04.489511840Z [2024-05-24T00:08:04.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:07:00+00:00 exited with status success for try_number 1 2024-05-24T00:08:04.496839390Z [2024-05-24T00:08:04.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:07:00+00:00, map_index=-1, run_start_date=2024-05-24 00:08:02.705361+00:00, run_end_date=2024-05-24 00:08:04.113788+00:00, run_duration=1.408427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:08:00.455536+00:00, queued_by_job_id=1, pid=6294 2024-05-24T00:08:05.548388526Z [2024-05-24T00:08:05.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:08:05.549212086Z [2024-05-24T00:08:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:07:00+00:00, run_id=scheduled__2024-05-24T00:07:00+00:00, run_start_date=2024-05-24 00:08:00.374259+00:00, run_end_date=2024-05-24 00:08:05.548551+00:00, run_duration=5.174292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:07:00+00:00, data_interval_end=2024-05-24 00:08:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:08:05.581560044Z [2024-05-24T00:08:05.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:08:00+00:00, run_after=2024-05-24T00:09:00+00:00 2024-05-24T00:08:05.641835164Z [2024-05-24T00:08:05.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:07:00+00:00 exited with status success for try_number 1 2024-05-24T00:08:05.652169954Z [2024-05-24T00:08:05.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:07:00+00:00, map_index=-1, run_start_date=2024-05-24 00:08:02.921909+00:00, run_end_date=2024-05-24 00:08:05.185325+00:00, run_duration=2.263416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:08:00.455536+00:00, queued_by_job_id=1, pid=6295 2024-05-24T00:09:00.251069260Z [2024-05-24T00:09:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:09:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:09:00.268293515Z [2024-05-24T00:09:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:09:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:09:00.279371947Z [2024-05-24T00:09:00.279+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:09:00.337420318Z [2024-05-24T00:09:00.335+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:09:00.337453213Z 2024-05-24T00:09:00.337456911Z 2024-05-24T00:09:00.337460138Z 2024-05-24T00:09:00.337463250Z [2024-05-24T00:09:00.335+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:09:00.337466552Z [2024-05-24T00:09:00.335+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:09:00.337469789Z [2024-05-24T00:09:00.335+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:09:00.337474336Z [2024-05-24T00:09:00.336+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:09:00.337477499Z 2024-05-24T00:09:00.337480689Z 2024-05-24T00:09:00.337483620Z 2024-05-24T00:09:00.341192068Z [2024-05-24T00:09:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:09:00.341208880Z [2024-05-24T00:09:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:09:00.341212325Z [2024-05-24T00:09:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:09:00.341215771Z [2024-05-24T00:09:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:09:00.341241116Z [2024-05-24T00:09:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:09:00.341244232Z [2024-05-24T00:09:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:09:00.607609631Z [2024-05-24T00:09:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status queued for try_number 1 2024-05-24T00:09:00.607632301Z [2024-05-24T00:09:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status queued for try_number 1 2024-05-24T00:09:00.607635885Z [2024-05-24T00:09:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status queued for try_number 1 2024-05-24T00:09:00.615225474Z [2024-05-24T00:09:00.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20333fe3-7b97-4c4e-9bac-4727c453f2cd 2024-05-24T00:09:00.615559921Z [2024-05-24T00:09:00.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1bb4bb6-7879-49cd-b1d4-143b8739f20b 2024-05-24T00:09:00.615767598Z [2024-05-24T00:09:00.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbac4501-612f-46f4-9f74-8b83968513e5 2024-05-24T00:09:01.764509413Z [2024-05-24T00:09:01.764+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:09:01.765253094Z [2024-05-24T00:09:01.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:08:00+00:00, run_id=scheduled__2024-05-24T00:08:00+00:00, run_start_date=2024-05-24 00:09:00.288910+00:00, run_end_date=2024-05-24 00:09:01.764763+00:00, run_duration=1.475853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:08:00+00:00, data_interval_end=2024-05-24 00:09:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:09:01.780982341Z [2024-05-24T00:09:01.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:09:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:09:01.820679825Z [2024-05-24T00:09:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status success for try_number 1 2024-05-24T00:09:01.843101816Z [2024-05-24T00:09:01.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:08:00+00:00, map_index=-1, run_start_date=2024-05-24 00:09:01.215539+00:00, run_end_date=2024-05-24 00:09:01.642549+00:00, run_duration=0.42701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:09:00.336825+00:00, queued_by_job_id=1, pid=6327 2024-05-24T00:09:04.002467597Z [2024-05-24T00:09:04.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:09:04.002877783Z [2024-05-24T00:09:04.002+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:08:00+00:00, run_id=scheduled__2024-05-24T00:08:00+00:00, run_start_date=2024-05-24 00:09:00.290371+00:00, run_end_date=2024-05-24 00:09:04.002359+00:00, run_duration=3.711988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:08:00+00:00, data_interval_end=2024-05-24 00:09:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:09:04.011758727Z [2024-05-24T00:09:04.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:09:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:09:04.018477485Z [2024-05-24T00:09:04.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:09:04.018834653Z [2024-05-24T00:09:04.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:08:00+00:00, run_id=scheduled__2024-05-24T00:08:00+00:00, run_start_date=2024-05-24 00:09:00.291524+00:00, run_end_date=2024-05-24 00:09:04.018326+00:00, run_duration=3.726802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:08:00+00:00, data_interval_end=2024-05-24 00:09:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:09:04.027644530Z [2024-05-24T00:09:04.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:09:00+00:00, run_after=2024-05-24T00:10:00+00:00 2024-05-24T00:09:04.062074253Z [2024-05-24T00:09:04.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status success for try_number 1 2024-05-24T00:09:04.070599404Z [2024-05-24T00:09:04.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:08:00+00:00, map_index=-1, run_start_date=2024-05-24 00:09:02.190860+00:00, run_end_date=2024-05-24 00:09:03.506114+00:00, run_duration=1.315254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:09:00.336825+00:00, queued_by_job_id=1, pid=6345 2024-05-24T00:09:04.307156113Z [2024-05-24T00:09:04.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status success for try_number 1 2024-05-24T00:09:04.328006291Z [2024-05-24T00:09:04.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:08:00+00:00, map_index=-1, run_start_date=2024-05-24 00:09:02.256363+00:00, run_end_date=2024-05-24 00:09:03.906443+00:00, run_duration=1.65008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:09:00.336825+00:00, queued_by_job_id=1, pid=6346 2024-05-24T00:10:00.088692917Z [2024-05-24T00:10:00.088+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:10:00.101602289Z [2024-05-24T00:10:00.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:15:00+00:00 2024-05-24T00:10:00.109343872Z [2024-05-24T00:10:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:10:00.120549218Z [2024-05-24T00:10:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:11:00+00:00 2024-05-24T00:10:00.133677159Z [2024-05-24T00:10:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:11:00+00:00 2024-05-24T00:10:00.214194195Z [2024-05-24T00:10:00.213+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T00:10:00.214216105Z 2024-05-24T00:10:00.214219560Z 2024-05-24T00:10:00.214226540Z 2024-05-24T00:10:00.214229622Z 2024-05-24T00:10:00.214232601Z 2024-05-24T00:10:00.214465350Z [2024-05-24T00:10:00.214+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:10:00.214668250Z [2024-05-24T00:10:00.214+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:10:00.214836752Z [2024-05-24T00:10:00.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:10:00.214993961Z [2024-05-24T00:10:00.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:10:00.215180140Z [2024-05-24T00:10:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:10:00.215845819Z [2024-05-24T00:10:00.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:10:00.215872208Z 2024-05-24T00:10:00.215876033Z 2024-05-24T00:10:00.215879356Z 2024-05-24T00:10:00.215882503Z 2024-05-24T00:10:00.215885631Z 2024-05-24T00:10:00.220402728Z [2024-05-24T00:10:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:10:00.220747107Z [2024-05-24T00:10:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:10:00.221053715Z [2024-05-24T00:10:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:10:00.221254055Z [2024-05-24T00:10:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:10:00.221474666Z [2024-05-24T00:10:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:10:00.221626940Z [2024-05-24T00:10:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:10:00.221937109Z [2024-05-24T00:10:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:10:00.222119661Z [2024-05-24T00:10:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:10:00.222299759Z [2024-05-24T00:10:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:10:00.222485583Z [2024-05-24T00:10:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:10:00.711636488Z [2024-05-24T00:10:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:00.711750653Z [2024-05-24T00:10:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:00.711888356Z [2024-05-24T00:10:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:09:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:00.712017743Z [2024-05-24T00:10:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:09:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:00.712152532Z [2024-05-24T00:10:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:09:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:00.735161893Z [2024-05-24T00:10:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1db4b89-3030-4772-8b62-49fa85ccca94 2024-05-24T00:10:00.735229622Z [2024-05-24T00:10:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed25c5b8-96e1-4723-9e23-9903903d4ae7 2024-05-24T00:10:00.735342215Z [2024-05-24T00:10:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70a9645a-5fea-40f7-9bcc-2adca2e24f07 2024-05-24T00:10:00.735571274Z [2024-05-24T00:10:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a0b41c4-b550-423e-b2aa-7c3884f4216a 2024-05-24T00:10:00.735720722Z [2024-05-24T00:10:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae92777b-3484-4421-9676-d6657d729079 2024-05-24T00:10:03.348125211Z [2024-05-24T00:10:03.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:10:03.348354600Z [2024-05-24T00:10:03.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:09:00+00:00, run_id=scheduled__2024-05-24T00:09:00+00:00, run_start_date=2024-05-24 00:10:00.146750+00:00, run_end_date=2024-05-24 00:10:03.348040+00:00, run_duration=3.20129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:09:00+00:00, data_interval_end=2024-05-24 00:10:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:10:03.365101695Z [2024-05-24T00:10:03.364+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:11:00+00:00 2024-05-24T00:10:03.399839586Z [2024-05-24T00:10:03.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:10:03.399982737Z [2024-05-24T00:10:03.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:08:00+00:00, run_id=scheduled__2024-05-24T00:08:00+00:00, run_start_date=2024-05-24 00:10:00.145758+00:00, run_end_date=2024-05-24 00:10:03.399749+00:00, run_duration=3.253991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:08:00+00:00, data_interval_end=2024-05-24 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:10:03.414256256Z [2024-05-24T00:10:03.413+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:12:00+00:00 2024-05-24T00:10:03.490456073Z [2024-05-24T00:10:03.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:09:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:03.498222731Z [2024-05-24T00:10:03.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:09:00+00:00, map_index=-1, run_start_date=2024-05-24 00:10:01.697706+00:00, run_end_date=2024-05-24 00:10:02.302552+00:00, run_duration=0.604846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:00.216909+00:00, queued_by_job_id=1, pid=6380 2024-05-24T00:10:04.594336132Z [2024-05-24T00:10:04.593+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:10:04.594378295Z 2024-05-24T00:10:04.594387129Z [2024-05-24T00:10:04.594+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:10:04.596461981Z [2024-05-24T00:10:04.596+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:10:04.596499223Z 2024-05-24T00:10:04.599476373Z [2024-05-24T00:10:04.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:10:04.599538669Z [2024-05-24T00:10:04.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:10:04.657684004Z [2024-05-24T00:10:04.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:04.657716810Z [2024-05-24T00:10:04.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:04.657741651Z [2024-05-24T00:10:04.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:08:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:04.663857498Z [2024-05-24T00:10:04.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:05:00+00:00, map_index=-1, run_start_date=2024-05-24 00:10:03.222191+00:00, run_end_date=2024-05-24 00:10:03.745919+00:00, run_duration=0.523728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:00.216909+00:00, queued_by_job_id=1, pid=6401 2024-05-24T00:10:04.663929497Z [2024-05-24T00:10:04.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b8bda9b-ffda-4c42-9ad2-65bef8091352 2024-05-24T00:10:04.664088938Z [2024-05-24T00:10:04.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:08:00+00:00, map_index=-1, run_start_date=2024-05-24 00:10:02.654301+00:00, run_end_date=2024-05-24 00:10:03.321635+00:00, run_duration=0.667334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:00.216909+00:00, queued_by_job_id=1, pid=6388 2024-05-24T00:10:04.728367207Z [2024-05-24T00:10:04.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:10:04.728714706Z [2024-05-24T00:10:04.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:09:00+00:00, run_id=scheduled__2024-05-24T00:09:00+00:00, run_start_date=2024-05-24 00:10:00.147818+00:00, run_end_date=2024-05-24 00:10:04.728266+00:00, run_duration=4.580448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:09:00+00:00, data_interval_end=2024-05-24 00:10:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:10:04.737344657Z [2024-05-24T00:10:04.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:11:00+00:00 2024-05-24T00:10:05.910377577Z [2024-05-24T00:10:05.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:09:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:05.915385420Z [2024-05-24T00:10:05.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:09:00+00:00, map_index=-1, run_start_date=2024-05-24 00:10:03.164443+00:00, run_end_date=2024-05-24 00:10:04.662003+00:00, run_duration=1.49756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:00.216909+00:00, queued_by_job_id=1, pid=6400 2024-05-24T00:10:06.979192939Z [2024-05-24T00:10:06.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:10:06.979645439Z [2024-05-24T00:10:06.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:09:00+00:00, run_id=scheduled__2024-05-24T00:09:00+00:00, run_start_date=2024-05-24 00:10:00.148774+00:00, run_end_date=2024-05-24 00:10:06.979043+00:00, run_duration=6.830269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:09:00+00:00, data_interval_end=2024-05-24 00:10:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:10:06.987857585Z [2024-05-24T00:10:06.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:11:00+00:00 2024-05-24T00:10:07.016905154Z [2024-05-24T00:10:07.016+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:10:07.016929516Z 2024-05-24T00:10:07.016933273Z [2024-05-24T00:10:07.016+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:10:07.017536626Z [2024-05-24T00:10:07.017+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:10:07.017548196Z 2024-05-24T00:10:07.019662771Z [2024-05-24T00:10:07.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:10:07.019905881Z [2024-05-24T00:10:07.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:10:07.080942140Z [2024-05-24T00:10:07.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:07.081345872Z [2024-05-24T00:10:07.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:09:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:07.081715140Z [2024-05-24T00:10:07.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:07.090454036Z [2024-05-24T00:10:07.090+0000] {scheduler_job.py:635} INFO - Setting external_id for to db0d467d-5a6f-4705-bc1a-326b358a82ab 2024-05-24T00:10:07.091568871Z [2024-05-24T00:10:07.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:09:00+00:00, map_index=-1, run_start_date=2024-05-24 00:10:04.268030+00:00, run_end_date=2024-05-24 00:10:06.010986+00:00, run_duration=1.742956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:00.216909+00:00, queued_by_job_id=1, pid=6422 2024-05-24T00:10:07.092195070Z [2024-05-24T00:10:07.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:05:00+00:00, map_index=-1, run_start_date=2024-05-24 00:10:06.217759+00:00, run_end_date=2024-05-24 00:10:06.586134+00:00, run_duration=0.368375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:04.596839+00:00, queued_by_job_id=1, pid=6435 2024-05-24T00:10:09.399093136Z [2024-05-24T00:10:09.398+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:10:09.399131565Z 2024-05-24T00:10:09.400121743Z [2024-05-24T00:10:09.399+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:10:09.405246788Z [2024-05-24T00:10:09.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:10:09.405275478Z 2024-05-24T00:10:09.414598677Z [2024-05-24T00:10:09.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:10:09.415522195Z [2024-05-24T00:10:09.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:10:09.515364337Z [2024-05-24T00:10:09.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status queued for try_number 1 2024-05-24T00:10:09.515420947Z [2024-05-24T00:10:09.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:09.521739617Z [2024-05-24T00:10:09.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 449ae7aa-9338-421f-bb2e-27ae26f1cc8f 2024-05-24T00:10:09.526843279Z [2024-05-24T00:10:09.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:05:00+00:00, map_index=0, run_start_date=2024-05-24 00:10:08.734770+00:00, run_end_date=2024-05-24 00:10:09.285666+00:00, run_duration=0.550896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:07.017895+00:00, queued_by_job_id=1, pid=6443 2024-05-24T00:10:12.070845633Z [2024-05-24T00:10:12.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:10:12.071142557Z [2024-05-24T00:10:12.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:05:00+00:00, run_id=scheduled__2024-05-24T00:05:00+00:00, run_start_date=2024-05-24 00:10:00.144152+00:00, run_end_date=2024-05-24 00:10:12.070804+00:00, run_duration=11.926652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:05:00+00:00, data_interval_end=2024-05-24 00:10:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:10:12.077354388Z [2024-05-24T00:10:12.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:10:00+00:00, run_after=2024-05-24T00:15:00+00:00 2024-05-24T00:10:12.122856436Z [2024-05-24T00:10:12.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:05:00+00:00 exited with status success for try_number 1 2024-05-24T00:10:12.129647248Z [2024-05-24T00:10:12.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:05:00+00:00, map_index=-1, run_start_date=2024-05-24 00:10:11.069021+00:00, run_end_date=2024-05-24 00:10:11.398770+00:00, run_duration=0.329749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:10:09.407166+00:00, queued_by_job_id=1, pid=6451 2024-05-24T00:11:00.700694425Z [2024-05-24T00:11:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:11:00+00:00, run_after=2024-05-24T00:12:00+00:00 2024-05-24T00:11:00.715414254Z [2024-05-24T00:11:00.714+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:11:00.740292328Z [2024-05-24T00:11:00.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:11:00+00:00, run_after=2024-05-24T00:12:00+00:00 2024-05-24T00:11:00.834379235Z [2024-05-24T00:11:00.833+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:11:00.834470174Z 2024-05-24T00:11:00.834482454Z 2024-05-24T00:11:00.834491452Z 2024-05-24T00:11:00.834919790Z [2024-05-24T00:11:00.834+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:11:00.835198259Z [2024-05-24T00:11:00.834+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:11:00.835207414Z [2024-05-24T00:11:00.835+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:11:00.835853123Z [2024-05-24T00:11:00.835+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:11:00.835864199Z 2024-05-24T00:11:00.835881051Z 2024-05-24T00:11:00.835884293Z 2024-05-24T00:11:00.839070442Z [2024-05-24T00:11:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:11:00.839557289Z [2024-05-24T00:11:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:11:00.839910833Z [2024-05-24T00:11:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:11:00.840107237Z [2024-05-24T00:11:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:11:00.840512804Z [2024-05-24T00:11:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:11:00.840801212Z [2024-05-24T00:11:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:11:01.136060783Z [2024-05-24T00:11:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:11:01.136125374Z [2024-05-24T00:11:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:11:01.136130826Z [2024-05-24T00:11:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:11:01.145405202Z [2024-05-24T00:11:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 877d4aaf-5ed3-42a7-9eb4-a265d220c1ca 2024-05-24T00:11:01.145536086Z [2024-05-24T00:11:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to d02c3a37-da70-4052-9ed7-0889866b6105 2024-05-24T00:11:01.145657795Z [2024-05-24T00:11:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b24df2d-22cb-4dd6-883d-f31f8753e1be 2024-05-24T00:11:03.013144781Z [2024-05-24T00:11:03.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:11:03.013338148Z [2024-05-24T00:11:03.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:10:00+00:00, run_id=scheduled__2024-05-24T00:10:00+00:00, run_start_date=2024-05-24 00:11:00.756760+00:00, run_end_date=2024-05-24 00:11:03.013040+00:00, run_duration=2.25628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:10:00+00:00, data_interval_end=2024-05-24 00:11:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:11:03.034060231Z [2024-05-24T00:11:03.033+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:11:00+00:00, run_after=2024-05-24T00:12:00+00:00 2024-05-24T00:11:03.132425959Z [2024-05-24T00:11:03.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:11:03.138159421Z [2024-05-24T00:11:03.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=-1, run_start_date=2024-05-24 00:11:01.671498+00:00, run_end_date=2024-05-24 00:11:02.107791+00:00, run_duration=0.436293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:11:00.836481+00:00, queued_by_job_id=1, pid=6473 2024-05-24T00:11:05.323203838Z [2024-05-24T00:11:05.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:11:05.323724980Z [2024-05-24T00:11:05.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:10:00+00:00, run_id=scheduled__2024-05-24T00:10:00+00:00, run_start_date=2024-05-24 00:11:00.759838+00:00, run_end_date=2024-05-24 00:11:05.323008+00:00, run_duration=4.56317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:10:00+00:00, data_interval_end=2024-05-24 00:11:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:11:05.335074455Z [2024-05-24T00:11:05.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:11:00+00:00, run_after=2024-05-24T00:12:00+00:00 2024-05-24T00:11:05.344271434Z [2024-05-24T00:11:05.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:11:05.344549272Z [2024-05-24T00:11:05.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:10:00+00:00, run_id=scheduled__2024-05-24T00:10:00+00:00, run_start_date=2024-05-24 00:11:00.758467+00:00, run_end_date=2024-05-24 00:11:05.344153+00:00, run_duration=4.585686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:10:00+00:00, data_interval_end=2024-05-24 00:11:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:11:05.355496447Z [2024-05-24T00:11:05.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:11:00+00:00, run_after=2024-05-24T00:12:00+00:00 2024-05-24T00:11:05.404172830Z [2024-05-24T00:11:05.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:11:05.404394855Z [2024-05-24T00:11:05.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:11:05.412386094Z [2024-05-24T00:11:05.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=-1, run_start_date=2024-05-24 00:11:02.693667+00:00, run_end_date=2024-05-24 00:11:04.573863+00:00, run_duration=1.880196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:11:00.836481+00:00, queued_by_job_id=1, pid=6492 2024-05-24T00:11:05.412855621Z [2024-05-24T00:11:05.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=-1, run_start_date=2024-05-24 00:11:02.649930+00:00, run_end_date=2024-05-24 00:11:04.160043+00:00, run_duration=1.510113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:11:00.836481+00:00, queued_by_job_id=1, pid=6491 2024-05-24T00:11:40.145513076Z [2024-05-24T00:11:40.144+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:12:01.065055597Z [2024-05-24T00:12:01.064+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:12:01.072325858Z [2024-05-24T00:12:01.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:12:01.083658087Z [2024-05-24T00:12:01.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:12:00+00:00, run_after=2024-05-24T00:13:00+00:00 2024-05-24T00:12:01.111589910Z [2024-05-24T00:12:01.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:12:00+00:00, run_after=2024-05-24T00:13:00+00:00 2024-05-24T00:12:01.215919264Z [2024-05-24T00:12:01.215+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:12:01.215953277Z 2024-05-24T00:12:01.215979769Z 2024-05-24T00:12:01.215985962Z 2024-05-24T00:12:01.215991495Z 2024-05-24T00:12:01.216031318Z [2024-05-24T00:12:01.215+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:12:01.216188302Z [2024-05-24T00:12:01.216+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:12:01.216511878Z [2024-05-24T00:12:01.216+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:12:01.216636308Z [2024-05-24T00:12:01.216+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:12:01.217608975Z [2024-05-24T00:12:01.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:12:01.217633031Z 2024-05-24T00:12:01.217643809Z 2024-05-24T00:12:01.217652955Z 2024-05-24T00:12:01.217662012Z 2024-05-24T00:12:01.222650310Z [2024-05-24T00:12:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:12:01.222960657Z [2024-05-24T00:12:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:12:01.223333407Z [2024-05-24T00:12:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:12:01.223541346Z [2024-05-24T00:12:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:12:01.223862803Z [2024-05-24T00:12:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:12:01.224027293Z [2024-05-24T00:12:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:12:01.224279912Z [2024-05-24T00:12:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:12:01.224420023Z [2024-05-24T00:12:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:12:01.487271665Z [2024-05-24T00:12:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:12:01.489337821Z [2024-05-24T00:12:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:11:00+00:00 exited with status queued for try_number 1 2024-05-24T00:12:01.489525729Z [2024-05-24T00:12:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:11:00+00:00 exited with status queued for try_number 1 2024-05-24T00:12:01.489671009Z [2024-05-24T00:12:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:11:00+00:00 exited with status queued for try_number 1 2024-05-24T00:12:01.497671086Z [2024-05-24T00:12:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83aa49a0-f62c-4199-ad63-0f627d4a67bc 2024-05-24T00:12:01.497857703Z [2024-05-24T00:12:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3466797-5058-46d4-addd-62c6077a9f42 2024-05-24T00:12:01.498037690Z [2024-05-24T00:12:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fd96987-3654-4b7e-be95-c96cdff60bf1 2024-05-24T00:12:01.498218257Z [2024-05-24T00:12:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03618964-f282-4997-8c1c-c357dd884c06 2024-05-24T00:12:02.787543183Z [2024-05-24T00:12:02.786+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:12:02.787885281Z [2024-05-24T00:12:02.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:10:00+00:00, run_id=scheduled__2024-05-24T00:10:00+00:00, run_start_date=2024-05-24 00:12:01.140337+00:00, run_end_date=2024-05-24 00:12:02.787449+00:00, run_duration=1.647112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:10:00+00:00, data_interval_end=2024-05-24 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:12:02.795796858Z [2024-05-24T00:12:02.795+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:12:00+00:00, run_after=2024-05-24T00:14:00+00:00 2024-05-24T00:12:02.844563652Z [2024-05-24T00:12:02.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:12:02.844677828Z [2024-05-24T00:12:02.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:11:00+00:00, run_id=scheduled__2024-05-24T00:11:00+00:00, run_start_date=2024-05-24 00:12:01.142290+00:00, run_end_date=2024-05-24 00:12:02.844438+00:00, run_duration=1.702148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:11:00+00:00, data_interval_end=2024-05-24 00:12:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:12:02.872326359Z [2024-05-24T00:12:02.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:12:00+00:00, run_after=2024-05-24T00:13:00+00:00 2024-05-24T00:12:02.930161687Z [2024-05-24T00:12:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:12:02.930206665Z [2024-05-24T00:12:02.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:11:00+00:00 exited with status success for try_number 1 2024-05-24T00:12:02.939450372Z [2024-05-24T00:12:02.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=-1, run_start_date=2024-05-24 00:12:02.092642+00:00, run_end_date=2024-05-24 00:12:02.422708+00:00, run_duration=0.330066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:12:01.218771+00:00, queued_by_job_id=1, pid=6525 2024-05-24T00:12:02.939507509Z [2024-05-24T00:12:02.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:11:00+00:00, map_index=-1, run_start_date=2024-05-24 00:12:02.030350+00:00, run_end_date=2024-05-24 00:12:02.453401+00:00, run_duration=0.423051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:12:01.218771+00:00, queued_by_job_id=1, pid=6524 2024-05-24T00:12:05.120720384Z [2024-05-24T00:12:05.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:12:05.121107192Z [2024-05-24T00:12:05.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:11:00+00:00, run_id=scheduled__2024-05-24T00:11:00+00:00, run_start_date=2024-05-24 00:12:01.143954+00:00, run_end_date=2024-05-24 00:12:05.120485+00:00, run_duration=3.976531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:11:00+00:00, data_interval_end=2024-05-24 00:12:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:12:05.131026252Z [2024-05-24T00:12:05.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:12:00+00:00, run_after=2024-05-24T00:13:00+00:00 2024-05-24T00:12:05.176462448Z [2024-05-24T00:12:05.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:11:00+00:00 exited with status success for try_number 1 2024-05-24T00:12:05.183213491Z [2024-05-24T00:12:05.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:11:00+00:00, map_index=-1, run_start_date=2024-05-24 00:12:03.234415+00:00, run_end_date=2024-05-24 00:12:04.936707+00:00, run_duration=1.702292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:12:01.218771+00:00, queued_by_job_id=1, pid=6548 2024-05-24T00:12:06.226858514Z [2024-05-24T00:12:06.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:12:06.227167653Z [2024-05-24T00:12:06.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:11:00+00:00, run_id=scheduled__2024-05-24T00:11:00+00:00, run_start_date=2024-05-24 00:12:01.145254+00:00, run_end_date=2024-05-24 00:12:06.226771+00:00, run_duration=5.081517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:11:00+00:00, data_interval_end=2024-05-24 00:12:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:12:06.235413659Z [2024-05-24T00:12:06.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:12:00+00:00, run_after=2024-05-24T00:13:00+00:00 2024-05-24T00:12:06.265950131Z [2024-05-24T00:12:06.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:11:00+00:00 exited with status success for try_number 1 2024-05-24T00:12:06.272630252Z [2024-05-24T00:12:06.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:11:00+00:00, map_index=-1, run_start_date=2024-05-24 00:12:03.341973+00:00, run_end_date=2024-05-24 00:12:05.257466+00:00, run_duration=1.915493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:12:01.218771+00:00, queued_by_job_id=1, pid=6549 2024-05-24T00:13:00.774173553Z [2024-05-24T00:13:00.773+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:13:00+00:00, run_after=2024-05-24T00:14:00+00:00 2024-05-24T00:13:00.792059951Z [2024-05-24T00:13:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:13:00+00:00, run_after=2024-05-24T00:14:00+00:00 2024-05-24T00:13:00.801835531Z [2024-05-24T00:13:00.801+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:13:00.891200914Z [2024-05-24T00:13:00.890+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:13:00.891229077Z 2024-05-24T00:13:00.891234573Z 2024-05-24T00:13:00.891240135Z 2024-05-24T00:13:00.891573390Z [2024-05-24T00:13:00.891+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:13:00.891902590Z [2024-05-24T00:13:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:13:00.892243085Z [2024-05-24T00:13:00.892+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:13:00.893241447Z [2024-05-24T00:13:00.892+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:13:00.893256373Z 2024-05-24T00:13:00.893280082Z 2024-05-24T00:13:00.893285304Z 2024-05-24T00:13:00.898246070Z [2024-05-24T00:13:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:13:00.898578874Z [2024-05-24T00:13:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:13:00.899051632Z [2024-05-24T00:13:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:13:00.899356017Z [2024-05-24T00:13:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:13:00.899777687Z [2024-05-24T00:13:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:13:00.900043232Z [2024-05-24T00:13:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:13:01.267416950Z [2024-05-24T00:13:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status queued for try_number 1 2024-05-24T00:13:01.267605376Z [2024-05-24T00:13:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status queued for try_number 1 2024-05-24T00:13:01.267775818Z [2024-05-24T00:13:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status queued for try_number 1 2024-05-24T00:13:01.279376385Z [2024-05-24T00:13:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to d005dc90-5afc-40c2-8992-c6cb0322d07a 2024-05-24T00:13:01.279630028Z [2024-05-24T00:13:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2339f9a-0a34-4b04-9c94-f9ed3c8e886c 2024-05-24T00:13:01.279880384Z [2024-05-24T00:13:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84fb2413-1670-458e-89c7-97d71f124313 2024-05-24T00:13:02.508218019Z [2024-05-24T00:13:02.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:13:02.508448575Z [2024-05-24T00:13:02.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:12:00+00:00, run_id=scheduled__2024-05-24T00:12:00+00:00, run_start_date=2024-05-24 00:13:00.816886+00:00, run_end_date=2024-05-24 00:13:02.508093+00:00, run_duration=1.691207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:12:00+00:00, data_interval_end=2024-05-24 00:13:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:13:02.522698635Z [2024-05-24T00:13:02.522+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:13:00+00:00, run_after=2024-05-24T00:14:00+00:00 2024-05-24T00:13:02.568685242Z [2024-05-24T00:13:02.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status success for try_number 1 2024-05-24T00:13:02.578441235Z [2024-05-24T00:13:02.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:12:00+00:00, map_index=-1, run_start_date=2024-05-24 00:13:01.800695+00:00, run_end_date=2024-05-24 00:13:02.225001+00:00, run_duration=0.424306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:13:00.894470+00:00, queued_by_job_id=1, pid=6581 2024-05-24T00:13:04.758117044Z [2024-05-24T00:13:04.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:13:04.758302799Z [2024-05-24T00:13:04.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:12:00+00:00, run_id=scheduled__2024-05-24T00:12:00+00:00, run_start_date=2024-05-24 00:13:00.818689+00:00, run_end_date=2024-05-24 00:13:04.757915+00:00, run_duration=3.939226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:12:00+00:00, data_interval_end=2024-05-24 00:13:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:13:04.770179763Z [2024-05-24T00:13:04.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:13:00+00:00, run_after=2024-05-24T00:14:00+00:00 2024-05-24T00:13:04.778155847Z [2024-05-24T00:13:04.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:13:04.778335374Z [2024-05-24T00:13:04.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:12:00+00:00, run_id=scheduled__2024-05-24T00:12:00+00:00, run_start_date=2024-05-24 00:13:00.820171+00:00, run_end_date=2024-05-24 00:13:04.778059+00:00, run_duration=3.957888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:12:00+00:00, data_interval_end=2024-05-24 00:13:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:13:04.787838365Z [2024-05-24T00:13:04.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:13:00+00:00, run_after=2024-05-24T00:14:00+00:00 2024-05-24T00:13:04.841876897Z [2024-05-24T00:13:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status success for try_number 1 2024-05-24T00:13:04.842352189Z [2024-05-24T00:13:04.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status success for try_number 1 2024-05-24T00:13:04.853810306Z [2024-05-24T00:13:04.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:12:00+00:00, map_index=-1, run_start_date=2024-05-24 00:13:02.975718+00:00, run_end_date=2024-05-24 00:13:04.230015+00:00, run_duration=1.254297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:13:00.894470+00:00, queued_by_job_id=1, pid=6600 2024-05-24T00:13:04.854218467Z [2024-05-24T00:13:04.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:12:00+00:00, map_index=-1, run_start_date=2024-05-24 00:13:02.912877+00:00, run_end_date=2024-05-24 00:13:04.536396+00:00, run_duration=1.623519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:13:00.894470+00:00, queued_by_job_id=1, pid=6599 2024-05-24T00:14:00.656113431Z [2024-05-24T00:14:00.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:14:00+00:00, run_after=2024-05-24T00:15:00+00:00 2024-05-24T00:14:00.667292577Z [2024-05-24T00:14:00.666+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:14:00.683272634Z [2024-05-24T00:14:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:14:00+00:00, run_after=2024-05-24T00:15:00+00:00 2024-05-24T00:14:00.692264278Z [2024-05-24T00:14:00.691+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:14:00.802111149Z [2024-05-24T00:14:00.801+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:14:00.802135643Z 2024-05-24T00:14:00.802139798Z 2024-05-24T00:14:00.802143061Z 2024-05-24T00:14:00.802146742Z 2024-05-24T00:14:00.802336971Z [2024-05-24T00:14:00.802+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:14:00.802499841Z [2024-05-24T00:14:00.802+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:14:00.802779571Z [2024-05-24T00:14:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:14:00.802921226Z [2024-05-24T00:14:00.802+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:14:00.803571273Z [2024-05-24T00:14:00.803+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:14:00.803582481Z 2024-05-24T00:14:00.803591670Z 2024-05-24T00:14:00.803595156Z 2024-05-24T00:14:00.803598359Z 2024-05-24T00:14:00.808394727Z [2024-05-24T00:14:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:14:00.808816038Z [2024-05-24T00:14:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:14:00.809218821Z [2024-05-24T00:14:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:14:00.809415349Z [2024-05-24T00:14:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:14:00.809787838Z [2024-05-24T00:14:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:14:00.809961342Z [2024-05-24T00:14:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:14:00.810284041Z [2024-05-24T00:14:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:14:00.810462066Z [2024-05-24T00:14:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:14:01.263942667Z [2024-05-24T00:14:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status queued for try_number 1 2024-05-24T00:14:01.264048955Z [2024-05-24T00:14:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:13:00+00:00 exited with status queued for try_number 1 2024-05-24T00:14:01.264180962Z [2024-05-24T00:14:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:13:00+00:00 exited with status queued for try_number 1 2024-05-24T00:14:01.264304789Z [2024-05-24T00:14:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:13:00+00:00 exited with status queued for try_number 1 2024-05-24T00:14:01.285403038Z [2024-05-24T00:14:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to f188633b-6df6-4347-b825-682cecbd291d 2024-05-24T00:14:01.285549869Z [2024-05-24T00:14:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 196e5c40-dbd5-44cc-8a1c-24d7c3365c15 2024-05-24T00:14:01.285706406Z [2024-05-24T00:14:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to e88c54b3-c474-494b-baac-583db2e19aa6 2024-05-24T00:14:01.285858864Z [2024-05-24T00:14:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c2ce651-971f-4660-8f9d-6216dcd1c5df 2024-05-24T00:14:02.560748515Z [2024-05-24T00:14:02.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:14:02.561219826Z [2024-05-24T00:14:02.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:12:00+00:00, run_id=scheduled__2024-05-24T00:12:00+00:00, run_start_date=2024-05-24 00:14:00.706974+00:00, run_end_date=2024-05-24 00:14:02.560599+00:00, run_duration=1.853625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:12:00+00:00, data_interval_end=2024-05-24 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:14:02.573181108Z [2024-05-24T00:14:02.572+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:14:00+00:00, run_after=2024-05-24T00:16:00+00:00 2024-05-24T00:14:02.594769708Z [2024-05-24T00:14:02.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:14:02.594793061Z [2024-05-24T00:14:02.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:13:00+00:00, run_id=scheduled__2024-05-24T00:13:00+00:00, run_start_date=2024-05-24 00:14:00.708408+00:00, run_end_date=2024-05-24 00:14:02.593062+00:00, run_duration=1.884654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:13:00+00:00, data_interval_end=2024-05-24 00:14:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:14:02.604642203Z [2024-05-24T00:14:02.604+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:14:00+00:00, run_after=2024-05-24T00:15:00+00:00 2024-05-24T00:14:02.634567033Z [2024-05-24T00:14:02.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:12:00+00:00 exited with status success for try_number 1 2024-05-24T00:14:02.634608507Z [2024-05-24T00:14:02.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:13:00+00:00 exited with status success for try_number 1 2024-05-24T00:14:02.643667866Z [2024-05-24T00:14:02.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:12:00+00:00, map_index=-1, run_start_date=2024-05-24 00:14:01.543401+00:00, run_end_date=2024-05-24 00:14:01.972022+00:00, run_duration=0.428621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:14:00.804544+00:00, queued_by_job_id=1, pid=6633 2024-05-24T00:14:02.643762637Z [2024-05-24T00:14:02.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:13:00+00:00, map_index=-1, run_start_date=2024-05-24 00:14:01.758340+00:00, run_end_date=2024-05-24 00:14:02.320791+00:00, run_duration=0.562451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:14:00.804544+00:00, queued_by_job_id=1, pid=6634 2024-05-24T00:14:05.777381386Z [2024-05-24T00:14:05.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:14:05.777450367Z [2024-05-24T00:14:05.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:13:00+00:00, run_id=scheduled__2024-05-24T00:13:00+00:00, run_start_date=2024-05-24 00:14:00.709640+00:00, run_end_date=2024-05-24 00:14:05.777199+00:00, run_duration=5.067559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:13:00+00:00, data_interval_end=2024-05-24 00:14:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:14:05.786651925Z [2024-05-24T00:14:05.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:14:00+00:00, run_after=2024-05-24T00:15:00+00:00 2024-05-24T00:14:05.793726004Z [2024-05-24T00:14:05.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:14:05.794598781Z [2024-05-24T00:14:05.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:13:00+00:00, run_id=scheduled__2024-05-24T00:13:00+00:00, run_start_date=2024-05-24 00:14:00.710948+00:00, run_end_date=2024-05-24 00:14:05.793475+00:00, run_duration=5.082527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:13:00+00:00, data_interval_end=2024-05-24 00:14:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:14:05.804316640Z [2024-05-24T00:14:05.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:14:00+00:00, run_after=2024-05-24T00:15:00+00:00 2024-05-24T00:14:05.849192274Z [2024-05-24T00:14:05.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:13:00+00:00 exited with status success for try_number 1 2024-05-24T00:14:05.849903640Z [2024-05-24T00:14:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:13:00+00:00 exited with status success for try_number 1 2024-05-24T00:14:05.861221371Z [2024-05-24T00:14:05.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:13:00+00:00, map_index=-1, run_start_date=2024-05-24 00:14:03.040339+00:00, run_end_date=2024-05-24 00:14:04.901111+00:00, run_duration=1.860772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:14:00.804544+00:00, queued_by_job_id=1, pid=6657 2024-05-24T00:14:05.861887544Z [2024-05-24T00:14:05.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:13:00+00:00, map_index=-1, run_start_date=2024-05-24 00:14:03.194346+00:00, run_end_date=2024-05-24 00:14:05.297681+00:00, run_duration=2.103335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:14:00.804544+00:00, queued_by_job_id=1, pid=6658 2024-05-24T00:15:00.327118518Z [2024-05-24T00:15:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:15:00+00:00, run_after=2024-05-24T00:16:00+00:00 2024-05-24T00:15:00.334358330Z [2024-05-24T00:15:00.333+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:15:00.348708380Z [2024-05-24T00:15:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:15:00+00:00, run_after=2024-05-24T00:16:00+00:00 2024-05-24T00:15:00.374273209Z [2024-05-24T00:15:00.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:15:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:15:00.468475273Z [2024-05-24T00:15:00.468+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:15:00.468499946Z 2024-05-24T00:15:00.468506516Z 2024-05-24T00:15:00.468509925Z 2024-05-24T00:15:00.468513107Z 2024-05-24T00:15:00.469608415Z [2024-05-24T00:15:00.469+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:15:00.469960646Z [2024-05-24T00:15:00.469+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:15:00.470322367Z [2024-05-24T00:15:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:15:00.470644600Z [2024-05-24T00:15:00.470+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:15:00.471524448Z [2024-05-24T00:15:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:15:00.471544909Z 2024-05-24T00:15:00.471550101Z 2024-05-24T00:15:00.471554656Z 2024-05-24T00:15:00.471568962Z 2024-05-24T00:15:00.475758574Z [2024-05-24T00:15:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:15:00.476150317Z [2024-05-24T00:15:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:15:00.476624789Z [2024-05-24T00:15:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:15:00.477068935Z [2024-05-24T00:15:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:15:00.479465549Z [2024-05-24T00:15:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:15:00.479950911Z [2024-05-24T00:15:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:15:00.480535956Z [2024-05-24T00:15:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:15:00.481326010Z [2024-05-24T00:15:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:15:00.814405102Z [2024-05-24T00:15:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:15:00.814485691Z [2024-05-24T00:15:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status queued for try_number 1 2024-05-24T00:15:00.814590935Z [2024-05-24T00:15:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status queued for try_number 1 2024-05-24T00:15:00.814707662Z [2024-05-24T00:15:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status queued for try_number 1 2024-05-24T00:15:00.823876550Z [2024-05-24T00:15:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to baae4526-ab5b-4d19-987a-58d6a5c9fe42 2024-05-24T00:15:00.823941045Z [2024-05-24T00:15:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8acc132-570a-4cff-87e0-795896158146 2024-05-24T00:15:00.824018092Z [2024-05-24T00:15:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a39092c-29e5-4cd8-ad71-0fd5548029c2 2024-05-24T00:15:00.824113839Z [2024-05-24T00:15:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdbca0ab-1138-442a-8802-085fcf6405f6 2024-05-24T00:15:02.122944071Z [2024-05-24T00:15:02.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:15:02.123394827Z [2024-05-24T00:15:02.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:14:00+00:00, run_id=scheduled__2024-05-24T00:14:00+00:00, run_start_date=2024-05-24 00:15:00.393592+00:00, run_end_date=2024-05-24 00:15:02.122836+00:00, run_duration=1.729244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:14:00+00:00, data_interval_end=2024-05-24 00:15:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:15:02.138105924Z [2024-05-24T00:15:02.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:15:00+00:00, run_after=2024-05-24T00:16:00+00:00 2024-05-24T00:15:02.191627929Z [2024-05-24T00:15:02.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status success for try_number 1 2024-05-24T00:15:02.196970362Z [2024-05-24T00:15:02.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:14:00+00:00, map_index=-1, run_start_date=2024-05-24 00:15:01.318468+00:00, run_end_date=2024-05-24 00:15:01.752961+00:00, run_duration=0.434493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:15:00.472745+00:00, queued_by_job_id=1, pid=6691 2024-05-24T00:15:03.304666356Z [2024-05-24T00:15:03.304+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:15:03.304692136Z 2024-05-24T00:15:03.304703024Z [2024-05-24T00:15:03.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:15:03.305343639Z [2024-05-24T00:15:03.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:15:03.305350048Z 2024-05-24T00:15:03.308752412Z [2024-05-24T00:15:03.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:15:03.308908869Z [2024-05-24T00:15:03.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:15:03.376480672Z [2024-05-24T00:15:03.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:15:03.376590155Z [2024-05-24T00:15:03.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:15:03.382785113Z [2024-05-24T00:15:03.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc293031-8b39-44ee-885b-264e9d62288e 2024-05-24T00:15:03.382888925Z [2024-05-24T00:15:03.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=-1, run_start_date=2024-05-24 00:15:02.412039+00:00, run_end_date=2024-05-24 00:15:02.874258+00:00, run_duration=0.462219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:15:00.472745+00:00, queued_by_job_id=1, pid=6711 2024-05-24T00:15:04.560659185Z [2024-05-24T00:15:04.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:15:04.560784891Z [2024-05-24T00:15:04.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:14:00+00:00, run_id=scheduled__2024-05-24T00:14:00+00:00, run_start_date=2024-05-24 00:15:00.394706+00:00, run_end_date=2024-05-24 00:15:04.560533+00:00, run_duration=4.165827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:14:00+00:00, data_interval_end=2024-05-24 00:15:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:15:04.572285039Z [2024-05-24T00:15:04.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:15:00+00:00, run_after=2024-05-24T00:16:00+00:00 2024-05-24T00:15:04.582554148Z [2024-05-24T00:15:04.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:15:04.582714592Z [2024-05-24T00:15:04.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:14:00+00:00, run_id=scheduled__2024-05-24T00:14:00+00:00, run_start_date=2024-05-24 00:15:00.395770+00:00, run_end_date=2024-05-24 00:15:04.582326+00:00, run_duration=4.186556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:14:00+00:00, data_interval_end=2024-05-24 00:15:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:15:04.593329371Z [2024-05-24T00:15:04.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:15:00+00:00, run_after=2024-05-24T00:16:00+00:00 2024-05-24T00:15:04.666616332Z [2024-05-24T00:15:04.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status success for try_number 1 2024-05-24T00:15:04.666996967Z [2024-05-24T00:15:04.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status success for try_number 1 2024-05-24T00:15:04.679683659Z [2024-05-24T00:15:04.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:14:00+00:00, map_index=-1, run_start_date=2024-05-24 00:15:02.702371+00:00, run_end_date=2024-05-24 00:15:04.411893+00:00, run_duration=1.709522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:15:00.472745+00:00, queued_by_job_id=1, pid=6717 2024-05-24T00:15:04.680127813Z [2024-05-24T00:15:04.679+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:14:00+00:00, map_index=-1, run_start_date=2024-05-24 00:15:02.396110+00:00, run_end_date=2024-05-24 00:15:03.869125+00:00, run_duration=1.473015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:15:00.472745+00:00, queued_by_job_id=1, pid=6710 2024-05-24T00:15:05.782903900Z [2024-05-24T00:15:05.782+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:15:05.782953990Z 2024-05-24T00:15:05.783276162Z [2024-05-24T00:15:05.782+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:15:05.784767644Z [2024-05-24T00:15:05.784+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:15:05.784794042Z 2024-05-24T00:15:05.789537814Z [2024-05-24T00:15:05.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:15:05.790049990Z [2024-05-24T00:15:05.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:15:05.850353521Z [2024-05-24T00:15:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:15:05.851763778Z [2024-05-24T00:15:05.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:15:05.865828703Z [2024-05-24T00:15:05.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1605ca02-3fb8-4b91-ba95-53cefa924173 2024-05-24T00:15:05.866184333Z [2024-05-24T00:15:05.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=-1, run_start_date=2024-05-24 00:15:04.976204+00:00, run_end_date=2024-05-24 00:15:05.397621+00:00, run_duration=0.421417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:15:03.306068+00:00, queued_by_job_id=1, pid=6740 2024-05-24T00:15:08.112097577Z [2024-05-24T00:15:08.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:15:08.112129116Z 2024-05-24T00:15:08.112715753Z [2024-05-24T00:15:08.111+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:15:08.113340868Z [2024-05-24T00:15:08.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:15:08.113353590Z 2024-05-24T00:15:08.116138276Z [2024-05-24T00:15:08.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:15:08.116386343Z [2024-05-24T00:15:08.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:15:08.177600995Z [2024-05-24T00:15:08.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status queued for try_number 1 2024-05-24T00:15:08.177845837Z [2024-05-24T00:15:08.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:15:08.182758112Z [2024-05-24T00:15:08.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ff57d66-b6d3-43eb-b670-39322a0e18c1 2024-05-24T00:15:08.183103863Z [2024-05-24T00:15:08.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=0, run_start_date=2024-05-24 00:15:07.482791+00:00, run_end_date=2024-05-24 00:15:07.825345+00:00, run_duration=0.342554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:15:05.785535+00:00, queued_by_job_id=1, pid=6748 2024-05-24T00:15:10.420890194Z [2024-05-24T00:15:10.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:15:10.422245684Z [2024-05-24T00:15:10.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:10:00+00:00, run_id=scheduled__2024-05-24T00:10:00+00:00, run_start_date=2024-05-24 00:15:00.392339+00:00, run_end_date=2024-05-24 00:15:10.420815+00:00, run_duration=10.028476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:10:00+00:00, data_interval_end=2024-05-24 00:15:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:15:10.427965171Z [2024-05-24T00:15:10.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:15:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:15:10.469951297Z [2024-05-24T00:15:10.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:10:00+00:00 exited with status success for try_number 1 2024-05-24T00:15:10.476996039Z [2024-05-24T00:15:10.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:10:00+00:00, map_index=-1, run_start_date=2024-05-24 00:15:09.802077+00:00, run_end_date=2024-05-24 00:15:10.178924+00:00, run_duration=0.376847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:15:08.113916+00:00, queued_by_job_id=1, pid=6756 2024-05-24T00:16:00.730020326Z [2024-05-24T00:16:00.729+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:16:00.749132651Z [2024-05-24T00:16:00.748+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:16:00+00:00, run_after=2024-05-24T00:17:00+00:00 2024-05-24T00:16:00.760328477Z [2024-05-24T00:16:00.760+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:16:00.777214278Z [2024-05-24T00:16:00.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:16:00+00:00, run_after=2024-05-24T00:17:00+00:00 2024-05-24T00:16:00.894661709Z [2024-05-24T00:16:00.894+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:16:00.894691278Z 2024-05-24T00:16:00.894703946Z 2024-05-24T00:16:00.894710594Z 2024-05-24T00:16:00.894717292Z 2024-05-24T00:16:00.894794126Z [2024-05-24T00:16:00.894+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:16:00.895315247Z [2024-05-24T00:16:00.895+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:16:00.895385817Z [2024-05-24T00:16:00.895+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:16:00.895627337Z [2024-05-24T00:16:00.895+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:16:00.897342012Z [2024-05-24T00:16:00.897+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:16:00.897354850Z 2024-05-24T00:16:00.897359593Z 2024-05-24T00:16:00.897364226Z 2024-05-24T00:16:00.897368442Z 2024-05-24T00:16:00.901923991Z [2024-05-24T00:16:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:16:00.901969867Z [2024-05-24T00:16:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:16:00.902217675Z [2024-05-24T00:16:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:16:00.902283036Z [2024-05-24T00:16:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:16:00.902790484Z [2024-05-24T00:16:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:16:00.902926487Z [2024-05-24T00:16:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:16:00.903168952Z [2024-05-24T00:16:00.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:16:00.903247635Z [2024-05-24T00:16:00.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:16:01.293884514Z [2024-05-24T00:16:01.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status queued for try_number 1 2024-05-24T00:16:01.294179308Z [2024-05-24T00:16:01.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status queued for try_number 1 2024-05-24T00:16:01.294384170Z [2024-05-24T00:16:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status queued for try_number 1 2024-05-24T00:16:01.294588204Z [2024-05-24T00:16:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status queued for try_number 1 2024-05-24T00:16:01.311879965Z [2024-05-24T00:16:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3b6f4bc-6a81-4f8f-8a56-2bab36fc75b0 2024-05-24T00:16:01.312032281Z [2024-05-24T00:16:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5215d795-68f8-4441-96ae-8f418f9f764f 2024-05-24T00:16:01.312184685Z [2024-05-24T00:16:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc6243a9-3817-4d17-9ca1-0d3829a8ee04 2024-05-24T00:16:01.312323472Z [2024-05-24T00:16:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5bb18ba-b2c4-458f-b96a-dcc8f2cfae79 2024-05-24T00:16:03.067173888Z [2024-05-24T00:16:03.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:16:03.067452650Z [2024-05-24T00:16:03.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:14:00+00:00, run_id=scheduled__2024-05-24T00:14:00+00:00, run_start_date=2024-05-24 00:16:00.794829+00:00, run_end_date=2024-05-24 00:16:03.067059+00:00, run_duration=2.27223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:14:00+00:00, data_interval_end=2024-05-24 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:16:03.075791865Z [2024-05-24T00:16:03.075+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:16:00+00:00, run_after=2024-05-24T00:18:00+00:00 2024-05-24T00:16:03.081672368Z [2024-05-24T00:16:03.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:16:03.081976309Z [2024-05-24T00:16:03.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:15:00+00:00, run_id=scheduled__2024-05-24T00:15:00+00:00, run_start_date=2024-05-24 00:16:00.797194+00:00, run_end_date=2024-05-24 00:16:03.081694+00:00, run_duration=2.2845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:15:00+00:00, data_interval_end=2024-05-24 00:16:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:16:03.091534930Z [2024-05-24T00:16:03.091+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:16:00+00:00, run_after=2024-05-24T00:17:00+00:00 2024-05-24T00:16:03.143711358Z [2024-05-24T00:16:03.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:14:00+00:00 exited with status success for try_number 1 2024-05-24T00:16:03.143807771Z [2024-05-24T00:16:03.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status success for try_number 1 2024-05-24T00:16:03.150882050Z [2024-05-24T00:16:03.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:14:00+00:00, map_index=-1, run_start_date=2024-05-24 00:16:01.676073+00:00, run_end_date=2024-05-24 00:16:02.097628+00:00, run_duration=0.421555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:16:00.898262+00:00, queued_by_job_id=1, pid=6779 2024-05-24T00:16:03.151068884Z [2024-05-24T00:16:03.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:15:00+00:00, map_index=-1, run_start_date=2024-05-24 00:16:01.760594+00:00, run_end_date=2024-05-24 00:16:02.188786+00:00, run_duration=0.428192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:16:00.898262+00:00, queued_by_job_id=1, pid=6780 2024-05-24T00:16:05.333655459Z [2024-05-24T00:16:05.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:16:05.333930720Z [2024-05-24T00:16:05.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:15:00+00:00, run_id=scheduled__2024-05-24T00:15:00+00:00, run_start_date=2024-05-24 00:16:00.800680+00:00, run_end_date=2024-05-24 00:16:05.333525+00:00, run_duration=4.532845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:15:00+00:00, data_interval_end=2024-05-24 00:16:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:16:05.347363283Z [2024-05-24T00:16:05.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:16:00+00:00, run_after=2024-05-24T00:17:00+00:00 2024-05-24T00:16:05.355455387Z [2024-05-24T00:16:05.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:16:05.355603743Z [2024-05-24T00:16:05.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:15:00+00:00, run_id=scheduled__2024-05-24T00:15:00+00:00, run_start_date=2024-05-24 00:16:00.799041+00:00, run_end_date=2024-05-24 00:16:05.355288+00:00, run_duration=4.556247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:15:00+00:00, data_interval_end=2024-05-24 00:16:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:16:05.366864221Z [2024-05-24T00:16:05.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:16:00+00:00, run_after=2024-05-24T00:17:00+00:00 2024-05-24T00:16:05.424395805Z [2024-05-24T00:16:05.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status success for try_number 1 2024-05-24T00:16:05.424682168Z [2024-05-24T00:16:05.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status success for try_number 1 2024-05-24T00:16:05.439226947Z [2024-05-24T00:16:05.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:15:00+00:00, map_index=-1, run_start_date=2024-05-24 00:16:02.916248+00:00, run_end_date=2024-05-24 00:16:04.848455+00:00, run_duration=1.932207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:16:00.898262+00:00, queued_by_job_id=1, pid=6803 2024-05-24T00:16:05.439543056Z [2024-05-24T00:16:05.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:15:00+00:00, map_index=-1, run_start_date=2024-05-24 00:16:02.939534+00:00, run_end_date=2024-05-24 00:16:04.740155+00:00, run_duration=1.800621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:16:00.898262+00:00, queued_by_job_id=1, pid=6804 2024-05-24T00:16:40.246196606Z [2024-05-24T00:16:40.243+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:17:00.093236516Z [2024-05-24T00:17:00.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:17:00+00:00, run_after=2024-05-24T00:18:00+00:00 2024-05-24T00:17:00.106490133Z [2024-05-24T00:17:00.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:17:00.123092611Z [2024-05-24T00:17:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:17:00+00:00, run_after=2024-05-24T00:18:00+00:00 2024-05-24T00:17:00.219698918Z [2024-05-24T00:17:00.219+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:17:00.219725744Z 2024-05-24T00:17:00.219729935Z 2024-05-24T00:17:00.219733687Z 2024-05-24T00:17:00.219943776Z [2024-05-24T00:17:00.219+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:17:00.220057526Z [2024-05-24T00:17:00.219+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:17:00.220183260Z [2024-05-24T00:17:00.220+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:17:00.220874985Z [2024-05-24T00:17:00.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:17:00.220884222Z 2024-05-24T00:17:00.220890413Z 2024-05-24T00:17:00.220896352Z 2024-05-24T00:17:00.224663369Z [2024-05-24T00:17:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:17:00.224745297Z [2024-05-24T00:17:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:17:00.224947270Z [2024-05-24T00:17:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:17:00.225044808Z [2024-05-24T00:17:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:17:00.225225420Z [2024-05-24T00:17:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:17:00.225325164Z [2024-05-24T00:17:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:17:00.581441596Z [2024-05-24T00:17:00.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status queued for try_number 1 2024-05-24T00:17:00.581598157Z [2024-05-24T00:17:00.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status queued for try_number 1 2024-05-24T00:17:00.581735893Z [2024-05-24T00:17:00.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status queued for try_number 1 2024-05-24T00:17:00.613832451Z [2024-05-24T00:17:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6de8306f-ab89-47b4-9bdc-fffbddac306d 2024-05-24T00:17:00.613897945Z [2024-05-24T00:17:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to a22b0bfd-f81a-40f5-8d1b-d72236f6e478 2024-05-24T00:17:00.614120228Z [2024-05-24T00:17:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53800368-94ef-4040-8c9e-48868140732d 2024-05-24T00:17:01.787485098Z [2024-05-24T00:17:01.786+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:17:01.787921914Z [2024-05-24T00:17:01.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:16:00+00:00, run_id=scheduled__2024-05-24T00:16:00+00:00, run_start_date=2024-05-24 00:17:00.135159+00:00, run_end_date=2024-05-24 00:17:01.787328+00:00, run_duration=1.652169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:16:00+00:00, data_interval_end=2024-05-24 00:17:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:17:01.802107739Z [2024-05-24T00:17:01.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:17:00+00:00, run_after=2024-05-24T00:18:00+00:00 2024-05-24T00:17:01.870843291Z [2024-05-24T00:17:01.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status success for try_number 1 2024-05-24T00:17:01.889519025Z [2024-05-24T00:17:01.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:16:00+00:00, map_index=-1, run_start_date=2024-05-24 00:17:01.085644+00:00, run_end_date=2024-05-24 00:17:01.455168+00:00, run_duration=0.369524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:17:00.221575+00:00, queued_by_job_id=1, pid=6836 2024-05-24T00:17:04.176406678Z [2024-05-24T00:17:04.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:17:04.176808979Z [2024-05-24T00:17:04.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:16:00+00:00, run_id=scheduled__2024-05-24T00:16:00+00:00, run_start_date=2024-05-24 00:17:00.136535+00:00, run_end_date=2024-05-24 00:17:04.176268+00:00, run_duration=4.039733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:16:00+00:00, data_interval_end=2024-05-24 00:17:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:17:04.186325168Z [2024-05-24T00:17:04.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:17:00+00:00, run_after=2024-05-24T00:18:00+00:00 2024-05-24T00:17:04.195511985Z [2024-05-24T00:17:04.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:17:04.195822524Z [2024-05-24T00:17:04.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:16:00+00:00, run_id=scheduled__2024-05-24T00:16:00+00:00, run_start_date=2024-05-24 00:17:00.137659+00:00, run_end_date=2024-05-24 00:17:04.195309+00:00, run_duration=4.05765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:16:00+00:00, data_interval_end=2024-05-24 00:17:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:17:04.206636409Z [2024-05-24T00:17:04.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:17:00+00:00, run_after=2024-05-24T00:18:00+00:00 2024-05-24T00:17:04.263645359Z [2024-05-24T00:17:04.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status success for try_number 1 2024-05-24T00:17:04.263691180Z [2024-05-24T00:17:04.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status success for try_number 1 2024-05-24T00:17:04.276413285Z [2024-05-24T00:17:04.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:16:00+00:00, map_index=-1, run_start_date=2024-05-24 00:17:02.132868+00:00, run_end_date=2024-05-24 00:17:03.367610+00:00, run_duration=1.234742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:17:00.221575+00:00, queued_by_job_id=1, pid=6855 2024-05-24T00:17:04.276866567Z [2024-05-24T00:17:04.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:16:00+00:00, map_index=-1, run_start_date=2024-05-24 00:17:01.984508+00:00, run_end_date=2024-05-24 00:17:03.769121+00:00, run_duration=1.784613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:17:00.221575+00:00, queued_by_job_id=1, pid=6854 2024-05-24T00:18:00.067242764Z [2024-05-24T00:18:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:18:00.074278312Z [2024-05-24T00:18:00.074+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:18:00.086007397Z [2024-05-24T00:18:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:18:00+00:00, run_after=2024-05-24T00:19:00+00:00 2024-05-24T00:18:00.098853331Z [2024-05-24T00:18:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:18:00+00:00, run_after=2024-05-24T00:19:00+00:00 2024-05-24T00:18:00.162893834Z [2024-05-24T00:18:00.162+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:18:00.162965214Z 2024-05-24T00:18:00.162977882Z 2024-05-24T00:18:00.162986505Z 2024-05-24T00:18:00.162994966Z 2024-05-24T00:18:00.163062898Z [2024-05-24T00:18:00.162+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:18:00.163084503Z [2024-05-24T00:18:00.162+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:18:00.163236583Z [2024-05-24T00:18:00.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:18:00.163411264Z [2024-05-24T00:18:00.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:18:00.163933317Z [2024-05-24T00:18:00.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:18:00.163990034Z 2024-05-24T00:18:00.164028129Z 2024-05-24T00:18:00.164037007Z 2024-05-24T00:18:00.164045546Z 2024-05-24T00:18:00.166966922Z [2024-05-24T00:18:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:18:00.167135003Z [2024-05-24T00:18:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:18:00.167410303Z [2024-05-24T00:18:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:18:00.167554685Z [2024-05-24T00:18:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:18:00.167800367Z [2024-05-24T00:18:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:18:00.167939439Z [2024-05-24T00:18:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:18:00.168190776Z [2024-05-24T00:18:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:18:00.168262492Z [2024-05-24T00:18:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:18:00.626717533Z [2024-05-24T00:18:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status queued for try_number 1 2024-05-24T00:18:00.626747063Z [2024-05-24T00:18:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:17:00+00:00 exited with status queued for try_number 1 2024-05-24T00:18:00.626750582Z [2024-05-24T00:18:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:17:00+00:00 exited with status queued for try_number 1 2024-05-24T00:18:00.626765952Z [2024-05-24T00:18:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:17:00+00:00 exited with status queued for try_number 1 2024-05-24T00:18:00.637984445Z [2024-05-24T00:18:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa04e206-6db8-41b6-8d0f-cab810304749 2024-05-24T00:18:00.638258717Z [2024-05-24T00:18:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27f6b890-1c0f-420d-905a-87f55cfedafb 2024-05-24T00:18:00.638446796Z [2024-05-24T00:18:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62b11249-f3d5-44b3-9e65-f3e229e6afeb 2024-05-24T00:18:00.638657595Z [2024-05-24T00:18:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9040e62d-dae1-4780-a7cd-e547011f4dc4 2024-05-24T00:18:02.199052277Z [2024-05-24T00:18:02.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:18:02.199215958Z [2024-05-24T00:18:02.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:16:00+00:00, run_id=scheduled__2024-05-24T00:16:00+00:00, run_start_date=2024-05-24 00:18:00.108664+00:00, run_end_date=2024-05-24 00:18:02.198901+00:00, run_duration=2.090237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:16:00+00:00, data_interval_end=2024-05-24 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:18:02.211874098Z [2024-05-24T00:18:02.211+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:18:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:18:02.229641144Z [2024-05-24T00:18:02.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:18:02.229692632Z [2024-05-24T00:18:02.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:17:00+00:00, run_id=scheduled__2024-05-24T00:17:00+00:00, run_start_date=2024-05-24 00:18:00.109998+00:00, run_end_date=2024-05-24 00:18:02.229450+00:00, run_duration=2.119452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:17:00+00:00, data_interval_end=2024-05-24 00:18:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:18:02.240129514Z [2024-05-24T00:18:02.239+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:18:00+00:00, run_after=2024-05-24T00:19:00+00:00 2024-05-24T00:18:02.309707517Z [2024-05-24T00:18:02.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:16:00+00:00 exited with status success for try_number 1 2024-05-24T00:18:02.309921999Z [2024-05-24T00:18:02.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:17:00+00:00 exited with status success for try_number 1 2024-05-24T00:18:02.318218206Z [2024-05-24T00:18:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:16:00+00:00, map_index=-1, run_start_date=2024-05-24 00:18:01.144777+00:00, run_end_date=2024-05-24 00:18:01.516267+00:00, run_duration=0.37149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:18:00.164638+00:00, queued_by_job_id=1, pid=6889 2024-05-24T00:18:02.318599239Z [2024-05-24T00:18:02.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:17:00+00:00, map_index=-1, run_start_date=2024-05-24 00:18:01.016297+00:00, run_end_date=2024-05-24 00:18:01.489085+00:00, run_duration=0.472788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:18:00.164638+00:00, queued_by_job_id=1, pid=6888 2024-05-24T00:18:04.099855447Z [2024-05-24T00:18:04.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:18:04.100710725Z [2024-05-24T00:18:04.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:17:00+00:00, run_id=scheduled__2024-05-24T00:17:00+00:00, run_start_date=2024-05-24 00:18:00.111995+00:00, run_end_date=2024-05-24 00:18:04.099922+00:00, run_duration=3.987927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:17:00+00:00, data_interval_end=2024-05-24 00:18:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:18:04.118626426Z [2024-05-24T00:18:04.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:18:00+00:00, run_after=2024-05-24T00:19:00+00:00 2024-05-24T00:18:04.128395201Z [2024-05-24T00:18:04.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:18:04.128686642Z [2024-05-24T00:18:04.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:17:00+00:00, run_id=scheduled__2024-05-24T00:17:00+00:00, run_start_date=2024-05-24 00:18:00.111024+00:00, run_end_date=2024-05-24 00:18:04.128210+00:00, run_duration=4.017186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:17:00+00:00, data_interval_end=2024-05-24 00:18:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:18:04.139345267Z [2024-05-24T00:18:04.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:18:00+00:00, run_after=2024-05-24T00:19:00+00:00 2024-05-24T00:18:04.198938919Z [2024-05-24T00:18:04.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:17:00+00:00 exited with status success for try_number 1 2024-05-24T00:18:04.199184232Z [2024-05-24T00:18:04.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:17:00+00:00 exited with status success for try_number 1 2024-05-24T00:18:04.205979173Z [2024-05-24T00:18:04.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:17:00+00:00, map_index=-1, run_start_date=2024-05-24 00:18:02.355097+00:00, run_end_date=2024-05-24 00:18:03.933098+00:00, run_duration=1.578001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:18:00.164638+00:00, queued_by_job_id=1, pid=6913 2024-05-24T00:18:04.206334140Z [2024-05-24T00:18:04.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:17:00+00:00, map_index=-1, run_start_date=2024-05-24 00:18:02.178324+00:00, run_end_date=2024-05-24 00:18:03.525561+00:00, run_duration=1.347237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:18:00.164638+00:00, queued_by_job_id=1, pid=6912 2024-05-24T00:19:00.144222594Z [2024-05-24T00:19:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:19:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:19:00.161699405Z [2024-05-24T00:19:00.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:19:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:19:00.173269318Z [2024-05-24T00:19:00.172+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:19:00.287644057Z [2024-05-24T00:19:00.287+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:19:00.287671045Z 2024-05-24T00:19:00.287675930Z 2024-05-24T00:19:00.287680581Z 2024-05-24T00:19:00.287714242Z [2024-05-24T00:19:00.287+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:19:00.287899808Z [2024-05-24T00:19:00.287+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:19:00.287990322Z [2024-05-24T00:19:00.287+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:19:00.288564826Z [2024-05-24T00:19:00.288+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:19:00.288575988Z 2024-05-24T00:19:00.288579445Z 2024-05-24T00:19:00.288582668Z 2024-05-24T00:19:00.292581739Z [2024-05-24T00:19:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:19:00.292859869Z [2024-05-24T00:19:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:19:00.293150237Z [2024-05-24T00:19:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:19:00.293297470Z [2024-05-24T00:19:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:19:00.293538569Z [2024-05-24T00:19:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:19:00.293678209Z [2024-05-24T00:19:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:19:00.612469693Z [2024-05-24T00:19:00.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status queued for try_number 1 2024-05-24T00:19:00.612494012Z [2024-05-24T00:19:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status queued for try_number 1 2024-05-24T00:19:00.612497923Z [2024-05-24T00:19:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status queued for try_number 1 2024-05-24T00:19:00.629528682Z [2024-05-24T00:19:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0bb090e-5fb4-476d-94e9-b3f301044dbf 2024-05-24T00:19:00.629828621Z [2024-05-24T00:19:00.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5713313-461f-4553-a5ba-375abf535edd 2024-05-24T00:19:00.631794929Z [2024-05-24T00:19:00.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to a497d5de-93fb-4f30-9b6e-7371b118b9cc 2024-05-24T00:19:02.804417421Z [2024-05-24T00:19:02.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:19:02.805144621Z [2024-05-24T00:19:02.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:18:00+00:00, run_id=scheduled__2024-05-24T00:18:00+00:00, run_start_date=2024-05-24 00:19:00.190550+00:00, run_end_date=2024-05-24 00:19:02.804309+00:00, run_duration=2.613759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:18:00+00:00, data_interval_end=2024-05-24 00:19:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:19:02.841016827Z [2024-05-24T00:19:02.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:19:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:19:02.914472062Z [2024-05-24T00:19:02.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status success for try_number 1 2024-05-24T00:19:02.926437065Z [2024-05-24T00:19:02.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:18:00+00:00, map_index=-1, run_start_date=2024-05-24 00:19:01.245337+00:00, run_end_date=2024-05-24 00:19:01.762287+00:00, run_duration=0.51695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:19:00.289642+00:00, queued_by_job_id=1, pid=6944 2024-05-24T00:19:05.087100404Z [2024-05-24T00:19:05.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:19:05.087462193Z [2024-05-24T00:19:05.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:18:00+00:00, run_id=scheduled__2024-05-24T00:18:00+00:00, run_start_date=2024-05-24 00:19:00.192536+00:00, run_end_date=2024-05-24 00:19:05.086862+00:00, run_duration=4.894326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:18:00+00:00, data_interval_end=2024-05-24 00:19:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:19:05.097590125Z [2024-05-24T00:19:05.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:19:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:19:05.150746237Z [2024-05-24T00:19:05.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status success for try_number 1 2024-05-24T00:19:05.158607698Z [2024-05-24T00:19:05.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:18:00+00:00, map_index=-1, run_start_date=2024-05-24 00:19:02.834202+00:00, run_end_date=2024-05-24 00:19:04.869979+00:00, run_duration=2.035777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:19:00.289642+00:00, queued_by_job_id=1, pid=6968 2024-05-24T00:19:05.724416363Z [2024-05-24T00:19:05.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:19:05.724677499Z [2024-05-24T00:19:05.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:18:00+00:00, run_id=scheduled__2024-05-24T00:18:00+00:00, run_start_date=2024-05-24 00:19:00.194084+00:00, run_end_date=2024-05-24 00:19:05.724205+00:00, run_duration=5.530121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:18:00+00:00, data_interval_end=2024-05-24 00:19:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:19:05.745291074Z [2024-05-24T00:19:05.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:19:00+00:00, run_after=2024-05-24T00:20:00+00:00 2024-05-24T00:19:05.780911320Z [2024-05-24T00:19:05.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status success for try_number 1 2024-05-24T00:19:05.785964847Z [2024-05-24T00:19:05.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:18:00+00:00, map_index=-1, run_start_date=2024-05-24 00:19:02.387022+00:00, run_end_date=2024-05-24 00:19:05.360661+00:00, run_duration=2.973639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:19:00.289642+00:00, queued_by_job_id=1, pid=6957 2024-05-24T00:20:00.124282157Z [2024-05-24T00:20:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:21:00+00:00 2024-05-24T00:20:00.132025676Z [2024-05-24T00:20:00.131+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:20:00.148824400Z [2024-05-24T00:20:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:25:00+00:00 2024-05-24T00:20:00.162300011Z [2024-05-24T00:20:00.161+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:20:00.175699624Z [2024-05-24T00:20:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:21:00+00:00 2024-05-24T00:20:00.325316432Z [2024-05-24T00:20:00.324+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T00:20:00.325392068Z 2024-05-24T00:20:00.325397369Z 2024-05-24T00:20:00.325403251Z 2024-05-24T00:20:00.325408228Z 2024-05-24T00:20:00.325412939Z 2024-05-24T00:20:00.326313157Z [2024-05-24T00:20:00.325+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:20:00.326367567Z [2024-05-24T00:20:00.325+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:20:00.326373012Z [2024-05-24T00:20:00.325+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:20:00.326377449Z [2024-05-24T00:20:00.325+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:20:00.326382345Z [2024-05-24T00:20:00.326+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:20:00.327292993Z [2024-05-24T00:20:00.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:20:00.327312362Z 2024-05-24T00:20:00.327318007Z 2024-05-24T00:20:00.327333708Z 2024-05-24T00:20:00.327338849Z 2024-05-24T00:20:00.327343190Z 2024-05-24T00:20:00.334619584Z [2024-05-24T00:20:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:20:00.334825340Z [2024-05-24T00:20:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:20:00.335162188Z [2024-05-24T00:20:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:20:00.335345941Z [2024-05-24T00:20:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:20:00.335713665Z [2024-05-24T00:20:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:20:00.335907748Z [2024-05-24T00:20:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:20:00.336291421Z [2024-05-24T00:20:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:20:00.336725012Z [2024-05-24T00:20:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:20:00.336769181Z [2024-05-24T00:20:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:20:00.337112411Z [2024-05-24T00:20:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:20:00.973490019Z [2024-05-24T00:20:00.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:00.973528181Z [2024-05-24T00:20:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:00.973532868Z [2024-05-24T00:20:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:00.973536549Z [2024-05-24T00:20:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:00.973539681Z [2024-05-24T00:20:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:00.982662822Z [2024-05-24T00:20:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to cca75607-56df-4833-a478-e2a75afd8e73 2024-05-24T00:20:00.982682726Z [2024-05-24T00:20:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to c30a3977-a052-4b9f-9e26-4cd764a27719 2024-05-24T00:20:00.982686580Z [2024-05-24T00:20:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d0554af-57ac-43f8-992d-ebf07f6f2d03 2024-05-24T00:20:00.982690413Z [2024-05-24T00:20:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0430443b-240f-4d69-b5d0-056c8c5050e7 2024-05-24T00:20:00.982693772Z [2024-05-24T00:20:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 371422ed-2750-4b2d-9460-cc9427f6b415 2024-05-24T00:20:02.120819016Z [2024-05-24T00:20:02.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:20:02.121171704Z [2024-05-24T00:20:02.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:19:00+00:00, run_id=scheduled__2024-05-24T00:19:00+00:00, run_start_date=2024-05-24 00:20:00.192384+00:00, run_end_date=2024-05-24 00:20:02.120682+00:00, run_duration=1.928298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:19:00+00:00, data_interval_end=2024-05-24 00:20:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:20:02.134773729Z [2024-05-24T00:20:02.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:21:00+00:00 2024-05-24T00:20:02.214222321Z [2024-05-24T00:20:02.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:18:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:02.214293426Z [2024-05-24T00:20:02.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:02.221221739Z [2024-05-24T00:20:02.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:18:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:01.492298+00:00, run_end_date=2024-05-24 00:20:02.044244+00:00, run_duration=0.551946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:00.328598+00:00, queued_by_job_id=1, pid=6999 2024-05-24T00:20:02.221413360Z [2024-05-24T00:20:02.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:19:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:01.434762+00:00, run_end_date=2024-05-24 00:20:01.949843+00:00, run_duration=0.515081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:00.328598+00:00, queued_by_job_id=1, pid=6998 2024-05-24T00:20:03.265793475Z [2024-05-24T00:20:03.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:20:03.265835884Z [2024-05-24T00:20:03.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:18:00+00:00, run_id=scheduled__2024-05-24T00:18:00+00:00, run_start_date=2024-05-24 00:20:00.189965+00:00, run_end_date=2024-05-24 00:20:03.264463+00:00, run_duration=3.074498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:18:00+00:00, data_interval_end=2024-05-24 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:20:03.275745808Z [2024-05-24T00:20:03.275+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:20:04.477174263Z [2024-05-24T00:20:04.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:20:04.477577051Z [2024-05-24T00:20:04.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:19:00+00:00, run_id=scheduled__2024-05-24T00:19:00+00:00, run_start_date=2024-05-24 00:20:00.194992+00:00, run_end_date=2024-05-24 00:20:04.477087+00:00, run_duration=4.282095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:19:00+00:00, data_interval_end=2024-05-24 00:20:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:20:04.486262021Z [2024-05-24T00:20:04.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:21:00+00:00 2024-05-24T00:20:04.553375359Z [2024-05-24T00:20:04.553+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:20:04.553408456Z 2024-05-24T00:20:04.553421984Z [2024-05-24T00:20:04.553+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:20:04.554181121Z [2024-05-24T00:20:04.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:20:04.554195999Z 2024-05-24T00:20:04.557328582Z [2024-05-24T00:20:04.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:20:04.557443004Z [2024-05-24T00:20:04.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:20:04.651153252Z [2024-05-24T00:20:04.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:04.655426859Z [2024-05-24T00:20:04.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:04.655524283Z [2024-05-24T00:20:04.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:04.668246203Z [2024-05-24T00:20:04.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:15:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:02.863579+00:00, run_end_date=2024-05-24 00:20:03.371942+00:00, run_duration=0.508363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:00.328598+00:00, queued_by_job_id=1, pid=7027 2024-05-24T00:20:04.668631246Z [2024-05-24T00:20:04.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:19:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:03.032197+00:00, run_end_date=2024-05-24 00:20:04.351822+00:00, run_duration=1.319625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:00.328598+00:00, queued_by_job_id=1, pid=7029 2024-05-24T00:20:04.668906414Z [2024-05-24T00:20:04.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcb96851-a77f-48d6-ad33-648a3609b714 2024-05-24T00:20:05.822263744Z [2024-05-24T00:20:05.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:20:05.822704949Z [2024-05-24T00:20:05.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:19:00+00:00, run_id=scheduled__2024-05-24T00:19:00+00:00, run_start_date=2024-05-24 00:20:00.197634+00:00, run_end_date=2024-05-24 00:20:05.821997+00:00, run_duration=5.624363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:19:00+00:00, data_interval_end=2024-05-24 00:20:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:20:05.833658489Z [2024-05-24T00:20:05.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:21:00+00:00 2024-05-24T00:20:05.891837129Z [2024-05-24T00:20:05.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:05.899284312Z [2024-05-24T00:20:05.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:19:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:03.185444+00:00, run_end_date=2024-05-24 00:20:05.583344+00:00, run_duration=2.3979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:00.328598+00:00, queued_by_job_id=1, pid=7030 2024-05-24T00:20:06.884299717Z [2024-05-24T00:20:06.883+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:20:06.884334072Z 2024-05-24T00:20:06.884351945Z [2024-05-24T00:20:06.884+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:20:06.885278684Z [2024-05-24T00:20:06.884+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:20:06.885296521Z 2024-05-24T00:20:06.888753367Z [2024-05-24T00:20:06.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:20:06.888977250Z [2024-05-24T00:20:06.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:20:06.960601744Z [2024-05-24T00:20:06.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:06.960632444Z [2024-05-24T00:20:06.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:06.967670741Z [2024-05-24T00:20:06.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ffd97e7-7426-4471-95a8-2108a6219cc9 2024-05-24T00:20:06.967863210Z [2024-05-24T00:20:06.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:15:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:06.209282+00:00, run_end_date=2024-05-24 00:20:06.608030+00:00, run_duration=0.398748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:04.554847+00:00, queued_by_job_id=1, pid=7053 2024-05-24T00:20:09.226784875Z [2024-05-24T00:20:09.226+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:20:09.226817347Z 2024-05-24T00:20:09.226878557Z [2024-05-24T00:20:09.226+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:20:09.227654180Z [2024-05-24T00:20:09.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:20:09.227684699Z 2024-05-24T00:20:09.230096306Z [2024-05-24T00:20:09.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:20:09.230175564Z [2024-05-24T00:20:09.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:20:09.283449983Z [2024-05-24T00:20:09.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:09.283692657Z [2024-05-24T00:20:09.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:09.290422788Z [2024-05-24T00:20:09.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd3d10b0-619c-491a-8f3d-fdaf1864d833 2024-05-24T00:20:09.290751025Z [2024-05-24T00:20:09.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:15:00+00:00, map_index=0, run_start_date=2024-05-24 00:20:08.485016+00:00, run_end_date=2024-05-24 00:20:08.928659+00:00, run_duration=0.443643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:06.886175+00:00, queued_by_job_id=1, pid=7061 2024-05-24T00:20:11.500650672Z [2024-05-24T00:20:11.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:20:11.501098139Z [2024-05-24T00:20:11.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:15:00+00:00, run_id=scheduled__2024-05-24T00:15:00+00:00, run_start_date=2024-05-24 00:20:00.186478+00:00, run_end_date=2024-05-24 00:20:11.500619+00:00, run_duration=11.314141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:15:00+00:00, data_interval_end=2024-05-24 00:20:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:20:11.509018891Z [2024-05-24T00:20:11.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:25:00+00:00 2024-05-24T00:20:12.075717582Z [2024-05-24T00:20:12.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:15:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:12.084920587Z [2024-05-24T00:20:12.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:15:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:11.084345+00:00, run_end_date=2024-05-24 00:20:11.443811+00:00, run_duration=0.359466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:09.228306+00:00, queued_by_job_id=1, pid=7069 2024-05-24T00:20:38.531856122Z [2024-05-24T00:20:38.531+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:21:00+00:00 2024-05-24T00:20:38.590118308Z [2024-05-24T00:20:38.589+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:20:38.590163675Z 2024-05-24T00:20:38.590430425Z [2024-05-24T00:20:38.589+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c has 0/16 running and queued tasks 2024-05-24T00:20:38.591577233Z [2024-05-24T00:20:38.591+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:20:38.591590807Z 2024-05-24T00:20:38.595145751Z [2024-05-24T00:20:38.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:20:38.595329392Z [2024-05-24T00:20:38.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:20:38.644257191Z [2024-05-24T00:20:38.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status queued for try_number 1 2024-05-24T00:20:38.648881258Z [2024-05-24T00:20:38.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf3c4c79-a189-4a19-9941-b6ea22896861 2024-05-24T00:20:39.795969907Z [2024-05-24T00:20:39.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:20:39.796606712Z [2024-05-24T00:20:39.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, execution_date=2024-05-24 00:19:00+00:00, run_id=scheduled__2024-05-24T00:19:00+00:00, run_start_date=2024-05-24 00:20:38.544909+00:00, run_end_date=2024-05-24 00:20:39.796142+00:00, run_duration=1.251233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:19:00+00:00, data_interval_end=2024-05-24 00:20:00+00:00, dag_hash=6b0f6d2c42039d466f03628d3e98b9dc 2024-05-24T00:20:39.810369149Z [2024-05-24T00:20:39.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c to 2024-05-24T00:20:00+00:00, run_after=2024-05-24T00:21:00+00:00 2024-05-24T00:20:39.855264830Z [2024-05-24T00:20:39.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:19:00+00:00 exited with status success for try_number 1 2024-05-24T00:20:39.863682588Z [2024-05-24T00:20:39.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:19:00+00:00, map_index=-1, run_start_date=2024-05-24 00:20:39.219244+00:00, run_end_date=2024-05-24 00:20:39.597273+00:00, run_duration=0.378029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:20:38.592311+00:00, queued_by_job_id=1, pid=7089 2024-05-24T00:21:00.397656452Z [2024-05-24T00:21:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c to 2024-05-24T00:21:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:21:00.411744272Z [2024-05-24T00:21:00.411+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:21:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:21:00.423270081Z [2024-05-24T00:21:00.422+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:21:00.440744204Z [2024-05-24T00:21:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:21:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:21:00.517699877Z [2024-05-24T00:21:00.517+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:21:00.517732042Z 2024-05-24T00:21:00.517735937Z 2024-05-24T00:21:00.517739040Z 2024-05-24T00:21:00.517742215Z 2024-05-24T00:21:00.517800477Z [2024-05-24T00:21:00.517+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c has 0/16 running and queued tasks 2024-05-24T00:21:00.517804916Z [2024-05-24T00:21:00.517+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:21:00.517915249Z [2024-05-24T00:21:00.517+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:21:00.517986441Z [2024-05-24T00:21:00.517+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:21:00.518600318Z [2024-05-24T00:21:00.518+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:21:00.518631203Z 2024-05-24T00:21:00.518639240Z 2024-05-24T00:21:00.518646412Z 2024-05-24T00:21:00.518733483Z 2024-05-24T00:21:00.521979080Z [2024-05-24T00:21:00.521+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:21:00.522116902Z [2024-05-24T00:21:00.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:21:00.522302578Z [2024-05-24T00:21:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:21:00.522381500Z [2024-05-24T00:21:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:21:00.522547287Z [2024-05-24T00:21:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:21:00.522644280Z [2024-05-24T00:21:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:21:00.522795158Z [2024-05-24T00:21:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:21:00.522858478Z [2024-05-24T00:21:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:21:00.913766638Z [2024-05-24T00:21:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:21:00.913935846Z [2024-05-24T00:21:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:21:00.914033005Z [2024-05-24T00:21:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:21:00.914169730Z [2024-05-24T00:21:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:21:00.930647776Z [2024-05-24T00:21:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 683dda1f-3332-4f6f-b84f-65643ea66e0a 2024-05-24T00:21:00.930684388Z [2024-05-24T00:21:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb2e8964-4da2-4b63-9b9b-57314ccfee3c 2024-05-24T00:21:00.933663937Z [2024-05-24T00:21:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3730e1ae-735d-453e-96ae-0b794db662cd 2024-05-24T00:21:00.933681360Z [2024-05-24T00:21:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad99fd3b-a8ae-4c2d-bef6-8216909e2d71 2024-05-24T00:21:02.156416038Z [2024-05-24T00:21:02.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:21:02.156982019Z [2024-05-24T00:21:02.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, execution_date=2024-05-24 00:20:00+00:00, run_id=scheduled__2024-05-24T00:20:00+00:00, run_start_date=2024-05-24 00:21:00.454410+00:00, run_end_date=2024-05-24 00:21:02.156505+00:00, run_duration=1.702095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:20:00+00:00, data_interval_end=2024-05-24 00:21:00+00:00, dag_hash=6b0f6d2c42039d466f03628d3e98b9dc 2024-05-24T00:21:02.167357501Z [2024-05-24T00:21:02.166+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c to 2024-05-24T00:21:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:21:02.192518493Z [2024-05-24T00:21:02.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:21:02.193016494Z [2024-05-24T00:21:02.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:20:00+00:00, run_id=scheduled__2024-05-24T00:20:00+00:00, run_start_date=2024-05-24 00:21:00.453139+00:00, run_end_date=2024-05-24 00:21:02.192547+00:00, run_duration=1.739408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:20:00+00:00, data_interval_end=2024-05-24 00:21:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:21:02.210021844Z [2024-05-24T00:21:02.209+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:21:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:21:02.252884370Z [2024-05-24T00:21:02.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:21:02.253050511Z [2024-05-24T00:21:02.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:21:02.265986257Z [2024-05-24T00:21:02.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:21:01.377864+00:00, run_end_date=2024-05-24 00:21:01.800032+00:00, run_duration=0.422168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:21:00.519427+00:00, queued_by_job_id=1, pid=7109 2024-05-24T00:21:02.266450764Z [2024-05-24T00:21:02.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:21:01.510295+00:00, run_end_date=2024-05-24 00:21:01.988322+00:00, run_duration=0.478027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:21:00.519427+00:00, queued_by_job_id=1, pid=7110 2024-05-24T00:21:05.119623688Z [2024-05-24T00:21:05.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:21:05.120480995Z [2024-05-24T00:21:05.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:20:00+00:00, run_id=scheduled__2024-05-24T00:20:00+00:00, run_start_date=2024-05-24 00:21:00.457896+00:00, run_end_date=2024-05-24 00:21:05.119425+00:00, run_duration=4.661529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:20:00+00:00, data_interval_end=2024-05-24 00:21:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:21:05.143539184Z [2024-05-24T00:21:05.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:21:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:21:05.153470412Z [2024-05-24T00:21:05.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:21:05.153967872Z [2024-05-24T00:21:05.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:20:00+00:00, run_id=scheduled__2024-05-24T00:20:00+00:00, run_start_date=2024-05-24 00:21:00.455635+00:00, run_end_date=2024-05-24 00:21:05.153258+00:00, run_duration=4.697623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:20:00+00:00, data_interval_end=2024-05-24 00:21:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:21:05.165497759Z [2024-05-24T00:21:05.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:21:00+00:00, run_after=2024-05-24T00:22:00+00:00 2024-05-24T00:21:05.214625367Z [2024-05-24T00:21:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:21:05.214913668Z [2024-05-24T00:21:05.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:21:05.226955225Z [2024-05-24T00:21:05.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:21:02.651187+00:00, run_end_date=2024-05-24 00:21:04.847567+00:00, run_duration=2.19638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:21:00.519427+00:00, queued_by_job_id=1, pid=7133 2024-05-24T00:21:05.227218764Z [2024-05-24T00:21:05.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:21:02.786338+00:00, run_end_date=2024-05-24 00:21:04.395321+00:00, run_duration=1.608983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:21:00.519427+00:00, queued_by_job_id=1, pid=7134 2024-05-24T00:21:40.328347203Z [2024-05-24T00:21:40.326+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:22:00.877121847Z [2024-05-24T00:22:00.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:23:00+00:00 2024-05-24T00:22:00.898089506Z [2024-05-24T00:22:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:23:00+00:00 2024-05-24T00:22:00.914268562Z [2024-05-24T00:22:00.913+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:22:00.952234833Z [2024-05-24T00:22:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:23:00+00:00 2024-05-24T00:22:00.963289228Z [2024-05-24T00:22:00.962+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:22:01.122087734Z [2024-05-24T00:22:01.121+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T00:22:01.122127665Z 2024-05-24T00:22:01.122135695Z 2024-05-24T00:22:01.122141413Z 2024-05-24T00:22:01.122146959Z 2024-05-24T00:22:01.122152442Z 2024-05-24T00:22:01.122221291Z [2024-05-24T00:22:01.121+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:22:01.122471103Z [2024-05-24T00:22:01.122+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:22:01.123439332Z [2024-05-24T00:22:01.123+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:22:01.123759094Z [2024-05-24T00:22:01.123+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c has 0/16 running and queued tasks 2024-05-24T00:22:01.124109432Z [2024-05-24T00:22:01.123+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:22:01.125689361Z [2024-05-24T00:22:01.125+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:22:01.125707558Z 2024-05-24T00:22:01.125713588Z 2024-05-24T00:22:01.125719299Z 2024-05-24T00:22:01.125724678Z 2024-05-24T00:22:01.125735010Z 2024-05-24T00:22:01.133114833Z [2024-05-24T00:22:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:22:01.133362784Z [2024-05-24T00:22:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:22:01.133711387Z [2024-05-24T00:22:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:22:01.133837725Z [2024-05-24T00:22:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:22:01.134112182Z [2024-05-24T00:22:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:22:01.134258366Z [2024-05-24T00:22:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:22:01.134394049Z [2024-05-24T00:22:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:22:01.134558224Z [2024-05-24T00:22:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:22:01.134824399Z [2024-05-24T00:22:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:22:01.134938832Z [2024-05-24T00:22:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:22:01.727599468Z [2024-05-24T00:22:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:22:01.727673466Z [2024-05-24T00:22:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status queued for try_number 1 2024-05-24T00:22:01.727678471Z [2024-05-24T00:22:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status queued for try_number 1 2024-05-24T00:22:01.727735388Z [2024-05-24T00:22:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status queued for try_number 1 2024-05-24T00:22:01.727831981Z [2024-05-24T00:22:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status queued for try_number 1 2024-05-24T00:22:01.756596300Z [2024-05-24T00:22:01.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fb0fd72-19c9-49c6-9e3a-f7dd5945e417 2024-05-24T00:22:01.756657869Z [2024-05-24T00:22:01.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6797f029-8434-4266-9d30-3f00a0080964 2024-05-24T00:22:01.756777592Z [2024-05-24T00:22:01.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0bc8a03-1830-42b9-beca-9d060032a954 2024-05-24T00:22:01.756882484Z [2024-05-24T00:22:01.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7deca5ab-4216-491f-bfbf-adce610e773b 2024-05-24T00:22:01.756959591Z [2024-05-24T00:22:01.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to f88ab5aa-7000-4c48-aee9-9581ba46d3ff 2024-05-24T00:22:03.127472122Z [2024-05-24T00:22:03.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:22:03.127986659Z [2024-05-24T00:22:03.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:20:00+00:00, run_id=scheduled__2024-05-24T00:20:00+00:00, run_start_date=2024-05-24 00:22:00.979851+00:00, run_end_date=2024-05-24 00:22:03.127570+00:00, run_duration=2.147719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:20:00+00:00, data_interval_end=2024-05-24 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:22:03.137064741Z [2024-05-24T00:22:03.136+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:24:00+00:00 2024-05-24T00:22:03.167613949Z [2024-05-24T00:22:03.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:22:03.167979864Z [2024-05-24T00:22:03.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:21:00+00:00, run_id=scheduled__2024-05-24T00:21:00+00:00, run_start_date=2024-05-24 00:22:00.983816+00:00, run_end_date=2024-05-24 00:22:03.167687+00:00, run_duration=2.183871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:21:00+00:00, data_interval_end=2024-05-24 00:22:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:22:03.180563812Z [2024-05-24T00:22:03.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:23:00+00:00 2024-05-24T00:22:03.223754542Z [2024-05-24T00:22:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:22:03.223887300Z [2024-05-24T00:22:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status success for try_number 1 2024-05-24T00:22:03.224061596Z [2024-05-24T00:22:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status failed for try_number 1 2024-05-24T00:22:03.237660587Z [2024-05-24T00:22:03.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:21:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:22:01.127722+00:00, queued_by_job_id=1, pid=None 2024-05-24T00:22:03.238275485Z [2024-05-24T00:22:03.238+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T00:22:03.241636679Z [2024-05-24T00:22:03.241+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T00:22:03.256957572Z [2024-05-24T00:22:03.256+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240524T002100, start_date=, end_date=20240524T002203 2024-05-24T00:22:03.269247999Z [2024-05-24T00:22:03.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:22:02.087249+00:00, run_end_date=2024-05-24 00:22:02.556106+00:00, run_duration=0.468857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:22:01.127722+00:00, queued_by_job_id=1, pid=7169 2024-05-24T00:22:03.269697000Z [2024-05-24T00:22:03.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:21:00+00:00, map_index=-1, run_start_date=2024-05-24 00:22:02.172218+00:00, run_end_date=2024-05-24 00:22:02.650122+00:00, run_duration=0.477904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:22:01.127722+00:00, queued_by_job_id=1, pid=7170 2024-05-24T00:22:04.931582583Z [2024-05-24T00:22:04.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:22:04.932166314Z [2024-05-24T00:22:04.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:21:00+00:00, run_id=scheduled__2024-05-24T00:21:00+00:00, run_start_date=2024-05-24 00:22:00.986861+00:00, run_end_date=2024-05-24 00:22:04.931682+00:00, run_duration=3.944821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:21:00+00:00, data_interval_end=2024-05-24 00:22:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:22:04.942966942Z [2024-05-24T00:22:04.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:23:00+00:00 2024-05-24T00:22:05.017602735Z [2024-05-24T00:22:05.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status success for try_number 1 2024-05-24T00:22:05.026289921Z [2024-05-24T00:22:05.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:21:00+00:00, map_index=-1, run_start_date=2024-05-24 00:22:03.241782+00:00, run_end_date=2024-05-24 00:22:04.651101+00:00, run_duration=1.409319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:22:01.127722+00:00, queued_by_job_id=1, pid=7198 2024-05-24T00:22:06.088588123Z [2024-05-24T00:22:06.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:22:06.089231872Z [2024-05-24T00:22:06.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:21:00+00:00, run_id=scheduled__2024-05-24T00:21:00+00:00, run_start_date=2024-05-24 00:22:00.988155+00:00, run_end_date=2024-05-24 00:22:06.088389+00:00, run_duration=5.100234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:21:00+00:00, data_interval_end=2024-05-24 00:22:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:22:06.113878524Z [2024-05-24T00:22:06.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:23:00+00:00 2024-05-24T00:22:06.174396591Z [2024-05-24T00:22:06.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status success for try_number 1 2024-05-24T00:22:06.182369372Z [2024-05-24T00:22:06.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:21:00+00:00, map_index=-1, run_start_date=2024-05-24 00:22:03.549259+00:00, run_end_date=2024-05-24 00:22:05.123522+00:00, run_duration=1.574263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:22:01.127722+00:00, queued_by_job_id=1, pid=7209 2024-05-24T00:22:13.290101117Z [2024-05-24T00:22:13.289+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:22:13.290159805Z 2024-05-24T00:22:13.290295587Z [2024-05-24T00:22:13.290+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c has 0/16 running and queued tasks 2024-05-24T00:22:13.291041337Z [2024-05-24T00:22:13.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:22:13.291064231Z 2024-05-24T00:22:13.293785299Z [2024-05-24T00:22:13.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:21:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:22:13.293975478Z [2024-05-24T00:22:13.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:22:13.354068404Z [2024-05-24T00:22:13.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status queued for try_number 2 2024-05-24T00:22:13.360768778Z [2024-05-24T00:22:13.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c5b17df-f639-45a4-8b77-73c914841120 2024-05-24T00:22:14.072452416Z [2024-05-24T00:22:14.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:21:00+00:00 exited with status failed for try_number 2 2024-05-24T00:22:14.079710074Z [2024-05-24T00:22:14.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:21:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 00:22:03.244368+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:22:13.291449+00:00, queued_by_job_id=1, pid=None 2024-05-24T00:22:14.080308068Z [2024-05-24T00:22:14.079+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T00:22:14.082582080Z [2024-05-24T00:22:14.082+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T00:22:14.094723285Z [2024-05-24T00:22:14.094+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240524T002100, start_date=, end_date=20240524T002214 2024-05-24T00:22:15.164600529Z [2024-05-24T00:22:15.164+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T00:22:15.165135631Z [2024-05-24T00:22:15.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c, execution_date=2024-05-24 00:21:00+00:00, run_id=scheduled__2024-05-24T00:21:00+00:00, run_start_date=2024-05-24 00:22:00.985310+00:00, run_end_date=2024-05-24 00:22:15.164501+00:00, run_duration=14.179191, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:21:00+00:00, data_interval_end=2024-05-24 00:22:00+00:00, dag_hash=6b0f6d2c42039d466f03628d3e98b9dc 2024-05-24T00:22:15.174358734Z [2024-05-24T00:22:15.173+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c684e7c8-d99e-4cc0-8e91-2474e330990c to 2024-05-24T00:22:00+00:00, run_after=2024-05-24T00:23:00+00:00 2024-05-24T00:23:00.877755325Z [2024-05-24T00:23:00.877+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:23:00+00:00, run_after=2024-05-24T00:24:00+00:00 2024-05-24T00:23:00.894492154Z [2024-05-24T00:23:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:23:00+00:00, run_after=2024-05-24T00:24:00+00:00 2024-05-24T00:23:00.903499838Z [2024-05-24T00:23:00.903+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:23:00.994667688Z [2024-05-24T00:23:00.994+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:23:00.994703738Z 2024-05-24T00:23:00.994708511Z 2024-05-24T00:23:00.994711953Z 2024-05-24T00:23:00.995066153Z [2024-05-24T00:23:00.994+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:23:00.997796149Z [2024-05-24T00:23:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:23:00.997811797Z [2024-05-24T00:23:00.995+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:23:00.997817335Z [2024-05-24T00:23:00.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:23:00.997820875Z 2024-05-24T00:23:00.997823982Z 2024-05-24T00:23:00.997827209Z 2024-05-24T00:23:00.999567702Z [2024-05-24T00:23:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:23:00.999586741Z [2024-05-24T00:23:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:23:00.999589981Z [2024-05-24T00:23:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:23:00.999592921Z [2024-05-24T00:23:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:23:00.999736538Z [2024-05-24T00:23:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:23:00.999830361Z [2024-05-24T00:23:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:23:01.286780336Z [2024-05-24T00:23:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status queued for try_number 1 2024-05-24T00:23:01.286873636Z [2024-05-24T00:23:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status queued for try_number 1 2024-05-24T00:23:01.286935558Z [2024-05-24T00:23:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status queued for try_number 1 2024-05-24T00:23:01.296992054Z [2024-05-24T00:23:01.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5487a08f-0375-4ca0-bcce-14c33879e83b 2024-05-24T00:23:01.297421189Z [2024-05-24T00:23:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to adeeee8a-82ec-4355-b107-bde92fba4f8c 2024-05-24T00:23:01.297753069Z [2024-05-24T00:23:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9200b7b9-f9de-4ed3-a512-d578e91000c3 2024-05-24T00:23:02.501268708Z [2024-05-24T00:23:02.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:23:02.501944945Z [2024-05-24T00:23:02.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:22:00+00:00, run_id=scheduled__2024-05-24T00:22:00+00:00, run_start_date=2024-05-24 00:23:00.918917+00:00, run_end_date=2024-05-24 00:23:02.501496+00:00, run_duration=1.582579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:22:00+00:00, data_interval_end=2024-05-24 00:23:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:23:02.518140866Z [2024-05-24T00:23:02.517+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:23:00+00:00, run_after=2024-05-24T00:24:00+00:00 2024-05-24T00:23:02.554528411Z [2024-05-24T00:23:02.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status success for try_number 1 2024-05-24T00:23:02.560605767Z [2024-05-24T00:23:02.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:22:00+00:00, map_index=-1, run_start_date=2024-05-24 00:23:01.855389+00:00, run_end_date=2024-05-24 00:23:02.273726+00:00, run_duration=0.418337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:23:00.996537+00:00, queued_by_job_id=1, pid=7246 2024-05-24T00:23:05.920702832Z [2024-05-24T00:23:05.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:23:05.921139215Z [2024-05-24T00:23:05.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:22:00+00:00, run_id=scheduled__2024-05-24T00:22:00+00:00, run_start_date=2024-05-24 00:23:00.925010+00:00, run_end_date=2024-05-24 00:23:05.920578+00:00, run_duration=4.995568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:22:00+00:00, data_interval_end=2024-05-24 00:23:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:23:05.942076685Z [2024-05-24T00:23:05.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:23:00+00:00, run_after=2024-05-24T00:24:00+00:00 2024-05-24T00:23:05.952691113Z [2024-05-24T00:23:05.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:23:05.952819803Z [2024-05-24T00:23:05.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:22:00+00:00, run_id=scheduled__2024-05-24T00:22:00+00:00, run_start_date=2024-05-24 00:23:00.923306+00:00, run_end_date=2024-05-24 00:23:05.952505+00:00, run_duration=5.029199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:22:00+00:00, data_interval_end=2024-05-24 00:23:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:23:05.963905444Z [2024-05-24T00:23:05.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:23:00+00:00, run_after=2024-05-24T00:24:00+00:00 2024-05-24T00:23:06.004765669Z [2024-05-24T00:23:06.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status success for try_number 1 2024-05-24T00:23:06.007022299Z [2024-05-24T00:23:06.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status success for try_number 1 2024-05-24T00:23:06.019398801Z [2024-05-24T00:23:06.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:22:00+00:00, map_index=-1, run_start_date=2024-05-24 00:23:02.997078+00:00, run_end_date=2024-05-24 00:23:04.782241+00:00, run_duration=1.785163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:23:00.996537+00:00, queued_by_job_id=1, pid=7265 2024-05-24T00:23:06.020417362Z [2024-05-24T00:23:06.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:22:00+00:00, map_index=-1, run_start_date=2024-05-24 00:23:02.840710+00:00, run_end_date=2024-05-24 00:23:05.087593+00:00, run_duration=2.246883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:23:00.996537+00:00, queued_by_job_id=1, pid=7264 2024-05-24T00:24:00.278889743Z [2024-05-24T00:24:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:24:00+00:00, run_after=2024-05-24T00:25:00+00:00 2024-05-24T00:24:00.289592754Z [2024-05-24T00:24:00.288+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:24:00.309776229Z [2024-05-24T00:24:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:24:00+00:00, run_after=2024-05-24T00:25:00+00:00 2024-05-24T00:24:00.316684966Z [2024-05-24T00:24:00.316+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:24:00.410943444Z [2024-05-24T00:24:00.410+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:24:00.410977082Z 2024-05-24T00:24:00.410988499Z 2024-05-24T00:24:00.410994886Z 2024-05-24T00:24:00.411001168Z 2024-05-24T00:24:00.411522844Z [2024-05-24T00:24:00.411+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:24:00.411787772Z [2024-05-24T00:24:00.411+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:24:00.412105463Z [2024-05-24T00:24:00.411+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:24:00.412363202Z [2024-05-24T00:24:00.412+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:24:00.413733085Z [2024-05-24T00:24:00.413+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:24:00.413744573Z 2024-05-24T00:24:00.413751209Z 2024-05-24T00:24:00.413755117Z 2024-05-24T00:24:00.413758719Z 2024-05-24T00:24:00.419258770Z [2024-05-24T00:24:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:24:00.419322972Z [2024-05-24T00:24:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:24:00.419679716Z [2024-05-24T00:24:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:24:00.419832342Z [2024-05-24T00:24:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:24:00.420067146Z [2024-05-24T00:24:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:24:00.420207308Z [2024-05-24T00:24:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:24:00.420557625Z [2024-05-24T00:24:00.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:24:00.420834103Z [2024-05-24T00:24:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:24:01.113846010Z [2024-05-24T00:24:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status queued for try_number 1 2024-05-24T00:24:01.114252491Z [2024-05-24T00:24:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:23:00+00:00 exited with status queued for try_number 1 2024-05-24T00:24:01.114476397Z [2024-05-24T00:24:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:23:00+00:00 exited with status queued for try_number 1 2024-05-24T00:24:01.114673511Z [2024-05-24T00:24:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:23:00+00:00 exited with status queued for try_number 1 2024-05-24T00:24:01.125178734Z [2024-05-24T00:24:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to dddde12c-6274-44aa-8d28-1dc6aa317145 2024-05-24T00:24:01.125467636Z [2024-05-24T00:24:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 267081ba-a264-41eb-b28c-295e95065d9a 2024-05-24T00:24:01.125705046Z [2024-05-24T00:24:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to edc59976-e1cd-43c2-8c42-c363b7a60c57 2024-05-24T00:24:01.125930072Z [2024-05-24T00:24:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9cf6cf8-4b4d-4806-9489-8603639b398a 2024-05-24T00:24:02.303612765Z [2024-05-24T00:24:02.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:24:02.304179603Z [2024-05-24T00:24:02.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:22:00+00:00, run_id=scheduled__2024-05-24T00:22:00+00:00, run_start_date=2024-05-24 00:24:00.327723+00:00, run_end_date=2024-05-24 00:24:02.303698+00:00, run_duration=1.975975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:22:00+00:00, data_interval_end=2024-05-24 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:24:02.313442108Z [2024-05-24T00:24:02.313+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:24:00+00:00, run_after=2024-05-24T00:26:00+00:00 2024-05-24T00:24:02.331818521Z [2024-05-24T00:24:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:24:02.332082694Z [2024-05-24T00:24:02.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:23:00+00:00, run_id=scheduled__2024-05-24T00:23:00+00:00, run_start_date=2024-05-24 00:24:00.329209+00:00, run_end_date=2024-05-24 00:24:02.331823+00:00, run_duration=2.002614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:23:00+00:00, data_interval_end=2024-05-24 00:24:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:24:02.355522994Z [2024-05-24T00:24:02.355+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:24:00+00:00, run_after=2024-05-24T00:25:00+00:00 2024-05-24T00:24:02.387538643Z [2024-05-24T00:24:02.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:22:00+00:00 exited with status success for try_number 1 2024-05-24T00:24:02.387555778Z [2024-05-24T00:24:02.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:23:00+00:00 exited with status success for try_number 1 2024-05-24T00:24:02.396018076Z [2024-05-24T00:24:02.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:22:00+00:00, map_index=-1, run_start_date=2024-05-24 00:24:01.314399+00:00, run_end_date=2024-05-24 00:24:01.703584+00:00, run_duration=0.389185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:24:00.415340+00:00, queued_by_job_id=1, pid=7298 2024-05-24T00:24:02.396341576Z [2024-05-24T00:24:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:23:00+00:00, map_index=-1, run_start_date=2024-05-24 00:24:01.547160+00:00, run_end_date=2024-05-24 00:24:01.957021+00:00, run_duration=0.409861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:24:00.415340+00:00, queued_by_job_id=1, pid=7299 2024-05-24T00:24:04.144030791Z [2024-05-24T00:24:04.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:24:04.144276346Z [2024-05-24T00:24:04.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:23:00+00:00, run_id=scheduled__2024-05-24T00:23:00+00:00, run_start_date=2024-05-24 00:24:00.330351+00:00, run_end_date=2024-05-24 00:24:04.143936+00:00, run_duration=3.813585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:23:00+00:00, data_interval_end=2024-05-24 00:24:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:24:04.152100794Z [2024-05-24T00:24:04.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:24:00+00:00, run_after=2024-05-24T00:25:00+00:00 2024-05-24T00:24:04.199173656Z [2024-05-24T00:24:04.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:23:00+00:00 exited with status success for try_number 1 2024-05-24T00:24:04.209216605Z [2024-05-24T00:24:04.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:23:00+00:00, map_index=-1, run_start_date=2024-05-24 00:24:02.501679+00:00, run_end_date=2024-05-24 00:24:03.822609+00:00, run_duration=1.32093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:24:00.415340+00:00, queued_by_job_id=1, pid=7322 2024-05-24T00:24:05.266042368Z [2024-05-24T00:24:05.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:24:05.266848768Z [2024-05-24T00:24:05.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:23:00+00:00, run_id=scheduled__2024-05-24T00:23:00+00:00, run_start_date=2024-05-24 00:24:00.331445+00:00, run_end_date=2024-05-24 00:24:05.265932+00:00, run_duration=4.934487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:23:00+00:00, data_interval_end=2024-05-24 00:24:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:24:05.285854977Z [2024-05-24T00:24:05.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:24:00+00:00, run_after=2024-05-24T00:25:00+00:00 2024-05-24T00:24:05.327676287Z [2024-05-24T00:24:05.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:23:00+00:00 exited with status success for try_number 1 2024-05-24T00:24:05.337997509Z [2024-05-24T00:24:05.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:23:00+00:00, map_index=-1, run_start_date=2024-05-24 00:24:02.565711+00:00, run_end_date=2024-05-24 00:24:04.206327+00:00, run_duration=1.640616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:24:00.415340+00:00, queued_by_job_id=1, pid=7323 2024-05-24T00:25:00.586660543Z [2024-05-24T00:25:00.586+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:25:00+00:00, run_after=2024-05-24T00:26:00+00:00 2024-05-24T00:25:00.599035139Z [2024-05-24T00:25:00.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:25:00+00:00, run_after=2024-05-24T00:26:00+00:00 2024-05-24T00:25:00.606311529Z [2024-05-24T00:25:00.605+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:25:00.618470931Z [2024-05-24T00:25:00.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:25:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:25:00.723494889Z [2024-05-24T00:25:00.723+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:25:00.723554652Z 2024-05-24T00:25:00.723571674Z 2024-05-24T00:25:00.723594669Z 2024-05-24T00:25:00.723604056Z 2024-05-24T00:25:00.723707200Z [2024-05-24T00:25:00.723+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:25:00.723737375Z [2024-05-24T00:25:00.723+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:25:00.723870997Z [2024-05-24T00:25:00.723+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:25:00.723950924Z [2024-05-24T00:25:00.723+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:25:00.725018849Z [2024-05-24T00:25:00.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:25:00.725039454Z 2024-05-24T00:25:00.725048792Z 2024-05-24T00:25:00.725057217Z 2024-05-24T00:25:00.725065507Z 2024-05-24T00:25:00.729405440Z [2024-05-24T00:25:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:25:00.729534175Z [2024-05-24T00:25:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:25:00.729894578Z [2024-05-24T00:25:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:25:00.730477994Z [2024-05-24T00:25:00.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:25:00.730825811Z [2024-05-24T00:25:00.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:25:00.730911312Z [2024-05-24T00:25:00.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:25:00.731124062Z [2024-05-24T00:25:00.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:25:00.731215475Z [2024-05-24T00:25:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:25:01.065425309Z [2024-05-24T00:25:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:25:01.065509276Z [2024-05-24T00:25:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status queued for try_number 1 2024-05-24T00:25:01.065609569Z [2024-05-24T00:25:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status queued for try_number 1 2024-05-24T00:25:01.065715080Z [2024-05-24T00:25:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status queued for try_number 1 2024-05-24T00:25:01.073690101Z [2024-05-24T00:25:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a59ea40-f71d-469a-b93d-91ec1ae61c8d 2024-05-24T00:25:01.073817392Z [2024-05-24T00:25:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ea69393-9301-4c67-9b73-19512ca40aab 2024-05-24T00:25:01.073958989Z [2024-05-24T00:25:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2df8715-9736-4f5c-a015-71cecb103b24 2024-05-24T00:25:01.074101159Z [2024-05-24T00:25:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to b523fc3f-2188-47d8-94f9-53d58f201d69 2024-05-24T00:25:03.289047673Z [2024-05-24T00:25:03.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:25:03.289268693Z [2024-05-24T00:25:03.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:24:00+00:00, run_id=scheduled__2024-05-24T00:24:00+00:00, run_start_date=2024-05-24 00:25:00.631315+00:00, run_end_date=2024-05-24 00:25:03.288941+00:00, run_duration=2.657626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:24:00+00:00, data_interval_end=2024-05-24 00:25:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:25:03.299272281Z [2024-05-24T00:25:03.298+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:25:00+00:00, run_after=2024-05-24T00:26:00+00:00 2024-05-24T00:25:03.363482635Z [2024-05-24T00:25:03.363+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:25:03.363506238Z 2024-05-24T00:25:03.363654837Z [2024-05-24T00:25:03.363+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:25:03.364768185Z [2024-05-24T00:25:03.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:25:03.364775336Z 2024-05-24T00:25:03.367508803Z [2024-05-24T00:25:03.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:25:03.367648885Z [2024-05-24T00:25:03.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:25:03.449311485Z [2024-05-24T00:25:03.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:25:03.449375275Z [2024-05-24T00:25:03.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:25:03.449380487Z [2024-05-24T00:25:03.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status success for try_number 1 2024-05-24T00:25:03.463873225Z [2024-05-24T00:25:03.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:25:02.621109+00:00, run_end_date=2024-05-24 00:25:03.090935+00:00, run_duration=0.469826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:25:00.726093+00:00, queued_by_job_id=1, pid=7380 2024-05-24T00:25:03.463989529Z [2024-05-24T00:25:03.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:24:00+00:00, map_index=-1, run_start_date=2024-05-24 00:25:01.701510+00:00, run_end_date=2024-05-24 00:25:02.188367+00:00, run_duration=0.486857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:25:00.726093+00:00, queued_by_job_id=1, pid=7356 2024-05-24T00:25:03.464128633Z [2024-05-24T00:25:03.464+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40bcfcef-5561-4b3b-9eb3-5bfdc832671e 2024-05-24T00:25:04.598430381Z [2024-05-24T00:25:04.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:25:04.598605246Z [2024-05-24T00:25:04.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:24:00+00:00, run_id=scheduled__2024-05-24T00:24:00+00:00, run_start_date=2024-05-24 00:25:00.632893+00:00, run_end_date=2024-05-24 00:25:04.598303+00:00, run_duration=3.96541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:24:00+00:00, data_interval_end=2024-05-24 00:25:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:25:04.607218898Z [2024-05-24T00:25:04.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:25:00+00:00, run_after=2024-05-24T00:26:00+00:00 2024-05-24T00:25:04.614215310Z [2024-05-24T00:25:04.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:25:04.614310376Z [2024-05-24T00:25:04.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:24:00+00:00, run_id=scheduled__2024-05-24T00:24:00+00:00, run_start_date=2024-05-24 00:25:00.634968+00:00, run_end_date=2024-05-24 00:25:04.614087+00:00, run_duration=3.979119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:24:00+00:00, data_interval_end=2024-05-24 00:25:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:25:04.623252022Z [2024-05-24T00:25:04.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:25:00+00:00, run_after=2024-05-24T00:26:00+00:00 2024-05-24T00:25:04.664526370Z [2024-05-24T00:25:04.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status success for try_number 1 2024-05-24T00:25:04.672263988Z [2024-05-24T00:25:04.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:24:00+00:00, map_index=-1, run_start_date=2024-05-24 00:25:02.898581+00:00, run_end_date=2024-05-24 00:25:04.251387+00:00, run_duration=1.352806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:25:00.726093+00:00, queued_by_job_id=1, pid=7382 2024-05-24T00:25:05.822545733Z [2024-05-24T00:25:05.821+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:25:05.822585276Z 2024-05-24T00:25:05.823024552Z [2024-05-24T00:25:05.822+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:25:05.824474320Z [2024-05-24T00:25:05.824+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:25:05.824518923Z 2024-05-24T00:25:05.829531335Z [2024-05-24T00:25:05.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:25:05.830839291Z [2024-05-24T00:25:05.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:25:05.880872146Z [2024-05-24T00:25:05.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:25:05.880905180Z [2024-05-24T00:25:05.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status success for try_number 1 2024-05-24T00:25:05.890835745Z [2024-05-24T00:25:05.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:24:00+00:00, map_index=-1, run_start_date=2024-05-24 00:25:02.880001+00:00, run_end_date=2024-05-24 00:25:04.541296+00:00, run_duration=1.661295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:25:00.726093+00:00, queued_by_job_id=1, pid=7381 2024-05-24T00:25:05.891033482Z [2024-05-24T00:25:05.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79762a56-897d-4c40-a050-181cefbf99b1 2024-05-24T00:25:05.997386738Z [2024-05-24T00:25:05.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:25:06.015192175Z [2024-05-24T00:25:06.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:25:05.252778+00:00, run_end_date=2024-05-24 00:25:05.683856+00:00, run_duration=0.431078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:25:03.365246+00:00, queued_by_job_id=1, pid=7405 2024-05-24T00:25:08.462784935Z [2024-05-24T00:25:08.462+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:25:08.462909738Z 2024-05-24T00:25:08.463008195Z [2024-05-24T00:25:08.462+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:25:08.463617124Z [2024-05-24T00:25:08.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:25:08.463635334Z 2024-05-24T00:25:08.467288543Z [2024-05-24T00:25:08.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:25:08.467462398Z [2024-05-24T00:25:08.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:25:08.547553463Z [2024-05-24T00:25:08.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status queued for try_number 1 2024-05-24T00:25:08.547849664Z [2024-05-24T00:25:08.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:25:08.555592773Z [2024-05-24T00:25:08.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=0, run_start_date=2024-05-24 00:25:07.448986+00:00, run_end_date=2024-05-24 00:25:07.803040+00:00, run_duration=0.354054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:25:05.825607+00:00, queued_by_job_id=1, pid=7413 2024-05-24T00:25:08.556162243Z [2024-05-24T00:25:08.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a2a4946-2e76-41b3-97e7-381d0e83faa0 2024-05-24T00:25:10.868985327Z [2024-05-24T00:25:10.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:25:10.869205021Z [2024-05-24T00:25:10.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:20:00+00:00, run_id=scheduled__2024-05-24T00:20:00+00:00, run_start_date=2024-05-24 00:25:00.630064+00:00, run_end_date=2024-05-24 00:25:10.868795+00:00, run_duration=10.238731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:20:00+00:00, data_interval_end=2024-05-24 00:25:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:25:10.875225471Z [2024-05-24T00:25:10.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:25:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:25:10.933966541Z [2024-05-24T00:25:10.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:20:00+00:00 exited with status success for try_number 1 2024-05-24T00:25:10.950636734Z [2024-05-24T00:25:10.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:20:00+00:00, map_index=-1, run_start_date=2024-05-24 00:25:10.203530+00:00, run_end_date=2024-05-24 00:25:10.634431+00:00, run_duration=0.430901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:25:08.464113+00:00, queued_by_job_id=1, pid=7421 2024-05-24T00:26:00.870122876Z [2024-05-24T00:26:00.869+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:26:00.882315615Z [2024-05-24T00:26:00.881+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:26:00.905981302Z [2024-05-24T00:26:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:26:00+00:00, run_after=2024-05-24T00:27:00+00:00 2024-05-24T00:26:00.925937442Z [2024-05-24T00:26:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:26:00+00:00, run_after=2024-05-24T00:27:00+00:00 2024-05-24T00:26:01.077045315Z [2024-05-24T00:26:01.076+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:26:01.077092625Z 2024-05-24T00:26:01.077103832Z 2024-05-24T00:26:01.077112441Z 2024-05-24T00:26:01.077121080Z 2024-05-24T00:26:01.077231280Z [2024-05-24T00:26:01.076+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:26:01.077515567Z [2024-05-24T00:26:01.077+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:26:01.077553914Z [2024-05-24T00:26:01.077+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:26:01.077850056Z [2024-05-24T00:26:01.077+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:26:01.078473092Z [2024-05-24T00:26:01.078+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:26:01.078487000Z 2024-05-24T00:26:01.078498635Z 2024-05-24T00:26:01.078516236Z 2024-05-24T00:26:01.078519677Z 2024-05-24T00:26:01.083884333Z [2024-05-24T00:26:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:26:01.084205870Z [2024-05-24T00:26:01.083+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:26:01.084557806Z [2024-05-24T00:26:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:26:01.084824865Z [2024-05-24T00:26:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:26:01.085174705Z [2024-05-24T00:26:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:26:01.085425239Z [2024-05-24T00:26:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:26:01.085761793Z [2024-05-24T00:26:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:26:01.085969990Z [2024-05-24T00:26:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:26:01.428509510Z [2024-05-24T00:26:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status queued for try_number 1 2024-05-24T00:26:01.428612803Z [2024-05-24T00:26:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status queued for try_number 1 2024-05-24T00:26:01.428762844Z [2024-05-24T00:26:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status queued for try_number 1 2024-05-24T00:26:01.428774039Z [2024-05-24T00:26:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status queued for try_number 1 2024-05-24T00:26:01.459957026Z [2024-05-24T00:26:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01a53e1a-6078-4cc2-978c-4ff624044c6f 2024-05-24T00:26:01.459992330Z [2024-05-24T00:26:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43b6fda7-44dd-41e4-b27c-debda60f57b6 2024-05-24T00:26:01.460271344Z [2024-05-24T00:26:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6506d199-57cd-43c9-99c0-ec2ba6f53e1c 2024-05-24T00:26:01.461205761Z [2024-05-24T00:26:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d69b494-3131-48b3-acf4-9fc7c3143ba4 2024-05-24T00:26:02.871705360Z [2024-05-24T00:26:02.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:26:02.872141182Z [2024-05-24T00:26:02.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:25:00+00:00, run_id=scheduled__2024-05-24T00:25:00+00:00, run_start_date=2024-05-24 00:26:00.963519+00:00, run_end_date=2024-05-24 00:26:02.871651+00:00, run_duration=1.908132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:25:00+00:00, data_interval_end=2024-05-24 00:26:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:26:02.900239534Z [2024-05-24T00:26:02.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:26:00+00:00, run_after=2024-05-24T00:27:00+00:00 2024-05-24T00:26:02.979041386Z [2024-05-24T00:26:02.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status success for try_number 1 2024-05-24T00:26:02.988511177Z [2024-05-24T00:26:02.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:25:00+00:00, map_index=-1, run_start_date=2024-05-24 00:26:02.083229+00:00, run_end_date=2024-05-24 00:26:02.648913+00:00, run_duration=0.565684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:26:01.079593+00:00, queued_by_job_id=1, pid=7444 2024-05-24T00:26:03.244457257Z [2024-05-24T00:26:03.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:26:03.246531985Z [2024-05-24T00:26:03.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:24:00+00:00, run_id=scheduled__2024-05-24T00:24:00+00:00, run_start_date=2024-05-24 00:26:00.961739+00:00, run_end_date=2024-05-24 00:26:03.244371+00:00, run_duration=2.282632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:24:00+00:00, data_interval_end=2024-05-24 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:26:03.253546094Z [2024-05-24T00:26:03.253+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:26:00+00:00, run_after=2024-05-24T00:28:00+00:00 2024-05-24T00:26:04.436940719Z [2024-05-24T00:26:04.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:24:00+00:00 exited with status success for try_number 1 2024-05-24T00:26:04.450244263Z [2024-05-24T00:26:04.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:24:00+00:00, map_index=-1, run_start_date=2024-05-24 00:26:02.400816+00:00, run_end_date=2024-05-24 00:26:03.229904+00:00, run_duration=0.829088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:26:01.079593+00:00, queued_by_job_id=1, pid=7445 2024-05-24T00:26:06.278825125Z [2024-05-24T00:26:06.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:26:06.278989919Z [2024-05-24T00:26:06.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:25:00+00:00, run_id=scheduled__2024-05-24T00:25:00+00:00, run_start_date=2024-05-24 00:26:00.966820+00:00, run_end_date=2024-05-24 00:26:06.278656+00:00, run_duration=5.311836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:25:00+00:00, data_interval_end=2024-05-24 00:26:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:26:06.290585941Z [2024-05-24T00:26:06.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:26:00+00:00, run_after=2024-05-24T00:27:00+00:00 2024-05-24T00:26:06.299586666Z [2024-05-24T00:26:06.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:26:06.299691431Z [2024-05-24T00:26:06.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:25:00+00:00, run_id=scheduled__2024-05-24T00:25:00+00:00, run_start_date=2024-05-24 00:26:00.965661+00:00, run_end_date=2024-05-24 00:26:06.299286+00:00, run_duration=5.333625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:25:00+00:00, data_interval_end=2024-05-24 00:26:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:26:06.311536322Z [2024-05-24T00:26:06.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:26:00+00:00, run_after=2024-05-24T00:27:00+00:00 2024-05-24T00:26:06.354406619Z [2024-05-24T00:26:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status success for try_number 1 2024-05-24T00:26:06.354476595Z [2024-05-24T00:26:06.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status success for try_number 1 2024-05-24T00:26:06.363363482Z [2024-05-24T00:26:06.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:25:00+00:00, map_index=-1, run_start_date=2024-05-24 00:26:03.676310+00:00, run_end_date=2024-05-24 00:26:05.092969+00:00, run_duration=1.416659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:26:01.079593+00:00, queued_by_job_id=1, pid=7469 2024-05-24T00:26:06.363526370Z [2024-05-24T00:26:06.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:25:00+00:00, map_index=-1, run_start_date=2024-05-24 00:26:03.565250+00:00, run_end_date=2024-05-24 00:26:05.487727+00:00, run_duration=1.922477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:26:01.079593+00:00, queued_by_job_id=1, pid=7468 2024-05-24T00:26:40.403854532Z [2024-05-24T00:26:40.403+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:27:00.103545871Z [2024-05-24T00:27:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:27:00+00:00, run_after=2024-05-24T00:28:00+00:00 2024-05-24T00:27:00.125260202Z [2024-05-24T00:27:00.124+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:27:00.144049143Z [2024-05-24T00:27:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:27:00+00:00, run_after=2024-05-24T00:28:00+00:00 2024-05-24T00:27:00.261879982Z [2024-05-24T00:27:00.261+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:27:00.261924802Z 2024-05-24T00:27:00.261934594Z 2024-05-24T00:27:00.261943478Z 2024-05-24T00:27:00.262371159Z [2024-05-24T00:27:00.262+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:27:00.262802624Z [2024-05-24T00:27:00.262+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:27:00.263091718Z [2024-05-24T00:27:00.262+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:27:00.264383206Z [2024-05-24T00:27:00.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:27:00.264413409Z 2024-05-24T00:27:00.264422586Z 2024-05-24T00:27:00.264430560Z 2024-05-24T00:27:00.272145122Z [2024-05-24T00:27:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:27:00.272656276Z [2024-05-24T00:27:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:27:00.273582145Z [2024-05-24T00:27:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:27:00.273826801Z [2024-05-24T00:27:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:27:00.274289350Z [2024-05-24T00:27:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:27:00.274633478Z [2024-05-24T00:27:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:27:00.659745866Z [2024-05-24T00:27:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status queued for try_number 1 2024-05-24T00:27:00.662495853Z [2024-05-24T00:27:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status queued for try_number 1 2024-05-24T00:27:00.662848917Z [2024-05-24T00:27:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status queued for try_number 1 2024-05-24T00:27:00.677212095Z [2024-05-24T00:27:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac6e3c41-9bd4-4b81-8061-42faac8a65e4 2024-05-24T00:27:00.677568104Z [2024-05-24T00:27:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to daf8cd93-7d45-44a2-9a2a-22cdc3005e5b 2024-05-24T00:27:00.677819298Z [2024-05-24T00:27:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fc13e78-00e6-41f6-88de-2ad8b1e4ae6d 2024-05-24T00:27:01.870429651Z [2024-05-24T00:27:01.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:27:01.871142869Z [2024-05-24T00:27:01.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:26:00+00:00, run_id=scheduled__2024-05-24T00:26:00+00:00, run_start_date=2024-05-24 00:27:00.158416+00:00, run_end_date=2024-05-24 00:27:01.870370+00:00, run_duration=1.711954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:26:00+00:00, data_interval_end=2024-05-24 00:27:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:27:01.883564240Z [2024-05-24T00:27:01.883+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:27:00+00:00, run_after=2024-05-24T00:28:00+00:00 2024-05-24T00:27:01.920301339Z [2024-05-24T00:27:01.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status success for try_number 1 2024-05-24T00:27:01.925255540Z [2024-05-24T00:27:01.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:26:00+00:00, map_index=-1, run_start_date=2024-05-24 00:27:01.109708+00:00, run_end_date=2024-05-24 00:27:01.469479+00:00, run_duration=0.359771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:27:00.266189+00:00, queued_by_job_id=1, pid=7500 2024-05-24T00:27:04.089942561Z [2024-05-24T00:27:04.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:27:04.090254974Z [2024-05-24T00:27:04.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:26:00+00:00, run_id=scheduled__2024-05-24T00:26:00+00:00, run_start_date=2024-05-24 00:27:00.162008+00:00, run_end_date=2024-05-24 00:27:04.089856+00:00, run_duration=3.927848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:26:00+00:00, data_interval_end=2024-05-24 00:27:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:27:04.101356395Z [2024-05-24T00:27:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:27:00+00:00, run_after=2024-05-24T00:28:00+00:00 2024-05-24T00:27:04.107520659Z [2024-05-24T00:27:04.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:27:04.107797170Z [2024-05-24T00:27:04.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:26:00+00:00, run_id=scheduled__2024-05-24T00:26:00+00:00, run_start_date=2024-05-24 00:27:00.160424+00:00, run_end_date=2024-05-24 00:27:04.107477+00:00, run_duration=3.947053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:26:00+00:00, data_interval_end=2024-05-24 00:27:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:27:04.118461753Z [2024-05-24T00:27:04.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:27:00+00:00, run_after=2024-05-24T00:28:00+00:00 2024-05-24T00:27:04.151681316Z [2024-05-24T00:27:04.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status success for try_number 1 2024-05-24T00:27:04.151740852Z [2024-05-24T00:27:04.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status success for try_number 1 2024-05-24T00:27:04.161082602Z [2024-05-24T00:27:04.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:26:00+00:00, map_index=-1, run_start_date=2024-05-24 00:27:02.135496+00:00, run_end_date=2024-05-24 00:27:03.907089+00:00, run_duration=1.771593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:27:00.266189+00:00, queued_by_job_id=1, pid=7518 2024-05-24T00:27:04.161716467Z [2024-05-24T00:27:04.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:26:00+00:00, map_index=-1, run_start_date=2024-05-24 00:27:02.231364+00:00, run_end_date=2024-05-24 00:27:03.469916+00:00, run_duration=1.238552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:27:00.266189+00:00, queued_by_job_id=1, pid=7519 2024-05-24T00:28:00.157732842Z [2024-05-24T00:28:00.157+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:28:00.171557041Z [2024-05-24T00:28:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:28:00+00:00, run_after=2024-05-24T00:29:00+00:00 2024-05-24T00:28:00.186563698Z [2024-05-24T00:28:00.186+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:28:00.214692716Z [2024-05-24T00:28:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:28:00+00:00, run_after=2024-05-24T00:29:00+00:00 2024-05-24T00:28:00.295751908Z [2024-05-24T00:28:00.294+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:28:00.295775158Z 2024-05-24T00:28:00.295789609Z 2024-05-24T00:28:00.295792750Z 2024-05-24T00:28:00.295795919Z 2024-05-24T00:28:00.295800832Z [2024-05-24T00:28:00.294+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:28:00.295803979Z [2024-05-24T00:28:00.295+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:28:00.295807298Z [2024-05-24T00:28:00.295+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:28:00.295810357Z [2024-05-24T00:28:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:28:00.296935340Z [2024-05-24T00:28:00.295+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:28:00.296948851Z 2024-05-24T00:28:00.296953024Z 2024-05-24T00:28:00.296956477Z 2024-05-24T00:28:00.296959742Z 2024-05-24T00:28:00.301809220Z [2024-05-24T00:28:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:28:00.301826735Z [2024-05-24T00:28:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:28:00.302273672Z [2024-05-24T00:28:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:28:00.302492239Z [2024-05-24T00:28:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:28:00.303255453Z [2024-05-24T00:28:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:28:00.303266371Z [2024-05-24T00:28:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:28:00.303269539Z [2024-05-24T00:28:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:28:00.303272592Z [2024-05-24T00:28:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:28:00.751345792Z [2024-05-24T00:28:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status queued for try_number 1 2024-05-24T00:28:00.754875586Z [2024-05-24T00:28:00.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:27:00+00:00 exited with status queued for try_number 1 2024-05-24T00:28:00.754995831Z [2024-05-24T00:28:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:27:00+00:00 exited with status queued for try_number 1 2024-05-24T00:28:00.755141147Z [2024-05-24T00:28:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:27:00+00:00 exited with status queued for try_number 1 2024-05-24T00:28:00.790102113Z [2024-05-24T00:28:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4feb4b67-1038-4bd3-9c2d-e835bce7d5a4 2024-05-24T00:28:00.790264787Z [2024-05-24T00:28:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a896a7c-1dda-4c96-beb3-4aad9fa4c1e8 2024-05-24T00:28:00.790422187Z [2024-05-24T00:28:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95504c91-8f1b-45ed-82b2-789c2515891b 2024-05-24T00:28:00.790576445Z [2024-05-24T00:28:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2729ff11-fdd0-4bc9-b123-6bb0f830962b 2024-05-24T00:28:02.086962743Z [2024-05-24T00:28:02.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:28:02.089091464Z [2024-05-24T00:28:02.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:26:00+00:00, run_id=scheduled__2024-05-24T00:26:00+00:00, run_start_date=2024-05-24 00:28:00.229101+00:00, run_end_date=2024-05-24 00:28:02.086869+00:00, run_duration=1.857768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:26:00+00:00, data_interval_end=2024-05-24 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:28:02.101034938Z [2024-05-24T00:28:02.100+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:28:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:28:02.120968343Z [2024-05-24T00:28:02.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:28:02.121175350Z [2024-05-24T00:28:02.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:27:00+00:00, run_id=scheduled__2024-05-24T00:27:00+00:00, run_start_date=2024-05-24 00:28:00.230423+00:00, run_end_date=2024-05-24 00:28:02.120890+00:00, run_duration=1.890467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:27:00+00:00, data_interval_end=2024-05-24 00:28:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:28:02.142048584Z [2024-05-24T00:28:02.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:28:00+00:00, run_after=2024-05-24T00:29:00+00:00 2024-05-24T00:28:02.224313046Z [2024-05-24T00:28:02.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:26:00+00:00 exited with status success for try_number 1 2024-05-24T00:28:02.243707355Z [2024-05-24T00:28:02.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:26:00+00:00, map_index=-1, run_start_date=2024-05-24 00:28:01.337677+00:00, run_end_date=2024-05-24 00:28:01.850010+00:00, run_duration=0.512333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:28:00.297907+00:00, queued_by_job_id=1, pid=7552 2024-05-24T00:28:03.363143995Z [2024-05-24T00:28:03.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:27:00+00:00 exited with status success for try_number 1 2024-05-24T00:28:03.370341719Z [2024-05-24T00:28:03.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:27:00+00:00, map_index=-1, run_start_date=2024-05-24 00:28:01.479700+00:00, run_end_date=2024-05-24 00:28:01.998329+00:00, run_duration=0.518629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:28:00.297907+00:00, queued_by_job_id=1, pid=7553 2024-05-24T00:28:04.446073388Z [2024-05-24T00:28:04.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:28:04.446814720Z [2024-05-24T00:28:04.446+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:27:00+00:00, run_id=scheduled__2024-05-24T00:27:00+00:00, run_start_date=2024-05-24 00:28:00.232023+00:00, run_end_date=2024-05-24 00:28:04.446158+00:00, run_duration=4.214135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:27:00+00:00, data_interval_end=2024-05-24 00:28:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:28:04.465875252Z [2024-05-24T00:28:04.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:28:00+00:00, run_after=2024-05-24T00:29:00+00:00 2024-05-24T00:28:05.645395721Z [2024-05-24T00:28:05.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:27:00+00:00 exited with status success for try_number 1 2024-05-24T00:28:05.658886504Z [2024-05-24T00:28:05.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:27:00+00:00, map_index=-1, run_start_date=2024-05-24 00:28:03.081256+00:00, run_end_date=2024-05-24 00:28:04.359985+00:00, run_duration=1.278729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:28:00.297907+00:00, queued_by_job_id=1, pid=7571 2024-05-24T00:28:07.288375102Z [2024-05-24T00:28:07.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:28:07.289048398Z [2024-05-24T00:28:07.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:27:00+00:00, run_id=scheduled__2024-05-24T00:27:00+00:00, run_start_date=2024-05-24 00:28:00.233395+00:00, run_end_date=2024-05-24 00:28:07.288229+00:00, run_duration=7.054834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:27:00+00:00, data_interval_end=2024-05-24 00:28:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:28:07.314676499Z [2024-05-24T00:28:07.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:28:00+00:00, run_after=2024-05-24T00:29:00+00:00 2024-05-24T00:28:07.360199722Z [2024-05-24T00:28:07.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:27:00+00:00 exited with status success for try_number 1 2024-05-24T00:28:07.370794898Z [2024-05-24T00:28:07.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:27:00+00:00, map_index=-1, run_start_date=2024-05-24 00:28:03.322093+00:00, run_end_date=2024-05-24 00:28:06.628033+00:00, run_duration=3.30594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:28:00.297907+00:00, queued_by_job_id=1, pid=7577 2024-05-24T00:29:01.012346724Z [2024-05-24T00:29:01.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:29:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:29:01.025181393Z [2024-05-24T00:29:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:29:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:29:01.033345645Z [2024-05-24T00:29:01.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:29:01.114044877Z [2024-05-24T00:29:01.112+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:29:01.114095231Z 2024-05-24T00:29:01.114110872Z 2024-05-24T00:29:01.114122221Z 2024-05-24T00:29:01.114132669Z [2024-05-24T00:29:01.112+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:29:01.114143018Z [2024-05-24T00:29:01.112+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:29:01.114152812Z [2024-05-24T00:29:01.112+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:29:01.114164214Z [2024-05-24T00:29:01.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:29:01.114173939Z 2024-05-24T00:29:01.114193376Z 2024-05-24T00:29:01.114204408Z 2024-05-24T00:29:01.119920160Z [2024-05-24T00:29:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:29:01.119960208Z [2024-05-24T00:29:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:29:01.120180641Z [2024-05-24T00:29:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:29:01.120286270Z [2024-05-24T00:29:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:29:01.120442350Z [2024-05-24T00:29:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:29:01.120523207Z [2024-05-24T00:29:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:29:01.341015488Z [2024-05-24T00:29:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status queued for try_number 1 2024-05-24T00:29:01.341340031Z [2024-05-24T00:29:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status queued for try_number 1 2024-05-24T00:29:01.341518201Z [2024-05-24T00:29:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status queued for try_number 1 2024-05-24T00:29:01.354942680Z [2024-05-24T00:29:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30bf48b9-0388-4ec3-9735-9f1b4e58a93e 2024-05-24T00:29:01.355381207Z [2024-05-24T00:29:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e27f9b6-8203-4bad-a2b8-dc9727a9d244 2024-05-24T00:29:01.355713413Z [2024-05-24T00:29:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d9702bd-1d07-4e89-abe0-bf143f7066f3 2024-05-24T00:29:02.915967057Z [2024-05-24T00:29:02.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:29:02.920837404Z [2024-05-24T00:29:02.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:28:00+00:00, run_id=scheduled__2024-05-24T00:28:00+00:00, run_start_date=2024-05-24 00:29:01.045704+00:00, run_end_date=2024-05-24 00:29:02.915876+00:00, run_duration=1.870172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:28:00+00:00, data_interval_end=2024-05-24 00:29:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:29:02.938430345Z [2024-05-24T00:29:02.938+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:29:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:29:03.042267044Z [2024-05-24T00:29:03.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status success for try_number 1 2024-05-24T00:29:03.054240044Z [2024-05-24T00:29:03.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:28:00+00:00, map_index=-1, run_start_date=2024-05-24 00:29:01.922822+00:00, run_end_date=2024-05-24 00:29:02.355252+00:00, run_duration=0.43243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:29:01.115518+00:00, queued_by_job_id=1, pid=7609 2024-05-24T00:29:05.241547604Z [2024-05-24T00:29:05.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:29:05.241968475Z [2024-05-24T00:29:05.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:28:00+00:00, run_id=scheduled__2024-05-24T00:28:00+00:00, run_start_date=2024-05-24 00:29:01.047066+00:00, run_end_date=2024-05-24 00:29:05.241385+00:00, run_duration=4.194319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:28:00+00:00, data_interval_end=2024-05-24 00:29:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:29:05.263298855Z [2024-05-24T00:29:05.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:29:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:29:05.334051756Z [2024-05-24T00:29:05.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status success for try_number 1 2024-05-24T00:29:05.345830247Z [2024-05-24T00:29:05.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:28:00+00:00, map_index=-1, run_start_date=2024-05-24 00:29:02.931880+00:00, run_end_date=2024-05-24 00:29:04.735655+00:00, run_duration=1.803775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:29:01.115518+00:00, queued_by_job_id=1, pid=7628 2024-05-24T00:29:06.411478969Z [2024-05-24T00:29:06.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:29:06.413396174Z [2024-05-24T00:29:06.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:28:00+00:00, run_id=scheduled__2024-05-24T00:28:00+00:00, run_start_date=2024-05-24 00:29:01.048120+00:00, run_end_date=2024-05-24 00:29:06.412694+00:00, run_duration=5.364574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:28:00+00:00, data_interval_end=2024-05-24 00:29:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:29:06.442317262Z [2024-05-24T00:29:06.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:29:00+00:00, run_after=2024-05-24T00:30:00+00:00 2024-05-24T00:29:06.494732808Z [2024-05-24T00:29:06.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status success for try_number 1 2024-05-24T00:29:06.504789916Z [2024-05-24T00:29:06.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:28:00+00:00, map_index=-1, run_start_date=2024-05-24 00:29:02.877957+00:00, run_end_date=2024-05-24 00:29:05.284828+00:00, run_duration=2.406871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:29:01.115518+00:00, queued_by_job_id=1, pid=7627 2024-05-24T00:30:00.933830932Z [2024-05-24T00:30:00.931+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:30:00.955610577Z [2024-05-24T00:30:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:31:00+00:00 2024-05-24T00:30:00.963823694Z [2024-05-24T00:30:00.963+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:30:00.976362775Z [2024-05-24T00:30:00.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:35:00+00:00 2024-05-24T00:30:00.996839079Z [2024-05-24T00:30:00.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:31:00+00:00 2024-05-24T00:30:01.149326816Z [2024-05-24T00:30:01.148+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T00:30:01.149388992Z 2024-05-24T00:30:01.149403580Z 2024-05-24T00:30:01.149417287Z 2024-05-24T00:30:01.149429783Z 2024-05-24T00:30:01.149442281Z 2024-05-24T00:30:01.149711876Z [2024-05-24T00:30:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:30:01.149933202Z [2024-05-24T00:30:01.149+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:30:01.150156600Z [2024-05-24T00:30:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:30:01.150362634Z [2024-05-24T00:30:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:30:01.150571893Z [2024-05-24T00:30:01.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:30:01.151617449Z [2024-05-24T00:30:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:30:01.151637560Z 2024-05-24T00:30:01.151676839Z 2024-05-24T00:30:01.151685528Z 2024-05-24T00:30:01.151695019Z 2024-05-24T00:30:01.151703640Z 2024-05-24T00:30:01.157949714Z [2024-05-24T00:30:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:30:01.158183332Z [2024-05-24T00:30:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:30:01.158575854Z [2024-05-24T00:30:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:30:01.158766139Z [2024-05-24T00:30:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:30:01.159117891Z [2024-05-24T00:30:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:30:01.159287477Z [2024-05-24T00:30:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:30:01.159653257Z [2024-05-24T00:30:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:30:01.159793276Z [2024-05-24T00:30:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:30:01.160142858Z [2024-05-24T00:30:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:30:01.160328594Z [2024-05-24T00:30:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:30:01.729236379Z [2024-05-24T00:30:01.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:01.731315963Z [2024-05-24T00:30:01.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:01.731404769Z [2024-05-24T00:30:01.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:29:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:01.731499298Z [2024-05-24T00:30:01.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:29:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:01.731588885Z [2024-05-24T00:30:01.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:29:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:01.743549840Z [2024-05-24T00:30:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18659abd-d769-47cf-a121-a35dc4b22616 2024-05-24T00:30:01.743717376Z [2024-05-24T00:30:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to bab0079f-63e1-4137-b98e-930ca3b08ac2 2024-05-24T00:30:01.743862389Z [2024-05-24T00:30:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4287cdf3-70be-48ed-a3f7-db6cf32e2f10 2024-05-24T00:30:01.744005150Z [2024-05-24T00:30:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aeb8d02-eef2-4588-a110-4a45cccecd88 2024-05-24T00:30:01.744133685Z [2024-05-24T00:30:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4086bf80-df2d-4224-80c3-dcca666632f8 2024-05-24T00:30:02.891065570Z [2024-05-24T00:30:02.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:30:02.891747302Z [2024-05-24T00:30:02.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:28:00+00:00, run_id=scheduled__2024-05-24T00:28:00+00:00, run_start_date=2024-05-24 00:30:01.021350+00:00, run_end_date=2024-05-24 00:30:02.891167+00:00, run_duration=1.869817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:28:00+00:00, data_interval_end=2024-05-24 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:30:02.911890558Z [2024-05-24T00:30:02.911+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:32:00+00:00 2024-05-24T00:30:02.919167010Z [2024-05-24T00:30:02.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:30:02.919491426Z [2024-05-24T00:30:02.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:29:00+00:00, run_id=scheduled__2024-05-24T00:29:00+00:00, run_start_date=2024-05-24 00:30:01.023463+00:00, run_end_date=2024-05-24 00:30:02.919134+00:00, run_duration=1.895671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:29:00+00:00, data_interval_end=2024-05-24 00:30:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:30:02.930128449Z [2024-05-24T00:30:02.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:31:00+00:00 2024-05-24T00:30:02.997614362Z [2024-05-24T00:30:02.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:28:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:02.997730303Z [2024-05-24T00:30:02.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:29:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:03.009469595Z [2024-05-24T00:30:03.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:28:00+00:00, map_index=-1, run_start_date=2024-05-24 00:30:02.138789+00:00, run_end_date=2024-05-24 00:30:02.580371+00:00, run_duration=0.441582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:01.153562+00:00, queued_by_job_id=1, pid=7662 2024-05-24T00:30:03.009680349Z [2024-05-24T00:30:03.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:29:00+00:00, map_index=-1, run_start_date=2024-05-24 00:30:02.285685+00:00, run_end_date=2024-05-24 00:30:02.634681+00:00, run_duration=0.348996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:01.153562+00:00, queued_by_job_id=1, pid=7663 2024-05-24T00:30:05.201910083Z [2024-05-24T00:30:05.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:30:05.202350429Z [2024-05-24T00:30:05.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:29:00+00:00, run_id=scheduled__2024-05-24T00:29:00+00:00, run_start_date=2024-05-24 00:30:01.025365+00:00, run_end_date=2024-05-24 00:30:05.202017+00:00, run_duration=4.176652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:29:00+00:00, data_interval_end=2024-05-24 00:30:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:30:05.210831515Z [2024-05-24T00:30:05.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:31:00+00:00 2024-05-24T00:30:05.216751057Z [2024-05-24T00:30:05.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:30:05.219884422Z [2024-05-24T00:30:05.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:29:00+00:00, run_id=scheduled__2024-05-24T00:29:00+00:00, run_start_date=2024-05-24 00:30:01.026982+00:00, run_end_date=2024-05-24 00:30:05.219452+00:00, run_duration=4.19247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:29:00+00:00, data_interval_end=2024-05-24 00:30:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:30:05.230579073Z [2024-05-24T00:30:05.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:31:00+00:00 2024-05-24T00:30:05.275571461Z [2024-05-24T00:30:05.275+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:30:05.275610293Z 2024-05-24T00:30:05.275657402Z [2024-05-24T00:30:05.275+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:30:05.276688832Z [2024-05-24T00:30:05.276+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:30:05.276712942Z 2024-05-24T00:30:05.281748779Z [2024-05-24T00:30:05.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:30:05.281938113Z [2024-05-24T00:30:05.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:30:05.336347531Z [2024-05-24T00:30:05.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:05.336512300Z [2024-05-24T00:30:05.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:05.336892701Z [2024-05-24T00:30:05.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:29:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:05.337014815Z [2024-05-24T00:30:05.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:29:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:05.350925672Z [2024-05-24T00:30:05.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2280e04a-8da1-4bb5-9d19-a426eaeafccb 2024-05-24T00:30:05.351158742Z [2024-05-24T00:30:05.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:25:00+00:00, map_index=-1, run_start_date=2024-05-24 00:30:03.622364+00:00, run_end_date=2024-05-24 00:30:04.074659+00:00, run_duration=0.452295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:01.153562+00:00, queued_by_job_id=1, pid=7694 2024-05-24T00:30:05.351425252Z [2024-05-24T00:30:05.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:29:00+00:00, map_index=-1, run_start_date=2024-05-24 00:30:03.472197+00:00, run_end_date=2024-05-24 00:30:05.051380+00:00, run_duration=1.579183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:01.153562+00:00, queued_by_job_id=1, pid=7693 2024-05-24T00:30:05.351595686Z [2024-05-24T00:30:05.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:29:00+00:00, map_index=-1, run_start_date=2024-05-24 00:30:03.378778+00:00, run_end_date=2024-05-24 00:30:05.142453+00:00, run_duration=1.763675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:01.153562+00:00, queued_by_job_id=1, pid=7687 2024-05-24T00:30:08.104660227Z [2024-05-24T00:30:08.104+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:30:08.104689831Z 2024-05-24T00:30:08.104699724Z [2024-05-24T00:30:08.104+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:30:08.105223773Z [2024-05-24T00:30:08.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:30:08.105234874Z 2024-05-24T00:30:08.107253397Z [2024-05-24T00:30:08.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:30:08.107305922Z [2024-05-24T00:30:08.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:30:08.158884812Z [2024-05-24T00:30:08.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:08.158912450Z [2024-05-24T00:30:08.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:08.174953437Z [2024-05-24T00:30:08.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3567cf3b-e733-45d6-9bcd-b1a35bd7ff72 2024-05-24T00:30:08.175038226Z [2024-05-24T00:30:08.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:25:00+00:00, map_index=-1, run_start_date=2024-05-24 00:30:06.884372+00:00, run_end_date=2024-05-24 00:30:07.291862+00:00, run_duration=0.40749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:05.278246+00:00, queued_by_job_id=1, pid=7717 2024-05-24T00:30:10.555341611Z [2024-05-24T00:30:10.554+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:30:10.555375577Z 2024-05-24T00:30:10.555382631Z [2024-05-24T00:30:10.554+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:30:10.555387383Z [2024-05-24T00:30:10.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:30:10.555390709Z 2024-05-24T00:30:10.557841500Z [2024-05-24T00:30:10.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:30:10.559015098Z [2024-05-24T00:30:10.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:30:10.604502406Z [2024-05-24T00:30:10.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status queued for try_number 1 2024-05-24T00:30:10.613115825Z [2024-05-24T00:30:10.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f4292a1-3e41-4c57-bae4-18aced0fc9b4 2024-05-24T00:30:10.690729717Z [2024-05-24T00:30:10.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:10.698858023Z [2024-05-24T00:30:10.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:25:00+00:00, map_index=0, run_start_date=2024-05-24 00:30:10.040196+00:00, run_end_date=2024-05-24 00:30:10.455300+00:00, run_duration=0.415104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:08.105508+00:00, queued_by_job_id=1, pid=7725 2024-05-24T00:30:12.872526315Z [2024-05-24T00:30:12.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:30:12.872745917Z [2024-05-24T00:30:12.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:25:00+00:00, run_id=scheduled__2024-05-24T00:25:00+00:00, run_start_date=2024-05-24 00:30:01.018376+00:00, run_end_date=2024-05-24 00:30:12.872398+00:00, run_duration=11.854022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:25:00+00:00, data_interval_end=2024-05-24 00:30:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:30:12.879804621Z [2024-05-24T00:30:12.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:30:00+00:00, run_after=2024-05-24T00:35:00+00:00 2024-05-24T00:30:12.924560635Z [2024-05-24T00:30:12.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:25:00+00:00 exited with status success for try_number 1 2024-05-24T00:30:12.932247063Z [2024-05-24T00:30:12.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:25:00+00:00, map_index=-1, run_start_date=2024-05-24 00:30:12.265467+00:00, run_end_date=2024-05-24 00:30:12.598975+00:00, run_duration=0.333508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:30:10.555589+00:00, queued_by_job_id=1, pid=7733 2024-05-24T00:31:01.048005645Z [2024-05-24T00:31:01.047+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:31:01.063792924Z [2024-05-24T00:31:01.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:31:00+00:00, run_after=2024-05-24T00:32:00+00:00 2024-05-24T00:31:01.075680067Z [2024-05-24T00:31:01.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:31:00+00:00, run_after=2024-05-24T00:32:00+00:00 2024-05-24T00:31:01.136821446Z [2024-05-24T00:31:01.136+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:31:01.136845969Z 2024-05-24T00:31:01.136849403Z 2024-05-24T00:31:01.136852521Z 2024-05-24T00:31:01.136910768Z [2024-05-24T00:31:01.136+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:31:01.137025000Z [2024-05-24T00:31:01.136+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:31:01.137217212Z [2024-05-24T00:31:01.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:31:01.137958339Z [2024-05-24T00:31:01.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:31:01.137968681Z 2024-05-24T00:31:01.137971928Z 2024-05-24T00:31:01.137988539Z 2024-05-24T00:31:01.141920121Z [2024-05-24T00:31:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:31:01.142045916Z [2024-05-24T00:31:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:31:01.142324361Z [2024-05-24T00:31:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:31:01.142453058Z [2024-05-24T00:31:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:31:01.142758194Z [2024-05-24T00:31:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:31:01.142869001Z [2024-05-24T00:31:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:31:01.365317388Z [2024-05-24T00:31:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:31:01.365352918Z [2024-05-24T00:31:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:31:01.365403591Z [2024-05-24T00:31:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:31:01.372418001Z [2024-05-24T00:31:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23d3e46b-bb9d-46d6-b628-e140e74db498 2024-05-24T00:31:01.372448976Z [2024-05-24T00:31:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fa8edd4-f52f-4d0f-a0e6-ed8074c7ac03 2024-05-24T00:31:01.372572009Z [2024-05-24T00:31:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91171728-b48b-4638-98bc-ccd543300221 2024-05-24T00:31:03.148425838Z [2024-05-24T00:31:03.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:31:03.148751698Z [2024-05-24T00:31:03.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:30:00+00:00, run_id=scheduled__2024-05-24T00:30:00+00:00, run_start_date=2024-05-24 00:31:01.085461+00:00, run_end_date=2024-05-24 00:31:03.148347+00:00, run_duration=2.062886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:30:00+00:00, data_interval_end=2024-05-24 00:31:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:31:03.158973817Z [2024-05-24T00:31:03.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:31:00+00:00, run_after=2024-05-24T00:32:00+00:00 2024-05-24T00:31:03.206735323Z [2024-05-24T00:31:03.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:31:03.211177840Z [2024-05-24T00:31:03.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=-1, run_start_date=2024-05-24 00:31:01.886910+00:00, run_end_date=2024-05-24 00:31:02.534075+00:00, run_duration=0.647165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:31:01.139117+00:00, queued_by_job_id=1, pid=7755 2024-05-24T00:31:05.148125602Z [2024-05-24T00:31:05.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:31:05.148457862Z [2024-05-24T00:31:05.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:30:00+00:00, run_id=scheduled__2024-05-24T00:30:00+00:00, run_start_date=2024-05-24 00:31:01.087753+00:00, run_end_date=2024-05-24 00:31:05.148012+00:00, run_duration=4.060259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:30:00+00:00, data_interval_end=2024-05-24 00:31:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:31:05.164709117Z [2024-05-24T00:31:05.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:31:00+00:00, run_after=2024-05-24T00:32:00+00:00 2024-05-24T00:31:05.172585748Z [2024-05-24T00:31:05.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:31:05.172856809Z [2024-05-24T00:31:05.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:30:00+00:00, run_id=scheduled__2024-05-24T00:30:00+00:00, run_start_date=2024-05-24 00:31:01.086739+00:00, run_end_date=2024-05-24 00:31:05.172459+00:00, run_duration=4.08572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:30:00+00:00, data_interval_end=2024-05-24 00:31:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:31:05.183938086Z [2024-05-24T00:31:05.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:31:00+00:00, run_after=2024-05-24T00:32:00+00:00 2024-05-24T00:31:05.227624930Z [2024-05-24T00:31:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:31:05.232504400Z [2024-05-24T00:31:05.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=-1, run_start_date=2024-05-24 00:31:03.083881+00:00, run_end_date=2024-05-24 00:31:04.737700+00:00, run_duration=1.653819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:31:01.139117+00:00, queued_by_job_id=1, pid=7773 2024-05-24T00:31:06.325335861Z [2024-05-24T00:31:06.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:31:06.332788514Z [2024-05-24T00:31:06.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=-1, run_start_date=2024-05-24 00:31:03.178477+00:00, run_end_date=2024-05-24 00:31:05.095800+00:00, run_duration=1.917323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:31:01.139117+00:00, queued_by_job_id=1, pid=7774 2024-05-24T00:31:40.492231573Z [2024-05-24T00:31:40.491+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:32:01.067887198Z [2024-05-24T00:32:01.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:32:01.093824786Z [2024-05-24T00:32:01.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:32:00+00:00, run_after=2024-05-24T00:33:00+00:00 2024-05-24T00:32:01.115782327Z [2024-05-24T00:32:01.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:32:00+00:00, run_after=2024-05-24T00:33:00+00:00 2024-05-24T00:32:01.127274704Z [2024-05-24T00:32:01.126+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:32:01.250905860Z [2024-05-24T00:32:01.250+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:32:01.251010385Z 2024-05-24T00:32:01.251033691Z 2024-05-24T00:32:01.251204066Z 2024-05-24T00:32:01.251221221Z 2024-05-24T00:32:01.255578713Z [2024-05-24T00:32:01.250+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:32:01.255607963Z [2024-05-24T00:32:01.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:32:01.255614856Z [2024-05-24T00:32:01.252+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:32:01.255621026Z [2024-05-24T00:32:01.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:32:01.255627212Z [2024-05-24T00:32:01.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:32:01.255634087Z 2024-05-24T00:32:01.255640193Z 2024-05-24T00:32:01.255646194Z 2024-05-24T00:32:01.255652305Z 2024-05-24T00:32:01.261370342Z [2024-05-24T00:32:01.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:32:01.261395412Z [2024-05-24T00:32:01.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:32:01.261403194Z [2024-05-24T00:32:01.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:32:01.261409391Z [2024-05-24T00:32:01.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:32:01.261416235Z [2024-05-24T00:32:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:32:01.261422303Z [2024-05-24T00:32:01.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:32:01.264137781Z [2024-05-24T00:32:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:32:01.264153264Z [2024-05-24T00:32:01.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:32:01.888217138Z [2024-05-24T00:32:01.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:32:01.888284125Z [2024-05-24T00:32:01.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:31:00+00:00 exited with status queued for try_number 1 2024-05-24T00:32:01.888306755Z [2024-05-24T00:32:01.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:31:00+00:00 exited with status queued for try_number 1 2024-05-24T00:32:01.888326237Z [2024-05-24T00:32:01.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:31:00+00:00 exited with status queued for try_number 1 2024-05-24T00:32:01.901143493Z [2024-05-24T00:32:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60178b98-878e-444b-b22f-1221e5ff4359 2024-05-24T00:32:01.901243135Z [2024-05-24T00:32:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25dfe120-43aa-4a66-bb2f-a924f009a731 2024-05-24T00:32:01.901282656Z [2024-05-24T00:32:01.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc81836f-3fde-41bf-8834-5cb28df27573 2024-05-24T00:32:01.901378419Z [2024-05-24T00:32:01.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13347cbc-d133-4d52-8b36-62f34084e5b2 2024-05-24T00:32:03.555140921Z [2024-05-24T00:32:03.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:32:03.555309239Z [2024-05-24T00:32:03.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:30:00+00:00, run_id=scheduled__2024-05-24T00:30:00+00:00, run_start_date=2024-05-24 00:32:01.140909+00:00, run_end_date=2024-05-24 00:32:03.554945+00:00, run_duration=2.414036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:30:00+00:00, data_interval_end=2024-05-24 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:32:03.563959998Z [2024-05-24T00:32:03.563+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:32:00+00:00, run_after=2024-05-24T00:34:00+00:00 2024-05-24T00:32:03.571550988Z [2024-05-24T00:32:03.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:32:03.571682180Z [2024-05-24T00:32:03.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:31:00+00:00, run_id=scheduled__2024-05-24T00:31:00+00:00, run_start_date=2024-05-24 00:32:01.142444+00:00, run_end_date=2024-05-24 00:32:03.571445+00:00, run_duration=2.429001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:31:00+00:00, data_interval_end=2024-05-24 00:32:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:32:03.584681852Z [2024-05-24T00:32:03.584+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:32:00+00:00, run_after=2024-05-24T00:33:00+00:00 2024-05-24T00:32:03.635755695Z [2024-05-24T00:32:03.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:32:03.635835644Z [2024-05-24T00:32:03.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:31:00+00:00 exited with status success for try_number 1 2024-05-24T00:32:03.643414255Z [2024-05-24T00:32:03.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=-1, run_start_date=2024-05-24 00:32:02.173448+00:00, run_end_date=2024-05-24 00:32:02.608491+00:00, run_duration=0.435043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:32:01.254184+00:00, queued_by_job_id=1, pid=7807 2024-05-24T00:32:03.643501084Z [2024-05-24T00:32:03.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:31:00+00:00, map_index=-1, run_start_date=2024-05-24 00:32:02.240488+00:00, run_end_date=2024-05-24 00:32:02.785164+00:00, run_duration=0.544676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:32:01.254184+00:00, queued_by_job_id=1, pid=7808 2024-05-24T00:32:06.185003476Z [2024-05-24T00:32:06.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:32:06.185240276Z [2024-05-24T00:32:06.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:31:00+00:00, run_id=scheduled__2024-05-24T00:31:00+00:00, run_start_date=2024-05-24 00:32:01.143811+00:00, run_end_date=2024-05-24 00:32:06.184839+00:00, run_duration=5.041028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:31:00+00:00, data_interval_end=2024-05-24 00:32:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:32:06.194786967Z [2024-05-24T00:32:06.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:32:00+00:00, run_after=2024-05-24T00:33:00+00:00 2024-05-24T00:32:06.202877135Z [2024-05-24T00:32:06.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:32:06.203183049Z [2024-05-24T00:32:06.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:31:00+00:00, run_id=scheduled__2024-05-24T00:31:00+00:00, run_start_date=2024-05-24 00:32:01.144970+00:00, run_end_date=2024-05-24 00:32:06.202852+00:00, run_duration=5.057882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:31:00+00:00, data_interval_end=2024-05-24 00:32:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:32:06.212762325Z [2024-05-24T00:32:06.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:32:00+00:00, run_after=2024-05-24T00:33:00+00:00 2024-05-24T00:32:06.257493801Z [2024-05-24T00:32:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:31:00+00:00 exited with status success for try_number 1 2024-05-24T00:32:06.257965372Z [2024-05-24T00:32:06.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:31:00+00:00 exited with status success for try_number 1 2024-05-24T00:32:06.269647389Z [2024-05-24T00:32:06.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:31:00+00:00, map_index=-1, run_start_date=2024-05-24 00:32:03.451436+00:00, run_end_date=2024-05-24 00:32:05.381178+00:00, run_duration=1.929742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:32:01.254184+00:00, queued_by_job_id=1, pid=7831 2024-05-24T00:32:06.269977948Z [2024-05-24T00:32:06.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:31:00+00:00, map_index=-1, run_start_date=2024-05-24 00:32:03.571172+00:00, run_end_date=2024-05-24 00:32:05.747766+00:00, run_duration=2.176594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:32:01.254184+00:00, queued_by_job_id=1, pid=7832 2024-05-24T00:33:00.506210010Z [2024-05-24T00:33:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:33:00+00:00, run_after=2024-05-24T00:34:00+00:00 2024-05-24T00:33:00.513912787Z [2024-05-24T00:33:00.513+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:33:00.529877611Z [2024-05-24T00:33:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:33:00+00:00, run_after=2024-05-24T00:34:00+00:00 2024-05-24T00:33:00.595936884Z [2024-05-24T00:33:00.595+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:33:00.595979078Z 2024-05-24T00:33:00.595987350Z 2024-05-24T00:33:00.595994175Z 2024-05-24T00:33:00.596169013Z [2024-05-24T00:33:00.595+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:33:00.596400458Z [2024-05-24T00:33:00.596+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:33:00.596626203Z [2024-05-24T00:33:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:33:00.597348302Z [2024-05-24T00:33:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:33:00.597359135Z 2024-05-24T00:33:00.597362667Z 2024-05-24T00:33:00.597365590Z 2024-05-24T00:33:00.600790048Z [2024-05-24T00:33:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:33:00.601041447Z [2024-05-24T00:33:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:33:00.601352239Z [2024-05-24T00:33:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:33:00.601540055Z [2024-05-24T00:33:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:33:00.601835751Z [2024-05-24T00:33:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:33:00.602036884Z [2024-05-24T00:33:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:33:00.809533427Z [2024-05-24T00:33:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status queued for try_number 1 2024-05-24T00:33:00.809590415Z [2024-05-24T00:33:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status queued for try_number 1 2024-05-24T00:33:00.809621586Z [2024-05-24T00:33:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status queued for try_number 1 2024-05-24T00:33:00.819000401Z [2024-05-24T00:33:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 559107c6-bbdf-456b-954b-7d3288aad36c 2024-05-24T00:33:00.819086033Z [2024-05-24T00:33:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03511a2d-a777-49da-b4bd-d0fa9dd0c879 2024-05-24T00:33:00.819269157Z [2024-05-24T00:33:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74b0245c-5e68-4533-8c9b-40db0a6b7e2d 2024-05-24T00:33:02.233573535Z [2024-05-24T00:33:02.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:33:02.233951050Z [2024-05-24T00:33:02.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:32:00+00:00, run_id=scheduled__2024-05-24T00:32:00+00:00, run_start_date=2024-05-24 00:33:00.542746+00:00, run_end_date=2024-05-24 00:33:02.233408+00:00, run_duration=1.690662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:32:00+00:00, data_interval_end=2024-05-24 00:33:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:33:02.251801251Z [2024-05-24T00:33:02.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:33:00+00:00, run_after=2024-05-24T00:34:00+00:00 2024-05-24T00:33:02.307154850Z [2024-05-24T00:33:02.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status success for try_number 1 2024-05-24T00:33:02.316595610Z [2024-05-24T00:33:02.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:32:00+00:00, map_index=-1, run_start_date=2024-05-24 00:33:01.421720+00:00, run_end_date=2024-05-24 00:33:01.881181+00:00, run_duration=0.459461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:33:00.598484+00:00, queued_by_job_id=1, pid=7864 2024-05-24T00:33:03.892218835Z [2024-05-24T00:33:03.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:33:03.892682382Z [2024-05-24T00:33:03.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:32:00+00:00, run_id=scheduled__2024-05-24T00:32:00+00:00, run_start_date=2024-05-24 00:33:00.544052+00:00, run_end_date=2024-05-24 00:33:03.892096+00:00, run_duration=3.348044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:32:00+00:00, data_interval_end=2024-05-24 00:33:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:33:03.902707425Z [2024-05-24T00:33:03.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:33:00+00:00, run_after=2024-05-24T00:34:00+00:00 2024-05-24T00:33:03.942379730Z [2024-05-24T00:33:03.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status success for try_number 1 2024-05-24T00:33:03.948557431Z [2024-05-24T00:33:03.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:32:00+00:00, map_index=-1, run_start_date=2024-05-24 00:33:02.444587+00:00, run_end_date=2024-05-24 00:33:03.759773+00:00, run_duration=1.315186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:33:00.598484+00:00, queued_by_job_id=1, pid=7882 2024-05-24T00:33:05.014089643Z [2024-05-24T00:33:05.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:33:05.014722368Z [2024-05-24T00:33:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:32:00+00:00, run_id=scheduled__2024-05-24T00:32:00+00:00, run_start_date=2024-05-24 00:33:00.546273+00:00, run_end_date=2024-05-24 00:33:05.014099+00:00, run_duration=4.467826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:32:00+00:00, data_interval_end=2024-05-24 00:33:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:33:05.029188138Z [2024-05-24T00:33:05.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:33:00+00:00, run_after=2024-05-24T00:34:00+00:00 2024-05-24T00:33:05.087947127Z [2024-05-24T00:33:05.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status success for try_number 1 2024-05-24T00:33:05.094042423Z [2024-05-24T00:33:05.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:32:00+00:00, map_index=-1, run_start_date=2024-05-24 00:33:02.529875+00:00, run_end_date=2024-05-24 00:33:04.258820+00:00, run_duration=1.728945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:33:00.598484+00:00, queued_by_job_id=1, pid=7883 2024-05-24T00:34:00.989174360Z [2024-05-24T00:34:00.988+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:34:01.004728045Z [2024-05-24T00:34:01.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:34:00+00:00, run_after=2024-05-24T00:35:00+00:00 2024-05-24T00:34:01.012082797Z [2024-05-24T00:34:01.011+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:34:01.024388357Z [2024-05-24T00:34:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:34:00+00:00, run_after=2024-05-24T00:35:00+00:00 2024-05-24T00:34:01.117368179Z [2024-05-24T00:34:01.116+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:34:01.117417171Z 2024-05-24T00:34:01.117421690Z 2024-05-24T00:34:01.117424868Z 2024-05-24T00:34:01.117432108Z 2024-05-24T00:34:01.117484994Z [2024-05-24T00:34:01.117+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:34:01.117586416Z [2024-05-24T00:34:01.117+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:34:01.117755982Z [2024-05-24T00:34:01.117+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:34:01.117875621Z [2024-05-24T00:34:01.117+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:34:01.118488136Z [2024-05-24T00:34:01.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:34:01.118496500Z 2024-05-24T00:34:01.118500131Z 2024-05-24T00:34:01.118536213Z 2024-05-24T00:34:01.118540386Z 2024-05-24T00:34:01.123995033Z [2024-05-24T00:34:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:34:01.124448916Z [2024-05-24T00:34:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:34:01.125122709Z [2024-05-24T00:34:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:34:01.125494933Z [2024-05-24T00:34:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:34:01.126128225Z [2024-05-24T00:34:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:34:01.126572763Z [2024-05-24T00:34:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:34:01.127153463Z [2024-05-24T00:34:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:34:01.127521440Z [2024-05-24T00:34:01.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:34:01.457751057Z [2024-05-24T00:34:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status queued for try_number 1 2024-05-24T00:34:01.457837073Z [2024-05-24T00:34:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:33:00+00:00 exited with status queued for try_number 1 2024-05-24T00:34:01.457894569Z [2024-05-24T00:34:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:33:00+00:00 exited with status queued for try_number 1 2024-05-24T00:34:01.457966257Z [2024-05-24T00:34:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:33:00+00:00 exited with status queued for try_number 1 2024-05-24T00:34:01.478320455Z [2024-05-24T00:34:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7e3aba4-1bf0-4a32-8f90-290b74bc63ca 2024-05-24T00:34:01.479068147Z [2024-05-24T00:34:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c15a373-6fc9-437d-85ef-acfab006b709 2024-05-24T00:34:01.479350078Z [2024-05-24T00:34:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4a20224-92fc-477f-886a-8df65b1fdf02 2024-05-24T00:34:01.479560840Z [2024-05-24T00:34:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0309191-1c64-47da-ad41-91e9ce918ba9 2024-05-24T00:34:03.123370044Z [2024-05-24T00:34:03.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:34:03.123672756Z [2024-05-24T00:34:03.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:32:00+00:00, run_id=scheduled__2024-05-24T00:32:00+00:00, run_start_date=2024-05-24 00:34:01.034523+00:00, run_end_date=2024-05-24 00:34:03.123257+00:00, run_duration=2.088734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:32:00+00:00, data_interval_end=2024-05-24 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:34:03.132102685Z [2024-05-24T00:34:03.131+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:34:00+00:00, run_after=2024-05-24T00:36:00+00:00 2024-05-24T00:34:03.159951256Z [2024-05-24T00:34:03.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:34:03.160188057Z [2024-05-24T00:34:03.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:33:00+00:00, run_id=scheduled__2024-05-24T00:33:00+00:00, run_start_date=2024-05-24 00:34:01.036001+00:00, run_end_date=2024-05-24 00:34:03.159893+00:00, run_duration=2.123892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:33:00+00:00, data_interval_end=2024-05-24 00:34:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:34:03.172407099Z [2024-05-24T00:34:03.172+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:34:00+00:00, run_after=2024-05-24T00:35:00+00:00 2024-05-24T00:34:03.221316815Z [2024-05-24T00:34:03.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:32:00+00:00 exited with status success for try_number 1 2024-05-24T00:34:03.221431444Z [2024-05-24T00:34:03.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:33:00+00:00 exited with status success for try_number 1 2024-05-24T00:34:03.228237820Z [2024-05-24T00:34:03.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:33:00+00:00, map_index=-1, run_start_date=2024-05-24 00:34:02.053425+00:00, run_end_date=2024-05-24 00:34:02.496684+00:00, run_duration=0.443259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:34:01.119411+00:00, queued_by_job_id=1, pid=7915 2024-05-24T00:34:03.228432111Z [2024-05-24T00:34:03.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:32:00+00:00, map_index=-1, run_start_date=2024-05-24 00:34:02.112099+00:00, run_end_date=2024-05-24 00:34:02.467862+00:00, run_duration=0.355763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:34:01.119411+00:00, queued_by_job_id=1, pid=7916 2024-05-24T00:34:05.436268652Z [2024-05-24T00:34:05.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:34:05.437101184Z [2024-05-24T00:34:05.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:33:00+00:00, run_id=scheduled__2024-05-24T00:33:00+00:00, run_start_date=2024-05-24 00:34:01.037321+00:00, run_end_date=2024-05-24 00:34:05.436364+00:00, run_duration=4.399043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:33:00+00:00, data_interval_end=2024-05-24 00:34:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:34:05.454814485Z [2024-05-24T00:34:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:34:00+00:00, run_after=2024-05-24T00:35:00+00:00 2024-05-24T00:34:05.529364754Z [2024-05-24T00:34:05.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:33:00+00:00 exited with status success for try_number 1 2024-05-24T00:34:05.536753768Z [2024-05-24T00:34:05.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:33:00+00:00, map_index=-1, run_start_date=2024-05-24 00:34:03.204171+00:00, run_end_date=2024-05-24 00:34:04.776961+00:00, run_duration=1.57279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:34:01.119411+00:00, queued_by_job_id=1, pid=7939 2024-05-24T00:34:06.593905818Z [2024-05-24T00:34:06.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:34:06.594340436Z [2024-05-24T00:34:06.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:33:00+00:00, run_id=scheduled__2024-05-24T00:33:00+00:00, run_start_date=2024-05-24 00:34:01.038544+00:00, run_end_date=2024-05-24 00:34:06.593811+00:00, run_duration=5.555267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:33:00+00:00, data_interval_end=2024-05-24 00:34:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:34:06.609274067Z [2024-05-24T00:34:06.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:34:00+00:00, run_after=2024-05-24T00:35:00+00:00 2024-05-24T00:34:06.670675597Z [2024-05-24T00:34:06.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:33:00+00:00 exited with status success for try_number 1 2024-05-24T00:34:06.682639717Z [2024-05-24T00:34:06.679+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:33:00+00:00, map_index=-1, run_start_date=2024-05-24 00:34:03.214304+00:00, run_end_date=2024-05-24 00:34:06.444872+00:00, run_duration=3.230568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:34:01.119411+00:00, queued_by_job_id=1, pid=7940 2024-05-24T00:35:00.309483478Z [2024-05-24T00:35:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:35:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:35:00.322501456Z [2024-05-24T00:35:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:35:00+00:00, run_after=2024-05-24T00:36:00+00:00 2024-05-24T00:35:00.342226970Z [2024-05-24T00:35:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:35:00+00:00, run_after=2024-05-24T00:36:00+00:00 2024-05-24T00:35:00.365668462Z [2024-05-24T00:35:00.359+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:35:00.437451621Z [2024-05-24T00:35:00.436+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:35:00.437520575Z 2024-05-24T00:35:00.437531172Z 2024-05-24T00:35:00.437539815Z 2024-05-24T00:35:00.437548491Z 2024-05-24T00:35:00.437783576Z [2024-05-24T00:35:00.437+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:35:00.438195385Z [2024-05-24T00:35:00.437+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:35:00.438742053Z [2024-05-24T00:35:00.438+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:35:00.439113367Z [2024-05-24T00:35:00.438+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:35:00.440337085Z [2024-05-24T00:35:00.439+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:35:00.440392437Z 2024-05-24T00:35:00.440403842Z 2024-05-24T00:35:00.440412319Z 2024-05-24T00:35:00.440425479Z 2024-05-24T00:35:00.446639608Z [2024-05-24T00:35:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:35:00.446682319Z [2024-05-24T00:35:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:35:00.446900867Z [2024-05-24T00:35:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:35:00.447075184Z [2024-05-24T00:35:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:35:00.447152023Z [2024-05-24T00:35:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:35:00.447285614Z [2024-05-24T00:35:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:35:00.447322200Z [2024-05-24T00:35:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:35:00.447426503Z [2024-05-24T00:35:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:35:00.787887625Z [2024-05-24T00:35:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:35:00.787939471Z [2024-05-24T00:35:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status queued for try_number 1 2024-05-24T00:35:00.787947442Z [2024-05-24T00:35:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status queued for try_number 1 2024-05-24T00:35:00.788027307Z [2024-05-24T00:35:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status queued for try_number 1 2024-05-24T00:35:00.796431500Z [2024-05-24T00:35:00.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb6680b0-c131-4eb8-bfa7-c830383d2bf1 2024-05-24T00:35:00.796504188Z [2024-05-24T00:35:00.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to abd2764e-cfe9-425f-9454-bc2b2c544f59 2024-05-24T00:35:00.796588103Z [2024-05-24T00:35:00.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99ef2146-5fe4-4f57-9715-98eec4dd76cd 2024-05-24T00:35:00.796736141Z [2024-05-24T00:35:00.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08f5b340-5987-4b38-8a8d-1e1a9ef397d1 2024-05-24T00:35:03.116368946Z [2024-05-24T00:35:03.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:35:03.117401804Z [2024-05-24T00:35:03.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:34:00+00:00, run_id=scheduled__2024-05-24T00:34:00+00:00, run_start_date=2024-05-24 00:35:00.374493+00:00, run_end_date=2024-05-24 00:35:03.116952+00:00, run_duration=2.742459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:34:00+00:00, data_interval_end=2024-05-24 00:35:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:35:03.129822934Z [2024-05-24T00:35:03.129+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:35:00+00:00, run_after=2024-05-24T00:36:00+00:00 2024-05-24T00:35:03.195517939Z [2024-05-24T00:35:03.195+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:35:03.195540515Z 2024-05-24T00:35:03.195788162Z [2024-05-24T00:35:03.195+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:35:03.196426503Z [2024-05-24T00:35:03.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:35:03.196436864Z 2024-05-24T00:35:03.199002685Z [2024-05-24T00:35:03.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:35:03.199140722Z [2024-05-24T00:35:03.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:35:03.283362734Z [2024-05-24T00:35:03.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:35:03.283390522Z [2024-05-24T00:35:03.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:35:03.285337092Z [2024-05-24T00:35:03.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status success for try_number 1 2024-05-24T00:35:03.306826870Z [2024-05-24T00:35:03.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed564f04-0d24-4f78-b693-d42131027272 2024-05-24T00:35:03.307316257Z [2024-05-24T00:35:03.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:34:00+00:00, map_index=-1, run_start_date=2024-05-24 00:35:01.480790+00:00, run_end_date=2024-05-24 00:35:02.132881+00:00, run_duration=0.652091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:35:00.442034+00:00, queued_by_job_id=1, pid=7975 2024-05-24T00:35:03.307539711Z [2024-05-24T00:35:03.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=-1, run_start_date=2024-05-24 00:35:02.475946+00:00, run_end_date=2024-05-24 00:35:02.974688+00:00, run_duration=0.498742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:35:00.442034+00:00, queued_by_job_id=1, pid=7989 2024-05-24T00:35:04.626336953Z [2024-05-24T00:35:04.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:35:04.626629362Z [2024-05-24T00:35:04.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:34:00+00:00, run_id=scheduled__2024-05-24T00:34:00+00:00, run_start_date=2024-05-24 00:35:00.375507+00:00, run_end_date=2024-05-24 00:35:04.626180+00:00, run_duration=4.250673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:34:00+00:00, data_interval_end=2024-05-24 00:35:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:35:04.635416615Z [2024-05-24T00:35:04.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:35:00+00:00, run_after=2024-05-24T00:36:00+00:00 2024-05-24T00:35:04.694470625Z [2024-05-24T00:35:04.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status success for try_number 1 2024-05-24T00:35:04.703042309Z [2024-05-24T00:35:04.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:34:00+00:00, map_index=-1, run_start_date=2024-05-24 00:35:02.749880+00:00, run_end_date=2024-05-24 00:35:04.089429+00:00, run_duration=1.339549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:35:00.442034+00:00, queued_by_job_id=1, pid=7998 2024-05-24T00:35:05.747020174Z [2024-05-24T00:35:05.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:35:05.747489897Z [2024-05-24T00:35:05.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:34:00+00:00, run_id=scheduled__2024-05-24T00:34:00+00:00, run_start_date=2024-05-24 00:35:00.376439+00:00, run_end_date=2024-05-24 00:35:05.746953+00:00, run_duration=5.370514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:34:00+00:00, data_interval_end=2024-05-24 00:35:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:35:05.760873910Z [2024-05-24T00:35:05.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:35:00+00:00, run_after=2024-05-24T00:36:00+00:00 2024-05-24T00:35:05.805945847Z [2024-05-24T00:35:05.805+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:35:05.805983669Z 2024-05-24T00:35:05.806091884Z [2024-05-24T00:35:05.805+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:35:05.807187152Z [2024-05-24T00:35:05.806+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:35:05.807224763Z 2024-05-24T00:35:05.810270088Z [2024-05-24T00:35:05.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:35:05.810625154Z [2024-05-24T00:35:05.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:35:05.875605052Z [2024-05-24T00:35:05.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:35:05.875883184Z [2024-05-24T00:35:05.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status success for try_number 1 2024-05-24T00:35:05.876059541Z [2024-05-24T00:35:05.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:35:05.887409638Z [2024-05-24T00:35:05.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=-1, run_start_date=2024-05-24 00:35:04.969039+00:00, run_end_date=2024-05-24 00:35:05.397912+00:00, run_duration=0.428873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:35:03.196923+00:00, queued_by_job_id=1, pid=8022 2024-05-24T00:35:05.887704680Z [2024-05-24T00:35:05.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to d87ea8b8-c95b-4ed3-a5b3-aed7a15d13ec 2024-05-24T00:35:05.887920541Z [2024-05-24T00:35:05.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:34:00+00:00, map_index=-1, run_start_date=2024-05-24 00:35:03.035827+00:00, run_end_date=2024-05-24 00:35:04.719850+00:00, run_duration=1.684023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:35:00.442034+00:00, queued_by_job_id=1, pid=8004 2024-05-24T00:35:08.142976550Z [2024-05-24T00:35:08.142+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:35:08.143003598Z 2024-05-24T00:35:08.143379862Z [2024-05-24T00:35:08.143+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:35:08.144825060Z [2024-05-24T00:35:08.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:35:08.144836556Z 2024-05-24T00:35:08.149372385Z [2024-05-24T00:35:08.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:35:08.149881442Z [2024-05-24T00:35:08.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:35:08.229455615Z [2024-05-24T00:35:08.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status queued for try_number 1 2024-05-24T00:35:08.229531202Z [2024-05-24T00:35:08.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:35:08.234817339Z [2024-05-24T00:35:08.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 923520a8-38a9-435b-8fbd-00159fe66130 2024-05-24T00:35:08.234909037Z [2024-05-24T00:35:08.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=0, run_start_date=2024-05-24 00:35:07.461533+00:00, run_end_date=2024-05-24 00:35:07.818481+00:00, run_duration=0.356948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:35:05.807687+00:00, queued_by_job_id=1, pid=8030 2024-05-24T00:35:10.495456071Z [2024-05-24T00:35:10.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:35:10.495959232Z [2024-05-24T00:35:10.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:30:00+00:00, run_id=scheduled__2024-05-24T00:30:00+00:00, run_start_date=2024-05-24 00:35:00.372939+00:00, run_end_date=2024-05-24 00:35:10.495369+00:00, run_duration=10.12243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:30:00+00:00, data_interval_end=2024-05-24 00:35:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:35:10.505002039Z [2024-05-24T00:35:10.504+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:35:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:35:10.541242836Z [2024-05-24T00:35:10.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:30:00+00:00 exited with status success for try_number 1 2024-05-24T00:35:10.546128277Z [2024-05-24T00:35:10.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:30:00+00:00, map_index=-1, run_start_date=2024-05-24 00:35:09.843783+00:00, run_end_date=2024-05-24 00:35:10.228063+00:00, run_duration=0.38428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:35:08.145789+00:00, queued_by_job_id=1, pid=8038 2024-05-24T00:36:00.853086536Z [2024-05-24T00:36:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:36:00+00:00, run_after=2024-05-24T00:37:00+00:00 2024-05-24T00:36:00.863069758Z [2024-05-24T00:36:00.862+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:36:00.874673712Z [2024-05-24T00:36:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:36:00+00:00, run_after=2024-05-24T00:37:00+00:00 2024-05-24T00:36:00.881230843Z [2024-05-24T00:36:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:36:00.982725169Z [2024-05-24T00:36:00.978+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:36:00.982750226Z 2024-05-24T00:36:00.982756061Z 2024-05-24T00:36:00.982760153Z 2024-05-24T00:36:00.982764255Z 2024-05-24T00:36:00.982768984Z [2024-05-24T00:36:00.979+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:36:00.982773280Z [2024-05-24T00:36:00.979+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:36:00.982777192Z [2024-05-24T00:36:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:36:00.982781358Z [2024-05-24T00:36:00.980+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:36:00.982785975Z [2024-05-24T00:36:00.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:36:00.982790109Z 2024-05-24T00:36:00.982794111Z 2024-05-24T00:36:00.982797924Z 2024-05-24T00:36:00.982801613Z 2024-05-24T00:36:00.990693401Z [2024-05-24T00:36:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:36:00.990729356Z [2024-05-24T00:36:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:36:00.990756293Z [2024-05-24T00:36:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:36:00.990763052Z [2024-05-24T00:36:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:36:00.990768371Z [2024-05-24T00:36:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:36:00.990773561Z [2024-05-24T00:36:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:36:00.990778756Z [2024-05-24T00:36:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:36:00.990784294Z [2024-05-24T00:36:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:36:01.365480166Z [2024-05-24T00:36:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status queued for try_number 1 2024-05-24T00:36:01.365732865Z [2024-05-24T00:36:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status queued for try_number 1 2024-05-24T00:36:01.365871081Z [2024-05-24T00:36:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status queued for try_number 1 2024-05-24T00:36:01.366006237Z [2024-05-24T00:36:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status queued for try_number 1 2024-05-24T00:36:01.376224011Z [2024-05-24T00:36:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1eee3ad-783d-46de-9ee0-92820231ea15 2024-05-24T00:36:01.376559811Z [2024-05-24T00:36:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3099fc2b-4f0f-4d20-9ab1-45d5cd278796 2024-05-24T00:36:01.376841460Z [2024-05-24T00:36:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8be09eb-3d66-47b5-816c-84bf45819523 2024-05-24T00:36:01.377025109Z [2024-05-24T00:36:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccc1f5a3-9fba-4a7c-8a7d-056253905f62 2024-05-24T00:36:02.572455631Z [2024-05-24T00:36:02.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:36:02.573023295Z [2024-05-24T00:36:02.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:34:00+00:00, run_id=scheduled__2024-05-24T00:34:00+00:00, run_start_date=2024-05-24 00:36:00.891911+00:00, run_end_date=2024-05-24 00:36:02.572323+00:00, run_duration=1.680412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:34:00+00:00, data_interval_end=2024-05-24 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:36:02.580949438Z [2024-05-24T00:36:02.580+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:36:00+00:00, run_after=2024-05-24T00:38:00+00:00 2024-05-24T00:36:02.604867716Z [2024-05-24T00:36:02.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:36:02.605275143Z [2024-05-24T00:36:02.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:35:00+00:00, run_id=scheduled__2024-05-24T00:35:00+00:00, run_start_date=2024-05-24 00:36:00.893485+00:00, run_end_date=2024-05-24 00:36:02.604767+00:00, run_duration=1.711282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:35:00+00:00, data_interval_end=2024-05-24 00:36:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:36:02.618607016Z [2024-05-24T00:36:02.618+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:36:00+00:00, run_after=2024-05-24T00:37:00+00:00 2024-05-24T00:36:02.680650762Z [2024-05-24T00:36:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:34:00+00:00 exited with status success for try_number 1 2024-05-24T00:36:02.680840647Z [2024-05-24T00:36:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status success for try_number 1 2024-05-24T00:36:02.696346163Z [2024-05-24T00:36:02.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:34:00+00:00, map_index=-1, run_start_date=2024-05-24 00:36:01.852994+00:00, run_end_date=2024-05-24 00:36:02.283538+00:00, run_duration=0.430544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:36:00.982147+00:00, queued_by_job_id=1, pid=8061 2024-05-24T00:36:02.699565383Z [2024-05-24T00:36:02.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:35:00+00:00, map_index=-1, run_start_date=2024-05-24 00:36:01.928551+00:00, run_end_date=2024-05-24 00:36:02.361668+00:00, run_duration=0.433117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:36:00.982147+00:00, queued_by_job_id=1, pid=8062 2024-05-24T00:36:05.562443794Z [2024-05-24T00:36:05.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:36:05.563312502Z [2024-05-24T00:36:05.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:35:00+00:00, run_id=scheduled__2024-05-24T00:35:00+00:00, run_start_date=2024-05-24 00:36:00.895060+00:00, run_end_date=2024-05-24 00:36:05.562289+00:00, run_duration=4.667229, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:35:00+00:00, data_interval_end=2024-05-24 00:36:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:36:05.577123186Z [2024-05-24T00:36:05.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:36:00+00:00, run_after=2024-05-24T00:37:00+00:00 2024-05-24T00:36:05.586587771Z [2024-05-24T00:36:05.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:36:05.586626865Z [2024-05-24T00:36:05.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:35:00+00:00, run_id=scheduled__2024-05-24T00:35:00+00:00, run_start_date=2024-05-24 00:36:00.896169+00:00, run_end_date=2024-05-24 00:36:05.584281+00:00, run_duration=4.688112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:35:00+00:00, data_interval_end=2024-05-24 00:36:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:36:05.597722649Z [2024-05-24T00:36:05.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:36:00+00:00, run_after=2024-05-24T00:37:00+00:00 2024-05-24T00:36:05.669377032Z [2024-05-24T00:36:05.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status success for try_number 1 2024-05-24T00:36:05.669410659Z [2024-05-24T00:36:05.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status success for try_number 1 2024-05-24T00:36:05.672242658Z [2024-05-24T00:36:05.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:35:00+00:00, map_index=-1, run_start_date=2024-05-24 00:36:03.144430+00:00, run_end_date=2024-05-24 00:36:05.169265+00:00, run_duration=2.024835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:36:00.982147+00:00, queued_by_job_id=1, pid=8086 2024-05-24T00:36:05.672379352Z [2024-05-24T00:36:05.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:35:00+00:00, map_index=-1, run_start_date=2024-05-24 00:36:03.106329+00:00, run_end_date=2024-05-24 00:36:04.784966+00:00, run_duration=1.678637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:36:00.982147+00:00, queued_by_job_id=1, pid=8085 2024-05-24T00:36:40.576770747Z [2024-05-24T00:36:40.576+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:37:00.196557131Z [2024-05-24T00:37:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:37:00+00:00, run_after=2024-05-24T00:38:00+00:00 2024-05-24T00:37:00.215904746Z [2024-05-24T00:37:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:37:00.241468951Z [2024-05-24T00:37:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:37:00+00:00, run_after=2024-05-24T00:38:00+00:00 2024-05-24T00:37:00.340556408Z [2024-05-24T00:37:00.340+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:37:00.340602261Z 2024-05-24T00:37:00.340607966Z 2024-05-24T00:37:00.340612760Z 2024-05-24T00:37:00.341239481Z [2024-05-24T00:37:00.340+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:37:00.341577982Z [2024-05-24T00:37:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:37:00.341837696Z [2024-05-24T00:37:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:37:00.342797252Z [2024-05-24T00:37:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:37:00.342815876Z 2024-05-24T00:37:00.342824925Z 2024-05-24T00:37:00.342833409Z 2024-05-24T00:37:00.347594493Z [2024-05-24T00:37:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:37:00.347957778Z [2024-05-24T00:37:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:37:00.348401807Z [2024-05-24T00:37:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:37:00.349049270Z [2024-05-24T00:37:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:37:00.349656860Z [2024-05-24T00:37:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:37:00.351790015Z [2024-05-24T00:37:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:37:00.666662917Z [2024-05-24T00:37:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status queued for try_number 1 2024-05-24T00:37:00.666686701Z [2024-05-24T00:37:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status queued for try_number 1 2024-05-24T00:37:00.666728680Z [2024-05-24T00:37:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status queued for try_number 1 2024-05-24T00:37:00.674010904Z [2024-05-24T00:37:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0a469a2-971e-492d-99e7-7edbd7145368 2024-05-24T00:37:00.674123246Z [2024-05-24T00:37:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84b54016-1a87-4f25-b31f-6630524d7cc7 2024-05-24T00:37:00.674246145Z [2024-05-24T00:37:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c89f802-18ee-4368-9983-11f4bf962f01 2024-05-24T00:37:01.845476030Z [2024-05-24T00:37:01.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:37:01.845871928Z [2024-05-24T00:37:01.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:36:00+00:00, run_id=scheduled__2024-05-24T00:36:00+00:00, run_start_date=2024-05-24 00:37:00.258872+00:00, run_end_date=2024-05-24 00:37:01.845364+00:00, run_duration=1.586492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:36:00+00:00, data_interval_end=2024-05-24 00:37:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:37:01.856654237Z [2024-05-24T00:37:01.856+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:37:00+00:00, run_after=2024-05-24T00:38:00+00:00 2024-05-24T00:37:01.892688284Z [2024-05-24T00:37:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status success for try_number 1 2024-05-24T00:37:01.901414068Z [2024-05-24T00:37:01.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:36:00+00:00, map_index=-1, run_start_date=2024-05-24 00:37:01.178235+00:00, run_end_date=2024-05-24 00:37:01.570130+00:00, run_duration=0.391895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:37:00.343988+00:00, queued_by_job_id=1, pid=8117 2024-05-24T00:37:04.050157511Z [2024-05-24T00:37:04.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:37:04.050376826Z [2024-05-24T00:37:04.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:36:00+00:00, run_id=scheduled__2024-05-24T00:36:00+00:00, run_start_date=2024-05-24 00:37:00.260804+00:00, run_end_date=2024-05-24 00:37:04.050022+00:00, run_duration=3.789218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:36:00+00:00, data_interval_end=2024-05-24 00:37:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:37:04.058961686Z [2024-05-24T00:37:04.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:37:00+00:00, run_after=2024-05-24T00:38:00+00:00 2024-05-24T00:37:04.119718268Z [2024-05-24T00:37:04.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status success for try_number 1 2024-05-24T00:37:04.129093119Z [2024-05-24T00:37:04.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:36:00+00:00, map_index=-1, run_start_date=2024-05-24 00:37:02.309480+00:00, run_end_date=2024-05-24 00:37:03.845981+00:00, run_duration=1.536501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:37:00.343988+00:00, queued_by_job_id=1, pid=8136 2024-05-24T00:37:05.194980646Z [2024-05-24T00:37:05.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:37:05.195722332Z [2024-05-24T00:37:05.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:36:00+00:00, run_id=scheduled__2024-05-24T00:36:00+00:00, run_start_date=2024-05-24 00:37:00.262370+00:00, run_end_date=2024-05-24 00:37:05.194806+00:00, run_duration=4.932436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:36:00+00:00, data_interval_end=2024-05-24 00:37:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:37:05.207654460Z [2024-05-24T00:37:05.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:37:00+00:00, run_after=2024-05-24T00:38:00+00:00 2024-05-24T00:37:05.260736292Z [2024-05-24T00:37:05.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status success for try_number 1 2024-05-24T00:37:05.269325547Z [2024-05-24T00:37:05.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:36:00+00:00, map_index=-1, run_start_date=2024-05-24 00:37:02.299553+00:00, run_end_date=2024-05-24 00:37:04.244915+00:00, run_duration=1.945362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:37:00.343988+00:00, queued_by_job_id=1, pid=8135 2024-05-24T00:38:00.799631203Z [2024-05-24T00:38:00.798+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:38:00.823001731Z [2024-05-24T00:38:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:38:00+00:00, run_after=2024-05-24T00:39:00+00:00 2024-05-24T00:38:00.833368648Z [2024-05-24T00:38:00.832+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:38:00.852883611Z [2024-05-24T00:38:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:38:00+00:00, run_after=2024-05-24T00:39:00+00:00 2024-05-24T00:38:00.973664015Z [2024-05-24T00:38:00.972+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:38:00.973714516Z 2024-05-24T00:38:00.973727163Z 2024-05-24T00:38:00.973737689Z 2024-05-24T00:38:00.973747330Z 2024-05-24T00:38:00.973759748Z [2024-05-24T00:38:00.973+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:38:00.973770493Z [2024-05-24T00:38:00.973+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:38:00.973781313Z [2024-05-24T00:38:00.973+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:38:00.973791035Z [2024-05-24T00:38:00.973+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:38:00.974480647Z [2024-05-24T00:38:00.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:38:00.974495976Z 2024-05-24T00:38:00.974499744Z 2024-05-24T00:38:00.974527070Z 2024-05-24T00:38:00.974531327Z 2024-05-24T00:38:00.978501373Z [2024-05-24T00:38:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:38:00.978775444Z [2024-05-24T00:38:00.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:38:00.979041555Z [2024-05-24T00:38:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:38:00.979177148Z [2024-05-24T00:38:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:38:00.979383397Z [2024-05-24T00:38:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:38:00.979506639Z [2024-05-24T00:38:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:38:00.979759435Z [2024-05-24T00:38:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:38:00.979873883Z [2024-05-24T00:38:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:38:01.234322438Z [2024-05-24T00:38:01.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status queued for try_number 1 2024-05-24T00:38:01.234397570Z [2024-05-24T00:38:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:37:00+00:00 exited with status queued for try_number 1 2024-05-24T00:38:01.234402751Z [2024-05-24T00:38:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:37:00+00:00 exited with status queued for try_number 1 2024-05-24T00:38:01.234601066Z [2024-05-24T00:38:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:37:00+00:00 exited with status queued for try_number 1 2024-05-24T00:38:01.247945302Z [2024-05-24T00:38:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6e66eb9-3904-4ea0-b8f5-b7215e2b746c 2024-05-24T00:38:01.248025028Z [2024-05-24T00:38:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0340321-ff59-4852-a226-5810128df7d9 2024-05-24T00:38:01.248127116Z [2024-05-24T00:38:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4f158c3-f754-4e1f-8e0a-da4851f77c6f 2024-05-24T00:38:01.248222176Z [2024-05-24T00:38:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25a575fa-401e-4e5a-92ea-923f62213a7f 2024-05-24T00:38:02.801383839Z [2024-05-24T00:38:02.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:38:02.801986318Z [2024-05-24T00:38:02.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:36:00+00:00, run_id=scheduled__2024-05-24T00:36:00+00:00, run_start_date=2024-05-24 00:38:00.868692+00:00, run_end_date=2024-05-24 00:38:02.801592+00:00, run_duration=1.9329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:36:00+00:00, data_interval_end=2024-05-24 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:38:02.811873380Z [2024-05-24T00:38:02.811+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:38:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:38:02.820277522Z [2024-05-24T00:38:02.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:38:02.820736540Z [2024-05-24T00:38:02.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:37:00+00:00, run_id=scheduled__2024-05-24T00:37:00+00:00, run_start_date=2024-05-24 00:38:00.871404+00:00, run_end_date=2024-05-24 00:38:02.820370+00:00, run_duration=1.948966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:37:00+00:00, data_interval_end=2024-05-24 00:38:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:38:02.834019951Z [2024-05-24T00:38:02.833+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:38:00+00:00, run_after=2024-05-24T00:39:00+00:00 2024-05-24T00:38:02.924412246Z [2024-05-24T00:38:02.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:36:00+00:00 exited with status success for try_number 1 2024-05-24T00:38:02.924843996Z [2024-05-24T00:38:02.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:37:00+00:00 exited with status success for try_number 1 2024-05-24T00:38:02.933906113Z [2024-05-24T00:38:02.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:36:00+00:00, map_index=-1, run_start_date=2024-05-24 00:38:01.799063+00:00, run_end_date=2024-05-24 00:38:02.134806+00:00, run_duration=0.335743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:38:00.975407+00:00, queued_by_job_id=1, pid=8169 2024-05-24T00:38:02.934290961Z [2024-05-24T00:38:02.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:37:00+00:00, map_index=-1, run_start_date=2024-05-24 00:38:01.975870+00:00, run_end_date=2024-05-24 00:38:02.405348+00:00, run_duration=0.429478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:38:00.975407+00:00, queued_by_job_id=1, pid=8171 2024-05-24T00:38:05.466194363Z [2024-05-24T00:38:05.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:38:05.466309374Z [2024-05-24T00:38:05.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:37:00+00:00, run_id=scheduled__2024-05-24T00:37:00+00:00, run_start_date=2024-05-24 00:38:00.873702+00:00, run_end_date=2024-05-24 00:38:05.465758+00:00, run_duration=4.592056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:37:00+00:00, data_interval_end=2024-05-24 00:38:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:38:05.477036048Z [2024-05-24T00:38:05.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:38:00+00:00, run_after=2024-05-24T00:39:00+00:00 2024-05-24T00:38:05.484653780Z [2024-05-24T00:38:05.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:38:05.484852923Z [2024-05-24T00:38:05.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:37:00+00:00, run_id=scheduled__2024-05-24T00:37:00+00:00, run_start_date=2024-05-24 00:38:00.876098+00:00, run_end_date=2024-05-24 00:38:05.484505+00:00, run_duration=4.608407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:37:00+00:00, data_interval_end=2024-05-24 00:38:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:38:05.493900133Z [2024-05-24T00:38:05.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:38:00+00:00, run_after=2024-05-24T00:39:00+00:00 2024-05-24T00:38:05.530040027Z [2024-05-24T00:38:05.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:37:00+00:00 exited with status success for try_number 1 2024-05-24T00:38:05.530144472Z [2024-05-24T00:38:05.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:37:00+00:00 exited with status success for try_number 1 2024-05-24T00:38:05.540282412Z [2024-05-24T00:38:05.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:37:00+00:00, map_index=-1, run_start_date=2024-05-24 00:38:03.074632+00:00, run_end_date=2024-05-24 00:38:04.329373+00:00, run_duration=1.254741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:38:00.975407+00:00, queued_by_job_id=1, pid=8194 2024-05-24T00:38:05.540695036Z [2024-05-24T00:38:05.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:37:00+00:00, map_index=-1, run_start_date=2024-05-24 00:38:02.788370+00:00, run_end_date=2024-05-24 00:38:04.415962+00:00, run_duration=1.627592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:38:00.975407+00:00, queued_by_job_id=1, pid=8188 2024-05-24T00:39:00.826215955Z [2024-05-24T00:39:00.825+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:39:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:39:00.837064860Z [2024-05-24T00:39:00.836+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:39:00.857069732Z [2024-05-24T00:39:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:39:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:39:00.951577052Z [2024-05-24T00:39:00.948+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:39:00.951609762Z 2024-05-24T00:39:00.951615853Z 2024-05-24T00:39:00.951621180Z 2024-05-24T00:39:00.951626065Z [2024-05-24T00:39:00.948+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:39:00.951630943Z [2024-05-24T00:39:00.948+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:39:00.951635655Z [2024-05-24T00:39:00.948+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:39:00.951642354Z [2024-05-24T00:39:00.949+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:39:00.951647100Z 2024-05-24T00:39:00.951651901Z 2024-05-24T00:39:00.951656644Z 2024-05-24T00:39:00.952597236Z [2024-05-24T00:39:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:39:00.952723634Z [2024-05-24T00:39:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:39:00.952915645Z [2024-05-24T00:39:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:39:00.953012408Z [2024-05-24T00:39:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:39:00.953162734Z [2024-05-24T00:39:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:39:00.953236200Z [2024-05-24T00:39:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:39:01.209166540Z [2024-05-24T00:39:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status queued for try_number 1 2024-05-24T00:39:01.209200374Z [2024-05-24T00:39:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status queued for try_number 1 2024-05-24T00:39:01.209256430Z [2024-05-24T00:39:01.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status queued for try_number 1 2024-05-24T00:39:01.227244696Z [2024-05-24T00:39:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b54df3f-6b50-44a3-b9ea-8cd4bfb4d0f3 2024-05-24T00:39:01.227327855Z [2024-05-24T00:39:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c36bc9f-e440-40f9-943e-980675283cc3 2024-05-24T00:39:01.227445010Z [2024-05-24T00:39:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e9b64e0-a944-4f2c-81bd-df58fa842747 2024-05-24T00:39:02.747746717Z [2024-05-24T00:39:02.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:39:02.748247307Z [2024-05-24T00:39:02.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:38:00+00:00, run_id=scheduled__2024-05-24T00:38:00+00:00, run_start_date=2024-05-24 00:39:00.875375+00:00, run_end_date=2024-05-24 00:39:02.747864+00:00, run_duration=1.872489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:38:00+00:00, data_interval_end=2024-05-24 00:39:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:39:02.763925663Z [2024-05-24T00:39:02.763+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:39:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:39:02.850378881Z [2024-05-24T00:39:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status success for try_number 1 2024-05-24T00:39:02.855360142Z [2024-05-24T00:39:02.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:38:00+00:00, map_index=-1, run_start_date=2024-05-24 00:39:01.733468+00:00, run_end_date=2024-05-24 00:39:02.129554+00:00, run_duration=0.396086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:39:00.950344+00:00, queued_by_job_id=1, pid=8226 2024-05-24T00:39:05.779510556Z [2024-05-24T00:39:05.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:39:05.779696159Z [2024-05-24T00:39:05.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:38:00+00:00, run_id=scheduled__2024-05-24T00:38:00+00:00, run_start_date=2024-05-24 00:39:00.877272+00:00, run_end_date=2024-05-24 00:39:05.779189+00:00, run_duration=4.901917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:38:00+00:00, data_interval_end=2024-05-24 00:39:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:39:05.791583016Z [2024-05-24T00:39:05.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:39:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:39:05.800493998Z [2024-05-24T00:39:05.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:39:05.800645787Z [2024-05-24T00:39:05.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:38:00+00:00, run_id=scheduled__2024-05-24T00:38:00+00:00, run_start_date=2024-05-24 00:39:00.878980+00:00, run_end_date=2024-05-24 00:39:05.800178+00:00, run_duration=4.921198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:38:00+00:00, data_interval_end=2024-05-24 00:39:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:39:05.810966601Z [2024-05-24T00:39:05.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:39:00+00:00, run_after=2024-05-24T00:40:00+00:00 2024-05-24T00:39:05.854690828Z [2024-05-24T00:39:05.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status success for try_number 1 2024-05-24T00:39:05.854741823Z [2024-05-24T00:39:05.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status success for try_number 1 2024-05-24T00:39:05.868965872Z [2024-05-24T00:39:05.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:38:00+00:00, map_index=-1, run_start_date=2024-05-24 00:39:02.870071+00:00, run_end_date=2024-05-24 00:39:04.561186+00:00, run_duration=1.691115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:39:00.950344+00:00, queued_by_job_id=1, pid=8244 2024-05-24T00:39:05.869111001Z [2024-05-24T00:39:05.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:38:00+00:00, map_index=-1, run_start_date=2024-05-24 00:39:02.894131+00:00, run_end_date=2024-05-24 00:39:05.104791+00:00, run_duration=2.21066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:39:00.950344+00:00, queued_by_job_id=1, pid=8245 2024-05-24T00:40:00.869842479Z [2024-05-24T00:40:00.869+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:40:00.886734184Z [2024-05-24T00:40:00.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:41:00+00:00 2024-05-24T00:40:00.894786774Z [2024-05-24T00:40:00.894+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:40:00.906780214Z [2024-05-24T00:40:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:45:00+00:00 2024-05-24T00:40:00.924213930Z [2024-05-24T00:40:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:41:00+00:00 2024-05-24T00:40:01.023809376Z [2024-05-24T00:40:01.023+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T00:40:01.023859256Z 2024-05-24T00:40:01.023869028Z 2024-05-24T00:40:01.023887935Z 2024-05-24T00:40:01.023897746Z 2024-05-24T00:40:01.023906537Z 2024-05-24T00:40:01.024751010Z [2024-05-24T00:40:01.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:40:01.025387125Z [2024-05-24T00:40:01.025+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:40:01.025940449Z [2024-05-24T00:40:01.025+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:40:01.026492472Z [2024-05-24T00:40:01.026+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:40:01.027075865Z [2024-05-24T00:40:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:40:01.028779549Z [2024-05-24T00:40:01.028+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:40:01.028792255Z 2024-05-24T00:40:01.028796061Z 2024-05-24T00:40:01.028799199Z 2024-05-24T00:40:01.028802069Z 2024-05-24T00:40:01.028804878Z 2024-05-24T00:40:01.035931986Z [2024-05-24T00:40:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:40:01.036860157Z [2024-05-24T00:40:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:40:01.037389259Z [2024-05-24T00:40:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:40:01.037699277Z [2024-05-24T00:40:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:40:01.038123687Z [2024-05-24T00:40:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:40:01.038416165Z [2024-05-24T00:40:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:40:01.038906938Z [2024-05-24T00:40:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:40:01.039194292Z [2024-05-24T00:40:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:40:01.039645827Z [2024-05-24T00:40:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:40:01.040048321Z [2024-05-24T00:40:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:40:01.447691012Z [2024-05-24T00:40:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:01.448026876Z [2024-05-24T00:40:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:01.448289119Z [2024-05-24T00:40:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:39:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:01.448517465Z [2024-05-24T00:40:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:39:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:01.448690796Z [2024-05-24T00:40:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:39:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:01.474134958Z [2024-05-24T00:40:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62f4ac81-b6f3-431f-9bf5-517352f66629 2024-05-24T00:40:01.474599639Z [2024-05-24T00:40:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6127da3c-846b-4e5f-af72-a197a55ac954 2024-05-24T00:40:01.474992260Z [2024-05-24T00:40:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c0ef0ae-2e1b-4a4e-904f-ce35fcb1cba6 2024-05-24T00:40:01.475323659Z [2024-05-24T00:40:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1de0d255-524f-4fce-b106-ae2cb6080a3c 2024-05-24T00:40:01.475540526Z [2024-05-24T00:40:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9183793e-3804-4785-8d3a-7d80adad658c 2024-05-24T00:40:03.420074240Z [2024-05-24T00:40:03.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:40:03.420188962Z [2024-05-24T00:40:03.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:38:00+00:00, run_id=scheduled__2024-05-24T00:38:00+00:00, run_start_date=2024-05-24 00:40:00.938472+00:00, run_end_date=2024-05-24 00:40:03.419884+00:00, run_duration=2.481412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:38:00+00:00, data_interval_end=2024-05-24 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:40:03.431965301Z [2024-05-24T00:40:03.431+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:42:00+00:00 2024-05-24T00:40:03.456374000Z [2024-05-24T00:40:03.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:40:03.456846662Z [2024-05-24T00:40:03.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:39:00+00:00, run_id=scheduled__2024-05-24T00:39:00+00:00, run_start_date=2024-05-24 00:40:00.939551+00:00, run_end_date=2024-05-24 00:40:03.456497+00:00, run_duration=2.516946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:39:00+00:00, data_interval_end=2024-05-24 00:40:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:40:03.471219583Z [2024-05-24T00:40:03.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:41:00+00:00 2024-05-24T00:40:03.520150085Z [2024-05-24T00:40:03.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:38:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:03.520635001Z [2024-05-24T00:40:03.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:39:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:03.527826224Z [2024-05-24T00:40:03.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:38:00+00:00, map_index=-1, run_start_date=2024-05-24 00:40:02.147586+00:00, run_end_date=2024-05-24 00:40:02.635201+00:00, run_duration=0.487615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:01.031130+00:00, queued_by_job_id=1, pid=8278 2024-05-24T00:40:03.528251447Z [2024-05-24T00:40:03.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:39:00+00:00, map_index=-1, run_start_date=2024-05-24 00:40:02.157303+00:00, run_end_date=2024-05-24 00:40:02.698782+00:00, run_duration=0.541479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:01.031130+00:00, queued_by_job_id=1, pid=8279 2024-05-24T00:40:04.999871390Z [2024-05-24T00:40:04.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:40:05.000069697Z [2024-05-24T00:40:04.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:39:00+00:00, run_id=scheduled__2024-05-24T00:39:00+00:00, run_start_date=2024-05-24 00:40:00.940586+00:00, run_end_date=2024-05-24 00:40:04.999553+00:00, run_duration=4.058967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:39:00+00:00, data_interval_end=2024-05-24 00:40:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:40:05.017976600Z [2024-05-24T00:40:05.017+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:41:00+00:00 2024-05-24T00:40:05.042988949Z [2024-05-24T00:40:05.042+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:40:05.043059229Z 2024-05-24T00:40:05.043070604Z [2024-05-24T00:40:05.042+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:40:05.043741541Z [2024-05-24T00:40:05.043+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:40:05.043760879Z 2024-05-24T00:40:05.046995265Z [2024-05-24T00:40:05.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:40:05.047017326Z [2024-05-24T00:40:05.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:40:05.133292647Z [2024-05-24T00:40:05.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:05.133409099Z [2024-05-24T00:40:05.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:05.133418767Z [2024-05-24T00:40:05.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:39:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:05.143919458Z [2024-05-24T00:40:05.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60ed73d8-75e3-4f42-830c-0af64aaab1b6 2024-05-24T00:40:05.144080716Z [2024-05-24T00:40:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:35:00+00:00, map_index=-1, run_start_date=2024-05-24 00:40:03.479478+00:00, run_end_date=2024-05-24 00:40:03.950338+00:00, run_duration=0.47086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:01.031130+00:00, queued_by_job_id=1, pid=8309 2024-05-24T00:40:05.144155082Z [2024-05-24T00:40:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:39:00+00:00, map_index=-1, run_start_date=2024-05-24 00:40:03.210574+00:00, run_end_date=2024-05-24 00:40:04.656374+00:00, run_duration=1.4458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:01.031130+00:00, queued_by_job_id=1, pid=8298 2024-05-24T00:40:06.290171471Z [2024-05-24T00:40:06.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:40:06.290418131Z [2024-05-24T00:40:06.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:39:00+00:00, run_id=scheduled__2024-05-24T00:39:00+00:00, run_start_date=2024-05-24 00:40:00.941605+00:00, run_end_date=2024-05-24 00:40:06.290027+00:00, run_duration=5.348422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:39:00+00:00, data_interval_end=2024-05-24 00:40:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:40:06.302807281Z [2024-05-24T00:40:06.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:41:00+00:00 2024-05-24T00:40:06.366240647Z [2024-05-24T00:40:06.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:39:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:06.375941618Z [2024-05-24T00:40:06.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:39:00+00:00, map_index=-1, run_start_date=2024-05-24 00:40:03.597558+00:00, run_end_date=2024-05-24 00:40:05.350947+00:00, run_duration=1.753389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:01.031130+00:00, queued_by_job_id=1, pid=8315 2024-05-24T00:40:07.457167782Z [2024-05-24T00:40:07.456+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:40:07.457211478Z 2024-05-24T00:40:07.457220871Z [2024-05-24T00:40:07.456+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:40:07.457791386Z [2024-05-24T00:40:07.457+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:40:07.457819533Z 2024-05-24T00:40:07.462728292Z [2024-05-24T00:40:07.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:40:07.462960549Z [2024-05-24T00:40:07.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:40:07.537242957Z [2024-05-24T00:40:07.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:07.537271517Z [2024-05-24T00:40:07.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:07.548020552Z [2024-05-24T00:40:07.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b107af8-0b1f-439f-a9ee-afb1fbf566ca 2024-05-24T00:40:07.548564779Z [2024-05-24T00:40:07.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:35:00+00:00, map_index=-1, run_start_date=2024-05-24 00:40:06.698173+00:00, run_end_date=2024-05-24 00:40:07.045056+00:00, run_duration=0.346883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:05.043861+00:00, queued_by_job_id=1, pid=8333 2024-05-24T00:40:10.290579973Z [2024-05-24T00:40:10.289+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:40:10.290612456Z 2024-05-24T00:40:10.290623719Z [2024-05-24T00:40:10.289+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:40:10.291809181Z [2024-05-24T00:40:10.291+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:40:10.291826112Z 2024-05-24T00:40:10.296321681Z [2024-05-24T00:40:10.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:40:10.296739109Z [2024-05-24T00:40:10.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:40:10.385405708Z [2024-05-24T00:40:10.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status queued for try_number 1 2024-05-24T00:40:10.385710757Z [2024-05-24T00:40:10.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:10.397707054Z [2024-05-24T00:40:10.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 481277bd-27d1-4a19-a749-afac89260b19 2024-05-24T00:40:10.398023433Z [2024-05-24T00:40:10.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:35:00+00:00, map_index=0, run_start_date=2024-05-24 00:40:09.206720+00:00, run_end_date=2024-05-24 00:40:09.562229+00:00, run_duration=0.355509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:07.458119+00:00, queued_by_job_id=1, pid=8341 2024-05-24T00:40:13.518299399Z [2024-05-24T00:40:13.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:40:13.518477425Z [2024-05-24T00:40:13.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:35:00+00:00, run_id=scheduled__2024-05-24T00:35:00+00:00, run_start_date=2024-05-24 00:40:00.937213+00:00, run_end_date=2024-05-24 00:40:13.518150+00:00, run_duration=12.580937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:35:00+00:00, data_interval_end=2024-05-24 00:40:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:40:13.524164527Z [2024-05-24T00:40:13.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:40:00+00:00, run_after=2024-05-24T00:45:00+00:00 2024-05-24T00:40:13.559831690Z [2024-05-24T00:40:13.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:35:00+00:00 exited with status success for try_number 1 2024-05-24T00:40:13.565018858Z [2024-05-24T00:40:13.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:35:00+00:00, map_index=-1, run_start_date=2024-05-24 00:40:12.006763+00:00, run_end_date=2024-05-24 00:40:12.479078+00:00, run_duration=0.472315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:40:10.292447+00:00, queued_by_job_id=1, pid=8349 2024-05-24T00:41:01.017647857Z [2024-05-24T00:41:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:41:00+00:00, run_after=2024-05-24T00:42:00+00:00 2024-05-24T00:41:01.024601608Z [2024-05-24T00:41:01.024+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:41:01.039091861Z [2024-05-24T00:41:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:41:00+00:00, run_after=2024-05-24T00:42:00+00:00 2024-05-24T00:41:01.150439886Z [2024-05-24T00:41:01.149+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:41:01.150495372Z 2024-05-24T00:41:01.150573230Z 2024-05-24T00:41:01.150588851Z 2024-05-24T00:41:01.150672632Z [2024-05-24T00:41:01.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:41:01.150764640Z [2024-05-24T00:41:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:41:01.151073415Z [2024-05-24T00:41:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:41:01.151946323Z [2024-05-24T00:41:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:41:01.151959600Z 2024-05-24T00:41:01.151966455Z 2024-05-24T00:41:01.151973100Z 2024-05-24T00:41:01.157454588Z [2024-05-24T00:41:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:41:01.157763921Z [2024-05-24T00:41:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:41:01.158206836Z [2024-05-24T00:41:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:41:01.158490882Z [2024-05-24T00:41:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:41:01.159055048Z [2024-05-24T00:41:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:41:01.159312292Z [2024-05-24T00:41:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:41:01.364114023Z [2024-05-24T00:41:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:41:01.364167761Z [2024-05-24T00:41:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:41:01.364292452Z [2024-05-24T00:41:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:41:01.372149846Z [2024-05-24T00:41:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3e3a5f1-3070-4b05-9871-a921c273439c 2024-05-24T00:41:01.372273543Z [2024-05-24T00:41:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to db244cd8-54b2-4f64-8cf5-c52660529ffe 2024-05-24T00:41:01.372417778Z [2024-05-24T00:41:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0bedd48-ffc4-45cc-8722-16da2c9a3536 2024-05-24T00:41:02.520744763Z [2024-05-24T00:41:02.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:41:02.521117477Z [2024-05-24T00:41:02.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:40:00+00:00, run_id=scheduled__2024-05-24T00:40:00+00:00, run_start_date=2024-05-24 00:41:01.054011+00:00, run_end_date=2024-05-24 00:41:02.520542+00:00, run_duration=1.466531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:40:00+00:00, data_interval_end=2024-05-24 00:41:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:41:02.536831174Z [2024-05-24T00:41:02.534+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:41:00+00:00, run_after=2024-05-24T00:42:00+00:00 2024-05-24T00:41:02.582725267Z [2024-05-24T00:41:02.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:41:02.588474526Z [2024-05-24T00:41:02.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=-1, run_start_date=2024-05-24 00:41:01.927157+00:00, run_end_date=2024-05-24 00:41:02.293702+00:00, run_duration=0.366545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:41:01.153156+00:00, queued_by_job_id=1, pid=8371 2024-05-24T00:41:05.033470733Z [2024-05-24T00:41:05.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:41:05.033551109Z [2024-05-24T00:41:05.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:40:00+00:00, run_id=scheduled__2024-05-24T00:40:00+00:00, run_start_date=2024-05-24 00:41:01.055399+00:00, run_end_date=2024-05-24 00:41:05.033304+00:00, run_duration=3.977905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:40:00+00:00, data_interval_end=2024-05-24 00:41:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:41:05.043354147Z [2024-05-24T00:41:05.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:41:00+00:00, run_after=2024-05-24T00:42:00+00:00 2024-05-24T00:41:05.086768794Z [2024-05-24T00:41:05.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:41:05.095323121Z [2024-05-24T00:41:05.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=-1, run_start_date=2024-05-24 00:41:03.036877+00:00, run_end_date=2024-05-24 00:41:04.563077+00:00, run_duration=1.5262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:41:01.153156+00:00, queued_by_job_id=1, pid=8389 2024-05-24T00:41:05.407307698Z [2024-05-24T00:41:05.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:41:05.407695944Z [2024-05-24T00:41:05.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:40:00+00:00, run_id=scheduled__2024-05-24T00:40:00+00:00, run_start_date=2024-05-24 00:41:01.066367+00:00, run_end_date=2024-05-24 00:41:05.407145+00:00, run_duration=4.340778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:40:00+00:00, data_interval_end=2024-05-24 00:41:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:41:05.422009080Z [2024-05-24T00:41:05.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:41:00+00:00, run_after=2024-05-24T00:42:00+00:00 2024-05-24T00:41:05.470461962Z [2024-05-24T00:41:05.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:41:05.476474818Z [2024-05-24T00:41:05.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=-1, run_start_date=2024-05-24 00:41:03.132056+00:00, run_end_date=2024-05-24 00:41:05.018207+00:00, run_duration=1.886151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:41:01.153156+00:00, queued_by_job_id=1, pid=8390 2024-05-24T00:41:40.673000742Z [2024-05-24T00:41:40.672+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:42:00.173240839Z [2024-05-24T00:42:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:42:00+00:00, run_after=2024-05-24T00:43:00+00:00 2024-05-24T00:42:00.182742137Z [2024-05-24T00:42:00.182+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:42:00.190499211Z [2024-05-24T00:42:00.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:42:00.207777973Z [2024-05-24T00:42:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:42:00+00:00, run_after=2024-05-24T00:43:00+00:00 2024-05-24T00:42:00.302747828Z [2024-05-24T00:42:00.302+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:42:00.302776693Z 2024-05-24T00:42:00.302781618Z 2024-05-24T00:42:00.302785551Z 2024-05-24T00:42:00.302789391Z 2024-05-24T00:42:00.303175526Z [2024-05-24T00:42:00.302+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:42:00.303380102Z [2024-05-24T00:42:00.303+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:42:00.303548833Z [2024-05-24T00:42:00.303+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:42:00.303717039Z [2024-05-24T00:42:00.303+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:42:00.304654788Z [2024-05-24T00:42:00.304+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:42:00.304669462Z 2024-05-24T00:42:00.304677020Z 2024-05-24T00:42:00.304681277Z 2024-05-24T00:42:00.304684932Z 2024-05-24T00:42:00.322281875Z [2024-05-24T00:42:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:42:00.322300780Z [2024-05-24T00:42:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:42:00.322305454Z [2024-05-24T00:42:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:42:00.322308784Z [2024-05-24T00:42:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:42:00.322312078Z [2024-05-24T00:42:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:42:00.322327211Z [2024-05-24T00:42:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:42:00.322330277Z [2024-05-24T00:42:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:42:00.322333390Z [2024-05-24T00:42:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:42:00.743629097Z [2024-05-24T00:42:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:42:00.743696084Z [2024-05-24T00:42:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:41:00+00:00 exited with status queued for try_number 1 2024-05-24T00:42:00.743820511Z [2024-05-24T00:42:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:41:00+00:00 exited with status queued for try_number 1 2024-05-24T00:42:00.743893916Z [2024-05-24T00:42:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:41:00+00:00 exited with status queued for try_number 1 2024-05-24T00:42:00.757528593Z [2024-05-24T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93106919-7cae-458d-8e9b-44d85be67923 2024-05-24T00:42:00.757728177Z [2024-05-24T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to d969b1e6-8d18-4586-a349-5120cf8b78c5 2024-05-24T00:42:00.757997839Z [2024-05-24T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccd4ad6f-2c9e-45fe-b302-437ea35bf9f0 2024-05-24T00:42:00.758162576Z [2024-05-24T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to b209ef79-af6d-4727-96ad-59f10bd017fc 2024-05-24T00:42:02.185906132Z [2024-05-24T00:42:02.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:42:02.186464409Z [2024-05-24T00:42:02.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:40:00+00:00, run_id=scheduled__2024-05-24T00:40:00+00:00, run_start_date=2024-05-24 00:42:00.222460+00:00, run_end_date=2024-05-24 00:42:02.186078+00:00, run_duration=1.963618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:40:00+00:00, data_interval_end=2024-05-24 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:42:02.194396045Z [2024-05-24T00:42:02.194+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:42:00+00:00, run_after=2024-05-24T00:44:00+00:00 2024-05-24T00:42:02.213129503Z [2024-05-24T00:42:02.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:42:02.213541241Z [2024-05-24T00:42:02.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:41:00+00:00, run_id=scheduled__2024-05-24T00:41:00+00:00, run_start_date=2024-05-24 00:42:00.223874+00:00, run_end_date=2024-05-24 00:42:02.213236+00:00, run_duration=1.989362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:41:00+00:00, data_interval_end=2024-05-24 00:42:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:42:02.223840587Z [2024-05-24T00:42:02.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:42:00+00:00, run_after=2024-05-24T00:43:00+00:00 2024-05-24T00:42:02.256483930Z [2024-05-24T00:42:02.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:42:02.256759713Z [2024-05-24T00:42:02.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:41:00+00:00 exited with status success for try_number 1 2024-05-24T00:42:02.263264556Z [2024-05-24T00:42:02.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=-1, run_start_date=2024-05-24 00:42:01.405129+00:00, run_end_date=2024-05-24 00:42:01.805231+00:00, run_duration=0.400102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:42:00.306626+00:00, queued_by_job_id=1, pid=8424 2024-05-24T00:42:02.263647496Z [2024-05-24T00:42:02.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:41:00+00:00, map_index=-1, run_start_date=2024-05-24 00:42:01.280820+00:00, run_end_date=2024-05-24 00:42:01.683100+00:00, run_duration=0.40228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:42:00.306626+00:00, queued_by_job_id=1, pid=8423 2024-05-24T00:42:04.424513637Z [2024-05-24T00:42:04.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:42:04.424799535Z [2024-05-24T00:42:04.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:41:00+00:00, run_id=scheduled__2024-05-24T00:41:00+00:00, run_start_date=2024-05-24 00:42:00.224952+00:00, run_end_date=2024-05-24 00:42:04.424270+00:00, run_duration=4.199318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:41:00+00:00, data_interval_end=2024-05-24 00:42:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:42:04.435286400Z [2024-05-24T00:42:04.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:42:00+00:00, run_after=2024-05-24T00:43:00+00:00 2024-05-24T00:42:04.497790823Z [2024-05-24T00:42:04.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:41:00+00:00 exited with status success for try_number 1 2024-05-24T00:42:04.504771551Z [2024-05-24T00:42:04.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:41:00+00:00, map_index=-1, run_start_date=2024-05-24 00:42:02.629204+00:00, run_end_date=2024-05-24 00:42:04.108582+00:00, run_duration=1.479378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:42:00.306626+00:00, queued_by_job_id=1, pid=8448 2024-05-24T00:42:05.548523259Z [2024-05-24T00:42:05.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:42:05.548901269Z [2024-05-24T00:42:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:41:00+00:00, run_id=scheduled__2024-05-24T00:41:00+00:00, run_start_date=2024-05-24 00:42:00.226086+00:00, run_end_date=2024-05-24 00:42:05.548316+00:00, run_duration=5.32223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:41:00+00:00, data_interval_end=2024-05-24 00:42:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:42:05.558850298Z [2024-05-24T00:42:05.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:42:00+00:00, run_after=2024-05-24T00:43:00+00:00 2024-05-24T00:42:05.603129621Z [2024-05-24T00:42:05.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:41:00+00:00 exited with status success for try_number 1 2024-05-24T00:42:05.611379033Z [2024-05-24T00:42:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:41:00+00:00, map_index=-1, run_start_date=2024-05-24 00:42:02.562875+00:00, run_end_date=2024-05-24 00:42:04.605630+00:00, run_duration=2.042755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:42:00.306626+00:00, queued_by_job_id=1, pid=8447 2024-05-24T00:43:00.222167131Z [2024-05-24T00:43:00.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:43:00+00:00, run_after=2024-05-24T00:44:00+00:00 2024-05-24T00:43:00.239336550Z [2024-05-24T00:43:00.238+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:43:00.257109976Z [2024-05-24T00:43:00.256+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:43:00+00:00, run_after=2024-05-24T00:44:00+00:00 2024-05-24T00:43:00.316547498Z [2024-05-24T00:43:00.316+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:43:00.316571188Z 2024-05-24T00:43:00.316574432Z 2024-05-24T00:43:00.316577277Z 2024-05-24T00:43:00.316618781Z [2024-05-24T00:43:00.316+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:43:00.316668670Z [2024-05-24T00:43:00.316+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:43:00.316729223Z [2024-05-24T00:43:00.316+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:43:00.318681170Z [2024-05-24T00:43:00.317+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:43:00.318706209Z 2024-05-24T00:43:00.318710538Z 2024-05-24T00:43:00.318713957Z 2024-05-24T00:43:00.322322535Z [2024-05-24T00:43:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:43:00.322335268Z [2024-05-24T00:43:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:43:00.322339126Z [2024-05-24T00:43:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:43:00.322342662Z [2024-05-24T00:43:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:43:00.322346105Z [2024-05-24T00:43:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:43:00.322349956Z [2024-05-24T00:43:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:43:00.586413061Z [2024-05-24T00:43:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status queued for try_number 1 2024-05-24T00:43:00.586490625Z [2024-05-24T00:43:00.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status queued for try_number 1 2024-05-24T00:43:00.586496526Z [2024-05-24T00:43:00.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status queued for try_number 1 2024-05-24T00:43:00.597333983Z [2024-05-24T00:43:00.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b837de6-fae7-4c79-88de-9fe7883e44bb 2024-05-24T00:43:00.597417915Z [2024-05-24T00:43:00.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a50e5fd-935c-45d9-890a-3928528c07db 2024-05-24T00:43:00.597487102Z [2024-05-24T00:43:00.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b8613e9-670d-45d4-8ebc-8db121c714f0 2024-05-24T00:43:01.730032568Z [2024-05-24T00:43:01.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:43:01.730416434Z [2024-05-24T00:43:01.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:42:00+00:00, run_id=scheduled__2024-05-24T00:42:00+00:00, run_start_date=2024-05-24 00:43:00.268251+00:00, run_end_date=2024-05-24 00:43:01.729954+00:00, run_duration=1.461703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:42:00+00:00, data_interval_end=2024-05-24 00:43:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:43:01.750979541Z [2024-05-24T00:43:01.750+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:43:00+00:00, run_after=2024-05-24T00:44:00+00:00 2024-05-24T00:43:02.119111824Z [2024-05-24T00:43:02.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status success for try_number 1 2024-05-24T00:43:02.125474540Z [2024-05-24T00:43:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:42:00+00:00, map_index=-1, run_start_date=2024-05-24 00:43:01.223848+00:00, run_end_date=2024-05-24 00:43:01.685151+00:00, run_duration=0.461303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:43:00.317996+00:00, queued_by_job_id=1, pid=8480 2024-05-24T00:43:04.990587242Z [2024-05-24T00:43:04.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:43:04.990891669Z [2024-05-24T00:43:04.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:42:00+00:00, run_id=scheduled__2024-05-24T00:42:00+00:00, run_start_date=2024-05-24 00:43:00.269613+00:00, run_end_date=2024-05-24 00:43:04.990337+00:00, run_duration=4.720724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:42:00+00:00, data_interval_end=2024-05-24 00:43:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:43:05.012604093Z [2024-05-24T00:43:05.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:43:00+00:00, run_after=2024-05-24T00:44:00+00:00 2024-05-24T00:43:05.070114557Z [2024-05-24T00:43:05.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status success for try_number 1 2024-05-24T00:43:05.076835510Z [2024-05-24T00:43:05.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:42:00+00:00, map_index=-1, run_start_date=2024-05-24 00:43:02.473578+00:00, run_end_date=2024-05-24 00:43:04.235349+00:00, run_duration=1.761771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:43:00.317996+00:00, queued_by_job_id=1, pid=8499 2024-05-24T00:43:05.925639948Z [2024-05-24T00:43:05.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:43:05.925991501Z [2024-05-24T00:43:05.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:42:00+00:00, run_id=scheduled__2024-05-24T00:42:00+00:00, run_start_date=2024-05-24 00:43:00.270683+00:00, run_end_date=2024-05-24 00:43:05.925679+00:00, run_duration=5.654996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:42:00+00:00, data_interval_end=2024-05-24 00:43:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:43:05.934583591Z [2024-05-24T00:43:05.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:43:00+00:00, run_after=2024-05-24T00:44:00+00:00 2024-05-24T00:43:05.982275877Z [2024-05-24T00:43:05.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status success for try_number 1 2024-05-24T00:43:05.990062632Z [2024-05-24T00:43:05.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:42:00+00:00, map_index=-1, run_start_date=2024-05-24 00:43:02.249933+00:00, run_end_date=2024-05-24 00:43:05.774812+00:00, run_duration=3.524879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:43:00.317996+00:00, queued_by_job_id=1, pid=8493 2024-05-24T00:44:00.309253534Z [2024-05-24T00:44:00.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:44:00+00:00, run_after=2024-05-24T00:45:00+00:00 2024-05-24T00:44:00.322662265Z [2024-05-24T00:44:00.322+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:44:00.332236169Z [2024-05-24T00:44:00.331+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:44:00.347865587Z [2024-05-24T00:44:00.347+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:44:00+00:00, run_after=2024-05-24T00:45:00+00:00 2024-05-24T00:44:00.489489138Z [2024-05-24T00:44:00.488+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:44:00.489551497Z 2024-05-24T00:44:00.489568573Z 2024-05-24T00:44:00.489582236Z 2024-05-24T00:44:00.489594422Z 2024-05-24T00:44:00.490233909Z [2024-05-24T00:44:00.489+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:44:00.490722020Z [2024-05-24T00:44:00.490+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:44:00.491414899Z [2024-05-24T00:44:00.491+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:44:00.492244378Z [2024-05-24T00:44:00.491+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:44:00.494590877Z [2024-05-24T00:44:00.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:44:00.494604427Z 2024-05-24T00:44:00.494607991Z 2024-05-24T00:44:00.494611271Z 2024-05-24T00:44:00.494614395Z 2024-05-24T00:44:00.501220672Z [2024-05-24T00:44:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:44:00.501609644Z [2024-05-24T00:44:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:44:00.502093165Z [2024-05-24T00:44:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:44:00.502397956Z [2024-05-24T00:44:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:44:00.503035692Z [2024-05-24T00:44:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:44:00.503371560Z [2024-05-24T00:44:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:44:00.503796052Z [2024-05-24T00:44:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:44:00.504072639Z [2024-05-24T00:44:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:44:00.919450842Z [2024-05-24T00:44:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status queued for try_number 1 2024-05-24T00:44:00.919461880Z [2024-05-24T00:44:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:43:00+00:00 exited with status queued for try_number 1 2024-05-24T00:44:00.929913974Z [2024-05-24T00:44:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:43:00+00:00 exited with status queued for try_number 1 2024-05-24T00:44:00.935061453Z [2024-05-24T00:44:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:43:00+00:00 exited with status queued for try_number 1 2024-05-24T00:44:00.952286621Z [2024-05-24T00:44:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4b3d7c4-8fc1-439e-8c6f-37c3c95f6535 2024-05-24T00:44:00.952350212Z [2024-05-24T00:44:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77ca4bc9-89b1-4108-a1f1-442935c7da5e 2024-05-24T00:44:00.952393185Z [2024-05-24T00:44:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e41dada-b880-4195-b721-bd04f11c3576 2024-05-24T00:44:00.956165839Z [2024-05-24T00:44:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to e02fc0c9-baf5-455b-a0ca-c5ed6bf06abf 2024-05-24T00:44:02.278212696Z [2024-05-24T00:44:02.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:44:02.278750031Z [2024-05-24T00:44:02.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:42:00+00:00, run_id=scheduled__2024-05-24T00:42:00+00:00, run_start_date=2024-05-24 00:44:00.406622+00:00, run_end_date=2024-05-24 00:44:02.278352+00:00, run_duration=1.87173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:42:00+00:00, data_interval_end=2024-05-24 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:44:02.294212592Z [2024-05-24T00:44:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:44:00+00:00, run_after=2024-05-24T00:46:00+00:00 2024-05-24T00:44:02.306243542Z [2024-05-24T00:44:02.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:44:02.306749514Z [2024-05-24T00:44:02.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:43:00+00:00, run_id=scheduled__2024-05-24T00:43:00+00:00, run_start_date=2024-05-24 00:44:00.411976+00:00, run_end_date=2024-05-24 00:44:02.306426+00:00, run_duration=1.89445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:43:00+00:00, data_interval_end=2024-05-24 00:44:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:44:02.318114188Z [2024-05-24T00:44:02.317+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:44:00+00:00, run_after=2024-05-24T00:45:00+00:00 2024-05-24T00:44:02.378453004Z [2024-05-24T00:44:02.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:42:00+00:00 exited with status success for try_number 1 2024-05-24T00:44:02.378821088Z [2024-05-24T00:44:02.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:43:00+00:00 exited with status success for try_number 1 2024-05-24T00:44:02.402612653Z [2024-05-24T00:44:02.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:42:00+00:00, map_index=-1, run_start_date=2024-05-24 00:44:01.678161+00:00, run_end_date=2024-05-24 00:44:02.108140+00:00, run_duration=0.429979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:44:00.496286+00:00, queued_by_job_id=1, pid=8533 2024-05-24T00:44:02.402923172Z [2024-05-24T00:44:02.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:43:00+00:00, map_index=-1, run_start_date=2024-05-24 00:44:01.612255+00:00, run_end_date=2024-05-24 00:44:02.076510+00:00, run_duration=0.464255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:44:00.496286+00:00, queued_by_job_id=1, pid=8532 2024-05-24T00:44:05.552949564Z [2024-05-24T00:44:05.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:44:05.553468334Z [2024-05-24T00:44:05.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:43:00+00:00, run_id=scheduled__2024-05-24T00:43:00+00:00, run_start_date=2024-05-24 00:44:00.416197+00:00, run_end_date=2024-05-24 00:44:05.553052+00:00, run_duration=5.136855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:43:00+00:00, data_interval_end=2024-05-24 00:44:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:44:05.566313209Z [2024-05-24T00:44:05.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:44:00+00:00, run_after=2024-05-24T00:45:00+00:00 2024-05-24T00:44:05.575254394Z [2024-05-24T00:44:05.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:44:05.575706093Z [2024-05-24T00:44:05.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:43:00+00:00, run_id=scheduled__2024-05-24T00:43:00+00:00, run_start_date=2024-05-24 00:44:00.417783+00:00, run_end_date=2024-05-24 00:44:05.575393+00:00, run_duration=5.15761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:43:00+00:00, data_interval_end=2024-05-24 00:44:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:44:05.585616057Z [2024-05-24T00:44:05.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:44:00+00:00, run_after=2024-05-24T00:45:00+00:00 2024-05-24T00:44:05.632837779Z [2024-05-24T00:44:05.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:43:00+00:00 exited with status success for try_number 1 2024-05-24T00:44:05.634970301Z [2024-05-24T00:44:05.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:43:00+00:00 exited with status success for try_number 1 2024-05-24T00:44:05.645584781Z [2024-05-24T00:44:05.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:43:00+00:00, map_index=-1, run_start_date=2024-05-24 00:44:02.958637+00:00, run_end_date=2024-05-24 00:44:04.875912+00:00, run_duration=1.917275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:44:00.496286+00:00, queued_by_job_id=1, pid=8557 2024-05-24T00:44:05.645927660Z [2024-05-24T00:44:05.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:43:00+00:00, map_index=-1, run_start_date=2024-05-24 00:44:02.662914+00:00, run_end_date=2024-05-24 00:44:05.133215+00:00, run_duration=2.470301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:44:00.496286+00:00, queued_by_job_id=1, pid=8556 2024-05-24T00:45:00.218497366Z [2024-05-24T00:45:00.218+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:45:00.238951165Z [2024-05-24T00:45:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:45:00+00:00, run_after=2024-05-24T00:46:00+00:00 2024-05-24T00:45:00.253092553Z [2024-05-24T00:45:00.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:45:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:45:00.265370323Z [2024-05-24T00:45:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:45:00+00:00, run_after=2024-05-24T00:46:00+00:00 2024-05-24T00:45:00.338823710Z [2024-05-24T00:45:00.338+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:45:00.338848721Z 2024-05-24T00:45:00.338855718Z 2024-05-24T00:45:00.338859010Z 2024-05-24T00:45:00.338862262Z 2024-05-24T00:45:00.338953933Z [2024-05-24T00:45:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:45:00.339080417Z [2024-05-24T00:45:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:45:00.339206140Z [2024-05-24T00:45:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:45:00.339429926Z [2024-05-24T00:45:00.339+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:45:00.340096468Z [2024-05-24T00:45:00.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:45:00.340105421Z 2024-05-24T00:45:00.340111396Z 2024-05-24T00:45:00.340114718Z 2024-05-24T00:45:00.340118003Z 2024-05-24T00:45:00.345614367Z [2024-05-24T00:45:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:45:00.345848989Z [2024-05-24T00:45:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:45:00.346584650Z [2024-05-24T00:45:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:45:00.346782022Z [2024-05-24T00:45:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:45:00.347458411Z [2024-05-24T00:45:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:45:00.348034475Z [2024-05-24T00:45:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:45:00.348285038Z [2024-05-24T00:45:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:45:00.348415170Z [2024-05-24T00:45:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:45:00.933407024Z [2024-05-24T00:45:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:45:00.933433004Z [2024-05-24T00:45:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status queued for try_number 1 2024-05-24T00:45:00.933436640Z [2024-05-24T00:45:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status queued for try_number 1 2024-05-24T00:45:00.933440117Z [2024-05-24T00:45:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status queued for try_number 1 2024-05-24T00:45:00.963476172Z [2024-05-24T00:45:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to b99ebcf5-8b3c-484e-991c-89b0658b13ec 2024-05-24T00:45:00.970611689Z [2024-05-24T00:45:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c01b440-8b02-47b9-ac28-2abc4b78c377 2024-05-24T00:45:00.970642395Z [2024-05-24T00:45:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f73b8c4-a153-486e-82a8-3b0a5e9f1810 2024-05-24T00:45:00.970645898Z [2024-05-24T00:45:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca131175-cf6a-4ab9-aafe-db1d39586f63 2024-05-24T00:45:03.460652316Z [2024-05-24T00:45:03.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:45:03.460784728Z [2024-05-24T00:45:03.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:44:00+00:00, run_id=scheduled__2024-05-24T00:44:00+00:00, run_start_date=2024-05-24 00:45:00.277843+00:00, run_end_date=2024-05-24 00:45:03.460493+00:00, run_duration=3.18265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:44:00+00:00, data_interval_end=2024-05-24 00:45:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:45:03.471566093Z [2024-05-24T00:45:03.471+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:45:00+00:00, run_after=2024-05-24T00:46:00+00:00 2024-05-24T00:45:03.506850411Z [2024-05-24T00:45:03.505+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:45:03.506872713Z 2024-05-24T00:45:03.506876984Z [2024-05-24T00:45:03.506+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:45:03.507692990Z [2024-05-24T00:45:03.507+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:45:03.507704444Z 2024-05-24T00:45:03.514022580Z [2024-05-24T00:45:03.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:45:03.514651028Z [2024-05-24T00:45:03.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:45:03.602472569Z [2024-05-24T00:45:03.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:45:03.602862308Z [2024-05-24T00:45:03.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:45:03.603083083Z [2024-05-24T00:45:03.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status success for try_number 1 2024-05-24T00:45:03.616983000Z [2024-05-24T00:45:03.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=-1, run_start_date=2024-05-24 00:45:02.882441+00:00, run_end_date=2024-05-24 00:45:03.335802+00:00, run_duration=0.453361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:45:00.341726+00:00, queued_by_job_id=1, pid=8605 2024-05-24T00:45:03.617241000Z [2024-05-24T00:45:03.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to d69b1b6d-3e75-4a62-b99c-98d2fc5ae9e5 2024-05-24T00:45:03.617791727Z [2024-05-24T00:45:03.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:44:00+00:00, map_index=-1, run_start_date=2024-05-24 00:45:02.593580+00:00, run_end_date=2024-05-24 00:45:03.191017+00:00, run_duration=0.597437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:45:00.341726+00:00, queued_by_job_id=1, pid=8602 2024-05-24T00:45:04.238301329Z [2024-05-24T00:45:04.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:45:04.238487240Z [2024-05-24T00:45:04.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:44:00+00:00, run_id=scheduled__2024-05-24T00:44:00+00:00, run_start_date=2024-05-24 00:45:00.278873+00:00, run_end_date=2024-05-24 00:45:04.238224+00:00, run_duration=3.959351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:44:00+00:00, data_interval_end=2024-05-24 00:45:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:45:04.247426663Z [2024-05-24T00:45:04.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:45:00+00:00, run_after=2024-05-24T00:46:00+00:00 2024-05-24T00:45:04.999452443Z [2024-05-24T00:45:04.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status success for try_number 1 2024-05-24T00:45:05.009691901Z [2024-05-24T00:45:05.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:44:00+00:00, map_index=-1, run_start_date=2024-05-24 00:45:02.844698+00:00, run_end_date=2024-05-24 00:45:04.189922+00:00, run_duration=1.345224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:45:00.341726+00:00, queued_by_job_id=1, pid=8604 2024-05-24T00:45:06.067801814Z [2024-05-24T00:45:06.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:45:06.068122246Z [2024-05-24T00:45:06.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:44:00+00:00, run_id=scheduled__2024-05-24T00:44:00+00:00, run_start_date=2024-05-24 00:45:00.279759+00:00, run_end_date=2024-05-24 00:45:06.067656+00:00, run_duration=5.787897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:44:00+00:00, data_interval_end=2024-05-24 00:45:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:45:06.077145494Z [2024-05-24T00:45:06.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:45:00+00:00, run_after=2024-05-24T00:46:00+00:00 2024-05-24T00:45:06.120659075Z [2024-05-24T00:45:06.120+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:45:06.120687627Z 2024-05-24T00:45:06.121277650Z [2024-05-24T00:45:06.120+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:45:06.122387525Z [2024-05-24T00:45:06.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:45:06.122393421Z 2024-05-24T00:45:06.126785521Z [2024-05-24T00:45:06.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:45:06.127074924Z [2024-05-24T00:45:06.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:45:06.183524544Z [2024-05-24T00:45:06.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:45:06.183583884Z [2024-05-24T00:45:06.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status success for try_number 1 2024-05-24T00:45:06.183786119Z [2024-05-24T00:45:06.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:45:06.193585467Z [2024-05-24T00:45:06.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:44:00+00:00, map_index=-1, run_start_date=2024-05-24 00:45:03.691304+00:00, run_end_date=2024-05-24 00:45:05.451897+00:00, run_duration=1.760593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:45:00.341726+00:00, queued_by_job_id=1, pid=8627 2024-05-24T00:45:06.193789607Z [2024-05-24T00:45:06.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=-1, run_start_date=2024-05-24 00:45:05.156225+00:00, run_end_date=2024-05-24 00:45:05.514435+00:00, run_duration=0.35821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:45:03.509786+00:00, queued_by_job_id=1, pid=8639 2024-05-24T00:45:06.194089090Z [2024-05-24T00:45:06.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59254ea0-df3f-4e3b-a99a-806ecf3a7dbb 2024-05-24T00:45:08.808490127Z [2024-05-24T00:45:08.808+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:45:08.808519982Z 2024-05-24T00:45:08.809740918Z [2024-05-24T00:45:08.808+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:45:08.812045408Z [2024-05-24T00:45:08.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:45:08.812061947Z 2024-05-24T00:45:08.816155246Z [2024-05-24T00:45:08.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:45:08.816553009Z [2024-05-24T00:45:08.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:45:08.929081310Z [2024-05-24T00:45:08.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status queued for try_number 1 2024-05-24T00:45:08.929114507Z [2024-05-24T00:45:08.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:45:08.935806853Z [2024-05-24T00:45:08.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bcda439-5db0-4fe7-88aa-0dae39cdfd9e 2024-05-24T00:45:08.935937013Z [2024-05-24T00:45:08.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=0, run_start_date=2024-05-24 00:45:07.764398+00:00, run_end_date=2024-05-24 00:45:08.165562+00:00, run_duration=0.401164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:45:06.123612+00:00, queued_by_job_id=1, pid=8647 2024-05-24T00:45:11.661277734Z [2024-05-24T00:45:11.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:45:11.662203403Z [2024-05-24T00:45:11.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:40:00+00:00, run_id=scheduled__2024-05-24T00:40:00+00:00, run_start_date=2024-05-24 00:45:00.276148+00:00, run_end_date=2024-05-24 00:45:11.661695+00:00, run_duration=11.385547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:40:00+00:00, data_interval_end=2024-05-24 00:45:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:45:11.670979203Z [2024-05-24T00:45:11.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:45:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:45:11.706470105Z [2024-05-24T00:45:11.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:40:00+00:00 exited with status success for try_number 1 2024-05-24T00:45:11.713849775Z [2024-05-24T00:45:11.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:40:00+00:00, map_index=-1, run_start_date=2024-05-24 00:45:10.557113+00:00, run_end_date=2024-05-24 00:45:10.956353+00:00, run_duration=0.39924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:45:08.813332+00:00, queued_by_job_id=1, pid=8655 2024-05-24T00:46:00.183793860Z [2024-05-24T00:46:00.183+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:46:00.191950056Z [2024-05-24T00:46:00.191+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:46:00.203892303Z [2024-05-24T00:46:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:46:00+00:00, run_after=2024-05-24T00:47:00+00:00 2024-05-24T00:46:00.217206726Z [2024-05-24T00:46:00.216+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:46:00+00:00, run_after=2024-05-24T00:47:00+00:00 2024-05-24T00:46:00.298072471Z [2024-05-24T00:46:00.296+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:46:00.298119103Z 2024-05-24T00:46:00.298126342Z 2024-05-24T00:46:00.298131298Z 2024-05-24T00:46:00.298136149Z 2024-05-24T00:46:00.298544867Z [2024-05-24T00:46:00.298+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:46:00.299281302Z [2024-05-24T00:46:00.298+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:46:00.299844436Z [2024-05-24T00:46:00.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:46:00.300177386Z [2024-05-24T00:46:00.299+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:46:00.301906786Z [2024-05-24T00:46:00.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:46:00.301934073Z 2024-05-24T00:46:00.301938614Z 2024-05-24T00:46:00.301942765Z 2024-05-24T00:46:00.301947387Z 2024-05-24T00:46:00.309092662Z [2024-05-24T00:46:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:46:00.309401276Z [2024-05-24T00:46:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:46:00.310036394Z [2024-05-24T00:46:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:46:00.310372383Z [2024-05-24T00:46:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:46:00.310739586Z [2024-05-24T00:46:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:46:00.310955820Z [2024-05-24T00:46:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:46:00.311343592Z [2024-05-24T00:46:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:46:00.311553152Z [2024-05-24T00:46:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:46:00.873861348Z [2024-05-24T00:46:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status queued for try_number 1 2024-05-24T00:46:00.873899658Z [2024-05-24T00:46:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status queued for try_number 1 2024-05-24T00:46:00.873966954Z [2024-05-24T00:46:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status queued for try_number 1 2024-05-24T00:46:00.874031954Z [2024-05-24T00:46:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status queued for try_number 1 2024-05-24T00:46:00.883781652Z [2024-05-24T00:46:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6deea80e-e1af-4638-84dd-0025b3881742 2024-05-24T00:46:00.883812644Z [2024-05-24T00:46:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33b7615a-ecbd-431c-8456-cbc8fa5d381c 2024-05-24T00:46:00.883942975Z [2024-05-24T00:46:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac8c071b-4183-48a2-b7ef-99c8be443963 2024-05-24T00:46:00.884018942Z [2024-05-24T00:46:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea786835-06f2-4676-871d-eae4c586834f 2024-05-24T00:46:02.038305887Z [2024-05-24T00:46:02.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:46:02.038805590Z [2024-05-24T00:46:02.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:44:00+00:00, run_id=scheduled__2024-05-24T00:44:00+00:00, run_start_date=2024-05-24 00:46:00.227214+00:00, run_end_date=2024-05-24 00:46:02.038366+00:00, run_duration=1.811152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:44:00+00:00, data_interval_end=2024-05-24 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:46:02.047233076Z [2024-05-24T00:46:02.046+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:46:00+00:00, run_after=2024-05-24T00:48:00+00:00 2024-05-24T00:46:02.054548550Z [2024-05-24T00:46:02.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:46:02.055066509Z [2024-05-24T00:46:02.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:45:00+00:00, run_id=scheduled__2024-05-24T00:45:00+00:00, run_start_date=2024-05-24 00:46:00.228282+00:00, run_end_date=2024-05-24 00:46:02.054729+00:00, run_duration=1.826447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:45:00+00:00, data_interval_end=2024-05-24 00:46:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:46:02.067184523Z [2024-05-24T00:46:02.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:46:00+00:00, run_after=2024-05-24T00:47:00+00:00 2024-05-24T00:46:02.111146466Z [2024-05-24T00:46:02.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:44:00+00:00 exited with status success for try_number 1 2024-05-24T00:46:02.111513620Z [2024-05-24T00:46:02.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status success for try_number 1 2024-05-24T00:46:02.118707739Z [2024-05-24T00:46:02.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:45:00+00:00, map_index=-1, run_start_date=2024-05-24 00:46:01.302564+00:00, run_end_date=2024-05-24 00:46:01.667984+00:00, run_duration=0.36542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:46:00.304755+00:00, queued_by_job_id=1, pid=8679 2024-05-24T00:46:02.119051456Z [2024-05-24T00:46:02.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:44:00+00:00, map_index=-1, run_start_date=2024-05-24 00:46:01.289285+00:00, run_end_date=2024-05-24 00:46:01.711668+00:00, run_duration=0.422383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:46:00.304755+00:00, queued_by_job_id=1, pid=8678 2024-05-24T00:46:04.280919000Z [2024-05-24T00:46:04.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:46:04.281667887Z [2024-05-24T00:46:04.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:45:00+00:00, run_id=scheduled__2024-05-24T00:45:00+00:00, run_start_date=2024-05-24 00:46:00.229268+00:00, run_end_date=2024-05-24 00:46:04.280923+00:00, run_duration=4.051655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:45:00+00:00, data_interval_end=2024-05-24 00:46:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:46:04.297288212Z [2024-05-24T00:46:04.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:46:00+00:00, run_after=2024-05-24T00:47:00+00:00 2024-05-24T00:46:04.304417680Z [2024-05-24T00:46:04.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:46:04.304697308Z [2024-05-24T00:46:04.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:45:00+00:00, run_id=scheduled__2024-05-24T00:45:00+00:00, run_start_date=2024-05-24 00:46:00.230240+00:00, run_end_date=2024-05-24 00:46:04.304347+00:00, run_duration=4.074107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:45:00+00:00, data_interval_end=2024-05-24 00:46:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:46:04.322814446Z [2024-05-24T00:46:04.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:46:00+00:00, run_after=2024-05-24T00:47:00+00:00 2024-05-24T00:46:04.364045553Z [2024-05-24T00:46:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status success for try_number 1 2024-05-24T00:46:04.370625380Z [2024-05-24T00:46:04.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:45:00+00:00, map_index=-1, run_start_date=2024-05-24 00:46:02.343090+00:00, run_end_date=2024-05-24 00:46:03.671661+00:00, run_duration=1.328571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:46:00.304755+00:00, queued_by_job_id=1, pid=8702 2024-05-24T00:46:05.435667555Z [2024-05-24T00:46:05.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status success for try_number 1 2024-05-24T00:46:05.441442117Z [2024-05-24T00:46:05.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:45:00+00:00, map_index=-1, run_start_date=2024-05-24 00:46:02.431828+00:00, run_end_date=2024-05-24 00:46:04.196034+00:00, run_duration=1.764206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:46:00.304755+00:00, queued_by_job_id=1, pid=8703 2024-05-24T00:46:40.757096688Z [2024-05-24T00:46:40.756+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:47:01.087223441Z [2024-05-24T00:47:01.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:47:01.118494338Z [2024-05-24T00:47:01.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:47:00+00:00, run_after=2024-05-24T00:48:00+00:00 2024-05-24T00:47:01.141458338Z [2024-05-24T00:47:01.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:47:00+00:00, run_after=2024-05-24T00:48:00+00:00 2024-05-24T00:47:01.276477784Z [2024-05-24T00:47:01.275+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:47:01.276537047Z 2024-05-24T00:47:01.276544380Z 2024-05-24T00:47:01.276550749Z 2024-05-24T00:47:01.276756577Z [2024-05-24T00:47:01.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:47:01.276814610Z [2024-05-24T00:47:01.276+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:47:01.277209514Z [2024-05-24T00:47:01.276+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:47:01.278547505Z [2024-05-24T00:47:01.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:47:01.278570219Z 2024-05-24T00:47:01.278609880Z 2024-05-24T00:47:01.278618712Z 2024-05-24T00:47:01.285155072Z [2024-05-24T00:47:01.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:47:01.285526958Z [2024-05-24T00:47:01.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:47:01.286131900Z [2024-05-24T00:47:01.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:47:01.286306970Z [2024-05-24T00:47:01.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:47:01.286826405Z [2024-05-24T00:47:01.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:47:01.287020473Z [2024-05-24T00:47:01.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:47:01.531868935Z [2024-05-24T00:47:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status queued for try_number 1 2024-05-24T00:47:01.534941157Z [2024-05-24T00:47:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status queued for try_number 1 2024-05-24T00:47:01.535137568Z [2024-05-24T00:47:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status queued for try_number 1 2024-05-24T00:47:01.545137668Z [2024-05-24T00:47:01.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ff7631d-76f5-4e1b-ab55-4ac5c0987232 2024-05-24T00:47:01.545359648Z [2024-05-24T00:47:01.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d72cf2f-f5c4-44dc-ac20-e5b05acda2cd 2024-05-24T00:47:01.545563881Z [2024-05-24T00:47:01.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11428511-35ef-4009-842d-f89a5fdbd29a 2024-05-24T00:47:03.022163728Z [2024-05-24T00:47:03.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:47:03.022714636Z [2024-05-24T00:47:03.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:46:00+00:00, run_id=scheduled__2024-05-24T00:46:00+00:00, run_start_date=2024-05-24 00:47:01.157058+00:00, run_end_date=2024-05-24 00:47:03.022303+00:00, run_duration=1.865245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:46:00+00:00, data_interval_end=2024-05-24 00:47:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:47:03.039667245Z [2024-05-24T00:47:03.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:47:00+00:00, run_after=2024-05-24T00:48:00+00:00 2024-05-24T00:47:03.117884677Z [2024-05-24T00:47:03.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status success for try_number 1 2024-05-24T00:47:03.123887786Z [2024-05-24T00:47:03.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:46:00+00:00, map_index=-1, run_start_date=2024-05-24 00:47:02.180940+00:00, run_end_date=2024-05-24 00:47:02.591495+00:00, run_duration=0.410555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:47:01.279959+00:00, queued_by_job_id=1, pid=8735 2024-05-24T00:47:05.286495495Z [2024-05-24T00:47:05.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:47:05.286968093Z [2024-05-24T00:47:05.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:46:00+00:00, run_id=scheduled__2024-05-24T00:46:00+00:00, run_start_date=2024-05-24 00:47:01.159016+00:00, run_end_date=2024-05-24 00:47:05.286384+00:00, run_duration=4.127368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:46:00+00:00, data_interval_end=2024-05-24 00:47:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:47:05.303364760Z [2024-05-24T00:47:05.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:47:00+00:00, run_after=2024-05-24T00:48:00+00:00 2024-05-24T00:47:05.356765917Z [2024-05-24T00:47:05.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status success for try_number 1 2024-05-24T00:47:05.362746638Z [2024-05-24T00:47:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:46:00+00:00, map_index=-1, run_start_date=2024-05-24 00:47:03.250737+00:00, run_end_date=2024-05-24 00:47:05.117405+00:00, run_duration=1.866668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:47:01.279959+00:00, queued_by_job_id=1, pid=8754 2024-05-24T00:47:06.030372160Z [2024-05-24T00:47:06.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:47:06.030859598Z [2024-05-24T00:47:06.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:46:00+00:00, run_id=scheduled__2024-05-24T00:46:00+00:00, run_start_date=2024-05-24 00:47:01.160802+00:00, run_end_date=2024-05-24 00:47:06.030227+00:00, run_duration=4.869425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:46:00+00:00, data_interval_end=2024-05-24 00:47:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:47:06.041437289Z [2024-05-24T00:47:06.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:47:00+00:00, run_after=2024-05-24T00:48:00+00:00 2024-05-24T00:47:06.088811384Z [2024-05-24T00:47:06.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status success for try_number 1 2024-05-24T00:47:06.102630964Z [2024-05-24T00:47:06.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:46:00+00:00, map_index=-1, run_start_date=2024-05-24 00:47:03.163584+00:00, run_end_date=2024-05-24 00:47:05.346315+00:00, run_duration=2.182731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:47:01.279959+00:00, queued_by_job_id=1, pid=8753 2024-05-24T00:48:01.076577872Z [2024-05-24T00:48:01.075+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:48:01.106867120Z [2024-05-24T00:48:01.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:48:00+00:00, run_after=2024-05-24T00:49:00+00:00 2024-05-24T00:48:01.125180032Z [2024-05-24T00:48:01.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:48:00+00:00, run_after=2024-05-24T00:49:00+00:00 2024-05-24T00:48:01.134267816Z [2024-05-24T00:48:01.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:48:01.221538485Z [2024-05-24T00:48:01.221+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:48:01.221585056Z 2024-05-24T00:48:01.221595584Z 2024-05-24T00:48:01.221604149Z 2024-05-24T00:48:01.221612614Z 2024-05-24T00:48:01.221757605Z [2024-05-24T00:48:01.221+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:48:01.221785741Z [2024-05-24T00:48:01.221+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:48:01.221824399Z [2024-05-24T00:48:01.221+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:48:01.221947387Z [2024-05-24T00:48:01.221+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:48:01.222715380Z [2024-05-24T00:48:01.222+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:48:01.222726068Z 2024-05-24T00:48:01.222730445Z 2024-05-24T00:48:01.222734129Z 2024-05-24T00:48:01.222737882Z 2024-05-24T00:48:01.227092032Z [2024-05-24T00:48:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:48:01.227126926Z [2024-05-24T00:48:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:48:01.227424012Z [2024-05-24T00:48:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:48:01.227569701Z [2024-05-24T00:48:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:48:01.227763611Z [2024-05-24T00:48:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:48:01.227782795Z [2024-05-24T00:48:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:48:01.227996237Z [2024-05-24T00:48:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:48:01.228014909Z [2024-05-24T00:48:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:48:01.749506191Z [2024-05-24T00:48:01.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status queued for try_number 1 2024-05-24T00:48:01.749558701Z [2024-05-24T00:48:01.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:47:00+00:00 exited with status queued for try_number 1 2024-05-24T00:48:01.751271473Z [2024-05-24T00:48:01.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:47:00+00:00 exited with status queued for try_number 1 2024-05-24T00:48:01.751430637Z [2024-05-24T00:48:01.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:47:00+00:00 exited with status queued for try_number 1 2024-05-24T00:48:01.770023411Z [2024-05-24T00:48:01.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4d9998b-5924-4525-88cf-adedd28955a7 2024-05-24T00:48:01.770121989Z [2024-05-24T00:48:01.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0389fde-2dcf-441c-9c35-b1191b9fee2e 2024-05-24T00:48:01.770518206Z [2024-05-24T00:48:01.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12f99875-96c2-425b-94e5-fc1358eef56d 2024-05-24T00:48:01.770705863Z [2024-05-24T00:48:01.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8acd83ac-1cec-4762-bf7c-22d9480f4845 2024-05-24T00:48:02.937032381Z [2024-05-24T00:48:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:48:02.937401128Z [2024-05-24T00:48:02.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:46:00+00:00, run_id=scheduled__2024-05-24T00:46:00+00:00, run_start_date=2024-05-24 00:48:01.147494+00:00, run_end_date=2024-05-24 00:48:02.936916+00:00, run_duration=1.789422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:46:00+00:00, data_interval_end=2024-05-24 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:48:02.944561964Z [2024-05-24T00:48:02.944+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:48:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:48:02.951951857Z [2024-05-24T00:48:02.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:48:02.952258576Z [2024-05-24T00:48:02.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:47:00+00:00, run_id=scheduled__2024-05-24T00:47:00+00:00, run_start_date=2024-05-24 00:48:01.149063+00:00, run_end_date=2024-05-24 00:48:02.951871+00:00, run_duration=1.802808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:47:00+00:00, data_interval_end=2024-05-24 00:48:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:48:02.963502194Z [2024-05-24T00:48:02.963+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:48:00+00:00, run_after=2024-05-24T00:49:00+00:00 2024-05-24T00:48:03.018640629Z [2024-05-24T00:48:03.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:46:00+00:00 exited with status success for try_number 1 2024-05-24T00:48:03.024217449Z [2024-05-24T00:48:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:46:00+00:00, map_index=-1, run_start_date=2024-05-24 00:48:01.957578+00:00, run_end_date=2024-05-24 00:48:02.400706+00:00, run_duration=0.443128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:48:01.223637+00:00, queued_by_job_id=1, pid=8782 2024-05-24T00:48:04.148742022Z [2024-05-24T00:48:04.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:47:00+00:00 exited with status success for try_number 1 2024-05-24T00:48:04.155549508Z [2024-05-24T00:48:04.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:47:00+00:00, map_index=-1, run_start_date=2024-05-24 00:48:02.385787+00:00, run_end_date=2024-05-24 00:48:02.900484+00:00, run_duration=0.514697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:48:01.223637+00:00, queued_by_job_id=1, pid=8794 2024-05-24T00:48:05.204215716Z [2024-05-24T00:48:05.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:48:05.204397178Z [2024-05-24T00:48:05.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:47:00+00:00, run_id=scheduled__2024-05-24T00:47:00+00:00, run_start_date=2024-05-24 00:48:01.150311+00:00, run_end_date=2024-05-24 00:48:05.204044+00:00, run_duration=4.053733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:47:00+00:00, data_interval_end=2024-05-24 00:48:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:48:05.215965465Z [2024-05-24T00:48:05.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:48:00+00:00, run_after=2024-05-24T00:49:00+00:00 2024-05-24T00:48:05.225582588Z [2024-05-24T00:48:05.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:48:05.225859341Z [2024-05-24T00:48:05.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:47:00+00:00, run_id=scheduled__2024-05-24T00:47:00+00:00, run_start_date=2024-05-24 00:48:01.151653+00:00, run_end_date=2024-05-24 00:48:05.225448+00:00, run_duration=4.073795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:47:00+00:00, data_interval_end=2024-05-24 00:48:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:48:05.235059238Z [2024-05-24T00:48:05.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:48:00+00:00, run_after=2024-05-24T00:49:00+00:00 2024-05-24T00:48:05.294753775Z [2024-05-24T00:48:05.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:47:00+00:00 exited with status success for try_number 1 2024-05-24T00:48:05.294963065Z [2024-05-24T00:48:05.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:47:00+00:00 exited with status success for try_number 1 2024-05-24T00:48:05.304556534Z [2024-05-24T00:48:05.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:47:00+00:00, map_index=-1, run_start_date=2024-05-24 00:48:03.398923+00:00, run_end_date=2024-05-24 00:48:04.713441+00:00, run_duration=1.314518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:48:01.223637+00:00, queued_by_job_id=1, pid=8812 2024-05-24T00:48:05.307158135Z [2024-05-24T00:48:05.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:47:00+00:00, map_index=-1, run_start_date=2024-05-24 00:48:03.256953+00:00, run_end_date=2024-05-24 00:48:04.864567+00:00, run_duration=1.607614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:48:01.223637+00:00, queued_by_job_id=1, pid=8811 2024-05-24T00:49:01.041248549Z [2024-05-24T00:49:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:49:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:49:01.057720079Z [2024-05-24T00:49:01.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:49:01.071343749Z [2024-05-24T00:49:01.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:49:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:49:01.148604186Z [2024-05-24T00:49:01.148+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:49:01.148637894Z 2024-05-24T00:49:01.148644423Z 2024-05-24T00:49:01.148649809Z 2024-05-24T00:49:01.149054371Z [2024-05-24T00:49:01.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:49:01.149443696Z [2024-05-24T00:49:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:49:01.149852382Z [2024-05-24T00:49:01.149+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:49:01.151271723Z [2024-05-24T00:49:01.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:49:01.151296628Z 2024-05-24T00:49:01.151304474Z 2024-05-24T00:49:01.151311565Z 2024-05-24T00:49:01.157258754Z [2024-05-24T00:49:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:49:01.157707050Z [2024-05-24T00:49:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:49:01.158329999Z [2024-05-24T00:49:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:49:01.158766065Z [2024-05-24T00:49:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:49:01.159345401Z [2024-05-24T00:49:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:49:01.159622764Z [2024-05-24T00:49:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:49:01.455586466Z [2024-05-24T00:49:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status queued for try_number 1 2024-05-24T00:49:01.455739826Z [2024-05-24T00:49:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status queued for try_number 1 2024-05-24T00:49:01.455871684Z [2024-05-24T00:49:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status queued for try_number 1 2024-05-24T00:49:01.467113528Z [2024-05-24T00:49:01.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7b164f0-60f3-4db5-af88-13c86eb34928 2024-05-24T00:49:01.467284371Z [2024-05-24T00:49:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0949ad5-09aa-4f74-8d96-2cab46d526ee 2024-05-24T00:49:01.467437274Z [2024-05-24T00:49:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to b99844c2-ba68-48c8-aae6-83a0533e9f2c 2024-05-24T00:49:02.708652530Z [2024-05-24T00:49:02.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:49:02.708687801Z [2024-05-24T00:49:02.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:48:00+00:00, run_id=scheduled__2024-05-24T00:48:00+00:00, run_start_date=2024-05-24 00:49:01.081508+00:00, run_end_date=2024-05-24 00:49:02.704890+00:00, run_duration=1.623382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:48:00+00:00, data_interval_end=2024-05-24 00:49:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:49:02.720311488Z [2024-05-24T00:49:02.719+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:49:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:49:02.851446806Z [2024-05-24T00:49:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status success for try_number 1 2024-05-24T00:49:02.887912692Z [2024-05-24T00:49:02.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:48:00+00:00, map_index=-1, run_start_date=2024-05-24 00:49:02.035668+00:00, run_end_date=2024-05-24 00:49:02.418570+00:00, run_duration=0.382902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:49:01.152901+00:00, queued_by_job_id=1, pid=8844 2024-05-24T00:49:05.075810309Z [2024-05-24T00:49:05.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:49:05.076222539Z [2024-05-24T00:49:05.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:48:00+00:00, run_id=scheduled__2024-05-24T00:48:00+00:00, run_start_date=2024-05-24 00:49:01.082779+00:00, run_end_date=2024-05-24 00:49:05.075858+00:00, run_duration=3.993079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:48:00+00:00, data_interval_end=2024-05-24 00:49:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:49:05.086475587Z [2024-05-24T00:49:05.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:49:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:49:05.094736312Z [2024-05-24T00:49:05.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:49:05.095957108Z [2024-05-24T00:49:05.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:48:00+00:00, run_id=scheduled__2024-05-24T00:48:00+00:00, run_start_date=2024-05-24 00:49:01.084124+00:00, run_end_date=2024-05-24 00:49:05.095585+00:00, run_duration=4.011461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:48:00+00:00, data_interval_end=2024-05-24 00:49:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:49:05.112018978Z [2024-05-24T00:49:05.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:49:00+00:00, run_after=2024-05-24T00:50:00+00:00 2024-05-24T00:49:05.173157248Z [2024-05-24T00:49:05.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status success for try_number 1 2024-05-24T00:49:05.184815606Z [2024-05-24T00:49:05.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:48:00+00:00, map_index=-1, run_start_date=2024-05-24 00:49:03.228932+00:00, run_end_date=2024-05-24 00:49:04.664716+00:00, run_duration=1.435784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:49:01.152901+00:00, queued_by_job_id=1, pid=8863 2024-05-24T00:49:06.296933483Z [2024-05-24T00:49:06.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status success for try_number 1 2024-05-24T00:49:06.316277765Z [2024-05-24T00:49:06.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:48:00+00:00, map_index=-1, run_start_date=2024-05-24 00:49:03.082223+00:00, run_end_date=2024-05-24 00:49:05.019848+00:00, run_duration=1.937625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:49:01.152901+00:00, queued_by_job_id=1, pid=8862 2024-05-24T00:50:00.970701284Z [2024-05-24T00:50:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:55:00+00:00 2024-05-24T00:50:00.988471757Z [2024-05-24T00:50:00.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:51:00+00:00 2024-05-24T00:50:00.995330021Z [2024-05-24T00:50:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:51:00+00:00 2024-05-24T00:50:01.000976496Z [2024-05-24T00:50:01.000+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:50:01.011361555Z [2024-05-24T00:50:01.011+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:50:01.137616301Z [2024-05-24T00:50:01.137+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T00:50:01.137664831Z 2024-05-24T00:50:01.137675459Z 2024-05-24T00:50:01.137685194Z 2024-05-24T00:50:01.137694207Z 2024-05-24T00:50:01.137702996Z 2024-05-24T00:50:01.137712131Z [2024-05-24T00:50:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:50:01.137783591Z [2024-05-24T00:50:01.137+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:50:01.137988283Z [2024-05-24T00:50:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:50:01.138018657Z [2024-05-24T00:50:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:50:01.138036665Z [2024-05-24T00:50:01.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:50:01.138821498Z [2024-05-24T00:50:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:50:01.138847912Z 2024-05-24T00:50:01.138858957Z 2024-05-24T00:50:01.138869468Z 2024-05-24T00:50:01.138878348Z 2024-05-24T00:50:01.138887055Z 2024-05-24T00:50:01.144297148Z [2024-05-24T00:50:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:50:01.144456013Z [2024-05-24T00:50:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:50:01.144655435Z [2024-05-24T00:50:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:50:01.144764523Z [2024-05-24T00:50:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:50:01.144965777Z [2024-05-24T00:50:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:50:01.145137871Z [2024-05-24T00:50:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:50:01.145345596Z [2024-05-24T00:50:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:50:01.145444127Z [2024-05-24T00:50:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:50:01.145676935Z [2024-05-24T00:50:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:50:01.145776288Z [2024-05-24T00:50:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:50:01.515822801Z [2024-05-24T00:50:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:01.515922835Z [2024-05-24T00:50:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:01.515947466Z [2024-05-24T00:50:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:49:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:01.515985287Z [2024-05-24T00:50:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:49:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:01.516082710Z [2024-05-24T00:50:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:49:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:01.525315410Z [2024-05-24T00:50:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6648e0fa-eabb-49d8-908f-2b38e61efd6d 2024-05-24T00:50:01.525434694Z [2024-05-24T00:50:01.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e4a62ad-02ab-482e-81e5-653a8bca3d19 2024-05-24T00:50:01.525543210Z [2024-05-24T00:50:01.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17a422f5-a77d-4cbc-ba62-b10bf5e6eb33 2024-05-24T00:50:01.525671262Z [2024-05-24T00:50:01.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5ee414a-7bc8-4f77-808a-8f070cdf92c3 2024-05-24T00:50:01.525757405Z [2024-05-24T00:50:01.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f3633ae-b07e-444c-bb32-9030bc71114a 2024-05-24T00:50:02.936563021Z [2024-05-24T00:50:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:50:02.937081029Z [2024-05-24T00:50:02.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:48:00+00:00, run_id=scheduled__2024-05-24T00:48:00+00:00, run_start_date=2024-05-24 00:50:01.025160+00:00, run_end_date=2024-05-24 00:50:02.936467+00:00, run_duration=1.911307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:48:00+00:00, data_interval_end=2024-05-24 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:50:02.945849719Z [2024-05-24T00:50:02.945+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:52:00+00:00 2024-05-24T00:50:04.077883878Z [2024-05-24T00:50:04.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:50:04.078053692Z [2024-05-24T00:50:04.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:49:00+00:00, run_id=scheduled__2024-05-24T00:49:00+00:00, run_start_date=2024-05-24 00:50:01.026222+00:00, run_end_date=2024-05-24 00:50:04.077791+00:00, run_duration=3.051569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:49:00+00:00, data_interval_end=2024-05-24 00:50:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:50:04.091955215Z [2024-05-24T00:50:04.091+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:51:00+00:00 2024-05-24T00:50:04.178158079Z [2024-05-24T00:50:04.176+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:50:04.178221847Z 2024-05-24T00:50:04.178234930Z [2024-05-24T00:50:04.178+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:50:04.178829467Z [2024-05-24T00:50:04.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:50:04.178845206Z 2024-05-24T00:50:04.181228713Z [2024-05-24T00:50:04.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:50:04.181269988Z [2024-05-24T00:50:04.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:50:04.320817188Z [2024-05-24T00:50:04.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:04.320888673Z [2024-05-24T00:50:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:04.320893360Z [2024-05-24T00:50:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:48:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:04.320960625Z [2024-05-24T00:50:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:49:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:04.337761084Z [2024-05-24T00:50:04.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:48:00+00:00, map_index=-1, run_start_date=2024-05-24 00:50:02.035981+00:00, run_end_date=2024-05-24 00:50:02.898601+00:00, run_duration=0.86262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:01.140082+00:00, queued_by_job_id=1, pid=8896 2024-05-24T00:50:04.337803029Z [2024-05-24T00:50:04.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:49:00+00:00, map_index=-1, run_start_date=2024-05-24 00:50:02.594685+00:00, run_end_date=2024-05-24 00:50:03.248880+00:00, run_duration=0.654195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:01.140082+00:00, queued_by_job_id=1, pid=8899 2024-05-24T00:50:04.337959433Z [2024-05-24T00:50:04.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:45:00+00:00, map_index=-1, run_start_date=2024-05-24 00:50:03.550912+00:00, run_end_date=2024-05-24 00:50:04.045761+00:00, run_duration=0.494849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:01.140082+00:00, queued_by_job_id=1, pid=8916 2024-05-24T00:50:04.338100578Z [2024-05-24T00:50:04.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12e3f971-1ec4-4ff8-b668-598a8031d20b 2024-05-24T00:50:06.101619030Z [2024-05-24T00:50:06.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:50:06.106379803Z [2024-05-24T00:50:06.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:49:00+00:00, run_id=scheduled__2024-05-24T00:49:00+00:00, run_start_date=2024-05-24 00:50:01.027312+00:00, run_end_date=2024-05-24 00:50:06.105607+00:00, run_duration=5.078295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:49:00+00:00, data_interval_end=2024-05-24 00:50:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:50:06.122823463Z [2024-05-24T00:50:06.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:51:00+00:00 2024-05-24T00:50:06.226371323Z [2024-05-24T00:50:06.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:49:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:06.234015896Z [2024-05-24T00:50:06.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:49:00+00:00, map_index=-1, run_start_date=2024-05-24 00:50:03.955894+00:00, run_end_date=2024-05-24 00:50:05.395944+00:00, run_duration=1.44005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:01.140082+00:00, queued_by_job_id=1, pid=8930 2024-05-24T00:50:07.294929310Z [2024-05-24T00:50:07.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:50:07.295396332Z [2024-05-24T00:50:07.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:49:00+00:00, run_id=scheduled__2024-05-24T00:49:00+00:00, run_start_date=2024-05-24 00:50:01.028511+00:00, run_end_date=2024-05-24 00:50:07.294715+00:00, run_duration=6.266204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:49:00+00:00, data_interval_end=2024-05-24 00:50:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:50:07.306343922Z [2024-05-24T00:50:07.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:51:00+00:00 2024-05-24T00:50:07.340278405Z [2024-05-24T00:50:07.339+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:50:07.340322094Z 2024-05-24T00:50:07.340827622Z [2024-05-24T00:50:07.340+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:50:07.343422650Z [2024-05-24T00:50:07.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:50:07.343465079Z 2024-05-24T00:50:07.348393148Z [2024-05-24T00:50:07.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:50:07.348489123Z [2024-05-24T00:50:07.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:50:07.452875014Z [2024-05-24T00:50:07.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:07.452930390Z [2024-05-24T00:50:07.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:49:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:07.453133309Z [2024-05-24T00:50:07.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:07.463129346Z [2024-05-24T00:50:07.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:49:00+00:00, map_index=-1, run_start_date=2024-05-24 00:50:04.321569+00:00, run_end_date=2024-05-24 00:50:06.138644+00:00, run_duration=1.817075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:01.140082+00:00, queued_by_job_id=1, pid=8934 2024-05-24T00:50:07.463357997Z [2024-05-24T00:50:07.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:45:00+00:00, map_index=-1, run_start_date=2024-05-24 00:50:06.114170+00:00, run_end_date=2024-05-24 00:50:06.525216+00:00, run_duration=0.411046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:04.179168+00:00, queued_by_job_id=1, pid=8951 2024-05-24T00:50:07.463601152Z [2024-05-24T00:50:07.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbbc5f94-118c-4627-b2ef-8dd619e30e67 2024-05-24T00:50:10.093647049Z [2024-05-24T00:50:10.093+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:50:10.093692433Z 2024-05-24T00:50:10.093968495Z [2024-05-24T00:50:10.093+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:50:10.094652117Z [2024-05-24T00:50:10.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:50:10.094674963Z 2024-05-24T00:50:10.099568626Z [2024-05-24T00:50:10.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:50:10.099642412Z [2024-05-24T00:50:10.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:50:10.171412358Z [2024-05-24T00:50:10.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status queued for try_number 1 2024-05-24T00:50:10.171532968Z [2024-05-24T00:50:10.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:10.194818351Z [2024-05-24T00:50:10.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b990151-e0ac-4a64-bb92-a3cb8f2eda74 2024-05-24T00:50:10.194900681Z [2024-05-24T00:50:10.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:45:00+00:00, map_index=0, run_start_date=2024-05-24 00:50:09.116515+00:00, run_end_date=2024-05-24 00:50:09.465224+00:00, run_duration=0.348709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:07.344002+00:00, queued_by_job_id=1, pid=8959 2024-05-24T00:50:13.483230945Z [2024-05-24T00:50:13.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:50:13.483508176Z [2024-05-24T00:50:13.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:45:00+00:00, run_id=scheduled__2024-05-24T00:45:00+00:00, run_start_date=2024-05-24 00:50:01.023643+00:00, run_end_date=2024-05-24 00:50:13.483069+00:00, run_duration=12.459426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:45:00+00:00, data_interval_end=2024-05-24 00:50:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:50:13.489690009Z [2024-05-24T00:50:13.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:50:00+00:00, run_after=2024-05-24T00:55:00+00:00 2024-05-24T00:50:13.526383095Z [2024-05-24T00:50:13.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:45:00+00:00 exited with status success for try_number 1 2024-05-24T00:50:13.536409138Z [2024-05-24T00:50:13.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:45:00+00:00, map_index=-1, run_start_date=2024-05-24 00:50:12.009510+00:00, run_end_date=2024-05-24 00:50:12.441057+00:00, run_duration=0.431547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:50:10.095042+00:00, queued_by_job_id=1, pid=8967 2024-05-24T00:51:00.966177639Z [2024-05-24T00:51:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:51:00+00:00, run_after=2024-05-24T00:52:00+00:00 2024-05-24T00:51:00.973480320Z [2024-05-24T00:51:00.973+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:51:00.984639159Z [2024-05-24T00:51:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:51:00+00:00, run_after=2024-05-24T00:52:00+00:00 2024-05-24T00:51:01.076789262Z [2024-05-24T00:51:01.076+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:51:01.076852380Z 2024-05-24T00:51:01.076863835Z 2024-05-24T00:51:01.076873144Z 2024-05-24T00:51:01.076917668Z [2024-05-24T00:51:01.076+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:51:01.077344531Z [2024-05-24T00:51:01.076+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:51:01.077700481Z [2024-05-24T00:51:01.077+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:51:01.079041122Z [2024-05-24T00:51:01.078+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:51:01.079070007Z 2024-05-24T00:51:01.079078969Z 2024-05-24T00:51:01.079087789Z 2024-05-24T00:51:01.085738260Z [2024-05-24T00:51:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:51:01.085792686Z [2024-05-24T00:51:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:51:01.086951689Z [2024-05-24T00:51:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:51:01.087200099Z [2024-05-24T00:51:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:51:01.087789544Z [2024-05-24T00:51:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:51:01.088405519Z [2024-05-24T00:51:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:51:01.341840074Z [2024-05-24T00:51:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:51:01.345646599Z [2024-05-24T00:51:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:51:01.345868570Z [2024-05-24T00:51:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:51:01.363899357Z [2024-05-24T00:51:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ca39c89-64a9-438f-8885-ef70225eaefb 2024-05-24T00:51:01.364255653Z [2024-05-24T00:51:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 427e35b9-f4fd-4ce7-b429-8778d912edfd 2024-05-24T00:51:01.364666342Z [2024-05-24T00:51:01.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 064e0f5c-88e9-441e-a04c-fbb5d7098f97 2024-05-24T00:51:02.562209218Z [2024-05-24T00:51:02.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:51:02.562599050Z [2024-05-24T00:51:02.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:50:00+00:00, run_id=scheduled__2024-05-24T00:50:00+00:00, run_start_date=2024-05-24 00:51:01.000097+00:00, run_end_date=2024-05-24 00:51:02.562212+00:00, run_duration=1.562115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:50:00+00:00, data_interval_end=2024-05-24 00:51:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:51:02.578901610Z [2024-05-24T00:51:02.578+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:51:00+00:00, run_after=2024-05-24T00:52:00+00:00 2024-05-24T00:51:03.739866945Z [2024-05-24T00:51:03.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:51:03.745368146Z [2024-05-24T00:51:03.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=-1, run_start_date=2024-05-24 00:51:01.959612+00:00, run_end_date=2024-05-24 00:51:02.442003+00:00, run_duration=0.482391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:51:01.080572+00:00, queued_by_job_id=1, pid=8988 2024-05-24T00:51:04.805117498Z [2024-05-24T00:51:04.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:51:04.805475990Z [2024-05-24T00:51:04.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:50:00+00:00, run_id=scheduled__2024-05-24T00:50:00+00:00, run_start_date=2024-05-24 00:51:01.004228+00:00, run_end_date=2024-05-24 00:51:04.805062+00:00, run_duration=3.800834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:50:00+00:00, data_interval_end=2024-05-24 00:51:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:51:04.814552549Z [2024-05-24T00:51:04.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:51:00+00:00, run_after=2024-05-24T00:52:00+00:00 2024-05-24T00:51:04.876317190Z [2024-05-24T00:51:04.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:51:04.885890767Z [2024-05-24T00:51:04.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=-1, run_start_date=2024-05-24 00:51:03.057944+00:00, run_end_date=2024-05-24 00:51:04.647912+00:00, run_duration=1.589968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:51:01.080572+00:00, queued_by_job_id=1, pid=9006 2024-05-24T00:51:05.949689818Z [2024-05-24T00:51:05.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:51:05.950429772Z [2024-05-24T00:51:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:50:00+00:00, run_id=scheduled__2024-05-24T00:50:00+00:00, run_start_date=2024-05-24 00:51:01.007354+00:00, run_end_date=2024-05-24 00:51:05.949496+00:00, run_duration=4.942142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:50:00+00:00, data_interval_end=2024-05-24 00:51:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:51:05.977471573Z [2024-05-24T00:51:05.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:51:00+00:00, run_after=2024-05-24T00:52:00+00:00 2024-05-24T00:51:06.042572033Z [2024-05-24T00:51:06.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:51:06.054401825Z [2024-05-24T00:51:06.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=-1, run_start_date=2024-05-24 00:51:03.064696+00:00, run_end_date=2024-05-24 00:51:05.289422+00:00, run_duration=2.224726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:51:01.080572+00:00, queued_by_job_id=1, pid=9007 2024-05-24T00:51:40.841103801Z [2024-05-24T00:51:40.840+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:52:00.414711984Z [2024-05-24T00:52:00.414+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:52:00.428350337Z [2024-05-24T00:52:00.428+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:52:00.447113565Z [2024-05-24T00:52:00.446+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:52:00+00:00, run_after=2024-05-24T00:53:00+00:00 2024-05-24T00:52:00.461140361Z [2024-05-24T00:52:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:52:00+00:00, run_after=2024-05-24T00:53:00+00:00 2024-05-24T00:52:00.533659307Z [2024-05-24T00:52:00.533+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:52:00.533692033Z 2024-05-24T00:52:00.533698978Z 2024-05-24T00:52:00.533704200Z 2024-05-24T00:52:00.533709601Z 2024-05-24T00:52:00.533948124Z [2024-05-24T00:52:00.533+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:52:00.535961593Z [2024-05-24T00:52:00.534+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:52:00.535976487Z [2024-05-24T00:52:00.534+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:52:00.535984967Z [2024-05-24T00:52:00.534+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:52:00.535988835Z [2024-05-24T00:52:00.534+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:52:00.535992935Z 2024-05-24T00:52:00.535995963Z 2024-05-24T00:52:00.535998936Z 2024-05-24T00:52:00.536001933Z 2024-05-24T00:52:00.538666147Z [2024-05-24T00:52:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:52:00.538981701Z [2024-05-24T00:52:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:52:00.539383269Z [2024-05-24T00:52:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:52:00.539577885Z [2024-05-24T00:52:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:52:00.539850298Z [2024-05-24T00:52:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:52:00.539955813Z [2024-05-24T00:52:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:52:00.540163073Z [2024-05-24T00:52:00.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:52:00.540283592Z [2024-05-24T00:52:00.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:52:01.029103610Z [2024-05-24T00:52:01.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:52:01.029147499Z [2024-05-24T00:52:01.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:51:00+00:00 exited with status queued for try_number 1 2024-05-24T00:52:01.029151203Z [2024-05-24T00:52:01.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:51:00+00:00 exited with status queued for try_number 1 2024-05-24T00:52:01.029154817Z [2024-05-24T00:52:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:51:00+00:00 exited with status queued for try_number 1 2024-05-24T00:52:01.041834442Z [2024-05-24T00:52:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae822613-452e-426f-814b-526589947a24 2024-05-24T00:52:01.041989380Z [2024-05-24T00:52:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb036eb6-42d8-4d68-9a73-5e0b78095253 2024-05-24T00:52:01.042208153Z [2024-05-24T00:52:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to eccc88da-d8de-4150-b07e-fe0c295818a7 2024-05-24T00:52:01.043175255Z [2024-05-24T00:52:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11a2ffd2-bd5a-410b-9547-c3129bd567fa 2024-05-24T00:52:02.244504659Z [2024-05-24T00:52:02.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:52:02.244816551Z [2024-05-24T00:52:02.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:50:00+00:00, run_id=scheduled__2024-05-24T00:50:00+00:00, run_start_date=2024-05-24 00:52:00.471505+00:00, run_end_date=2024-05-24 00:52:02.244449+00:00, run_duration=1.772944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:50:00+00:00, data_interval_end=2024-05-24 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:52:02.260483334Z [2024-05-24T00:52:02.259+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:52:00+00:00, run_after=2024-05-24T00:54:00+00:00 2024-05-24T00:52:02.292894025Z [2024-05-24T00:52:02.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:52:02.293812924Z [2024-05-24T00:52:02.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:51:00+00:00, run_id=scheduled__2024-05-24T00:51:00+00:00, run_start_date=2024-05-24 00:52:00.473004+00:00, run_end_date=2024-05-24 00:52:02.293287+00:00, run_duration=1.820283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:51:00+00:00, data_interval_end=2024-05-24 00:52:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:52:02.307472764Z [2024-05-24T00:52:02.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:52:00+00:00, run_after=2024-05-24T00:53:00+00:00 2024-05-24T00:52:02.368027965Z [2024-05-24T00:52:02.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:52:02.368317987Z [2024-05-24T00:52:02.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:51:00+00:00 exited with status success for try_number 1 2024-05-24T00:52:02.377787406Z [2024-05-24T00:52:02.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=-1, run_start_date=2024-05-24 00:52:01.443297+00:00, run_end_date=2024-05-24 00:52:01.939129+00:00, run_duration=0.495832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:52:00.535599+00:00, queued_by_job_id=1, pid=9040 2024-05-24T00:52:02.378224787Z [2024-05-24T00:52:02.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:51:00+00:00, map_index=-1, run_start_date=2024-05-24 00:52:01.664880+00:00, run_end_date=2024-05-24 00:52:02.086939+00:00, run_duration=0.422059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:52:00.535599+00:00, queued_by_job_id=1, pid=9041 2024-05-24T00:52:04.583397427Z [2024-05-24T00:52:04.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:52:04.583433639Z [2024-05-24T00:52:04.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:51:00+00:00, run_id=scheduled__2024-05-24T00:51:00+00:00, run_start_date=2024-05-24 00:52:00.474994+00:00, run_end_date=2024-05-24 00:52:04.583084+00:00, run_duration=4.10809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:51:00+00:00, data_interval_end=2024-05-24 00:52:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:52:04.606156757Z [2024-05-24T00:52:04.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:52:00+00:00, run_after=2024-05-24T00:53:00+00:00 2024-05-24T00:52:04.620463870Z [2024-05-24T00:52:04.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:52:04.620914989Z [2024-05-24T00:52:04.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:51:00+00:00, run_id=scheduled__2024-05-24T00:51:00+00:00, run_start_date=2024-05-24 00:52:00.473993+00:00, run_end_date=2024-05-24 00:52:04.620459+00:00, run_duration=4.146466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:51:00+00:00, data_interval_end=2024-05-24 00:52:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:52:04.636092580Z [2024-05-24T00:52:04.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:52:00+00:00, run_after=2024-05-24T00:53:00+00:00 2024-05-24T00:52:04.685691445Z [2024-05-24T00:52:04.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:51:00+00:00 exited with status success for try_number 1 2024-05-24T00:52:04.686027745Z [2024-05-24T00:52:04.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:51:00+00:00 exited with status success for try_number 1 2024-05-24T00:52:04.696436016Z [2024-05-24T00:52:04.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:51:00+00:00, map_index=-1, run_start_date=2024-05-24 00:52:02.636561+00:00, run_end_date=2024-05-24 00:52:04.084726+00:00, run_duration=1.448165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:52:00.535599+00:00, queued_by_job_id=1, pid=9064 2024-05-24T00:52:04.696757894Z [2024-05-24T00:52:04.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:51:00+00:00, map_index=-1, run_start_date=2024-05-24 00:52:02.679202+00:00, run_end_date=2024-05-24 00:52:04.459164+00:00, run_duration=1.779962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:52:00.535599+00:00, queued_by_job_id=1, pid=9065 2024-05-24T00:53:00.840993096Z [2024-05-24T00:53:00.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:53:00+00:00, run_after=2024-05-24T00:54:00+00:00 2024-05-24T00:53:00.858778314Z [2024-05-24T00:53:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:53:00+00:00, run_after=2024-05-24T00:54:00+00:00 2024-05-24T00:53:00.868472906Z [2024-05-24T00:53:00.868+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:53:00.946722955Z [2024-05-24T00:53:00.946+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:53:00.946762087Z 2024-05-24T00:53:00.946766123Z 2024-05-24T00:53:00.946769451Z 2024-05-24T00:53:00.946772734Z [2024-05-24T00:53:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:53:00.946776317Z [2024-05-24T00:53:00.946+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:53:00.946829028Z [2024-05-24T00:53:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:53:00.947747585Z [2024-05-24T00:53:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:53:00.947756655Z 2024-05-24T00:53:00.947760208Z 2024-05-24T00:53:00.947763380Z 2024-05-24T00:53:00.951674291Z [2024-05-24T00:53:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:53:00.951933350Z [2024-05-24T00:53:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:53:00.952278091Z [2024-05-24T00:53:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:53:00.952436906Z [2024-05-24T00:53:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:53:00.952639857Z [2024-05-24T00:53:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:53:00.952724474Z [2024-05-24T00:53:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:53:01.224485074Z [2024-05-24T00:53:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status queued for try_number 1 2024-05-24T00:53:01.224541302Z [2024-05-24T00:53:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status queued for try_number 1 2024-05-24T00:53:01.224578337Z [2024-05-24T00:53:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status queued for try_number 1 2024-05-24T00:53:01.233702623Z [2024-05-24T00:53:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9dd43ce-f3ee-44bd-a66b-0b2e3d51d8a0 2024-05-24T00:53:01.233738763Z [2024-05-24T00:53:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08701c13-02d6-4aa4-8201-85ec3ac41c1a 2024-05-24T00:53:01.233833287Z [2024-05-24T00:53:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to eca06f38-28ee-4835-b93d-6a5fc7dba6c5 2024-05-24T00:53:02.412444459Z [2024-05-24T00:53:02.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:53:02.412959759Z [2024-05-24T00:53:02.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:52:00+00:00, run_id=scheduled__2024-05-24T00:52:00+00:00, run_start_date=2024-05-24 00:53:00.880550+00:00, run_end_date=2024-05-24 00:53:02.412333+00:00, run_duration=1.531783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:52:00+00:00, data_interval_end=2024-05-24 00:53:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:53:02.423143361Z [2024-05-24T00:53:02.422+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:53:00+00:00, run_after=2024-05-24T00:54:00+00:00 2024-05-24T00:53:02.458815665Z [2024-05-24T00:53:02.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status success for try_number 1 2024-05-24T00:53:02.465875793Z [2024-05-24T00:53:02.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:52:00+00:00, map_index=-1, run_start_date=2024-05-24 00:53:01.866909+00:00, run_end_date=2024-05-24 00:53:02.280970+00:00, run_duration=0.414061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:53:00.948748+00:00, queued_by_job_id=1, pid=9097 2024-05-24T00:53:05.600574770Z [2024-05-24T00:53:05.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:53:05.600902090Z [2024-05-24T00:53:05.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:52:00+00:00, run_id=scheduled__2024-05-24T00:52:00+00:00, run_start_date=2024-05-24 00:53:00.882915+00:00, run_end_date=2024-05-24 00:53:05.600396+00:00, run_duration=4.717481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:52:00+00:00, data_interval_end=2024-05-24 00:53:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:53:05.612557906Z [2024-05-24T00:53:05.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:53:00+00:00, run_after=2024-05-24T00:54:00+00:00 2024-05-24T00:53:05.627951676Z [2024-05-24T00:53:05.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:53:05.628458496Z [2024-05-24T00:53:05.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:52:00+00:00, run_id=scheduled__2024-05-24T00:52:00+00:00, run_start_date=2024-05-24 00:53:00.881900+00:00, run_end_date=2024-05-24 00:53:05.627979+00:00, run_duration=4.746079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:52:00+00:00, data_interval_end=2024-05-24 00:53:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:53:05.644767003Z [2024-05-24T00:53:05.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:53:00+00:00, run_after=2024-05-24T00:54:00+00:00 2024-05-24T00:53:05.692026410Z [2024-05-24T00:53:05.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status success for try_number 1 2024-05-24T00:53:05.692329221Z [2024-05-24T00:53:05.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status success for try_number 1 2024-05-24T00:53:05.703953344Z [2024-05-24T00:53:05.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:52:00+00:00, map_index=-1, run_start_date=2024-05-24 00:53:03.087131+00:00, run_end_date=2024-05-24 00:53:05.093344+00:00, run_duration=2.006213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:53:00.948748+00:00, queued_by_job_id=1, pid=9116 2024-05-24T00:53:05.707432391Z [2024-05-24T00:53:05.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:52:00+00:00, map_index=-1, run_start_date=2024-05-24 00:53:02.912173+00:00, run_end_date=2024-05-24 00:53:04.712290+00:00, run_duration=1.800117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:53:00.948748+00:00, queued_by_job_id=1, pid=9115 2024-05-24T00:54:00.431068803Z [2024-05-24T00:54:00.430+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:54:00+00:00, run_after=2024-05-24T00:55:00+00:00 2024-05-24T00:54:00.450094485Z [2024-05-24T00:54:00.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:54:00+00:00, run_after=2024-05-24T00:55:00+00:00 2024-05-24T00:54:00.459724905Z [2024-05-24T00:54:00.459+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:54:00.467965578Z [2024-05-24T00:54:00.467+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:54:00.607698905Z [2024-05-24T00:54:00.607+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:54:00.607722808Z 2024-05-24T00:54:00.607730277Z 2024-05-24T00:54:00.607733975Z 2024-05-24T00:54:00.607737503Z 2024-05-24T00:54:00.607853813Z [2024-05-24T00:54:00.607+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:54:00.608002818Z [2024-05-24T00:54:00.607+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:54:00.608162385Z [2024-05-24T00:54:00.608+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:54:00.609974100Z [2024-05-24T00:54:00.609+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:54:00.612277093Z [2024-05-24T00:54:00.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:54:00.612291940Z 2024-05-24T00:54:00.612296420Z 2024-05-24T00:54:00.612311573Z 2024-05-24T00:54:00.612314889Z 2024-05-24T00:54:00.617544795Z [2024-05-24T00:54:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:54:00.617559133Z [2024-05-24T00:54:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:54:00.617563521Z [2024-05-24T00:54:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:54:00.617572576Z [2024-05-24T00:54:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:54:00.618553578Z [2024-05-24T00:54:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:54:00.618563356Z [2024-05-24T00:54:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:54:00.618566866Z [2024-05-24T00:54:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:54:00.618570231Z [2024-05-24T00:54:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:54:01.013055526Z [2024-05-24T00:54:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status queued for try_number 1 2024-05-24T00:54:01.014472265Z [2024-05-24T00:54:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:53:00+00:00 exited with status queued for try_number 1 2024-05-24T00:54:01.014660467Z [2024-05-24T00:54:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:53:00+00:00 exited with status queued for try_number 1 2024-05-24T00:54:01.014809933Z [2024-05-24T00:54:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:53:00+00:00 exited with status queued for try_number 1 2024-05-24T00:54:01.027783021Z [2024-05-24T00:54:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cd47c65-21ce-44f4-ac0b-f274f4705c98 2024-05-24T00:54:01.029637834Z [2024-05-24T00:54:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19344d25-da57-4c21-8cc5-831210745959 2024-05-24T00:54:01.029861552Z [2024-05-24T00:54:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7457a0f7-0f1e-4218-879f-9a0e7446fd7b 2024-05-24T00:54:01.030060614Z [2024-05-24T00:54:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa72a448-860d-4620-b035-d80484f03f28 2024-05-24T00:54:02.224132885Z [2024-05-24T00:54:02.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:54:02.224616376Z [2024-05-24T00:54:02.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:52:00+00:00, run_id=scheduled__2024-05-24T00:52:00+00:00, run_start_date=2024-05-24 00:54:00.480644+00:00, run_end_date=2024-05-24 00:54:02.224231+00:00, run_duration=1.743587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:52:00+00:00, data_interval_end=2024-05-24 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:54:02.233076241Z [2024-05-24T00:54:02.232+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:54:00+00:00, run_after=2024-05-24T00:56:00+00:00 2024-05-24T00:54:02.253550413Z [2024-05-24T00:54:02.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:54:02.253942933Z [2024-05-24T00:54:02.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:53:00+00:00, run_id=scheduled__2024-05-24T00:53:00+00:00, run_start_date=2024-05-24 00:54:00.481930+00:00, run_end_date=2024-05-24 00:54:02.253661+00:00, run_duration=1.771731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:53:00+00:00, data_interval_end=2024-05-24 00:54:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:54:02.265350504Z [2024-05-24T00:54:02.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:54:00+00:00, run_after=2024-05-24T00:55:00+00:00 2024-05-24T00:54:02.305975150Z [2024-05-24T00:54:02.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:52:00+00:00 exited with status success for try_number 1 2024-05-24T00:54:02.306409470Z [2024-05-24T00:54:02.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:53:00+00:00 exited with status success for try_number 1 2024-05-24T00:54:02.316087804Z [2024-05-24T00:54:02.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:52:00+00:00, map_index=-1, run_start_date=2024-05-24 00:54:01.597793+00:00, run_end_date=2024-05-24 00:54:01.955609+00:00, run_duration=0.357816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:54:00.613541+00:00, queued_by_job_id=1, pid=9149 2024-05-24T00:54:02.320268453Z [2024-05-24T00:54:02.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:53:00+00:00, map_index=-1, run_start_date=2024-05-24 00:54:01.647677+00:00, run_end_date=2024-05-24 00:54:02.090251+00:00, run_duration=0.442574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:54:00.613541+00:00, queued_by_job_id=1, pid=9150 2024-05-24T00:54:04.453639484Z [2024-05-24T00:54:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:54:04.453892312Z [2024-05-24T00:54:04.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:53:00+00:00, run_id=scheduled__2024-05-24T00:53:00+00:00, run_start_date=2024-05-24 00:54:00.483036+00:00, run_end_date=2024-05-24 00:54:04.453530+00:00, run_duration=3.970494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:53:00+00:00, data_interval_end=2024-05-24 00:54:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:54:04.463254422Z [2024-05-24T00:54:04.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:54:00+00:00, run_after=2024-05-24T00:55:00+00:00 2024-05-24T00:54:05.588877508Z [2024-05-24T00:54:05.588+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:54:05.589005549Z [2024-05-24T00:54:05.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:53:00+00:00, run_id=scheduled__2024-05-24T00:53:00+00:00, run_start_date=2024-05-24 00:54:00.483953+00:00, run_end_date=2024-05-24 00:54:05.588716+00:00, run_duration=5.104763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:53:00+00:00, data_interval_end=2024-05-24 00:54:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:54:05.598266607Z [2024-05-24T00:54:05.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:54:00+00:00, run_after=2024-05-24T00:55:00+00:00 2024-05-24T00:54:05.635091213Z [2024-05-24T00:54:05.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:53:00+00:00 exited with status success for try_number 1 2024-05-24T00:54:05.635130039Z [2024-05-24T00:54:05.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:53:00+00:00 exited with status success for try_number 1 2024-05-24T00:54:05.642337333Z [2024-05-24T00:54:05.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:53:00+00:00, map_index=-1, run_start_date=2024-05-24 00:54:02.853150+00:00, run_end_date=2024-05-24 00:54:04.386134+00:00, run_duration=1.532984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:54:00.613541+00:00, queued_by_job_id=1, pid=9173 2024-05-24T00:54:05.642465927Z [2024-05-24T00:54:05.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:53:00+00:00, map_index=-1, run_start_date=2024-05-24 00:54:03.012663+00:00, run_end_date=2024-05-24 00:54:05.043360+00:00, run_duration=2.030697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:54:00.613541+00:00, queued_by_job_id=1, pid=9174 2024-05-24T00:55:00.419466737Z [2024-05-24T00:55:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:55:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:55:00.427525507Z [2024-05-24T00:55:00.427+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:55:00.444784897Z [2024-05-24T00:55:00.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:55:00+00:00, run_after=2024-05-24T00:56:00+00:00 2024-05-24T00:55:00.465344858Z [2024-05-24T00:55:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:55:00+00:00, run_after=2024-05-24T00:56:00+00:00 2024-05-24T00:55:00.565843919Z [2024-05-24T00:55:00.565+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:55:00.565892483Z 2024-05-24T00:55:00.565905069Z 2024-05-24T00:55:00.565913991Z 2024-05-24T00:55:00.565922939Z 2024-05-24T00:55:00.566193135Z [2024-05-24T00:55:00.565+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:55:00.566444295Z [2024-05-24T00:55:00.566+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:55:00.566730913Z [2024-05-24T00:55:00.566+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:55:00.566967562Z [2024-05-24T00:55:00.566+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:55:00.568755701Z [2024-05-24T00:55:00.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:55:00.568778925Z 2024-05-24T00:55:00.568843624Z 2024-05-24T00:55:00.568853411Z 2024-05-24T00:55:00.568862481Z 2024-05-24T00:55:00.576250625Z [2024-05-24T00:55:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T00:55:00.576285879Z [2024-05-24T00:55:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:55:00.576580304Z [2024-05-24T00:55:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:55:00.576791210Z [2024-05-24T00:55:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:55:00.577057614Z [2024-05-24T00:55:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:55:00.577172041Z [2024-05-24T00:55:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:55:00.577755120Z [2024-05-24T00:55:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:55:00.577975467Z [2024-05-24T00:55:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:55:01.029681342Z [2024-05-24T00:55:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:55:01.029783229Z [2024-05-24T00:55:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status queued for try_number 1 2024-05-24T00:55:01.029810969Z [2024-05-24T00:55:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status queued for try_number 1 2024-05-24T00:55:01.029857610Z [2024-05-24T00:55:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status queued for try_number 1 2024-05-24T00:55:01.047824730Z [2024-05-24T00:55:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to afe80902-edec-4260-ad45-8ff792e824ac 2024-05-24T00:55:01.047893286Z [2024-05-24T00:55:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a3f027f-dd14-42be-8956-0896f41b822f 2024-05-24T00:55:01.047995765Z [2024-05-24T00:55:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to efc78dc4-1478-4c3e-9fe7-4cc2a3c971ed 2024-05-24T00:55:01.048072520Z [2024-05-24T00:55:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8b82c20-95d4-4bdb-bab2-76e9671afe47 2024-05-24T00:55:02.386564854Z [2024-05-24T00:55:02.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:55:02.386786933Z [2024-05-24T00:55:02.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:54:00+00:00, run_id=scheduled__2024-05-24T00:54:00+00:00, run_start_date=2024-05-24 00:55:00.482294+00:00, run_end_date=2024-05-24 00:55:02.386454+00:00, run_duration=1.90416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:54:00+00:00, data_interval_end=2024-05-24 00:55:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:55:02.411927238Z [2024-05-24T00:55:02.411+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:55:00+00:00, run_after=2024-05-24T00:56:00+00:00 2024-05-24T00:55:02.571055004Z [2024-05-24T00:55:02.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status success for try_number 1 2024-05-24T00:55:02.588233796Z [2024-05-24T00:55:02.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:54:00+00:00, map_index=-1, run_start_date=2024-05-24 00:55:01.470971+00:00, run_end_date=2024-05-24 00:55:01.864687+00:00, run_duration=0.393716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:55:00.571212+00:00, queued_by_job_id=1, pid=9207 2024-05-24T00:55:03.679323838Z [2024-05-24T00:55:03.678+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:55:03.679367118Z 2024-05-24T00:55:03.679414623Z [2024-05-24T00:55:03.679+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:55:03.680212619Z [2024-05-24T00:55:03.679+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:55:03.680223262Z 2024-05-24T00:55:03.682612046Z [2024-05-24T00:55:03.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T00:55:03.682754466Z [2024-05-24T00:55:03.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:55:03.732668034Z [2024-05-24T00:55:03.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:55:03.738666830Z [2024-05-24T00:55:03.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:55:03.741488478Z [2024-05-24T00:55:03.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6d950df-51c4-4418-9be7-cd3d572ebf28 2024-05-24T00:55:03.742585012Z [2024-05-24T00:55:03.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=-1, run_start_date=2024-05-24 00:55:02.869136+00:00, run_end_date=2024-05-24 00:55:03.401449+00:00, run_duration=0.532313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:55:00.571212+00:00, queued_by_job_id=1, pid=9231 2024-05-24T00:55:04.928473814Z [2024-05-24T00:55:04.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:55:04.928755407Z [2024-05-24T00:55:04.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:54:00+00:00, run_id=scheduled__2024-05-24T00:54:00+00:00, run_start_date=2024-05-24 00:55:00.483794+00:00, run_end_date=2024-05-24 00:55:04.928369+00:00, run_duration=4.444575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:54:00+00:00, data_interval_end=2024-05-24 00:55:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:55:04.943463763Z [2024-05-24T00:55:04.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:55:00+00:00, run_after=2024-05-24T00:56:00+00:00 2024-05-24T00:55:04.950745072Z [2024-05-24T00:55:04.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:55:04.950877454Z [2024-05-24T00:55:04.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:54:00+00:00, run_id=scheduled__2024-05-24T00:54:00+00:00, run_start_date=2024-05-24 00:55:00.484922+00:00, run_end_date=2024-05-24 00:55:04.950566+00:00, run_duration=4.465644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:54:00+00:00, data_interval_end=2024-05-24 00:55:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:55:04.960244811Z [2024-05-24T00:55:04.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:55:00+00:00, run_after=2024-05-24T00:56:00+00:00 2024-05-24T00:55:05.015561994Z [2024-05-24T00:55:05.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status success for try_number 1 2024-05-24T00:55:05.015779862Z [2024-05-24T00:55:05.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status success for try_number 1 2024-05-24T00:55:05.023435733Z [2024-05-24T00:55:05.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:54:00+00:00, map_index=-1, run_start_date=2024-05-24 00:55:03.065036+00:00, run_end_date=2024-05-24 00:55:04.434358+00:00, run_duration=1.369322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:55:00.571212+00:00, queued_by_job_id=1, pid=9233 2024-05-24T00:55:05.023676597Z [2024-05-24T00:55:05.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:54:00+00:00, map_index=-1, run_start_date=2024-05-24 00:55:03.006374+00:00, run_end_date=2024-05-24 00:55:04.738164+00:00, run_duration=1.73179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:55:00.571212+00:00, queued_by_job_id=1, pid=9232 2024-05-24T00:55:07.192202652Z [2024-05-24T00:55:07.191+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:55:07.192273157Z 2024-05-24T00:55:07.192283812Z [2024-05-24T00:55:07.192+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:55:07.192758082Z [2024-05-24T00:55:07.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:55:07.192802251Z 2024-05-24T00:55:07.195144733Z [2024-05-24T00:55:07.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T00:55:07.195221472Z [2024-05-24T00:55:07.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T00:55:07.250459441Z [2024-05-24T00:55:07.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:55:07.251798909Z [2024-05-24T00:55:07.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:55:07.263898908Z [2024-05-24T00:55:07.263+0000] {scheduler_job.py:635} INFO - Setting external_id for to e97cd8e7-c755-47c6-a5a5-f747bb36a101 2024-05-24T00:55:07.264569218Z [2024-05-24T00:55:07.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=-1, run_start_date=2024-05-24 00:55:05.562065+00:00, run_end_date=2024-05-24 00:55:05.962074+00:00, run_duration=0.400009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:55:03.680571+00:00, queued_by_job_id=1, pid=9256 2024-05-24T00:55:09.617375820Z [2024-05-24T00:55:09.615+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T00:55:09.617408763Z 2024-05-24T00:55:09.617415071Z [2024-05-24T00:55:09.615+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:55:09.617422156Z [2024-05-24T00:55:09.616+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:55:09.617427283Z 2024-05-24T00:55:09.621161614Z [2024-05-24T00:55:09.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:55:09.621524008Z [2024-05-24T00:55:09.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T00:55:09.704032914Z [2024-05-24T00:55:09.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status queued for try_number 1 2024-05-24T00:55:09.704326009Z [2024-05-24T00:55:09.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:55:09.711408106Z [2024-05-24T00:55:09.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b3fe17b-f8e8-4c7f-9e6e-b7e6f4276f10 2024-05-24T00:55:09.711882236Z [2024-05-24T00:55:09.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=0, run_start_date=2024-05-24 00:55:08.946858+00:00, run_end_date=2024-05-24 00:55:09.442339+00:00, run_duration=0.495481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:55:07.193029+00:00, queued_by_job_id=1, pid=9264 2024-05-24T00:55:12.265371182Z [2024-05-24T00:55:12.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:55:12.265442681Z [2024-05-24T00:55:12.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:50:00+00:00, run_id=scheduled__2024-05-24T00:50:00+00:00, run_start_date=2024-05-24 00:55:00.480494+00:00, run_end_date=2024-05-24 00:55:12.265130+00:00, run_duration=11.784636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:50:00+00:00, data_interval_end=2024-05-24 00:55:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T00:55:12.272230216Z [2024-05-24T00:55:12.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:55:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:55:12.316892296Z [2024-05-24T00:55:12.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:50:00+00:00 exited with status success for try_number 1 2024-05-24T00:55:12.326326802Z [2024-05-24T00:55:12.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:50:00+00:00, map_index=-1, run_start_date=2024-05-24 00:55:11.580786+00:00, run_end_date=2024-05-24 00:55:11.971880+00:00, run_duration=0.391094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:55:09.617266+00:00, queued_by_job_id=1, pid=9272 2024-05-24T00:56:01.110283435Z [2024-05-24T00:56:01.109+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:56:00+00:00, run_after=2024-05-24T00:57:00+00:00 2024-05-24T00:56:01.122747028Z [2024-05-24T00:56:01.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:56:01.136275980Z [2024-05-24T00:56:01.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:56:00+00:00, run_after=2024-05-24T00:57:00+00:00 2024-05-24T00:56:01.144581069Z [2024-05-24T00:56:01.144+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:56:01.254240307Z [2024-05-24T00:56:01.253+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:56:01.254293210Z 2024-05-24T00:56:01.254304200Z 2024-05-24T00:56:01.254344331Z 2024-05-24T00:56:01.254353267Z 2024-05-24T00:56:01.254379758Z [2024-05-24T00:56:01.254+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:56:01.254389781Z [2024-05-24T00:56:01.254+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:56:01.254698149Z [2024-05-24T00:56:01.254+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:56:01.254731308Z [2024-05-24T00:56:01.254+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:56:01.255724287Z [2024-05-24T00:56:01.255+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:56:01.255747169Z 2024-05-24T00:56:01.255756869Z 2024-05-24T00:56:01.255765434Z 2024-05-24T00:56:01.255774200Z 2024-05-24T00:56:01.262344446Z [2024-05-24T00:56:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:56:01.262397418Z [2024-05-24T00:56:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:56:01.262687459Z [2024-05-24T00:56:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:56:01.262808312Z [2024-05-24T00:56:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:56:01.263075684Z [2024-05-24T00:56:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:56:01.263225230Z [2024-05-24T00:56:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:56:01.263393838Z [2024-05-24T00:56:01.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:56:01.263459153Z [2024-05-24T00:56:01.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:56:01.785780116Z [2024-05-24T00:56:01.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status queued for try_number 1 2024-05-24T00:56:01.785837921Z [2024-05-24T00:56:01.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status queued for try_number 1 2024-05-24T00:56:01.785916371Z [2024-05-24T00:56:01.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status queued for try_number 1 2024-05-24T00:56:01.785990335Z [2024-05-24T00:56:01.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status queued for try_number 1 2024-05-24T00:56:01.798752361Z [2024-05-24T00:56:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 329b6461-05ae-4c15-a0c0-6ac24cc0bc62 2024-05-24T00:56:01.798788773Z [2024-05-24T00:56:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c8671c6-7356-486a-ace0-a74ea6c19ac4 2024-05-24T00:56:01.798907868Z [2024-05-24T00:56:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 761a0f50-8cbd-44b6-aac2-500b2da2d095 2024-05-24T00:56:01.799000317Z [2024-05-24T00:56:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 903bbc7b-420b-4925-8594-ca86424a321a 2024-05-24T00:56:03.169422466Z [2024-05-24T00:56:03.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:56:03.169931490Z [2024-05-24T00:56:03.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:54:00+00:00, run_id=scheduled__2024-05-24T00:54:00+00:00, run_start_date=2024-05-24 00:56:01.162859+00:00, run_end_date=2024-05-24 00:56:03.169547+00:00, run_duration=2.006688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:54:00+00:00, data_interval_end=2024-05-24 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:56:03.180526397Z [2024-05-24T00:56:03.180+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:56:00+00:00, run_after=2024-05-24T00:58:00+00:00 2024-05-24T00:56:03.187248743Z [2024-05-24T00:56:03.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:56:03.187538530Z [2024-05-24T00:56:03.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:55:00+00:00, run_id=scheduled__2024-05-24T00:55:00+00:00, run_start_date=2024-05-24 00:56:01.164252+00:00, run_end_date=2024-05-24 00:56:03.187228+00:00, run_duration=2.022976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:55:00+00:00, data_interval_end=2024-05-24 00:56:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:56:03.198615957Z [2024-05-24T00:56:03.198+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:56:00+00:00, run_after=2024-05-24T00:57:00+00:00 2024-05-24T00:56:03.257223163Z [2024-05-24T00:56:03.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:54:00+00:00 exited with status success for try_number 1 2024-05-24T00:56:03.257521822Z [2024-05-24T00:56:03.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status success for try_number 1 2024-05-24T00:56:03.266990926Z [2024-05-24T00:56:03.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:54:00+00:00, map_index=-1, run_start_date=2024-05-24 00:56:02.071396+00:00, run_end_date=2024-05-24 00:56:02.519853+00:00, run_duration=0.448457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:56:01.257004+00:00, queued_by_job_id=1, pid=9295 2024-05-24T00:56:03.267540276Z [2024-05-24T00:56:03.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:55:00+00:00, map_index=-1, run_start_date=2024-05-24 00:56:02.238744+00:00, run_end_date=2024-05-24 00:56:02.791384+00:00, run_duration=0.55264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:56:01.257004+00:00, queued_by_job_id=1, pid=9296 2024-05-24T00:56:05.440215528Z [2024-05-24T00:56:05.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:56:05.440516676Z [2024-05-24T00:56:05.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:55:00+00:00, run_id=scheduled__2024-05-24T00:55:00+00:00, run_start_date=2024-05-24 00:56:01.165480+00:00, run_end_date=2024-05-24 00:56:05.440023+00:00, run_duration=4.274543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:55:00+00:00, data_interval_end=2024-05-24 00:56:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:56:05.450183979Z [2024-05-24T00:56:05.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:56:00+00:00, run_after=2024-05-24T00:57:00+00:00 2024-05-24T00:56:05.458678589Z [2024-05-24T00:56:05.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:56:05.459052708Z [2024-05-24T00:56:05.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:55:00+00:00, run_id=scheduled__2024-05-24T00:55:00+00:00, run_start_date=2024-05-24 00:56:01.166700+00:00, run_end_date=2024-05-24 00:56:05.458482+00:00, run_duration=4.291782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:55:00+00:00, data_interval_end=2024-05-24 00:56:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:56:05.467921378Z [2024-05-24T00:56:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:56:00+00:00, run_after=2024-05-24T00:57:00+00:00 2024-05-24T00:56:05.512642024Z [2024-05-24T00:56:05.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status success for try_number 1 2024-05-24T00:56:05.513153346Z [2024-05-24T00:56:05.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status success for try_number 1 2024-05-24T00:56:05.526091518Z [2024-05-24T00:56:05.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:55:00+00:00, map_index=-1, run_start_date=2024-05-24 00:56:03.603195+00:00, run_end_date=2024-05-24 00:56:04.979529+00:00, run_duration=1.376334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:56:01.257004+00:00, queued_by_job_id=1, pid=9320 2024-05-24T00:56:05.526555678Z [2024-05-24T00:56:05.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:55:00+00:00, map_index=-1, run_start_date=2024-05-24 00:56:03.531088+00:00, run_end_date=2024-05-24 00:56:05.260850+00:00, run_duration=1.729762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:56:01.257004+00:00, queued_by_job_id=1, pid=9319 2024-05-24T00:56:40.930001635Z [2024-05-24T00:56:40.929+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T00:57:00.179358787Z [2024-05-24T00:57:00.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:57:00+00:00, run_after=2024-05-24T00:58:00+00:00 2024-05-24T00:57:00.188201946Z [2024-05-24T00:57:00.187+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:57:00.201384547Z [2024-05-24T00:57:00.201+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:57:00+00:00, run_after=2024-05-24T00:58:00+00:00 2024-05-24T00:57:00.306540205Z [2024-05-24T00:57:00.300+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:57:00.306568741Z 2024-05-24T00:57:00.306572748Z 2024-05-24T00:57:00.306591468Z 2024-05-24T00:57:00.306594768Z [2024-05-24T00:57:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:57:00.306598011Z [2024-05-24T00:57:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:57:00.306601214Z [2024-05-24T00:57:00.300+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:57:00.306604869Z [2024-05-24T00:57:00.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:57:00.306608060Z 2024-05-24T00:57:00.306611229Z 2024-05-24T00:57:00.306614532Z 2024-05-24T00:57:00.306618319Z [2024-05-24T00:57:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:57:00.306621496Z [2024-05-24T00:57:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:57:00.306624758Z [2024-05-24T00:57:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:57:00.306627943Z [2024-05-24T00:57:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:57:00.306635278Z [2024-05-24T00:57:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:57:00.306638578Z [2024-05-24T00:57:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:57:00.665758682Z [2024-05-24T00:57:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status queued for try_number 1 2024-05-24T00:57:00.666033129Z [2024-05-24T00:57:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status queued for try_number 1 2024-05-24T00:57:00.666173225Z [2024-05-24T00:57:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status queued for try_number 1 2024-05-24T00:57:00.679742223Z [2024-05-24T00:57:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85361fe7-6f9f-49c7-84f8-8f84463dd56e 2024-05-24T00:57:00.679949877Z [2024-05-24T00:57:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to dceb3e1d-4ddb-411c-ac33-969aa8d93669 2024-05-24T00:57:00.680131997Z [2024-05-24T00:57:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba39dafc-85ac-485e-b346-80b702fdee41 2024-05-24T00:57:01.835684172Z [2024-05-24T00:57:01.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:57:01.836530737Z [2024-05-24T00:57:01.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:56:00+00:00, run_id=scheduled__2024-05-24T00:56:00+00:00, run_start_date=2024-05-24 00:57:00.212307+00:00, run_end_date=2024-05-24 00:57:01.835970+00:00, run_duration=1.623663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:56:00+00:00, data_interval_end=2024-05-24 00:57:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:57:01.847146020Z [2024-05-24T00:57:01.846+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:57:00+00:00, run_after=2024-05-24T00:58:00+00:00 2024-05-24T00:57:01.916126619Z [2024-05-24T00:57:01.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status success for try_number 1 2024-05-24T00:57:01.921561194Z [2024-05-24T00:57:01.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:56:00+00:00, map_index=-1, run_start_date=2024-05-24 00:57:01.258799+00:00, run_end_date=2024-05-24 00:57:01.673313+00:00, run_duration=0.414514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:57:00.302097+00:00, queued_by_job_id=1, pid=9352 2024-05-24T00:57:04.259350650Z [2024-05-24T00:57:04.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:57:04.259582179Z [2024-05-24T00:57:04.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:56:00+00:00, run_id=scheduled__2024-05-24T00:56:00+00:00, run_start_date=2024-05-24 00:57:00.213600+00:00, run_end_date=2024-05-24 00:57:04.259148+00:00, run_duration=4.045548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:56:00+00:00, data_interval_end=2024-05-24 00:57:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:57:04.269530708Z [2024-05-24T00:57:04.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:57:00+00:00, run_after=2024-05-24T00:58:00+00:00 2024-05-24T00:57:04.276757447Z [2024-05-24T00:57:04.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:57:04.277134155Z [2024-05-24T00:57:04.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:56:00+00:00, run_id=scheduled__2024-05-24T00:56:00+00:00, run_start_date=2024-05-24 00:57:00.214891+00:00, run_end_date=2024-05-24 00:57:04.276601+00:00, run_duration=4.06171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:56:00+00:00, data_interval_end=2024-05-24 00:57:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:57:04.286172990Z [2024-05-24T00:57:04.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:57:00+00:00, run_after=2024-05-24T00:58:00+00:00 2024-05-24T00:57:04.328961152Z [2024-05-24T00:57:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status success for try_number 1 2024-05-24T00:57:04.329296330Z [2024-05-24T00:57:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status success for try_number 1 2024-05-24T00:57:04.337496724Z [2024-05-24T00:57:04.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:56:00+00:00, map_index=-1, run_start_date=2024-05-24 00:57:02.202671+00:00, run_end_date=2024-05-24 00:57:03.838322+00:00, run_duration=1.635651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:57:00.302097+00:00, queued_by_job_id=1, pid=9370 2024-05-24T00:57:04.337767378Z [2024-05-24T00:57:04.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:56:00+00:00, map_index=-1, run_start_date=2024-05-24 00:57:02.318818+00:00, run_end_date=2024-05-24 00:57:03.693190+00:00, run_duration=1.374372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:57:00.302097+00:00, queued_by_job_id=1, pid=9371 2024-05-24T00:58:00.138213353Z [2024-05-24T00:58:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:58:00+00:00, run_after=2024-05-24T00:59:00+00:00 2024-05-24T00:58:00.144800212Z [2024-05-24T00:58:00.144+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:58:00.155283915Z [2024-05-24T00:58:00.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:58:00+00:00, run_after=2024-05-24T00:59:00+00:00 2024-05-24T00:58:00.161642519Z [2024-05-24T00:58:00.161+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:58:00.225451327Z [2024-05-24T00:58:00.224+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T00:58:00.225483909Z 2024-05-24T00:58:00.225491687Z 2024-05-24T00:58:00.225498430Z 2024-05-24T00:58:00.225504866Z 2024-05-24T00:58:00.225578760Z [2024-05-24T00:58:00.225+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T00:58:00.225733358Z [2024-05-24T00:58:00.225+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:58:00.225891525Z [2024-05-24T00:58:00.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:58:00.226014598Z [2024-05-24T00:58:00.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:58:00.226970344Z [2024-05-24T00:58:00.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:58:00.226978915Z 2024-05-24T00:58:00.226982817Z 2024-05-24T00:58:00.226985898Z 2024-05-24T00:58:00.226989416Z 2024-05-24T00:58:00.232226371Z [2024-05-24T00:58:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:58:00.232367323Z [2024-05-24T00:58:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T00:58:00.232628222Z [2024-05-24T00:58:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:58:00.232777639Z [2024-05-24T00:58:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:58:00.232992785Z [2024-05-24T00:58:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:58:00.233095098Z [2024-05-24T00:58:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:58:00.233404508Z [2024-05-24T00:58:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:58:00.233561579Z [2024-05-24T00:58:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:58:00.730191673Z [2024-05-24T00:58:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status queued for try_number 1 2024-05-24T00:58:00.731396934Z [2024-05-24T00:58:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:57:00+00:00 exited with status queued for try_number 1 2024-05-24T00:58:00.731593097Z [2024-05-24T00:58:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:57:00+00:00 exited with status queued for try_number 1 2024-05-24T00:58:00.731762294Z [2024-05-24T00:58:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:57:00+00:00 exited with status queued for try_number 1 2024-05-24T00:58:00.748385138Z [2024-05-24T00:58:00.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to 898da7cc-5b02-4723-beaf-c83481166875 2024-05-24T00:58:00.748525384Z [2024-05-24T00:58:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89f2397c-83b3-4ca2-8f73-391c5f40d5bd 2024-05-24T00:58:00.748709468Z [2024-05-24T00:58:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab24c699-e846-4ded-8534-6bc5ab37b350 2024-05-24T00:58:00.748914840Z [2024-05-24T00:58:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa398914-c63d-4ed3-8aa1-494cd037c5a8 2024-05-24T00:58:02.269949061Z [2024-05-24T00:58:02.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:58:02.271112012Z [2024-05-24T00:58:02.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:56:00+00:00, run_id=scheduled__2024-05-24T00:56:00+00:00, run_start_date=2024-05-24 00:58:00.169897+00:00, run_end_date=2024-05-24 00:58:02.270321+00:00, run_duration=2.100424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:56:00+00:00, data_interval_end=2024-05-24 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T00:58:02.281362890Z [2024-05-24T00:58:02.281+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T00:58:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:58:02.294029667Z [2024-05-24T00:58:02.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:58:02.294425703Z [2024-05-24T00:58:02.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:57:00+00:00, run_id=scheduled__2024-05-24T00:57:00+00:00, run_start_date=2024-05-24 00:58:00.170998+00:00, run_end_date=2024-05-24 00:58:02.293934+00:00, run_duration=2.122936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:57:00+00:00, data_interval_end=2024-05-24 00:58:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:58:02.305321797Z [2024-05-24T00:58:02.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:58:00+00:00, run_after=2024-05-24T00:59:00+00:00 2024-05-24T00:58:02.368791231Z [2024-05-24T00:58:02.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:56:00+00:00 exited with status success for try_number 1 2024-05-24T00:58:02.369291820Z [2024-05-24T00:58:02.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:57:00+00:00 exited with status success for try_number 1 2024-05-24T00:58:02.386384619Z [2024-05-24T00:58:02.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:56:00+00:00, map_index=-1, run_start_date=2024-05-24 00:58:01.206158+00:00, run_end_date=2024-05-24 00:58:01.618815+00:00, run_duration=0.412657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:58:00.228339+00:00, queued_by_job_id=1, pid=9404 2024-05-24T00:58:02.386949935Z [2024-05-24T00:58:02.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:57:00+00:00, map_index=-1, run_start_date=2024-05-24 00:58:01.377072+00:00, run_end_date=2024-05-24 00:58:01.898671+00:00, run_duration=0.521599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:58:00.228339+00:00, queued_by_job_id=1, pid=9405 2024-05-24T00:58:04.154944448Z [2024-05-24T00:58:04.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:58:04.155700348Z [2024-05-24T00:58:04.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:57:00+00:00, run_id=scheduled__2024-05-24T00:57:00+00:00, run_start_date=2024-05-24 00:58:00.171943+00:00, run_end_date=2024-05-24 00:58:04.154832+00:00, run_duration=3.982889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:57:00+00:00, data_interval_end=2024-05-24 00:58:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:58:04.164730260Z [2024-05-24T00:58:04.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:58:00+00:00, run_after=2024-05-24T00:59:00+00:00 2024-05-24T00:58:04.224767544Z [2024-05-24T00:58:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:57:00+00:00 exited with status success for try_number 1 2024-05-24T00:58:04.235031408Z [2024-05-24T00:58:04.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:57:00+00:00, map_index=-1, run_start_date=2024-05-24 00:58:02.383181+00:00, run_end_date=2024-05-24 00:58:03.754564+00:00, run_duration=1.371383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:58:00.228339+00:00, queued_by_job_id=1, pid=9429 2024-05-24T00:58:05.354180935Z [2024-05-24T00:58:05.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:58:05.354562324Z [2024-05-24T00:58:05.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:57:00+00:00, run_id=scheduled__2024-05-24T00:57:00+00:00, run_start_date=2024-05-24 00:58:00.172860+00:00, run_end_date=2024-05-24 00:58:05.354074+00:00, run_duration=5.181214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:57:00+00:00, data_interval_end=2024-05-24 00:58:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:58:05.365568678Z [2024-05-24T00:58:05.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:58:00+00:00, run_after=2024-05-24T00:59:00+00:00 2024-05-24T00:58:05.416601684Z [2024-05-24T00:58:05.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:57:00+00:00 exited with status success for try_number 1 2024-05-24T00:58:05.426595831Z [2024-05-24T00:58:05.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:57:00+00:00, map_index=-1, run_start_date=2024-05-24 00:58:02.358450+00:00, run_end_date=2024-05-24 00:58:04.144509+00:00, run_duration=1.786059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:58:00.228339+00:00, queued_by_job_id=1, pid=9428 2024-05-24T00:59:00.060521918Z [2024-05-24T00:59:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:59:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:59:00.067015429Z [2024-05-24T00:59:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T00:59:00.078778499Z [2024-05-24T00:59:00.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:59:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:59:00.143087071Z [2024-05-24T00:59:00.142+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T00:59:00.143125659Z 2024-05-24T00:59:00.143130635Z 2024-05-24T00:59:00.143134888Z 2024-05-24T00:59:00.143159393Z [2024-05-24T00:59:00.142+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:59:00.143205618Z [2024-05-24T00:59:00.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T00:59:00.143323774Z [2024-05-24T00:59:00.143+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T00:59:00.144221280Z [2024-05-24T00:59:00.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T00:59:00.144272769Z 2024-05-24T00:59:00.144278383Z 2024-05-24T00:59:00.144282981Z 2024-05-24T00:59:00.151227376Z [2024-05-24T00:59:00.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:59:00.151309110Z [2024-05-24T00:59:00.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T00:59:00.151561964Z [2024-05-24T00:59:00.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:59:00.151681223Z [2024-05-24T00:59:00.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T00:59:00.151810124Z [2024-05-24T00:59:00.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T00:59:00.151872635Z [2024-05-24T00:59:00.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T00:59:00.593579799Z [2024-05-24T00:59:00.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status queued for try_number 1 2024-05-24T00:59:00.593831374Z [2024-05-24T00:59:00.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status queued for try_number 1 2024-05-24T00:59:00.593994082Z [2024-05-24T00:59:00.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status queued for try_number 1 2024-05-24T00:59:00.606747386Z [2024-05-24T00:59:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42af3842-f597-4575-b156-22cb547b9cd0 2024-05-24T00:59:00.606801702Z [2024-05-24T00:59:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48962c62-a116-409d-887f-2ca43f960144 2024-05-24T00:59:00.606902384Z [2024-05-24T00:59:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85e290f6-f1cf-44c3-b6a4-71de9112fb00 2024-05-24T00:59:02.828060882Z [2024-05-24T00:59:02.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:59:02.828553707Z [2024-05-24T00:59:02.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:58:00+00:00, run_id=scheduled__2024-05-24T00:58:00+00:00, run_start_date=2024-05-24 00:59:00.090258+00:00, run_end_date=2024-05-24 00:59:02.827949+00:00, run_duration=2.737691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:58:00+00:00, data_interval_end=2024-05-24 00:59:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T00:59:02.838555724Z [2024-05-24T00:59:02.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T00:59:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:59:02.901418973Z [2024-05-24T00:59:02.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status success for try_number 1 2024-05-24T00:59:02.908235808Z [2024-05-24T00:59:02.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:58:00+00:00, map_index=-1, run_start_date=2024-05-24 00:59:01.279090+00:00, run_end_date=2024-05-24 00:59:01.703774+00:00, run_duration=0.424684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:59:00.144832+00:00, queued_by_job_id=1, pid=9462 2024-05-24T00:59:03.974563243Z [2024-05-24T00:59:03.973+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:59:03.974847385Z [2024-05-24T00:59:03.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:58:00+00:00, run_id=scheduled__2024-05-24T00:58:00+00:00, run_start_date=2024-05-24 00:59:00.091537+00:00, run_end_date=2024-05-24 00:59:03.974378+00:00, run_duration=3.882841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:58:00+00:00, data_interval_end=2024-05-24 00:59:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T00:59:03.986292445Z [2024-05-24T00:59:03.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:59:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:59:04.047149097Z [2024-05-24T00:59:04.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status success for try_number 1 2024-05-24T00:59:04.054489832Z [2024-05-24T00:59:04.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:58:00+00:00, map_index=-1, run_start_date=2024-05-24 00:59:02.203537+00:00, run_end_date=2024-05-24 00:59:03.475703+00:00, run_duration=1.272166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:59:00.144832+00:00, queued_by_job_id=1, pid=9480 2024-05-24T00:59:05.120959257Z [2024-05-24T00:59:05.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T00:59:05.121081241Z [2024-05-24T00:59:05.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:58:00+00:00, run_id=scheduled__2024-05-24T00:58:00+00:00, run_start_date=2024-05-24 00:59:00.092516+00:00, run_end_date=2024-05-24 00:59:05.120531+00:00, run_duration=5.028015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:58:00+00:00, data_interval_end=2024-05-24 00:59:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T00:59:05.132247057Z [2024-05-24T00:59:05.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T00:59:00+00:00, run_after=2024-05-24T01:00:00+00:00 2024-05-24T00:59:05.186607604Z [2024-05-24T00:59:05.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status success for try_number 1 2024-05-24T00:59:05.196090432Z [2024-05-24T00:59:05.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:58:00+00:00, map_index=-1, run_start_date=2024-05-24 00:59:02.364809+00:00, run_end_date=2024-05-24 00:59:04.143104+00:00, run_duration=1.778295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 00:59:00.144832+00:00, queued_by_job_id=1, pid=9481 2024-05-24T01:00:00.754827773Z [2024-05-24T01:00:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:05:00+00:00 2024-05-24T01:00:00.770191058Z [2024-05-24T01:00:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:01:00+00:00 2024-05-24T01:00:00.781231843Z [2024-05-24T01:00:00.780+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:00:00.793125771Z [2024-05-24T01:00:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:00:00.822909472Z [2024-05-24T01:00:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:01:00+00:00 2024-05-24T01:00:00.956575861Z [2024-05-24T01:00:00.942+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T01:00:00.956600053Z 2024-05-24T01:00:00.956604135Z 2024-05-24T01:00:00.956609409Z 2024-05-24T01:00:00.956612693Z 2024-05-24T01:00:00.956616164Z 2024-05-24T01:00:00.956619325Z [2024-05-24T01:00:00.943+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:00:00.956624259Z [2024-05-24T01:00:00.943+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:00:00.956627437Z [2024-05-24T01:00:00.943+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:00:00.956630982Z [2024-05-24T01:00:00.943+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:00:00.956638936Z [2024-05-24T01:00:00.943+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:00:00.956645230Z [2024-05-24T01:00:00.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:00:00.956650026Z 2024-05-24T01:00:00.956654736Z 2024-05-24T01:00:00.956669732Z 2024-05-24T01:00:00.956674318Z 2024-05-24T01:00:00.956679001Z 2024-05-24T01:00:00.956698915Z [2024-05-24T01:00:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:00:00.956703961Z [2024-05-24T01:00:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:00:00.956710347Z [2024-05-24T01:00:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:00:00.956716941Z [2024-05-24T01:00:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:00:00.956721682Z [2024-05-24T01:00:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:00:00.956726244Z [2024-05-24T01:00:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:00:00.956735068Z [2024-05-24T01:00:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:00:00.956739925Z [2024-05-24T01:00:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:00:00.956744284Z [2024-05-24T01:00:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:00:00.956748811Z [2024-05-24T01:00:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:00:01.625333561Z [2024-05-24T01:00:01.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:01.625469910Z [2024-05-24T01:00:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:01.625708686Z [2024-05-24T01:00:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:59:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:01.625825465Z [2024-05-24T01:00:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:59:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:01.625916994Z [2024-05-24T01:00:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:59:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:01.647396152Z [2024-05-24T01:00:01.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e139612-ef9f-4a0a-89e2-c562aa304994 2024-05-24T01:00:01.650995441Z [2024-05-24T01:00:01.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e388bbc-baf4-4f0a-8ad4-642bace9ad4d 2024-05-24T01:00:01.651121167Z [2024-05-24T01:00:01.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9d18c6b-f7ed-48f7-9da4-cae983562ba3 2024-05-24T01:00:01.651256688Z [2024-05-24T01:00:01.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fd2545d-4736-4d2c-83a4-2ce548813a19 2024-05-24T01:00:01.651390075Z [2024-05-24T01:00:01.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84be4ce8-0426-4cee-bf20-e2b2fa6a572d 2024-05-24T01:00:03.612776862Z [2024-05-24T01:00:03.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:00:03.613574721Z [2024-05-24T01:00:03.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 00:58:00+00:00, run_id=scheduled__2024-05-24T00:58:00+00:00, run_start_date=2024-05-24 01:00:00.836172+00:00, run_end_date=2024-05-24 01:00:03.612527+00:00, run_duration=2.776355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:58:00+00:00, data_interval_end=2024-05-24 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:00:03.634150696Z [2024-05-24T01:00:03.633+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:02:00+00:00 2024-05-24T01:00:03.674047798Z [2024-05-24T01:00:03.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:00:03.674658355Z [2024-05-24T01:00:03.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 00:59:00+00:00, run_id=scheduled__2024-05-24T00:59:00+00:00, run_start_date=2024-05-24 01:00:00.837325+00:00, run_end_date=2024-05-24 01:00:03.673908+00:00, run_duration=2.836583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:59:00+00:00, data_interval_end=2024-05-24 01:00:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:00:03.706676964Z [2024-05-24T01:00:03.701+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:01:00+00:00 2024-05-24T01:00:03.808712602Z [2024-05-24T01:00:03.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T00:58:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:03.808909204Z [2024-05-24T01:00:03.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:59:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:03.826024428Z [2024-05-24T01:00:03.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:59:00+00:00, map_index=-1, run_start_date=2024-05-24 01:00:02.211922+00:00, run_end_date=2024-05-24 01:00:02.883370+00:00, run_duration=0.671448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:00.945068+00:00, queued_by_job_id=1, pid=9516 2024-05-24T01:00:03.826534450Z [2024-05-24T01:00:03.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T00:58:00+00:00, map_index=-1, run_start_date=2024-05-24 01:00:02.085717+00:00, run_end_date=2024-05-24 01:00:02.911643+00:00, run_duration=0.825926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:00.945068+00:00, queued_by_job_id=1, pid=9515 2024-05-24T01:00:04.948580092Z [2024-05-24T01:00:04.947+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:00:04.948648019Z 2024-05-24T01:00:04.949207149Z [2024-05-24T01:00:04.948+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:00:04.951019425Z [2024-05-24T01:00:04.950+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:00:04.951035289Z 2024-05-24T01:00:04.958237882Z [2024-05-24T01:00:04.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:00:04.958622031Z [2024-05-24T01:00:04.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:00:05.048379171Z [2024-05-24T01:00:05.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:05.048756795Z [2024-05-24T01:00:05.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:05.058478805Z [2024-05-24T01:00:05.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7d53a18-c846-4f7a-ac3d-a9fc32dd5fab 2024-05-24T01:00:05.059027385Z [2024-05-24T01:00:05.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T00:55:00+00:00, map_index=-1, run_start_date=2024-05-24 01:00:03.646648+00:00, run_end_date=2024-05-24 01:00:04.185581+00:00, run_duration=0.538933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:00.945068+00:00, queued_by_job_id=1, pid=9540 2024-05-24T01:00:06.252756806Z [2024-05-24T01:00:06.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:00:06.253084719Z [2024-05-24T01:00:06.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:59:00+00:00, run_id=scheduled__2024-05-24T00:59:00+00:00, run_start_date=2024-05-24 01:00:00.838574+00:00, run_end_date=2024-05-24 01:00:06.252631+00:00, run_duration=5.414057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:59:00+00:00, data_interval_end=2024-05-24 01:00:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:00:06.263688901Z [2024-05-24T01:00:06.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:01:00+00:00 2024-05-24T01:00:06.271683042Z [2024-05-24T01:00:06.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:00:06.272083727Z [2024-05-24T01:00:06.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:59:00+00:00, run_id=scheduled__2024-05-24T00:59:00+00:00, run_start_date=2024-05-24 01:00:00.840351+00:00, run_end_date=2024-05-24 01:00:06.271580+00:00, run_duration=5.431229, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:59:00+00:00, data_interval_end=2024-05-24 01:00:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:00:06.285266078Z [2024-05-24T01:00:06.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:01:00+00:00 2024-05-24T01:00:06.344693630Z [2024-05-24T01:00:06.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:59:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:06.344918463Z [2024-05-24T01:00:06.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T00:59:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:06.351247137Z [2024-05-24T01:00:06.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:59:00+00:00, map_index=-1, run_start_date=2024-05-24 01:00:03.694541+00:00, run_end_date=2024-05-24 01:00:05.084984+00:00, run_duration=1.390443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:00.945068+00:00, queued_by_job_id=1, pid=9541 2024-05-24T01:00:06.351528529Z [2024-05-24T01:00:06.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T00:59:00+00:00, map_index=-1, run_start_date=2024-05-24 01:00:04.066470+00:00, run_end_date=2024-05-24 01:00:05.750480+00:00, run_duration=1.68401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:00.945068+00:00, queued_by_job_id=1, pid=9552 2024-05-24T01:00:07.957271941Z [2024-05-24T01:00:07.956+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:00:07.957332726Z 2024-05-24T01:00:07.957343276Z [2024-05-24T01:00:07.956+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:00:07.957663993Z [2024-05-24T01:00:07.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:00:07.957679871Z 2024-05-24T01:00:07.959890799Z [2024-05-24T01:00:07.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:00:07.959980465Z [2024-05-24T01:00:07.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:00:08.029190235Z [2024-05-24T01:00:08.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:08.029285772Z [2024-05-24T01:00:08.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:08.042594427Z [2024-05-24T01:00:08.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1806a94b-be50-43fe-bab9-09098694f3e2 2024-05-24T01:00:08.042685844Z [2024-05-24T01:00:08.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T00:55:00+00:00, map_index=-1, run_start_date=2024-05-24 01:00:06.924505+00:00, run_end_date=2024-05-24 01:00:07.339046+00:00, run_duration=0.414541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:04.952236+00:00, queued_by_job_id=1, pid=9570 2024-05-24T01:00:10.346962690Z [2024-05-24T01:00:10.344+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:00:10.346995773Z 2024-05-24T01:00:10.347010956Z [2024-05-24T01:00:10.346+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:00:10.354427744Z [2024-05-24T01:00:10.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:00:10.354467678Z 2024-05-24T01:00:10.358288895Z [2024-05-24T01:00:10.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:00:10.358311534Z [2024-05-24T01:00:10.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:00:10.545480002Z [2024-05-24T01:00:10.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status queued for try_number 1 2024-05-24T01:00:10.545503626Z [2024-05-24T01:00:10.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:10.565465584Z [2024-05-24T01:00:10.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc5040d3-8ac1-465d-82a2-5931ea79791f 2024-05-24T01:00:10.565705433Z [2024-05-24T01:00:10.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T00:55:00+00:00, map_index=0, run_start_date=2024-05-24 01:00:09.812344+00:00, run_end_date=2024-05-24 01:00:10.258162+00:00, run_duration=0.445818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:07.957913+00:00, queued_by_job_id=1, pid=9578 2024-05-24T01:00:13.720385131Z [2024-05-24T01:00:13.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:00:13.720799525Z [2024-05-24T01:00:13.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 00:55:00+00:00, run_id=scheduled__2024-05-24T00:55:00+00:00, run_start_date=2024-05-24 01:00:00.834695+00:00, run_end_date=2024-05-24 01:00:13.720279+00:00, run_duration=12.885584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 00:55:00+00:00, data_interval_end=2024-05-24 01:00:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:00:13.728087363Z [2024-05-24T01:00:13.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:00:00+00:00, run_after=2024-05-24T01:05:00+00:00 2024-05-24T01:00:13.787286403Z [2024-05-24T01:00:13.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T00:55:00+00:00 exited with status success for try_number 1 2024-05-24T01:00:13.796462522Z [2024-05-24T01:00:13.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T00:55:00+00:00, map_index=-1, run_start_date=2024-05-24 01:00:12.367466+00:00, run_end_date=2024-05-24 01:00:12.784379+00:00, run_duration=0.416913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:00:10.352710+00:00, queued_by_job_id=1, pid=9586 2024-05-24T01:01:00.804792631Z [2024-05-24T01:01:00.804+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:01:00.834232807Z [2024-05-24T01:01:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:01:00+00:00, run_after=2024-05-24T01:02:00+00:00 2024-05-24T01:01:00.853035063Z [2024-05-24T01:01:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:01:00+00:00, run_after=2024-05-24T01:02:00+00:00 2024-05-24T01:01:00.981767097Z [2024-05-24T01:01:00.981+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:01:00.981817239Z 2024-05-24T01:01:00.981824600Z 2024-05-24T01:01:00.981830879Z 2024-05-24T01:01:00.981846513Z [2024-05-24T01:01:00.981+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:01:00.981926184Z [2024-05-24T01:01:00.981+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:01:00.981976978Z [2024-05-24T01:01:00.981+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:01:00.982670098Z [2024-05-24T01:01:00.982+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:01:00.982682607Z 2024-05-24T01:01:00.982688301Z 2024-05-24T01:01:00.982694884Z 2024-05-24T01:01:00.985867235Z [2024-05-24T01:01:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:01:00.985941620Z [2024-05-24T01:01:00.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:01:00.986155552Z [2024-05-24T01:01:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:01:00.986208925Z [2024-05-24T01:01:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:01:00.986376677Z [2024-05-24T01:01:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:01:00.986451520Z [2024-05-24T01:01:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:01:01.410640043Z [2024-05-24T01:01:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:01:01.410829713Z [2024-05-24T01:01:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:01:01.410893535Z [2024-05-24T01:01:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:01:01.418647052Z [2024-05-24T01:01:01.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56cdbfc7-20ca-4f4a-982c-23e9bdc22138 2024-05-24T01:01:01.418720922Z [2024-05-24T01:01:01.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15389115-fa26-4315-a8b3-b7d6d981964d 2024-05-24T01:01:01.418825494Z [2024-05-24T01:01:01.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to d499ee16-462c-4e51-b6ef-ccecfd084171 2024-05-24T01:01:02.570005525Z [2024-05-24T01:01:02.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:01:02.571230259Z [2024-05-24T01:01:02.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:00:00+00:00, run_id=scheduled__2024-05-24T01:00:00+00:00, run_start_date=2024-05-24 01:01:00.875975+00:00, run_end_date=2024-05-24 01:01:02.570733+00:00, run_duration=1.694758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:00:00+00:00, data_interval_end=2024-05-24 01:01:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:01:02.581266783Z [2024-05-24T01:01:02.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:01:00+00:00, run_after=2024-05-24T01:02:00+00:00 2024-05-24T01:01:02.629262964Z [2024-05-24T01:01:02.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:01:02.635100383Z [2024-05-24T01:01:02.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=-1, run_start_date=2024-05-24 01:01:01.770028+00:00, run_end_date=2024-05-24 01:01:02.287217+00:00, run_duration=0.517189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:01:00.983355+00:00, queued_by_job_id=1, pid=9607 2024-05-24T01:01:05.261582672Z [2024-05-24T01:01:05.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:01:05.261853172Z [2024-05-24T01:01:05.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:00:00+00:00, run_id=scheduled__2024-05-24T01:00:00+00:00, run_start_date=2024-05-24 01:01:00.878315+00:00, run_end_date=2024-05-24 01:01:05.261363+00:00, run_duration=4.383048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:00:00+00:00, data_interval_end=2024-05-24 01:01:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:01:05.272442064Z [2024-05-24T01:01:05.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:01:00+00:00, run_after=2024-05-24T01:02:00+00:00 2024-05-24T01:01:05.327154548Z [2024-05-24T01:01:05.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:01:05.332839333Z [2024-05-24T01:01:05.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=-1, run_start_date=2024-05-24 01:01:03.048513+00:00, run_end_date=2024-05-24 01:01:04.770209+00:00, run_duration=1.721696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:01:00.983355+00:00, queued_by_job_id=1, pid=9625 2024-05-24T01:01:06.399933868Z [2024-05-24T01:01:06.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:01:06.400365822Z [2024-05-24T01:01:06.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:00:00+00:00, run_id=scheduled__2024-05-24T01:00:00+00:00, run_start_date=2024-05-24 01:01:00.880484+00:00, run_end_date=2024-05-24 01:01:06.399884+00:00, run_duration=5.5194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:00:00+00:00, data_interval_end=2024-05-24 01:01:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:01:06.418128106Z [2024-05-24T01:01:06.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:01:00+00:00, run_after=2024-05-24T01:02:00+00:00 2024-05-24T01:01:06.485877340Z [2024-05-24T01:01:06.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:01:06.492988297Z [2024-05-24T01:01:06.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=-1, run_start_date=2024-05-24 01:01:03.165211+00:00, run_end_date=2024-05-24 01:01:05.455309+00:00, run_duration=2.290098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:01:00.983355+00:00, queued_by_job_id=1, pid=9626 2024-05-24T01:01:41.028705072Z [2024-05-24T01:01:41.027+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:02:00.968894501Z [2024-05-24T01:02:00.968+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:02:00.985215242Z [2024-05-24T01:02:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:02:00+00:00, run_after=2024-05-24T01:03:00+00:00 2024-05-24T01:02:01.002720325Z [2024-05-24T01:02:00.999+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:02:01.015325143Z [2024-05-24T01:02:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:02:00+00:00, run_after=2024-05-24T01:03:00+00:00 2024-05-24T01:02:01.161971050Z [2024-05-24T01:02:01.161+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:02:01.162009190Z 2024-05-24T01:02:01.162015219Z 2024-05-24T01:02:01.162020703Z 2024-05-24T01:02:01.162025382Z 2024-05-24T01:02:01.162461781Z [2024-05-24T01:02:01.162+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:02:01.162960465Z [2024-05-24T01:02:01.162+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:02:01.163387475Z [2024-05-24T01:02:01.163+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:02:01.163814287Z [2024-05-24T01:02:01.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:02:01.165867348Z [2024-05-24T01:02:01.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:02:01.165882503Z 2024-05-24T01:02:01.165887871Z 2024-05-24T01:02:01.165892616Z 2024-05-24T01:02:01.165897104Z 2024-05-24T01:02:01.173076209Z [2024-05-24T01:02:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:02:01.174216574Z [2024-05-24T01:02:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:02:01.176197397Z [2024-05-24T01:02:01.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:02:01.176537332Z [2024-05-24T01:02:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:02:01.177099281Z [2024-05-24T01:02:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:02:01.177392250Z [2024-05-24T01:02:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:02:01.177862163Z [2024-05-24T01:02:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:02:01.178260657Z [2024-05-24T01:02:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:02:01.665820021Z [2024-05-24T01:02:01.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:02:01.665943922Z [2024-05-24T01:02:01.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:01:00+00:00 exited with status queued for try_number 1 2024-05-24T01:02:01.666153306Z [2024-05-24T01:02:01.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:01:00+00:00 exited with status queued for try_number 1 2024-05-24T01:02:01.666329936Z [2024-05-24T01:02:01.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:01:00+00:00 exited with status queued for try_number 1 2024-05-24T01:02:01.675742553Z [2024-05-24T01:02:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7342158-79fa-4b38-bbb6-6736bba25566 2024-05-24T01:02:01.676058069Z [2024-05-24T01:02:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6862d002-aa48-4b59-bfdc-4f5b50d9acbb 2024-05-24T01:02:01.676333822Z [2024-05-24T01:02:01.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to a70c7938-8907-4ae7-8f65-55a9dd648593 2024-05-24T01:02:01.676538730Z [2024-05-24T01:02:01.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e2de8c0-74c0-4ec7-b55e-ef00b0364e14 2024-05-24T01:02:02.903974745Z [2024-05-24T01:02:02.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:02:02.906354154Z [2024-05-24T01:02:02.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:00:00+00:00, run_id=scheduled__2024-05-24T01:00:00+00:00, run_start_date=2024-05-24 01:02:01.035568+00:00, run_end_date=2024-05-24 01:02:02.905875+00:00, run_duration=1.870307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:00:00+00:00, data_interval_end=2024-05-24 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:02:02.915167475Z [2024-05-24T01:02:02.914+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:02:00+00:00, run_after=2024-05-24T01:04:00+00:00 2024-05-24T01:02:02.982288689Z [2024-05-24T01:02:02.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:02:02.990257086Z [2024-05-24T01:02:02.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=-1, run_start_date=2024-05-24 01:02:02.123477+00:00, run_end_date=2024-05-24 01:02:02.617090+00:00, run_duration=0.493613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:02:01.167645+00:00, queued_by_job_id=1, pid=9659 2024-05-24T01:02:03.640034901Z [2024-05-24T01:02:03.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:02:03.640602169Z [2024-05-24T01:02:03.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:01:00+00:00, run_id=scheduled__2024-05-24T01:01:00+00:00, run_start_date=2024-05-24 01:02:01.038905+00:00, run_end_date=2024-05-24 01:02:03.640065+00:00, run_duration=2.60116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:01:00+00:00, data_interval_end=2024-05-24 01:02:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:02:03.651226184Z [2024-05-24T01:02:03.650+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:02:00+00:00, run_after=2024-05-24T01:03:00+00:00 2024-05-24T01:02:03.726636307Z [2024-05-24T01:02:03.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:01:00+00:00 exited with status success for try_number 1 2024-05-24T01:02:03.732028287Z [2024-05-24T01:02:03.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:01:00+00:00, map_index=-1, run_start_date=2024-05-24 01:02:02.285471+00:00, run_end_date=2024-05-24 01:02:03.006812+00:00, run_duration=0.721341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:02:01.167645+00:00, queued_by_job_id=1, pid=9660 2024-05-24T01:02:06.201574631Z [2024-05-24T01:02:06.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:02:06.202257508Z [2024-05-24T01:02:06.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:01:00+00:00, run_id=scheduled__2024-05-24T01:01:00+00:00, run_start_date=2024-05-24 01:02:01.041505+00:00, run_end_date=2024-05-24 01:02:06.201447+00:00, run_duration=5.159942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:01:00+00:00, data_interval_end=2024-05-24 01:02:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:02:06.225591285Z [2024-05-24T01:02:06.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:02:00+00:00, run_after=2024-05-24T01:03:00+00:00 2024-05-24T01:02:06.239338992Z [2024-05-24T01:02:06.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:02:06.239775025Z [2024-05-24T01:02:06.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:01:00+00:00, run_id=scheduled__2024-05-24T01:01:00+00:00, run_start_date=2024-05-24 01:02:01.045418+00:00, run_end_date=2024-05-24 01:02:06.239148+00:00, run_duration=5.19373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:01:00+00:00, data_interval_end=2024-05-24 01:02:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:02:06.257111497Z [2024-05-24T01:02:06.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:02:00+00:00, run_after=2024-05-24T01:03:00+00:00 2024-05-24T01:02:06.302645315Z [2024-05-24T01:02:06.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:01:00+00:00 exited with status success for try_number 1 2024-05-24T01:02:06.302956520Z [2024-05-24T01:02:06.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:01:00+00:00 exited with status success for try_number 1 2024-05-24T01:02:06.312195151Z [2024-05-24T01:02:06.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:01:00+00:00, map_index=-1, run_start_date=2024-05-24 01:02:03.580391+00:00, run_end_date=2024-05-24 01:02:05.748837+00:00, run_duration=2.168446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:02:01.167645+00:00, queued_by_job_id=1, pid=9684 2024-05-24T01:02:06.312550997Z [2024-05-24T01:02:06.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:01:00+00:00, map_index=-1, run_start_date=2024-05-24 01:02:03.568635+00:00, run_end_date=2024-05-24 01:02:05.131852+00:00, run_duration=1.563217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:02:01.167645+00:00, queued_by_job_id=1, pid=9683 2024-05-24T01:03:00.989537308Z [2024-05-24T01:03:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:03:00+00:00, run_after=2024-05-24T01:04:00+00:00 2024-05-24T01:03:00.998990766Z [2024-05-24T01:03:00.996+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:03:01.008356424Z [2024-05-24T01:03:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:03:00+00:00, run_after=2024-05-24T01:04:00+00:00 2024-05-24T01:03:01.087540945Z [2024-05-24T01:03:01.086+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:03:01.087698055Z 2024-05-24T01:03:01.087715392Z 2024-05-24T01:03:01.087731842Z 2024-05-24T01:03:01.087744106Z [2024-05-24T01:03:01.087+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:03:01.087816656Z [2024-05-24T01:03:01.087+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:03:01.087832409Z [2024-05-24T01:03:01.087+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:03:01.088372329Z [2024-05-24T01:03:01.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:03:01.088423408Z 2024-05-24T01:03:01.088452214Z 2024-05-24T01:03:01.088458700Z 2024-05-24T01:03:01.093204583Z [2024-05-24T01:03:01.092+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:03:01.093262643Z [2024-05-24T01:03:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:03:01.093576676Z [2024-05-24T01:03:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:03:01.093641616Z [2024-05-24T01:03:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:03:01.093895711Z [2024-05-24T01:03:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:03:01.093996197Z [2024-05-24T01:03:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:03:01.406486378Z [2024-05-24T01:03:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status queued for try_number 1 2024-05-24T01:03:01.406656286Z [2024-05-24T01:03:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status queued for try_number 1 2024-05-24T01:03:01.406678161Z [2024-05-24T01:03:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status queued for try_number 1 2024-05-24T01:03:01.417991392Z [2024-05-24T01:03:01.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bd928c4-203b-42f9-89a7-7cac2c21a530 2024-05-24T01:03:01.418029980Z [2024-05-24T01:03:01.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to dac1a7e6-4aab-467d-ae16-3a18a5ccd587 2024-05-24T01:03:01.418112211Z [2024-05-24T01:03:01.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e31b1e5-a45e-43d9-ab91-f6ae986be140 2024-05-24T01:03:02.557679567Z [2024-05-24T01:03:02.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:03:02.557923793Z [2024-05-24T01:03:02.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:02:00+00:00, run_id=scheduled__2024-05-24T01:02:00+00:00, run_start_date=2024-05-24 01:03:01.018932+00:00, run_end_date=2024-05-24 01:03:02.557604+00:00, run_duration=1.538672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:02:00+00:00, data_interval_end=2024-05-24 01:03:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:03:02.568707445Z [2024-05-24T01:03:02.568+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:03:00+00:00, run_after=2024-05-24T01:04:00+00:00 2024-05-24T01:03:02.646669392Z [2024-05-24T01:03:02.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status success for try_number 1 2024-05-24T01:03:02.657434983Z [2024-05-24T01:03:02.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:02:00+00:00, map_index=-1, run_start_date=2024-05-24 01:03:01.983058+00:00, run_end_date=2024-05-24 01:03:02.375272+00:00, run_duration=0.392214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:03:01.089229+00:00, queued_by_job_id=1, pid=9716 2024-05-24T01:03:06.163966372Z [2024-05-24T01:03:06.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:03:06.164434541Z [2024-05-24T01:03:06.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:02:00+00:00, run_id=scheduled__2024-05-24T01:02:00+00:00, run_start_date=2024-05-24 01:03:01.020390+00:00, run_end_date=2024-05-24 01:03:06.163879+00:00, run_duration=5.143489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:02:00+00:00, data_interval_end=2024-05-24 01:03:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:03:06.174353353Z [2024-05-24T01:03:06.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:03:00+00:00, run_after=2024-05-24T01:04:00+00:00 2024-05-24T01:03:06.182059842Z [2024-05-24T01:03:06.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:03:06.182433782Z [2024-05-24T01:03:06.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:02:00+00:00, run_id=scheduled__2024-05-24T01:02:00+00:00, run_start_date=2024-05-24 01:03:01.021496+00:00, run_end_date=2024-05-24 01:03:06.182149+00:00, run_duration=5.160653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:02:00+00:00, data_interval_end=2024-05-24 01:03:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:03:06.193108934Z [2024-05-24T01:03:06.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:03:00+00:00, run_after=2024-05-24T01:04:00+00:00 2024-05-24T01:03:06.229176225Z [2024-05-24T01:03:06.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status success for try_number 1 2024-05-24T01:03:06.229254938Z [2024-05-24T01:03:06.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status success for try_number 1 2024-05-24T01:03:06.236927075Z [2024-05-24T01:03:06.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:02:00+00:00, map_index=-1, run_start_date=2024-05-24 01:03:02.977426+00:00, run_end_date=2024-05-24 01:03:05.397407+00:00, run_duration=2.419981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:03:01.089229+00:00, queued_by_job_id=1, pid=9734 2024-05-24T01:03:06.237178499Z [2024-05-24T01:03:06.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:02:00+00:00, map_index=-1, run_start_date=2024-05-24 01:03:02.973267+00:00, run_end_date=2024-05-24 01:03:06.044713+00:00, run_duration=3.071446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:03:01.089229+00:00, queued_by_job_id=1, pid=9735 2024-05-24T01:04:00.501913094Z [2024-05-24T01:04:00.501+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:04:00.515981329Z [2024-05-24T01:04:00.515+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:04:00+00:00, run_after=2024-05-24T01:05:00+00:00 2024-05-24T01:04:00.529509196Z [2024-05-24T01:04:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:04:00+00:00, run_after=2024-05-24T01:05:00+00:00 2024-05-24T01:04:00.547480642Z [2024-05-24T01:04:00.545+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:04:00.650186098Z [2024-05-24T01:04:00.649+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:04:00.650218441Z 2024-05-24T01:04:00.650224251Z 2024-05-24T01:04:00.650229312Z 2024-05-24T01:04:00.650234392Z 2024-05-24T01:04:00.650541322Z [2024-05-24T01:04:00.650+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:04:00.650843300Z [2024-05-24T01:04:00.650+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:04:00.651140218Z [2024-05-24T01:04:00.650+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:04:00.651414141Z [2024-05-24T01:04:00.651+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:04:00.652515182Z [2024-05-24T01:04:00.652+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:04:00.652521623Z 2024-05-24T01:04:00.652524833Z 2024-05-24T01:04:00.652528002Z 2024-05-24T01:04:00.652531545Z 2024-05-24T01:04:00.658711472Z [2024-05-24T01:04:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:04:00.659065119Z [2024-05-24T01:04:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:04:00.660182119Z [2024-05-24T01:04:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:04:00.660557652Z [2024-05-24T01:04:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:04:00.661545225Z [2024-05-24T01:04:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:04:00.661849076Z [2024-05-24T01:04:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:04:00.662227351Z [2024-05-24T01:04:00.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:04:00.662458992Z [2024-05-24T01:04:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:04:01.147924442Z [2024-05-24T01:04:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status queued for try_number 1 2024-05-24T01:04:01.148111650Z [2024-05-24T01:04:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:03:00+00:00 exited with status queued for try_number 1 2024-05-24T01:04:01.148262000Z [2024-05-24T01:04:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:03:00+00:00 exited with status queued for try_number 1 2024-05-24T01:04:01.148395167Z [2024-05-24T01:04:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:03:00+00:00 exited with status queued for try_number 1 2024-05-24T01:04:01.158983567Z [2024-05-24T01:04:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8937d27d-4f47-4c5b-aa5c-fc9b72e34d1f 2024-05-24T01:04:01.159122157Z [2024-05-24T01:04:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6716b666-b969-47a1-b0d3-a7b2201e5fc9 2024-05-24T01:04:01.159271391Z [2024-05-24T01:04:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d42cc23-0a6c-4fd0-a020-60a92dec36a0 2024-05-24T01:04:01.159409766Z [2024-05-24T01:04:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35dd7516-7a26-4994-b8c0-36859099b6e9 2024-05-24T01:04:02.366600180Z [2024-05-24T01:04:02.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:04:02.366940347Z [2024-05-24T01:04:02.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:02:00+00:00, run_id=scheduled__2024-05-24T01:02:00+00:00, run_start_date=2024-05-24 01:04:00.563782+00:00, run_end_date=2024-05-24 01:04:02.366588+00:00, run_duration=1.802806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:02:00+00:00, data_interval_end=2024-05-24 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:04:02.384669705Z [2024-05-24T01:04:02.384+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:04:00+00:00, run_after=2024-05-24T01:06:00+00:00 2024-05-24T01:04:02.413235059Z [2024-05-24T01:04:02.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:04:02.417736629Z [2024-05-24T01:04:02.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:03:00+00:00, run_id=scheduled__2024-05-24T01:03:00+00:00, run_start_date=2024-05-24 01:04:00.565561+00:00, run_end_date=2024-05-24 01:04:02.417263+00:00, run_duration=1.851702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:03:00+00:00, data_interval_end=2024-05-24 01:04:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:04:02.445177043Z [2024-05-24T01:04:02.444+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:04:00+00:00, run_after=2024-05-24T01:05:00+00:00 2024-05-24T01:04:02.551387013Z [2024-05-24T01:04:02.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:02:00+00:00 exited with status success for try_number 1 2024-05-24T01:04:02.569070630Z [2024-05-24T01:04:02.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:02:00+00:00, map_index=-1, run_start_date=2024-05-24 01:04:01.435406+00:00, run_end_date=2024-05-24 01:04:02.048874+00:00, run_duration=0.613468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:04:00.654111+00:00, queued_by_job_id=1, pid=9764 2024-05-24T01:04:03.721298602Z [2024-05-24T01:04:03.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:03:00+00:00 exited with status success for try_number 1 2024-05-24T01:04:03.721331837Z [2024-05-24T01:04:03.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:03:00+00:00, map_index=-1, run_start_date=2024-05-24 01:04:01.735802+00:00, run_end_date=2024-05-24 01:04:02.331765+00:00, run_duration=0.595963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:04:00.654111+00:00, queued_by_job_id=1, pid=9769 2024-05-24T01:04:04.715890952Z [2024-05-24T01:04:04.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:04:04.716050898Z [2024-05-24T01:04:04.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:03:00+00:00, run_id=scheduled__2024-05-24T01:03:00+00:00, run_start_date=2024-05-24 01:04:00.566663+00:00, run_end_date=2024-05-24 01:04:04.715730+00:00, run_duration=4.149067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:03:00+00:00, data_interval_end=2024-05-24 01:04:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:04:04.726945306Z [2024-05-24T01:04:04.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:04:00+00:00, run_after=2024-05-24T01:05:00+00:00 2024-05-24T01:04:04.787255655Z [2024-05-24T01:04:04.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:03:00+00:00 exited with status success for try_number 1 2024-05-24T01:04:04.797033733Z [2024-05-24T01:04:04.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:03:00+00:00, map_index=-1, run_start_date=2024-05-24 01:04:03.006584+00:00, run_end_date=2024-05-24 01:04:04.259986+00:00, run_duration=1.253402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:04:00.654111+00:00, queued_by_job_id=1, pid=9792 2024-05-24T01:04:05.876361968Z [2024-05-24T01:04:05.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:04:05.876651373Z [2024-05-24T01:04:05.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:03:00+00:00, run_id=scheduled__2024-05-24T01:03:00+00:00, run_start_date=2024-05-24 01:04:00.569778+00:00, run_end_date=2024-05-24 01:04:05.876109+00:00, run_duration=5.306331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:03:00+00:00, data_interval_end=2024-05-24 01:04:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:04:05.889869724Z [2024-05-24T01:04:05.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:04:00+00:00, run_after=2024-05-24T01:05:00+00:00 2024-05-24T01:04:05.959013187Z [2024-05-24T01:04:05.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:03:00+00:00 exited with status success for try_number 1 2024-05-24T01:04:05.967285908Z [2024-05-24T01:04:05.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:03:00+00:00, map_index=-1, run_start_date=2024-05-24 01:04:03.085010+00:00, run_end_date=2024-05-24 01:04:04.915167+00:00, run_duration=1.830157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:04:00.654111+00:00, queued_by_job_id=1, pid=9793 2024-05-24T01:05:00.871130661Z [2024-05-24T01:05:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:05:00+00:00, run_after=2024-05-24T01:06:00+00:00 2024-05-24T01:05:00.884616426Z [2024-05-24T01:05:00.883+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:05:00.906802130Z [2024-05-24T01:05:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:05:00+00:00, run_after=2024-05-24T01:06:00+00:00 2024-05-24T01:05:00.926663333Z [2024-05-24T01:05:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:05:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:05:01.030355242Z [2024-05-24T01:05:01.029+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:05:01.030403705Z 2024-05-24T01:05:01.030414389Z 2024-05-24T01:05:01.030423699Z 2024-05-24T01:05:01.030463553Z 2024-05-24T01:05:01.030722453Z [2024-05-24T01:05:01.030+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:05:01.030946112Z [2024-05-24T01:05:01.030+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:05:01.031121935Z [2024-05-24T01:05:01.030+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:05:01.031143756Z [2024-05-24T01:05:01.030+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:05:01.031972404Z [2024-05-24T01:05:01.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:05:01.031990723Z 2024-05-24T01:05:01.032000122Z 2024-05-24T01:05:01.032009221Z 2024-05-24T01:05:01.032017900Z 2024-05-24T01:05:01.040272472Z [2024-05-24T01:05:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:05:01.040309150Z [2024-05-24T01:05:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:05:01.040318193Z [2024-05-24T01:05:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:05:01.040326530Z [2024-05-24T01:05:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:05:01.040344301Z [2024-05-24T01:05:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:05:01.040352894Z [2024-05-24T01:05:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:05:01.040361029Z [2024-05-24T01:05:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:05:01.040400270Z [2024-05-24T01:05:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:05:01.521532464Z [2024-05-24T01:05:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:05:01.521949130Z [2024-05-24T01:05:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status queued for try_number 1 2024-05-24T01:05:01.522199508Z [2024-05-24T01:05:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status queued for try_number 1 2024-05-24T01:05:01.522406628Z [2024-05-24T01:05:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status queued for try_number 1 2024-05-24T01:05:01.543997918Z [2024-05-24T01:05:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to afa41d00-3189-4ce6-a9bb-2f496b7535af 2024-05-24T01:05:01.546945594Z [2024-05-24T01:05:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to d436b442-b200-491e-a4ae-d2124a10bb31 2024-05-24T01:05:01.547322722Z [2024-05-24T01:05:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9c09429-e643-432b-894f-9896e31b8a64 2024-05-24T01:05:01.547558555Z [2024-05-24T01:05:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ec31861-8cee-4ae2-b055-1c2e9bf7e200 2024-05-24T01:05:03.342894584Z [2024-05-24T01:05:03.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:05:03.343503528Z [2024-05-24T01:05:03.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:04:00+00:00, run_id=scheduled__2024-05-24T01:04:00+00:00, run_start_date=2024-05-24 01:05:00.937310+00:00, run_end_date=2024-05-24 01:05:03.343043+00:00, run_duration=2.405733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:04:00+00:00, data_interval_end=2024-05-24 01:05:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:05:03.354474787Z [2024-05-24T01:05:03.353+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:05:00+00:00, run_after=2024-05-24T01:06:00+00:00 2024-05-24T01:05:03.401073621Z [2024-05-24T01:05:03.400+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:05:03.401096863Z 2024-05-24T01:05:03.401247293Z [2024-05-24T01:05:03.400+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:05:03.401787291Z [2024-05-24T01:05:03.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:05:03.401799145Z 2024-05-24T01:05:03.404386447Z [2024-05-24T01:05:03.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:05:03.404593636Z [2024-05-24T01:05:03.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:05:03.474132065Z [2024-05-24T01:05:03.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:05:03.474292546Z [2024-05-24T01:05:03.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status success for try_number 1 2024-05-24T01:05:03.482343056Z [2024-05-24T01:05:03.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:04:00+00:00, map_index=-1, run_start_date=2024-05-24 01:05:01.867518+00:00, run_end_date=2024-05-24 01:05:02.324440+00:00, run_duration=0.456922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:05:01.033182+00:00, queued_by_job_id=1, pid=9826 2024-05-24T01:05:03.482653116Z [2024-05-24T01:05:03.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74ac7d31-7760-4b72-a1c0-8af4cff5dbbd 2024-05-24T01:05:03.570592518Z [2024-05-24T01:05:03.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:05:03.576451052Z [2024-05-24T01:05:03.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=-1, run_start_date=2024-05-24 01:05:02.904069+00:00, run_end_date=2024-05-24 01:05:03.332117+00:00, run_duration=0.428048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:05:01.033182+00:00, queued_by_job_id=1, pid=9850 2024-05-24T01:05:04.639500088Z [2024-05-24T01:05:04.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:05:04.639622534Z [2024-05-24T01:05:04.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:04:00+00:00, run_id=scheduled__2024-05-24T01:04:00+00:00, run_start_date=2024-05-24 01:05:00.938300+00:00, run_end_date=2024-05-24 01:05:04.639405+00:00, run_duration=3.701105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:04:00+00:00, data_interval_end=2024-05-24 01:05:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:05:04.649602681Z [2024-05-24T01:05:04.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:05:00+00:00, run_after=2024-05-24T01:06:00+00:00 2024-05-24T01:05:04.727915679Z [2024-05-24T01:05:04.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status success for try_number 1 2024-05-24T01:05:04.734045419Z [2024-05-24T01:05:04.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:04:00+00:00, map_index=-1, run_start_date=2024-05-24 01:05:02.985033+00:00, run_end_date=2024-05-24 01:05:04.347829+00:00, run_duration=1.362796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:05:01.033182+00:00, queued_by_job_id=1, pid=9851 2024-05-24T01:05:05.222126206Z [2024-05-24T01:05:05.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:05:05.222593481Z [2024-05-24T01:05:05.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:04:00+00:00, run_id=scheduled__2024-05-24T01:04:00+00:00, run_start_date=2024-05-24 01:05:00.939287+00:00, run_end_date=2024-05-24 01:05:05.222223+00:00, run_duration=4.282936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:04:00+00:00, data_interval_end=2024-05-24 01:05:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:05:05.230822102Z [2024-05-24T01:05:05.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:05:00+00:00, run_after=2024-05-24T01:06:00+00:00 2024-05-24T01:05:05.284463656Z [2024-05-24T01:05:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status success for try_number 1 2024-05-24T01:05:05.291401985Z [2024-05-24T01:05:05.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:04:00+00:00, map_index=-1, run_start_date=2024-05-24 01:05:03.104089+00:00, run_end_date=2024-05-24 01:05:04.694235+00:00, run_duration=1.590146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:05:01.033182+00:00, queued_by_job_id=1, pid=9852 2024-05-24T01:05:06.365694426Z [2024-05-24T01:05:06.365+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:05:06.365766390Z 2024-05-24T01:05:06.365771872Z [2024-05-24T01:05:06.365+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:05:06.367581419Z [2024-05-24T01:05:06.367+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:05:06.367601730Z 2024-05-24T01:05:06.370026832Z [2024-05-24T01:05:06.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:05:06.370170692Z [2024-05-24T01:05:06.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:05:06.459341644Z [2024-05-24T01:05:06.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:05:06.459737836Z [2024-05-24T01:05:06.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:05:06.468371137Z [2024-05-24T01:05:06.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4527df8f-6e3b-4dce-8b11-a1e3a90e1d30 2024-05-24T01:05:06.468738280Z [2024-05-24T01:05:06.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=-1, run_start_date=2024-05-24 01:05:05.153069+00:00, run_end_date=2024-05-24 01:05:05.514128+00:00, run_duration=0.361059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:05:03.402118+00:00, queued_by_job_id=1, pid=9875 2024-05-24T01:05:09.577366733Z [2024-05-24T01:05:09.576+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:05:09.577397029Z 2024-05-24T01:05:09.577622812Z [2024-05-24T01:05:09.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:05:09.578679108Z [2024-05-24T01:05:09.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:05:09.578694013Z 2024-05-24T01:05:09.580831695Z [2024-05-24T01:05:09.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:05:09.581094867Z [2024-05-24T01:05:09.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:05:09.653924184Z [2024-05-24T01:05:09.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status queued for try_number 1 2024-05-24T01:05:09.654194958Z [2024-05-24T01:05:09.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:05:09.662392120Z [2024-05-24T01:05:09.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce63c907-3e76-4b50-a472-b1f43fd5e34d 2024-05-24T01:05:09.662813970Z [2024-05-24T01:05:09.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=0, run_start_date=2024-05-24 01:05:08.155044+00:00, run_end_date=2024-05-24 01:05:08.493120+00:00, run_duration=0.338076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:05:06.368015+00:00, queued_by_job_id=1, pid=9883 2024-05-24T01:05:11.882624180Z [2024-05-24T01:05:11.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:05:11.882936770Z [2024-05-24T01:05:11.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:00:00+00:00, run_id=scheduled__2024-05-24T01:00:00+00:00, run_start_date=2024-05-24 01:05:00.936094+00:00, run_end_date=2024-05-24 01:05:11.882576+00:00, run_duration=10.946482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:00:00+00:00, data_interval_end=2024-05-24 01:05:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:05:11.890040276Z [2024-05-24T01:05:11.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:05:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:05:11.929346723Z [2024-05-24T01:05:11.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:00:00+00:00 exited with status success for try_number 1 2024-05-24T01:05:11.935621915Z [2024-05-24T01:05:11.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:00:00+00:00, map_index=-1, run_start_date=2024-05-24 01:05:11.333574+00:00, run_end_date=2024-05-24 01:05:11.739663+00:00, run_duration=0.406089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:05:09.579077+00:00, queued_by_job_id=1, pid=9891 2024-05-24T01:06:00.270802130Z [2024-05-24T01:06:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:06:00+00:00, run_after=2024-05-24T01:07:00+00:00 2024-05-24T01:06:00.279946032Z [2024-05-24T01:06:00.279+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:06:00.286286917Z [2024-05-24T01:06:00.285+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:06:00.298715582Z [2024-05-24T01:06:00.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:06:00+00:00, run_after=2024-05-24T01:07:00+00:00 2024-05-24T01:06:00.394657676Z [2024-05-24T01:06:00.390+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:06:00.394696454Z 2024-05-24T01:06:00.394706340Z 2024-05-24T01:06:00.394715192Z 2024-05-24T01:06:00.394723089Z 2024-05-24T01:06:00.394734224Z [2024-05-24T01:06:00.390+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:06:00.394742194Z [2024-05-24T01:06:00.390+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:06:00.394750037Z [2024-05-24T01:06:00.390+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:06:00.394757767Z [2024-05-24T01:06:00.390+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:06:00.394765450Z [2024-05-24T01:06:00.391+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:06:00.394773362Z 2024-05-24T01:06:00.394781322Z 2024-05-24T01:06:00.394788998Z 2024-05-24T01:06:00.394815613Z 2024-05-24T01:06:00.398337578Z [2024-05-24T01:06:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:06:00.398414314Z [2024-05-24T01:06:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:06:00.398705294Z [2024-05-24T01:06:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:06:00.398766711Z [2024-05-24T01:06:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:06:00.399042459Z [2024-05-24T01:06:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:06:00.399190964Z [2024-05-24T01:06:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:06:00.399425959Z [2024-05-24T01:06:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:06:00.399486772Z [2024-05-24T01:06:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:06:00.847747962Z [2024-05-24T01:06:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status queued for try_number 1 2024-05-24T01:06:00.847803459Z [2024-05-24T01:06:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status queued for try_number 1 2024-05-24T01:06:00.847940782Z [2024-05-24T01:06:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status queued for try_number 1 2024-05-24T01:06:00.848109918Z [2024-05-24T01:06:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status queued for try_number 1 2024-05-24T01:06:00.857774512Z [2024-05-24T01:06:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7b30172-e7e1-45d2-91bd-0ca1aa1797ff 2024-05-24T01:06:00.858081189Z [2024-05-24T01:06:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d0ad664-2ffd-4207-8d7c-9c607b171e30 2024-05-24T01:06:00.859124813Z [2024-05-24T01:06:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3d6f231-c818-497b-afe1-9fa243fa6aad 2024-05-24T01:06:00.859779256Z [2024-05-24T01:06:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4011bf61-232a-4eff-9d7e-beb2672a9bb3 2024-05-24T01:06:02.055949927Z [2024-05-24T01:06:02.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:06:02.056100173Z [2024-05-24T01:06:02.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:04:00+00:00, run_id=scheduled__2024-05-24T01:04:00+00:00, run_start_date=2024-05-24 01:06:00.308751+00:00, run_end_date=2024-05-24 01:06:02.055728+00:00, run_duration=1.746977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:04:00+00:00, data_interval_end=2024-05-24 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:06:02.063325162Z [2024-05-24T01:06:02.062+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:06:00+00:00, run_after=2024-05-24T01:08:00+00:00 2024-05-24T01:06:02.069719587Z [2024-05-24T01:06:02.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:06:02.070138545Z [2024-05-24T01:06:02.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:05:00+00:00, run_id=scheduled__2024-05-24T01:05:00+00:00, run_start_date=2024-05-24 01:06:00.309844+00:00, run_end_date=2024-05-24 01:06:02.069563+00:00, run_duration=1.759719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:05:00+00:00, data_interval_end=2024-05-24 01:06:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:06:02.082026577Z [2024-05-24T01:06:02.081+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:06:00+00:00, run_after=2024-05-24T01:07:00+00:00 2024-05-24T01:06:02.151509533Z [2024-05-24T01:06:02.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:04:00+00:00 exited with status success for try_number 1 2024-05-24T01:06:02.159125460Z [2024-05-24T01:06:02.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:04:00+00:00, map_index=-1, run_start_date=2024-05-24 01:06:01.335426+00:00, run_end_date=2024-05-24 01:06:01.839143+00:00, run_duration=0.503717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:06:00.393006+00:00, queued_by_job_id=1, pid=9914 2024-05-24T01:06:03.251881124Z [2024-05-24T01:06:03.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status success for try_number 1 2024-05-24T01:06:03.257967706Z [2024-05-24T01:06:03.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:05:00+00:00, map_index=-1, run_start_date=2024-05-24 01:06:01.468340+00:00, run_end_date=2024-05-24 01:06:02.001353+00:00, run_duration=0.533013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:06:00.393006+00:00, queued_by_job_id=1, pid=9915 2024-05-24T01:06:04.331295467Z [2024-05-24T01:06:04.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:06:04.331359444Z [2024-05-24T01:06:04.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:05:00+00:00, run_id=scheduled__2024-05-24T01:05:00+00:00, run_start_date=2024-05-24 01:06:00.310893+00:00, run_end_date=2024-05-24 01:06:04.330987+00:00, run_duration=4.020094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:05:00+00:00, data_interval_end=2024-05-24 01:06:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:06:04.339361858Z [2024-05-24T01:06:04.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:06:00+00:00, run_after=2024-05-24T01:07:00+00:00 2024-05-24T01:06:04.398945944Z [2024-05-24T01:06:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status success for try_number 1 2024-05-24T01:06:04.403410991Z [2024-05-24T01:06:04.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:05:00+00:00, map_index=-1, run_start_date=2024-05-24 01:06:02.618817+00:00, run_end_date=2024-05-24 01:06:03.981364+00:00, run_duration=1.362547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:06:00.393006+00:00, queued_by_job_id=1, pid=9938 2024-05-24T01:06:05.466178266Z [2024-05-24T01:06:05.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:06:05.466619138Z [2024-05-24T01:06:05.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:05:00+00:00, run_id=scheduled__2024-05-24T01:05:00+00:00, run_start_date=2024-05-24 01:06:00.312044+00:00, run_end_date=2024-05-24 01:06:05.465976+00:00, run_duration=5.153932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:05:00+00:00, data_interval_end=2024-05-24 01:06:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:06:05.476536946Z [2024-05-24T01:06:05.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:06:00+00:00, run_after=2024-05-24T01:07:00+00:00 2024-05-24T01:06:05.518615309Z [2024-05-24T01:06:05.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status success for try_number 1 2024-05-24T01:06:05.529148770Z [2024-05-24T01:06:05.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:05:00+00:00, map_index=-1, run_start_date=2024-05-24 01:06:02.740325+00:00, run_end_date=2024-05-24 01:06:04.647318+00:00, run_duration=1.906993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:06:00.393006+00:00, queued_by_job_id=1, pid=9939 2024-05-24T01:06:41.088908003Z [2024-05-24T01:06:41.088+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:07:00.243707823Z [2024-05-24T01:07:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:07:00+00:00, run_after=2024-05-24T01:08:00+00:00 2024-05-24T01:07:00.253939328Z [2024-05-24T01:07:00.253+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:07:00.280413161Z [2024-05-24T01:07:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:07:00+00:00, run_after=2024-05-24T01:08:00+00:00 2024-05-24T01:07:00.367584895Z [2024-05-24T01:07:00.367+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:07:00.367615713Z 2024-05-24T01:07:00.367619634Z 2024-05-24T01:07:00.367622868Z 2024-05-24T01:07:00.368205610Z [2024-05-24T01:07:00.367+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:07:00.368391380Z [2024-05-24T01:07:00.368+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:07:00.368572395Z [2024-05-24T01:07:00.368+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:07:00.369472463Z [2024-05-24T01:07:00.369+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:07:00.369484789Z 2024-05-24T01:07:00.369490928Z 2024-05-24T01:07:00.369528921Z 2024-05-24T01:07:00.373234287Z [2024-05-24T01:07:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:07:00.373461122Z [2024-05-24T01:07:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:07:00.373767539Z [2024-05-24T01:07:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:07:00.373912305Z [2024-05-24T01:07:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:07:00.374234266Z [2024-05-24T01:07:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:07:00.374330263Z [2024-05-24T01:07:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:07:00.607588670Z [2024-05-24T01:07:00.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status queued for try_number 1 2024-05-24T01:07:00.609368245Z [2024-05-24T01:07:00.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status queued for try_number 1 2024-05-24T01:07:00.609511281Z [2024-05-24T01:07:00.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status queued for try_number 1 2024-05-24T01:07:00.619861527Z [2024-05-24T01:07:00.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ce88c0a-057d-44bb-b150-243891156b82 2024-05-24T01:07:00.620033831Z [2024-05-24T01:07:00.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ea51514-574d-4305-8e27-7ff1f244eda1 2024-05-24T01:07:00.620200898Z [2024-05-24T01:07:00.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43625f34-5287-4fe7-9507-77657755d921 2024-05-24T01:07:01.778424915Z [2024-05-24T01:07:01.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:07:01.778990758Z [2024-05-24T01:07:01.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:06:00+00:00, run_id=scheduled__2024-05-24T01:06:00+00:00, run_start_date=2024-05-24 01:07:00.292561+00:00, run_end_date=2024-05-24 01:07:01.778623+00:00, run_duration=1.486062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:06:00+00:00, data_interval_end=2024-05-24 01:07:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:07:01.793364431Z [2024-05-24T01:07:01.793+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:07:00+00:00, run_after=2024-05-24T01:08:00+00:00 2024-05-24T01:07:01.855160923Z [2024-05-24T01:07:01.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status success for try_number 1 2024-05-24T01:07:01.864904957Z [2024-05-24T01:07:01.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:06:00+00:00, map_index=-1, run_start_date=2024-05-24 01:07:01.185061+00:00, run_end_date=2024-05-24 01:07:01.561574+00:00, run_duration=0.376513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:07:00.370308+00:00, queued_by_job_id=1, pid=9972 2024-05-24T01:07:04.050596629Z [2024-05-24T01:07:04.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:07:04.050964290Z [2024-05-24T01:07:04.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:06:00+00:00, run_id=scheduled__2024-05-24T01:06:00+00:00, run_start_date=2024-05-24 01:07:00.294133+00:00, run_end_date=2024-05-24 01:07:04.050589+00:00, run_duration=3.756456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:06:00+00:00, data_interval_end=2024-05-24 01:07:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:07:04.060043617Z [2024-05-24T01:07:04.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:07:00+00:00, run_after=2024-05-24T01:08:00+00:00 2024-05-24T01:07:04.141879374Z [2024-05-24T01:07:04.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status success for try_number 1 2024-05-24T01:07:04.149334720Z [2024-05-24T01:07:04.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:06:00+00:00, map_index=-1, run_start_date=2024-05-24 01:07:02.029969+00:00, run_end_date=2024-05-24 01:07:03.551100+00:00, run_duration=1.521131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:07:00.370308+00:00, queued_by_job_id=1, pid=9990 2024-05-24T01:07:04.266494322Z [2024-05-24T01:07:04.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:07:04.266634528Z [2024-05-24T01:07:04.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:06:00+00:00, run_id=scheduled__2024-05-24T01:06:00+00:00, run_start_date=2024-05-24 01:07:00.295746+00:00, run_end_date=2024-05-24 01:07:04.265189+00:00, run_duration=3.969443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:06:00+00:00, data_interval_end=2024-05-24 01:07:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:07:04.294756162Z [2024-05-24T01:07:04.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:07:00+00:00, run_after=2024-05-24T01:08:00+00:00 2024-05-24T01:07:04.339238129Z [2024-05-24T01:07:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status success for try_number 1 2024-05-24T01:07:04.344379187Z [2024-05-24T01:07:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:06:00+00:00, map_index=-1, run_start_date=2024-05-24 01:07:02.237544+00:00, run_end_date=2024-05-24 01:07:04.143850+00:00, run_duration=1.906306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:07:00.370308+00:00, queued_by_job_id=1, pid=9991 2024-05-24T01:08:00.177629100Z [2024-05-24T01:08:00.174+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:08:00.187607371Z [2024-05-24T01:08:00.187+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:08:00.210433905Z [2024-05-24T01:08:00.210+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:08:00+00:00, run_after=2024-05-24T01:09:00+00:00 2024-05-24T01:08:00.222856511Z [2024-05-24T01:08:00.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:08:00+00:00, run_after=2024-05-24T01:09:00+00:00 2024-05-24T01:08:00.320984517Z [2024-05-24T01:08:00.320+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:08:00.321069075Z 2024-05-24T01:08:00.321120744Z 2024-05-24T01:08:00.321132476Z 2024-05-24T01:08:00.321141088Z 2024-05-24T01:08:00.321152874Z [2024-05-24T01:08:00.320+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:08:00.321213945Z [2024-05-24T01:08:00.320+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:08:00.321225469Z [2024-05-24T01:08:00.320+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:08:00.321233929Z [2024-05-24T01:08:00.321+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:08:00.321867722Z [2024-05-24T01:08:00.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:08:00.321882087Z 2024-05-24T01:08:00.321891046Z 2024-05-24T01:08:00.321899656Z 2024-05-24T01:08:00.321940862Z 2024-05-24T01:08:00.326997907Z [2024-05-24T01:08:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:08:00.327305639Z [2024-05-24T01:08:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:08:00.327783169Z [2024-05-24T01:08:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:08:00.327904978Z [2024-05-24T01:08:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:08:00.328160446Z [2024-05-24T01:08:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:08:00.328344829Z [2024-05-24T01:08:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:08:00.328791312Z [2024-05-24T01:08:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:08:00.329110969Z [2024-05-24T01:08:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:08:00.840090612Z [2024-05-24T01:08:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status queued for try_number 1 2024-05-24T01:08:00.840360628Z [2024-05-24T01:08:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:07:00+00:00 exited with status queued for try_number 1 2024-05-24T01:08:00.840634778Z [2024-05-24T01:08:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:07:00+00:00 exited with status queued for try_number 1 2024-05-24T01:08:00.840827689Z [2024-05-24T01:08:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:07:00+00:00 exited with status queued for try_number 1 2024-05-24T01:08:00.859790160Z [2024-05-24T01:08:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 226dd9e3-2987-4475-bcc6-f7669faff2c3 2024-05-24T01:08:00.859873384Z [2024-05-24T01:08:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 516a208f-89c1-4c68-b402-6068636f586b 2024-05-24T01:08:00.859960625Z [2024-05-24T01:08:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to caf7c2c7-b9d5-4949-bb13-a0c2cdfdf4c3 2024-05-24T01:08:00.860064565Z [2024-05-24T01:08:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4b7a65f-3e21-4429-82d1-a24f934f5101 2024-05-24T01:08:02.185090816Z [2024-05-24T01:08:02.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:08:02.185725050Z [2024-05-24T01:08:02.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:06:00+00:00, run_id=scheduled__2024-05-24T01:06:00+00:00, run_start_date=2024-05-24 01:08:00.236911+00:00, run_end_date=2024-05-24 01:08:02.184789+00:00, run_duration=1.947878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:06:00+00:00, data_interval_end=2024-05-24 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:08:02.199226543Z [2024-05-24T01:08:02.198+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:08:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:08:02.206923335Z [2024-05-24T01:08:02.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:08:02.207309981Z [2024-05-24T01:08:02.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:07:00+00:00, run_id=scheduled__2024-05-24T01:07:00+00:00, run_start_date=2024-05-24 01:08:00.241364+00:00, run_end_date=2024-05-24 01:08:02.206816+00:00, run_duration=1.965452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:07:00+00:00, data_interval_end=2024-05-24 01:08:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:08:02.216908108Z [2024-05-24T01:08:02.216+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:08:00+00:00, run_after=2024-05-24T01:09:00+00:00 2024-05-24T01:08:02.260751713Z [2024-05-24T01:08:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:06:00+00:00 exited with status success for try_number 1 2024-05-24T01:08:02.261057246Z [2024-05-24T01:08:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:07:00+00:00 exited with status success for try_number 1 2024-05-24T01:08:02.267710855Z [2024-05-24T01:08:02.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:06:00+00:00, map_index=-1, run_start_date=2024-05-24 01:08:01.407010+00:00, run_end_date=2024-05-24 01:08:01.886786+00:00, run_duration=0.479776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:08:00.323131+00:00, queued_by_job_id=1, pid=10027 2024-05-24T01:08:02.268045605Z [2024-05-24T01:08:02.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:07:00+00:00, map_index=-1, run_start_date=2024-05-24 01:08:01.278613+00:00, run_end_date=2024-05-24 01:08:01.763200+00:00, run_duration=0.484587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:08:00.323131+00:00, queued_by_job_id=1, pid=10025 2024-05-24T01:08:04.429534154Z [2024-05-24T01:08:04.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:08:04.430042299Z [2024-05-24T01:08:04.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:07:00+00:00, run_id=scheduled__2024-05-24T01:07:00+00:00, run_start_date=2024-05-24 01:08:00.246345+00:00, run_end_date=2024-05-24 01:08:04.429415+00:00, run_duration=4.18307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:07:00+00:00, data_interval_end=2024-05-24 01:08:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:08:04.448688757Z [2024-05-24T01:08:04.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:08:00+00:00, run_after=2024-05-24T01:09:00+00:00 2024-05-24T01:08:04.459977335Z [2024-05-24T01:08:04.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:08:04.460327967Z [2024-05-24T01:08:04.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:07:00+00:00, run_id=scheduled__2024-05-24T01:07:00+00:00, run_start_date=2024-05-24 01:08:00.245111+00:00, run_end_date=2024-05-24 01:08:04.459949+00:00, run_duration=4.214838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:07:00+00:00, data_interval_end=2024-05-24 01:08:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:08:04.476555225Z [2024-05-24T01:08:04.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:08:00+00:00, run_after=2024-05-24T01:09:00+00:00 2024-05-24T01:08:04.528505319Z [2024-05-24T01:08:04.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:07:00+00:00 exited with status success for try_number 1 2024-05-24T01:08:04.528698110Z [2024-05-24T01:08:04.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:07:00+00:00 exited with status success for try_number 1 2024-05-24T01:08:04.534731936Z [2024-05-24T01:08:04.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:07:00+00:00, map_index=-1, run_start_date=2024-05-24 01:08:02.206285+00:00, run_end_date=2024-05-24 01:08:03.409243+00:00, run_duration=1.202958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:08:00.323131+00:00, queued_by_job_id=1, pid=10049 2024-05-24T01:08:04.534924978Z [2024-05-24T01:08:04.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:07:00+00:00, map_index=-1, run_start_date=2024-05-24 01:08:02.218939+00:00, run_end_date=2024-05-24 01:08:03.856004+00:00, run_duration=1.637065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:08:00.323131+00:00, queued_by_job_id=1, pid=10050 2024-05-24T01:09:00.816583629Z [2024-05-24T01:09:00.816+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:09:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:09:00.825052372Z [2024-05-24T01:09:00.824+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:09:00.835792893Z [2024-05-24T01:09:00.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:09:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:09:00.924107698Z [2024-05-24T01:09:00.923+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:09:00.924135426Z 2024-05-24T01:09:00.924139447Z 2024-05-24T01:09:00.924142734Z 2024-05-24T01:09:00.924535135Z [2024-05-24T01:09:00.924+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:09:00.924889123Z [2024-05-24T01:09:00.924+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:09:00.925185986Z [2024-05-24T01:09:00.924+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:09:00.926259190Z [2024-05-24T01:09:00.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:09:00.926271303Z 2024-05-24T01:09:00.926275030Z 2024-05-24T01:09:00.926278397Z 2024-05-24T01:09:00.931763259Z [2024-05-24T01:09:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:09:00.931792515Z [2024-05-24T01:09:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:09:00.931799825Z [2024-05-24T01:09:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:09:00.931820844Z [2024-05-24T01:09:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:09:00.931827806Z [2024-05-24T01:09:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:09:00.932057378Z [2024-05-24T01:09:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:09:01.290775912Z [2024-05-24T01:09:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status queued for try_number 1 2024-05-24T01:09:01.291070401Z [2024-05-24T01:09:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status queued for try_number 1 2024-05-24T01:09:01.291251367Z [2024-05-24T01:09:01.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status queued for try_number 1 2024-05-24T01:09:01.300814082Z [2024-05-24T01:09:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b643752-7273-4ca2-b2d2-1c3719387fa5 2024-05-24T01:09:01.301068084Z [2024-05-24T01:09:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to b98693af-c0fe-4a83-afbb-c73c1b8e3ba4 2024-05-24T01:09:01.301251657Z [2024-05-24T01:09:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63151b15-4889-4774-b977-73c9f2d6cb11 2024-05-24T01:09:03.055505233Z [2024-05-24T01:09:03.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:09:03.056062926Z [2024-05-24T01:09:03.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:08:00+00:00, run_id=scheduled__2024-05-24T01:08:00+00:00, run_start_date=2024-05-24 01:09:00.845580+00:00, run_end_date=2024-05-24 01:09:03.055680+00:00, run_duration=2.2101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:08:00+00:00, data_interval_end=2024-05-24 01:09:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:09:03.065173664Z [2024-05-24T01:09:03.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:09:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:09:03.108053250Z [2024-05-24T01:09:03.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status success for try_number 1 2024-05-24T01:09:03.114563163Z [2024-05-24T01:09:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:08:00+00:00, map_index=-1, run_start_date=2024-05-24 01:09:01.795220+00:00, run_end_date=2024-05-24 01:09:02.258187+00:00, run_duration=0.462967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:09:00.927298+00:00, queued_by_job_id=1, pid=10082 2024-05-24T01:09:05.313450839Z [2024-05-24T01:09:05.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:09:05.313485152Z [2024-05-24T01:09:05.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:08:00+00:00, run_id=scheduled__2024-05-24T01:08:00+00:00, run_start_date=2024-05-24 01:09:00.846771+00:00, run_end_date=2024-05-24 01:09:05.313104+00:00, run_duration=4.466333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:08:00+00:00, data_interval_end=2024-05-24 01:09:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:09:05.321440351Z [2024-05-24T01:09:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:09:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:09:05.364359297Z [2024-05-24T01:09:05.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status success for try_number 1 2024-05-24T01:09:05.369758596Z [2024-05-24T01:09:05.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:08:00+00:00, map_index=-1, run_start_date=2024-05-24 01:09:02.943297+00:00, run_end_date=2024-05-24 01:09:04.918319+00:00, run_duration=1.975022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:09:00.927298+00:00, queued_by_job_id=1, pid=10101 2024-05-24T01:09:06.451765850Z [2024-05-24T01:09:06.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:09:06.452614994Z [2024-05-24T01:09:06.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:08:00+00:00, run_id=scheduled__2024-05-24T01:08:00+00:00, run_start_date=2024-05-24 01:09:00.847768+00:00, run_end_date=2024-05-24 01:09:06.451866+00:00, run_duration=5.604098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:08:00+00:00, data_interval_end=2024-05-24 01:09:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:09:06.467472606Z [2024-05-24T01:09:06.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:09:00+00:00, run_after=2024-05-24T01:10:00+00:00 2024-05-24T01:09:06.505174109Z [2024-05-24T01:09:06.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status success for try_number 1 2024-05-24T01:09:06.515882047Z [2024-05-24T01:09:06.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:08:00+00:00, map_index=-1, run_start_date=2024-05-24 01:09:02.777746+00:00, run_end_date=2024-05-24 01:09:05.310943+00:00, run_duration=2.533197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:09:00.927298+00:00, queued_by_job_id=1, pid=10100 2024-05-24T01:10:01.071753348Z [2024-05-24T01:10:01.070+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:10:01.096178032Z [2024-05-24T01:10:01.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:15:00+00:00 2024-05-24T01:10:01.130721579Z [2024-05-24T01:10:01.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:11:00+00:00 2024-05-24T01:10:01.149272860Z [2024-05-24T01:10:01.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:11:00+00:00 2024-05-24T01:10:01.158805841Z [2024-05-24T01:10:01.158+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:10:01.287519952Z [2024-05-24T01:10:01.287+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T01:10:01.287556164Z 2024-05-24T01:10:01.287561681Z 2024-05-24T01:10:01.287571001Z 2024-05-24T01:10:01.287576001Z 2024-05-24T01:10:01.287580959Z 2024-05-24T01:10:01.287933579Z [2024-05-24T01:10:01.287+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:10:01.288408952Z [2024-05-24T01:10:01.288+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:10:01.288886502Z [2024-05-24T01:10:01.288+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:10:01.289446705Z [2024-05-24T01:10:01.289+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:10:01.290025904Z [2024-05-24T01:10:01.289+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:10:01.291155733Z [2024-05-24T01:10:01.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:10:01.291173463Z 2024-05-24T01:10:01.291179454Z 2024-05-24T01:10:01.291244420Z 2024-05-24T01:10:01.291251049Z 2024-05-24T01:10:01.291256565Z 2024-05-24T01:10:01.299324828Z [2024-05-24T01:10:01.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:10:01.299731197Z [2024-05-24T01:10:01.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:10:01.300235365Z [2024-05-24T01:10:01.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:10:01.300460176Z [2024-05-24T01:10:01.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:10:01.300862003Z [2024-05-24T01:10:01.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:10:01.301177799Z [2024-05-24T01:10:01.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:10:01.301721192Z [2024-05-24T01:10:01.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:10:01.302015364Z [2024-05-24T01:10:01.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:10:01.302373883Z [2024-05-24T01:10:01.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:10:01.302650222Z [2024-05-24T01:10:01.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:10:01.851247912Z [2024-05-24T01:10:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:01.851339591Z [2024-05-24T01:10:01.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:01.851544560Z [2024-05-24T01:10:01.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:09:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:01.851654183Z [2024-05-24T01:10:01.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:09:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:01.851766611Z [2024-05-24T01:10:01.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:09:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:01.896896131Z [2024-05-24T01:10:01.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad90a615-17d5-4569-935a-128c84da0483 2024-05-24T01:10:01.897256308Z [2024-05-24T01:10:01.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to 779c189a-2138-4a01-850f-25ed1a8cb562 2024-05-24T01:10:01.897434789Z [2024-05-24T01:10:01.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a16a16f-c491-472d-8f9a-cce7aea55ba9 2024-05-24T01:10:01.897597830Z [2024-05-24T01:10:01.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0840bac9-2cfc-40aa-b9e9-8b667094d4ef 2024-05-24T01:10:01.897755364Z [2024-05-24T01:10:01.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 667a8849-3a6e-48c1-a0eb-5fd3671576a2 2024-05-24T01:10:04.184066362Z [2024-05-24T01:10:04.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:10:04.184615545Z [2024-05-24T01:10:04.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:08:00+00:00, run_id=scheduled__2024-05-24T01:08:00+00:00, run_start_date=2024-05-24 01:10:01.172412+00:00, run_end_date=2024-05-24 01:10:04.184244+00:00, run_duration=3.011832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:08:00+00:00, data_interval_end=2024-05-24 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:10:04.191888991Z [2024-05-24T01:10:04.191+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:12:00+00:00 2024-05-24T01:10:04.204162693Z [2024-05-24T01:10:04.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:10:04.204538930Z [2024-05-24T01:10:04.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:09:00+00:00, run_id=scheduled__2024-05-24T01:09:00+00:00, run_start_date=2024-05-24 01:10:01.173607+00:00, run_end_date=2024-05-24 01:10:04.204231+00:00, run_duration=3.030624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:09:00+00:00, data_interval_end=2024-05-24 01:10:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:10:04.215605734Z [2024-05-24T01:10:04.215+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:11:00+00:00 2024-05-24T01:10:04.276041036Z [2024-05-24T01:10:04.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:08:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:04.276066459Z [2024-05-24T01:10:04.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:09:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:04.290977556Z [2024-05-24T01:10:04.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:08:00+00:00, map_index=-1, run_start_date=2024-05-24 01:10:02.571771+00:00, run_end_date=2024-05-24 01:10:03.150048+00:00, run_duration=0.578277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:01.294384+00:00, queued_by_job_id=1, pid=10135 2024-05-24T01:10:04.291345648Z [2024-05-24T01:10:04.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:09:00+00:00, map_index=-1, run_start_date=2024-05-24 01:10:02.610613+00:00, run_end_date=2024-05-24 01:10:03.337535+00:00, run_duration=0.726922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:01.294384+00:00, queued_by_job_id=1, pid=10136 2024-05-24T01:10:05.382827230Z [2024-05-24T01:10:05.382+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:10:05.382856136Z 2024-05-24T01:10:05.383038009Z [2024-05-24T01:10:05.382+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:10:05.383669070Z [2024-05-24T01:10:05.383+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:10:05.383680003Z 2024-05-24T01:10:05.385908403Z [2024-05-24T01:10:05.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:10:05.386143846Z [2024-05-24T01:10:05.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:10:05.459721383Z [2024-05-24T01:10:05.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:05.460608458Z [2024-05-24T01:10:05.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:05.469289636Z [2024-05-24T01:10:05.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3536c94b-321b-43ba-b5da-d0dfa817a8f1 2024-05-24T01:10:05.469547147Z [2024-05-24T01:10:05.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:05:00+00:00, map_index=-1, run_start_date=2024-05-24 01:10:04.219714+00:00, run_end_date=2024-05-24 01:10:04.727045+00:00, run_duration=0.507331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:01.294384+00:00, queued_by_job_id=1, pid=10171 2024-05-24T01:10:05.519361994Z [2024-05-24T01:10:05.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:10:05.519871998Z [2024-05-24T01:10:05.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:09:00+00:00, run_id=scheduled__2024-05-24T01:09:00+00:00, run_start_date=2024-05-24 01:10:01.174742+00:00, run_end_date=2024-05-24 01:10:05.519491+00:00, run_duration=4.344749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:09:00+00:00, data_interval_end=2024-05-24 01:10:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:10:05.530095221Z [2024-05-24T01:10:05.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:11:00+00:00 2024-05-24T01:10:05.587852052Z [2024-05-24T01:10:05.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:09:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:05.599914552Z [2024-05-24T01:10:05.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:09:00+00:00, map_index=-1, run_start_date=2024-05-24 01:10:03.939039+00:00, run_end_date=2024-05-24 01:10:05.365943+00:00, run_duration=1.426904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:01.294384+00:00, queued_by_job_id=1, pid=10161 2024-05-24T01:10:06.681723213Z [2024-05-24T01:10:06.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:10:06.683847232Z [2024-05-24T01:10:06.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:09:00+00:00, run_id=scheduled__2024-05-24T01:09:00+00:00, run_start_date=2024-05-24 01:10:01.175737+00:00, run_end_date=2024-05-24 01:10:06.682257+00:00, run_duration=5.50652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:09:00+00:00, data_interval_end=2024-05-24 01:10:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:10:06.695418896Z [2024-05-24T01:10:06.695+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:11:00+00:00 2024-05-24T01:10:06.763186118Z [2024-05-24T01:10:06.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:09:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:06.768184156Z [2024-05-24T01:10:06.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:09:00+00:00, map_index=-1, run_start_date=2024-05-24 01:10:03.944058+00:00, run_end_date=2024-05-24 01:10:05.883986+00:00, run_duration=1.939928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:01.294384+00:00, queued_by_job_id=1, pid=10160 2024-05-24T01:10:07.632675937Z [2024-05-24T01:10:07.632+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:10:07.632702711Z 2024-05-24T01:10:07.632706666Z [2024-05-24T01:10:07.632+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:10:07.633379438Z [2024-05-24T01:10:07.633+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:10:07.633396648Z 2024-05-24T01:10:07.639867335Z [2024-05-24T01:10:07.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:10:07.640275674Z [2024-05-24T01:10:07.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:10:07.725157356Z [2024-05-24T01:10:07.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:07.732331815Z [2024-05-24T01:10:07.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to a746dfaf-2b59-40f2-bcf4-4b96e20bb0c7 2024-05-24T01:10:07.821850556Z [2024-05-24T01:10:07.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:07.830920669Z [2024-05-24T01:10:07.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:05:00+00:00, map_index=-1, run_start_date=2024-05-24 01:10:07.045159+00:00, run_end_date=2024-05-24 01:10:07.467346+00:00, run_duration=0.422187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:05.384022+00:00, queued_by_job_id=1, pid=10190 2024-05-24T01:10:10.420175617Z [2024-05-24T01:10:10.419+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:10:10.420219299Z 2024-05-24T01:10:10.420718585Z [2024-05-24T01:10:10.420+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:10:10.422006360Z [2024-05-24T01:10:10.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:10:10.422013818Z 2024-05-24T01:10:10.425499028Z [2024-05-24T01:10:10.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:10:10.425719173Z [2024-05-24T01:10:10.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:10:10.475332546Z [2024-05-24T01:10:10.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status queued for try_number 1 2024-05-24T01:10:10.475375682Z [2024-05-24T01:10:10.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:10.485899817Z [2024-05-24T01:10:10.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd4ede0e-c8f4-4170-b1d2-d317fe0de398 2024-05-24T01:10:10.486354574Z [2024-05-24T01:10:10.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:05:00+00:00, map_index=0, run_start_date=2024-05-24 01:10:09.454650+00:00, run_end_date=2024-05-24 01:10:09.832200+00:00, run_duration=0.37755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:07.635818+00:00, queued_by_job_id=1, pid=10198 2024-05-24T01:10:12.717990121Z [2024-05-24T01:10:12.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:10:12.718149474Z [2024-05-24T01:10:12.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:05:00+00:00, run_id=scheduled__2024-05-24T01:05:00+00:00, run_start_date=2024-05-24 01:10:01.170654+00:00, run_end_date=2024-05-24 01:10:12.717871+00:00, run_duration=11.547217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:05:00+00:00, data_interval_end=2024-05-24 01:10:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:10:12.724098806Z [2024-05-24T01:10:12.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:10:00+00:00, run_after=2024-05-24T01:15:00+00:00 2024-05-24T01:10:12.755239793Z [2024-05-24T01:10:12.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:05:00+00:00 exited with status success for try_number 1 2024-05-24T01:10:12.758712787Z [2024-05-24T01:10:12.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:05:00+00:00, map_index=-1, run_start_date=2024-05-24 01:10:12.029368+00:00, run_end_date=2024-05-24 01:10:12.446313+00:00, run_duration=0.416945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:10:10.422787+00:00, queued_by_job_id=1, pid=10206 2024-05-24T01:11:00.288487726Z [2024-05-24T01:11:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:11:00+00:00, run_after=2024-05-24T01:12:00+00:00 2024-05-24T01:11:00.305940718Z [2024-05-24T01:11:00.305+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:11:00+00:00, run_after=2024-05-24T01:12:00+00:00 2024-05-24T01:11:00.312439039Z [2024-05-24T01:11:00.312+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:11:00.389769833Z [2024-05-24T01:11:00.389+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:11:00.389812981Z 2024-05-24T01:11:00.389818141Z 2024-05-24T01:11:00.389822302Z 2024-05-24T01:11:00.389835306Z [2024-05-24T01:11:00.389+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:11:00.389971083Z [2024-05-24T01:11:00.389+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:11:00.390129107Z [2024-05-24T01:11:00.389+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:11:00.391086233Z [2024-05-24T01:11:00.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:11:00.391098400Z 2024-05-24T01:11:00.391102806Z 2024-05-24T01:11:00.391106994Z 2024-05-24T01:11:00.394989402Z [2024-05-24T01:11:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:11:00.395147030Z [2024-05-24T01:11:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:11:00.395389179Z [2024-05-24T01:11:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:11:00.395500068Z [2024-05-24T01:11:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:11:00.395715645Z [2024-05-24T01:11:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:11:00.395796791Z [2024-05-24T01:11:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:11:00.597467407Z [2024-05-24T01:11:00.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:11:00.597494827Z [2024-05-24T01:11:00.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:11:00.597498394Z [2024-05-24T01:11:00.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:11:00.601990036Z [2024-05-24T01:11:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92bec85e-ca89-4e5f-8775-d2df1a9f4f95 2024-05-24T01:11:00.602173458Z [2024-05-24T01:11:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to faa345f7-9127-476f-900d-069252e78157 2024-05-24T01:11:00.602322138Z [2024-05-24T01:11:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8868bc9f-a2a8-4f5e-8cdf-3310074c1fbe 2024-05-24T01:11:01.735817752Z [2024-05-24T01:11:01.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:11:01.736343797Z [2024-05-24T01:11:01.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:10:00+00:00, run_id=scheduled__2024-05-24T01:10:00+00:00, run_start_date=2024-05-24 01:11:00.323670+00:00, run_end_date=2024-05-24 01:11:01.735946+00:00, run_duration=1.412276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:10:00+00:00, data_interval_end=2024-05-24 01:11:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:11:01.746651739Z [2024-05-24T01:11:01.746+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:11:00+00:00, run_after=2024-05-24T01:12:00+00:00 2024-05-24T01:11:01.800180766Z [2024-05-24T01:11:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:11:01.805711803Z [2024-05-24T01:11:01.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:11:01.263689+00:00, run_end_date=2024-05-24 01:11:01.643265+00:00, run_duration=0.379576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:11:00.392273+00:00, queued_by_job_id=1, pid=10228 2024-05-24T01:11:03.950095605Z [2024-05-24T01:11:03.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:11:03.950625429Z [2024-05-24T01:11:03.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:10:00+00:00, run_id=scheduled__2024-05-24T01:10:00+00:00, run_start_date=2024-05-24 01:11:00.324873+00:00, run_end_date=2024-05-24 01:11:03.950219+00:00, run_duration=3.625346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:10:00+00:00, data_interval_end=2024-05-24 01:11:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:11:03.959817240Z [2024-05-24T01:11:03.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:11:00+00:00, run_after=2024-05-24T01:12:00+00:00 2024-05-24T01:11:03.981574436Z [2024-05-24T01:11:03.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:11:03.981992374Z [2024-05-24T01:11:03.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:10:00+00:00, run_id=scheduled__2024-05-24T01:10:00+00:00, run_start_date=2024-05-24 01:11:00.326198+00:00, run_end_date=2024-05-24 01:11:03.981449+00:00, run_duration=3.655251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:10:00+00:00, data_interval_end=2024-05-24 01:11:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:11:03.992019229Z [2024-05-24T01:11:03.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:11:00+00:00, run_after=2024-05-24T01:12:00+00:00 2024-05-24T01:11:04.030589033Z [2024-05-24T01:11:04.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:11:04.030810752Z [2024-05-24T01:11:04.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:11:04.040643822Z [2024-05-24T01:11:04.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:11:02.146623+00:00, run_end_date=2024-05-24 01:11:03.699532+00:00, run_duration=1.552909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:11:00.392273+00:00, queued_by_job_id=1, pid=10247 2024-05-24T01:11:04.040973774Z [2024-05-24T01:11:04.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:11:02.133621+00:00, run_end_date=2024-05-24 01:11:03.389213+00:00, run_duration=1.255592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:11:00.392273+00:00, queued_by_job_id=1, pid=10246 2024-05-24T01:11:41.182261263Z [2024-05-24T01:11:41.181+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:12:00.089903041Z [2024-05-24T01:12:00.089+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:12:00+00:00, run_after=2024-05-24T01:13:00+00:00 2024-05-24T01:12:00.098988832Z [2024-05-24T01:12:00.098+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:12:00.109300730Z [2024-05-24T01:12:00.108+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:12:00.121749262Z [2024-05-24T01:12:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:12:00+00:00, run_after=2024-05-24T01:13:00+00:00 2024-05-24T01:12:00.213369855Z [2024-05-24T01:12:00.212+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:12:00.213405046Z 2024-05-24T01:12:00.213412071Z 2024-05-24T01:12:00.213438748Z 2024-05-24T01:12:00.213444761Z 2024-05-24T01:12:00.214032136Z [2024-05-24T01:12:00.213+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:12:00.214334655Z [2024-05-24T01:12:00.214+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:12:00.214789833Z [2024-05-24T01:12:00.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:12:00.215266716Z [2024-05-24T01:12:00.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:12:00.216413452Z [2024-05-24T01:12:00.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:12:00.216438954Z 2024-05-24T01:12:00.216448375Z 2024-05-24T01:12:00.216456562Z 2024-05-24T01:12:00.216464434Z 2024-05-24T01:12:00.226564305Z [2024-05-24T01:12:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:12:00.226716180Z [2024-05-24T01:12:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:12:00.227057173Z [2024-05-24T01:12:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:12:00.227246703Z [2024-05-24T01:12:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:12:00.227550942Z [2024-05-24T01:12:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:12:00.227729291Z [2024-05-24T01:12:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:12:00.228035717Z [2024-05-24T01:12:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:12:00.228210923Z [2024-05-24T01:12:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:12:01.018120143Z [2024-05-24T01:12:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:12:01.018988206Z [2024-05-24T01:12:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:11:00+00:00 exited with status queued for try_number 1 2024-05-24T01:12:01.019520755Z [2024-05-24T01:12:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:11:00+00:00 exited with status queued for try_number 1 2024-05-24T01:12:01.022737652Z [2024-05-24T01:12:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:11:00+00:00 exited with status queued for try_number 1 2024-05-24T01:12:01.033802404Z [2024-05-24T01:12:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 631d453b-080f-4c81-93d3-32b2df9b6d14 2024-05-24T01:12:01.033963387Z [2024-05-24T01:12:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to fda4e654-7a93-4a3a-9615-a51c25574651 2024-05-24T01:12:01.034124177Z [2024-05-24T01:12:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1838a95-21f9-401c-86b7-8d4d6cdb47c7 2024-05-24T01:12:01.034292093Z [2024-05-24T01:12:01.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to acc2f8c4-5b35-4a1d-a830-55770df1305e 2024-05-24T01:12:02.268750481Z [2024-05-24T01:12:02.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:12:02.269238295Z [2024-05-24T01:12:02.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:10:00+00:00, run_id=scheduled__2024-05-24T01:10:00+00:00, run_start_date=2024-05-24 01:12:00.132892+00:00, run_end_date=2024-05-24 01:12:02.268764+00:00, run_duration=2.135872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:10:00+00:00, data_interval_end=2024-05-24 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:12:02.300632981Z [2024-05-24T01:12:02.300+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:12:00+00:00, run_after=2024-05-24T01:14:00+00:00 2024-05-24T01:12:02.325280649Z [2024-05-24T01:12:02.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:12:02.325885546Z [2024-05-24T01:12:02.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:11:00+00:00, run_id=scheduled__2024-05-24T01:11:00+00:00, run_start_date=2024-05-24 01:12:00.134376+00:00, run_end_date=2024-05-24 01:12:02.325496+00:00, run_duration=2.19112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:11:00+00:00, data_interval_end=2024-05-24 01:12:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:12:02.360699660Z [2024-05-24T01:12:02.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:12:00+00:00, run_after=2024-05-24T01:13:00+00:00 2024-05-24T01:12:02.527435404Z [2024-05-24T01:12:02.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:11:00+00:00 exited with status success for try_number 1 2024-05-24T01:12:02.551491684Z [2024-05-24T01:12:02.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:11:00+00:00, map_index=-1, run_start_date=2024-05-24 01:12:01.606018+00:00, run_end_date=2024-05-24 01:12:02.182816+00:00, run_duration=0.576798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:12:00.219911+00:00, queued_by_job_id=1, pid=10280 2024-05-24T01:12:03.703465871Z [2024-05-24T01:12:03.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:12:03.709705506Z [2024-05-24T01:12:03.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:12:01.556687+00:00, run_end_date=2024-05-24 01:12:02.131691+00:00, run_duration=0.575004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:12:00.219911+00:00, queued_by_job_id=1, pid=10281 2024-05-24T01:12:04.782625556Z [2024-05-24T01:12:04.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:12:04.783312628Z [2024-05-24T01:12:04.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:11:00+00:00, run_id=scheduled__2024-05-24T01:11:00+00:00, run_start_date=2024-05-24 01:12:00.135397+00:00, run_end_date=2024-05-24 01:12:04.782331+00:00, run_duration=4.646934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:11:00+00:00, data_interval_end=2024-05-24 01:12:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:12:04.803875159Z [2024-05-24T01:12:04.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:12:00+00:00, run_after=2024-05-24T01:13:00+00:00 2024-05-24T01:12:04.812966753Z [2024-05-24T01:12:04.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:12:04.813297522Z [2024-05-24T01:12:04.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:11:00+00:00, run_id=scheduled__2024-05-24T01:11:00+00:00, run_start_date=2024-05-24 01:12:00.136476+00:00, run_end_date=2024-05-24 01:12:04.812840+00:00, run_duration=4.676364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:11:00+00:00, data_interval_end=2024-05-24 01:12:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:12:04.825956692Z [2024-05-24T01:12:04.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:12:00+00:00, run_after=2024-05-24T01:13:00+00:00 2024-05-24T01:12:04.865534915Z [2024-05-24T01:12:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:11:00+00:00 exited with status success for try_number 1 2024-05-24T01:12:04.865742076Z [2024-05-24T01:12:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:11:00+00:00 exited with status success for try_number 1 2024-05-24T01:12:04.877532549Z [2024-05-24T01:12:04.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:11:00+00:00, map_index=-1, run_start_date=2024-05-24 01:12:02.797681+00:00, run_end_date=2024-05-24 01:12:04.286675+00:00, run_duration=1.488994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:12:00.219911+00:00, queued_by_job_id=1, pid=10304 2024-05-24T01:12:04.877690046Z [2024-05-24T01:12:04.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:11:00+00:00, map_index=-1, run_start_date=2024-05-24 01:12:02.999287+00:00, run_end_date=2024-05-24 01:12:04.660543+00:00, run_duration=1.661256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:12:00.219911+00:00, queued_by_job_id=1, pid=10305 2024-05-24T01:13:00.826471090Z [2024-05-24T01:13:00.825+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:13:00+00:00, run_after=2024-05-24T01:14:00+00:00 2024-05-24T01:13:00.839346217Z [2024-05-24T01:13:00.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:13:00+00:00, run_after=2024-05-24T01:14:00+00:00 2024-05-24T01:13:00.846135874Z [2024-05-24T01:13:00.845+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:13:00.934594473Z [2024-05-24T01:13:00.930+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:13:00.934623033Z 2024-05-24T01:13:00.934628858Z 2024-05-24T01:13:00.934649192Z 2024-05-24T01:13:00.934654569Z [2024-05-24T01:13:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:13:00.934659576Z [2024-05-24T01:13:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:13:00.934664484Z [2024-05-24T01:13:00.931+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:13:00.934671429Z [2024-05-24T01:13:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:13:00.934676533Z 2024-05-24T01:13:00.934681612Z 2024-05-24T01:13:00.934686513Z 2024-05-24T01:13:00.937341763Z [2024-05-24T01:13:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:13:00.937476390Z [2024-05-24T01:13:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:13:00.937810786Z [2024-05-24T01:13:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:13:00.937942469Z [2024-05-24T01:13:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:13:00.938157578Z [2024-05-24T01:13:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:13:00.938265447Z [2024-05-24T01:13:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:13:01.205736713Z [2024-05-24T01:13:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status queued for try_number 1 2024-05-24T01:13:01.206110126Z [2024-05-24T01:13:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status queued for try_number 1 2024-05-24T01:13:01.206397625Z [2024-05-24T01:13:01.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status queued for try_number 1 2024-05-24T01:13:01.222044244Z [2024-05-24T01:13:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25a65c20-ae0f-4921-8b85-8f048b5950de 2024-05-24T01:13:01.222369781Z [2024-05-24T01:13:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc2542d5-b4b4-4a01-98a5-cdd4d987c2ec 2024-05-24T01:13:01.222803460Z [2024-05-24T01:13:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c5280ee-5bed-4545-abce-947be3003cb9 2024-05-24T01:13:03.165755377Z [2024-05-24T01:13:03.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:13:03.166113988Z [2024-05-24T01:13:03.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:12:00+00:00, run_id=scheduled__2024-05-24T01:12:00+00:00, run_start_date=2024-05-24 01:13:00.857190+00:00, run_end_date=2024-05-24 01:13:03.165793+00:00, run_duration=2.308603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:12:00+00:00, data_interval_end=2024-05-24 01:13:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:13:03.179423019Z [2024-05-24T01:13:03.179+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:13:00+00:00, run_after=2024-05-24T01:14:00+00:00 2024-05-24T01:13:03.310218237Z [2024-05-24T01:13:03.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status success for try_number 1 2024-05-24T01:13:03.315044629Z [2024-05-24T01:13:03.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:12:00+00:00, map_index=-1, run_start_date=2024-05-24 01:13:01.742240+00:00, run_end_date=2024-05-24 01:13:02.152446+00:00, run_duration=0.410206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:13:00.933513+00:00, queued_by_job_id=1, pid=10338 2024-05-24T01:13:04.391918685Z [2024-05-24T01:13:04.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:13:04.393558528Z [2024-05-24T01:13:04.393+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:12:00+00:00, run_id=scheduled__2024-05-24T01:12:00+00:00, run_start_date=2024-05-24 01:13:00.858607+00:00, run_end_date=2024-05-24 01:13:04.393099+00:00, run_duration=3.534492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:12:00+00:00, data_interval_end=2024-05-24 01:13:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:13:04.404837940Z [2024-05-24T01:13:04.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:13:00+00:00, run_after=2024-05-24T01:14:00+00:00 2024-05-24T01:13:04.442687041Z [2024-05-24T01:13:04.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status success for try_number 1 2024-05-24T01:13:04.448328746Z [2024-05-24T01:13:04.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:12:00+00:00, map_index=-1, run_start_date=2024-05-24 01:13:02.712415+00:00, run_end_date=2024-05-24 01:13:04.138368+00:00, run_duration=1.425953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:13:00.933513+00:00, queued_by_job_id=1, pid=10357 2024-05-24T01:13:05.502018189Z [2024-05-24T01:13:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:13:05.502406630Z [2024-05-24T01:13:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:12:00+00:00, run_id=scheduled__2024-05-24T01:12:00+00:00, run_start_date=2024-05-24 01:13:00.859688+00:00, run_end_date=2024-05-24 01:13:05.501878+00:00, run_duration=4.64219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:12:00+00:00, data_interval_end=2024-05-24 01:13:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:13:05.521686491Z [2024-05-24T01:13:05.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:13:00+00:00, run_after=2024-05-24T01:14:00+00:00 2024-05-24T01:13:05.569665240Z [2024-05-24T01:13:05.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status success for try_number 1 2024-05-24T01:13:05.581105437Z [2024-05-24T01:13:05.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:12:00+00:00, map_index=-1, run_start_date=2024-05-24 01:13:02.744307+00:00, run_end_date=2024-05-24 01:13:05.117568+00:00, run_duration=2.373261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:13:00.933513+00:00, queued_by_job_id=1, pid=10356 2024-05-24T01:14:00.034797421Z [2024-05-24T01:14:00.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:14:00.053491435Z [2024-05-24T01:14:00.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:14:00+00:00, run_after=2024-05-24T01:15:00+00:00 2024-05-24T01:14:00.066132345Z [2024-05-24T01:14:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:14:00+00:00, run_after=2024-05-24T01:15:00+00:00 2024-05-24T01:14:00.073201032Z [2024-05-24T01:14:00.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:14:00.174296135Z [2024-05-24T01:14:00.173+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:14:00.174344109Z 2024-05-24T01:14:00.174359098Z 2024-05-24T01:14:00.174368094Z 2024-05-24T01:14:00.174378051Z 2024-05-24T01:14:00.174776776Z [2024-05-24T01:14:00.174+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:14:00.175235931Z [2024-05-24T01:14:00.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:14:00.175659764Z [2024-05-24T01:14:00.175+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:14:00.176070193Z [2024-05-24T01:14:00.175+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:14:00.177379323Z [2024-05-24T01:14:00.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:14:00.177413775Z 2024-05-24T01:14:00.177426968Z 2024-05-24T01:14:00.177439117Z 2024-05-24T01:14:00.177451986Z 2024-05-24T01:14:00.183841331Z [2024-05-24T01:14:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:14:00.184079410Z [2024-05-24T01:14:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:14:00.184474081Z [2024-05-24T01:14:00.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:14:00.184849100Z [2024-05-24T01:14:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:14:00.185399395Z [2024-05-24T01:14:00.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:14:00.185663276Z [2024-05-24T01:14:00.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:14:00.186191078Z [2024-05-24T01:14:00.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:14:00.186455101Z [2024-05-24T01:14:00.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:14:00.561492081Z [2024-05-24T01:14:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status queued for try_number 1 2024-05-24T01:14:00.561522386Z [2024-05-24T01:14:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:13:00+00:00 exited with status queued for try_number 1 2024-05-24T01:14:00.561528590Z [2024-05-24T01:14:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:13:00+00:00 exited with status queued for try_number 1 2024-05-24T01:14:00.561534311Z [2024-05-24T01:14:00.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:13:00+00:00 exited with status queued for try_number 1 2024-05-24T01:14:00.586667512Z [2024-05-24T01:14:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddd80e1b-e757-46c3-b28a-567e106db73a 2024-05-24T01:14:00.586691451Z [2024-05-24T01:14:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bf3d238-6f6c-4fbc-8f6b-b4ed076b2e20 2024-05-24T01:14:00.586695237Z [2024-05-24T01:14:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea9c60dc-ac9f-4429-8ecf-290cfaac6737 2024-05-24T01:14:00.586698586Z [2024-05-24T01:14:00.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 763a0c68-77ce-45f6-b5d3-915fc59725bb 2024-05-24T01:14:01.931005689Z [2024-05-24T01:14:01.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:14:01.931565054Z [2024-05-24T01:14:01.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:12:00+00:00, run_id=scheduled__2024-05-24T01:12:00+00:00, run_start_date=2024-05-24 01:14:00.085054+00:00, run_end_date=2024-05-24 01:14:01.930908+00:00, run_duration=1.845854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:12:00+00:00, data_interval_end=2024-05-24 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:14:01.941717679Z [2024-05-24T01:14:01.941+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:14:00+00:00, run_after=2024-05-24T01:16:00+00:00 2024-05-24T01:14:01.950226707Z [2024-05-24T01:14:01.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:14:01.950653255Z [2024-05-24T01:14:01.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:13:00+00:00, run_id=scheduled__2024-05-24T01:13:00+00:00, run_start_date=2024-05-24 01:14:00.086336+00:00, run_end_date=2024-05-24 01:14:01.950151+00:00, run_duration=1.863815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:13:00+00:00, data_interval_end=2024-05-24 01:14:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:14:01.963926695Z [2024-05-24T01:14:01.963+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:14:00+00:00, run_after=2024-05-24T01:15:00+00:00 2024-05-24T01:14:02.034491765Z [2024-05-24T01:14:02.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:12:00+00:00 exited with status success for try_number 1 2024-05-24T01:14:02.034553017Z [2024-05-24T01:14:02.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:13:00+00:00 exited with status success for try_number 1 2024-05-24T01:14:02.040946507Z [2024-05-24T01:14:02.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:12:00+00:00, map_index=-1, run_start_date=2024-05-24 01:14:01.130434+00:00, run_end_date=2024-05-24 01:14:01.512966+00:00, run_duration=0.382532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:14:00.179309+00:00, queued_by_job_id=1, pid=10391 2024-05-24T01:14:02.041077987Z [2024-05-24T01:14:02.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:13:00+00:00, map_index=-1, run_start_date=2024-05-24 01:14:01.195889+00:00, run_end_date=2024-05-24 01:14:01.550193+00:00, run_duration=0.354304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:14:00.179309+00:00, queued_by_job_id=1, pid=10392 2024-05-24T01:14:04.196634441Z [2024-05-24T01:14:04.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:14:04.197339663Z [2024-05-24T01:14:04.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:13:00+00:00, run_id=scheduled__2024-05-24T01:13:00+00:00, run_start_date=2024-05-24 01:14:00.087795+00:00, run_end_date=2024-05-24 01:14:04.196491+00:00, run_duration=4.108696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:13:00+00:00, data_interval_end=2024-05-24 01:14:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:14:04.215930963Z [2024-05-24T01:14:04.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:14:00+00:00, run_after=2024-05-24T01:15:00+00:00 2024-05-24T01:14:04.280889761Z [2024-05-24T01:14:04.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:13:00+00:00 exited with status success for try_number 1 2024-05-24T01:14:04.289222231Z [2024-05-24T01:14:04.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:13:00+00:00, map_index=-1, run_start_date=2024-05-24 01:14:02.185454+00:00, run_end_date=2024-05-24 01:14:03.428925+00:00, run_duration=1.243471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:14:00.179309+00:00, queued_by_job_id=1, pid=10415 2024-05-24T01:14:05.335928294Z [2024-05-24T01:14:05.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:14:05.336498831Z [2024-05-24T01:14:05.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:13:00+00:00, run_id=scheduled__2024-05-24T01:13:00+00:00, run_start_date=2024-05-24 01:14:00.088786+00:00, run_end_date=2024-05-24 01:14:05.336014+00:00, run_duration=5.247228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:13:00+00:00, data_interval_end=2024-05-24 01:14:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:14:05.346671712Z [2024-05-24T01:14:05.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:14:00+00:00, run_after=2024-05-24T01:15:00+00:00 2024-05-24T01:14:05.389608862Z [2024-05-24T01:14:05.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:13:00+00:00 exited with status success for try_number 1 2024-05-24T01:14:05.396889574Z [2024-05-24T01:14:05.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:13:00+00:00, map_index=-1, run_start_date=2024-05-24 01:14:02.338102+00:00, run_end_date=2024-05-24 01:14:04.379019+00:00, run_duration=2.040917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:14:00.179309+00:00, queued_by_job_id=1, pid=10416 2024-05-24T01:15:00.837573193Z [2024-05-24T01:15:00.836+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:15:00.850847729Z [2024-05-24T01:15:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:16:00+00:00 2024-05-24T01:15:00.865754464Z [2024-05-24T01:15:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:15:00.882676728Z [2024-05-24T01:15:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:16:00+00:00 2024-05-24T01:15:00.989732089Z [2024-05-24T01:15:00.989+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:15:00.989765922Z 2024-05-24T01:15:00.989773333Z 2024-05-24T01:15:00.989779416Z 2024-05-24T01:15:00.989785419Z 2024-05-24T01:15:00.990839980Z [2024-05-24T01:15:00.989+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:15:00.991095049Z [2024-05-24T01:15:00.990+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:15:00.991296699Z [2024-05-24T01:15:00.991+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:15:00.991521558Z [2024-05-24T01:15:00.991+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:15:00.992160342Z [2024-05-24T01:15:00.991+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:15:00.992168327Z 2024-05-24T01:15:00.992179647Z 2024-05-24T01:15:00.992185503Z 2024-05-24T01:15:00.992191182Z 2024-05-24T01:15:00.996157011Z [2024-05-24T01:15:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:15:00.996202260Z [2024-05-24T01:15:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:15:00.996513177Z [2024-05-24T01:15:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:15:00.996665422Z [2024-05-24T01:15:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:15:00.997006238Z [2024-05-24T01:15:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:15:00.997180918Z [2024-05-24T01:15:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:15:00.997457899Z [2024-05-24T01:15:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:15:00.997611964Z [2024-05-24T01:15:00.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:15:01.331244279Z [2024-05-24T01:15:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:15:01.331523890Z [2024-05-24T01:15:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status queued for try_number 1 2024-05-24T01:15:01.331774547Z [2024-05-24T01:15:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status queued for try_number 1 2024-05-24T01:15:01.331989881Z [2024-05-24T01:15:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status queued for try_number 1 2024-05-24T01:15:01.341791486Z [2024-05-24T01:15:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 238cfc3b-8bc0-430e-9380-ccf8f30183e9 2024-05-24T01:15:01.342147083Z [2024-05-24T01:15:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c261562-94b9-4b28-b99e-8e4d4542e5c6 2024-05-24T01:15:01.342387296Z [2024-05-24T01:15:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b4f847a-2a19-4712-9cde-ca8fc699dec7 2024-05-24T01:15:01.342973375Z [2024-05-24T01:15:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to be04f0dd-ba2d-4649-8772-3c9fdfe11623 2024-05-24T01:15:02.537175307Z [2024-05-24T01:15:02.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:15:02.537715803Z [2024-05-24T01:15:02.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:14:00+00:00, run_id=scheduled__2024-05-24T01:14:00+00:00, run_start_date=2024-05-24 01:15:00.898078+00:00, run_end_date=2024-05-24 01:15:02.537084+00:00, run_duration=1.639006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:14:00+00:00, data_interval_end=2024-05-24 01:15:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:15:02.547350524Z [2024-05-24T01:15:02.547+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:16:00+00:00 2024-05-24T01:15:02.620870244Z [2024-05-24T01:15:02.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status success for try_number 1 2024-05-24T01:15:02.631750074Z [2024-05-24T01:15:02.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:14:00+00:00, map_index=-1, run_start_date=2024-05-24 01:15:02.026300+00:00, run_end_date=2024-05-24 01:15:02.369796+00:00, run_duration=0.343496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:00.993102+00:00, queued_by_job_id=1, pid=10450 2024-05-24T01:15:03.764750271Z [2024-05-24T01:15:03.764+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:15:03.764800839Z 2024-05-24T01:15:03.765004220Z [2024-05-24T01:15:03.764+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:15:03.765900188Z [2024-05-24T01:15:03.765+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:15:03.765932719Z 2024-05-24T01:15:03.769352065Z [2024-05-24T01:15:03.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:15:03.769596717Z [2024-05-24T01:15:03.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:15:03.826754308Z [2024-05-24T01:15:03.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:15:03.826945467Z [2024-05-24T01:15:03.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:15:03.833137014Z [2024-05-24T01:15:03.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f420853-7a48-49c2-9e2a-ed8dc864b7ed 2024-05-24T01:15:03.833401715Z [2024-05-24T01:15:03.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:15:02.813005+00:00, run_end_date=2024-05-24 01:15:03.166931+00:00, run_duration=0.353926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:00.993102+00:00, queued_by_job_id=1, pid=10463 2024-05-24T01:15:05.258972605Z [2024-05-24T01:15:05.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:15:05.259490985Z [2024-05-24T01:15:05.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:14:00+00:00, run_id=scheduled__2024-05-24T01:14:00+00:00, run_start_date=2024-05-24 01:15:00.899085+00:00, run_end_date=2024-05-24 01:15:05.258833+00:00, run_duration=4.359748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:14:00+00:00, data_interval_end=2024-05-24 01:15:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:15:05.272705719Z [2024-05-24T01:15:05.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:16:00+00:00 2024-05-24T01:15:05.281756506Z [2024-05-24T01:15:05.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:15:05.282127407Z [2024-05-24T01:15:05.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:14:00+00:00, run_id=scheduled__2024-05-24T01:14:00+00:00, run_start_date=2024-05-24 01:15:00.900126+00:00, run_end_date=2024-05-24 01:15:05.281633+00:00, run_duration=4.381507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:14:00+00:00, data_interval_end=2024-05-24 01:15:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:15:05.293289638Z [2024-05-24T01:15:05.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:16:00+00:00 2024-05-24T01:15:05.349234768Z [2024-05-24T01:15:05.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status success for try_number 1 2024-05-24T01:15:05.349466898Z [2024-05-24T01:15:05.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status success for try_number 1 2024-05-24T01:15:05.355402365Z [2024-05-24T01:15:05.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:14:00+00:00, map_index=-1, run_start_date=2024-05-24 01:15:03.113866+00:00, run_end_date=2024-05-24 01:15:04.382222+00:00, run_duration=1.268356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:00.993102+00:00, queued_by_job_id=1, pid=10479 2024-05-24T01:15:05.355831896Z [2024-05-24T01:15:05.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:14:00+00:00, map_index=-1, run_start_date=2024-05-24 01:15:03.176533+00:00, run_end_date=2024-05-24 01:15:04.826111+00:00, run_duration=1.649578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:00.993102+00:00, queued_by_job_id=1, pid=10480 2024-05-24T01:15:06.438530735Z [2024-05-24T01:15:06.437+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:15:06.438567899Z 2024-05-24T01:15:06.440172279Z [2024-05-24T01:15:06.438+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:15:06.441592931Z [2024-05-24T01:15:06.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:15:06.441604581Z 2024-05-24T01:15:06.446136274Z [2024-05-24T01:15:06.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:15:06.446381005Z [2024-05-24T01:15:06.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:15:06.531704613Z [2024-05-24T01:15:06.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:15:06.531772828Z [2024-05-24T01:15:06.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:15:06.538088660Z [2024-05-24T01:15:06.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to e42c1aeb-6537-4dbc-a400-d7b744821b12 2024-05-24T01:15:06.538298882Z [2024-05-24T01:15:06.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:15:05.485960+00:00, run_end_date=2024-05-24 01:15:05.893261+00:00, run_duration=0.407301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:03.766424+00:00, queued_by_job_id=1, pid=10498 2024-05-24T01:15:08.895558763Z [2024-05-24T01:15:08.895+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:15:08.895588533Z 2024-05-24T01:15:08.895750461Z [2024-05-24T01:15:08.895+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:15:08.896365926Z [2024-05-24T01:15:08.896+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:15:08.896377027Z 2024-05-24T01:15:08.899569446Z [2024-05-24T01:15:08.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:15:08.900037526Z [2024-05-24T01:15:08.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:15:09.027303481Z [2024-05-24T01:15:09.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:15:09.028702209Z [2024-05-24T01:15:09.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:15:09.047561305Z [2024-05-24T01:15:09.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40f39c86-c510-4334-bf2e-d395fa80122c 2024-05-24T01:15:09.047850388Z [2024-05-24T01:15:09.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=0, run_start_date=2024-05-24 01:15:08.123715+00:00, run_end_date=2024-05-24 01:15:08.418067+00:00, run_duration=0.294352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:06.442581+00:00, queued_by_job_id=1, pid=10506 2024-05-24T01:15:11.084241787Z [2024-05-24T01:15:11.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:15:11.084555106Z [2024-05-24T01:15:11.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:10:00+00:00, run_id=scheduled__2024-05-24T01:10:00+00:00, run_start_date=2024-05-24 01:15:00.896606+00:00, run_end_date=2024-05-24 01:15:11.084156+00:00, run_duration=10.18755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:10:00+00:00, data_interval_end=2024-05-24 01:15:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:15:11.090741756Z [2024-05-24T01:15:11.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:15:11.125685312Z [2024-05-24T01:15:11.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:15:11.130411430Z [2024-05-24T01:15:11.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:15:10.571516+00:00, run_end_date=2024-05-24 01:15:10.899277+00:00, run_duration=0.327761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:08.896770+00:00, queued_by_job_id=1, pid=10514 2024-05-24T01:15:38.900003423Z [2024-05-24T01:15:38.899+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:15:38.900031624Z 2024-05-24T01:15:38.900219988Z [2024-05-24T01:15:38.899+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-24T01:15:38.901045118Z [2024-05-24T01:15:38.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:15:38.901054072Z 2024-05-24T01:15:38.903923856Z [2024-05-24T01:15:38.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240524011537_503148', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:15:38.904231067Z [2024-05-24T01:15:38.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240524011537_503148', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-24T01:15:38.971336304Z [2024-05-24T01:15:38.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240524011537_503148 exited with status queued for try_number 1 2024-05-24T01:15:38.975048528Z [2024-05-24T01:15:38.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebf0d694-b7c0-43e9-9c08-76462c25198f 2024-05-24T01:15:40.243681101Z [2024-05-24T01:15:40.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:15:40.243972685Z [2024-05-24T01:15:40.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-24 01:15:38.052177+00:00, run_id=vdu_down_20240524011537_503148, run_start_date=2024-05-24 01:15:38.858281+00:00, run_end_date=2024-05-24 01:15:40.243613+00:00, run_duration=1.385332, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-24 01:15:38.052177+00:00, data_interval_end=2024-05-24 01:15:38.052177+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-24T01:15:40.254239339Z [2024-05-24T01:15:40.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-24T01:15:40.287045298Z [2024-05-24T01:15:40.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240524011537_503148 exited with status success for try_number 1 2024-05-24T01:15:40.291991798Z [2024-05-24T01:15:40.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240524011537_503148, map_index=-1, run_start_date=2024-05-24 01:15:39.681600+00:00, run_end_date=2024-05-24 01:15:40.093361+00:00, run_duration=0.411761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:15:38.901527+00:00, queued_by_job_id=1, pid=10529 2024-05-24T01:16:00.414686215Z [2024-05-24T01:16:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:16:00+00:00, run_after=2024-05-24T01:17:00+00:00 2024-05-24T01:16:00.426768238Z [2024-05-24T01:16:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:16:00.434937844Z [2024-05-24T01:16:00.434+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:16:00.448995010Z [2024-05-24T01:16:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:16:00+00:00, run_after=2024-05-24T01:17:00+00:00 2024-05-24T01:16:00.560446329Z [2024-05-24T01:16:00.560+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:16:00.560469173Z 2024-05-24T01:16:00.560475825Z 2024-05-24T01:16:00.560479343Z 2024-05-24T01:16:00.560482695Z 2024-05-24T01:16:00.560633879Z [2024-05-24T01:16:00.560+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:16:00.560838199Z [2024-05-24T01:16:00.560+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:16:00.561006379Z [2024-05-24T01:16:00.560+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:16:00.561190078Z [2024-05-24T01:16:00.561+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:16:00.561809454Z [2024-05-24T01:16:00.561+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:16:00.561821863Z 2024-05-24T01:16:00.561825885Z 2024-05-24T01:16:00.561829346Z 2024-05-24T01:16:00.561833057Z 2024-05-24T01:16:00.565386601Z [2024-05-24T01:16:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:16:00.565548448Z [2024-05-24T01:16:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:16:00.565872241Z [2024-05-24T01:16:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:16:00.566068503Z [2024-05-24T01:16:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:16:00.566366387Z [2024-05-24T01:16:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:16:00.566597351Z [2024-05-24T01:16:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:16:00.566851114Z [2024-05-24T01:16:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:16:00.567032036Z [2024-05-24T01:16:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:16:01.011146442Z [2024-05-24T01:16:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status queued for try_number 1 2024-05-24T01:16:01.011331416Z [2024-05-24T01:16:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status queued for try_number 1 2024-05-24T01:16:01.011552520Z [2024-05-24T01:16:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status queued for try_number 1 2024-05-24T01:16:01.011714103Z [2024-05-24T01:16:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status queued for try_number 1 2024-05-24T01:16:01.021696074Z [2024-05-24T01:16:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1029adf-2483-4226-847b-5c884cd7c437 2024-05-24T01:16:01.021996628Z [2024-05-24T01:16:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to a585a085-15ff-4ebe-ae9a-9fd885882e3e 2024-05-24T01:16:01.022204430Z [2024-05-24T01:16:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to b34d528e-b334-4ac4-bfb3-7169e576615c 2024-05-24T01:16:01.022416870Z [2024-05-24T01:16:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47cd6140-6223-47fb-b86c-993fe741d3e4 2024-05-24T01:16:02.761192788Z [2024-05-24T01:16:02.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:16:02.764626387Z [2024-05-24T01:16:02.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:14:00+00:00, run_id=scheduled__2024-05-24T01:14:00+00:00, run_start_date=2024-05-24 01:16:00.466899+00:00, run_end_date=2024-05-24 01:16:02.761156+00:00, run_duration=2.294257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:14:00+00:00, data_interval_end=2024-05-24 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:16:02.774599923Z [2024-05-24T01:16:02.774+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:16:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:16:02.782107591Z [2024-05-24T01:16:02.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:16:02.782446092Z [2024-05-24T01:16:02.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:15:00+00:00, run_id=scheduled__2024-05-24T01:15:00+00:00, run_start_date=2024-05-24 01:16:00.469030+00:00, run_end_date=2024-05-24 01:16:02.782032+00:00, run_duration=2.313002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:15:00+00:00, data_interval_end=2024-05-24 01:16:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:16:02.794474213Z [2024-05-24T01:16:02.794+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:16:00+00:00, run_after=2024-05-24T01:17:00+00:00 2024-05-24T01:16:02.885903938Z [2024-05-24T01:16:02.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:14:00+00:00 exited with status success for try_number 1 2024-05-24T01:16:02.889363056Z [2024-05-24T01:16:02.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status success for try_number 1 2024-05-24T01:16:02.896976655Z [2024-05-24T01:16:02.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:14:00+00:00, map_index=-1, run_start_date=2024-05-24 01:16:01.417633+00:00, run_end_date=2024-05-24 01:16:01.881150+00:00, run_duration=0.463517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:16:00.562734+00:00, queued_by_job_id=1, pid=10545 2024-05-24T01:16:02.897278779Z [2024-05-24T01:16:02.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:15:00+00:00, map_index=-1, run_start_date=2024-05-24 01:16:01.541575+00:00, run_end_date=2024-05-24 01:16:02.034641+00:00, run_duration=0.493066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:16:00.562734+00:00, queued_by_job_id=1, pid=10546 2024-05-24T01:16:05.072472575Z [2024-05-24T01:16:05.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:16:05.072697593Z [2024-05-24T01:16:05.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:15:00+00:00, run_id=scheduled__2024-05-24T01:15:00+00:00, run_start_date=2024-05-24 01:16:00.471258+00:00, run_end_date=2024-05-24 01:16:05.072004+00:00, run_duration=4.600746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:15:00+00:00, data_interval_end=2024-05-24 01:16:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:16:05.092272175Z [2024-05-24T01:16:05.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:16:00+00:00, run_after=2024-05-24T01:17:00+00:00 2024-05-24T01:16:05.163436023Z [2024-05-24T01:16:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status success for try_number 1 2024-05-24T01:16:05.169749903Z [2024-05-24T01:16:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:15:00+00:00, map_index=-1, run_start_date=2024-05-24 01:16:02.527914+00:00, run_end_date=2024-05-24 01:16:04.168936+00:00, run_duration=1.641022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:16:00.562734+00:00, queued_by_job_id=1, pid=10569 2024-05-24T01:16:06.235121685Z [2024-05-24T01:16:06.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:16:06.235546087Z [2024-05-24T01:16:06.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:15:00+00:00, run_id=scheduled__2024-05-24T01:15:00+00:00, run_start_date=2024-05-24 01:16:00.473687+00:00, run_end_date=2024-05-24 01:16:06.235236+00:00, run_duration=5.761549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:15:00+00:00, data_interval_end=2024-05-24 01:16:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:16:06.248687585Z [2024-05-24T01:16:06.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:16:00+00:00, run_after=2024-05-24T01:17:00+00:00 2024-05-24T01:16:06.285482585Z [2024-05-24T01:16:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status success for try_number 1 2024-05-24T01:16:06.300012283Z [2024-05-24T01:16:06.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:15:00+00:00, map_index=-1, run_start_date=2024-05-24 01:16:02.645087+00:00, run_end_date=2024-05-24 01:16:05.173860+00:00, run_duration=2.528773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:16:00.562734+00:00, queued_by_job_id=1, pid=10570 2024-05-24T01:16:41.260307950Z [2024-05-24T01:16:41.259+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:16:54.584931699Z [2024-05-24T01:16:54.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:16:54.653521393Z [2024-05-24T01:16:54.653+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:16:54.653545972Z 2024-05-24T01:16:54.653760138Z [2024-05-24T01:16:54.653+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:16:54.654427343Z [2024-05-24T01:16:54.654+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:16:54.654432547Z 2024-05-24T01:16:54.656807023Z [2024-05-24T01:16:54.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:16:54.657270927Z [2024-05-24T01:16:54.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:16:54.736150314Z [2024-05-24T01:16:54.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:16:54.741518427Z [2024-05-24T01:16:54.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28ec348b-4193-452d-b199-5f1f1f5aac96 2024-05-24T01:16:58.189391911Z [2024-05-24T01:16:58.188+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:16:58.189408130Z 2024-05-24T01:16:58.189413223Z [2024-05-24T01:16:58.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:16:58.189881184Z [2024-05-24T01:16:58.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:16:58.189887405Z 2024-05-24T01:16:58.196476610Z [2024-05-24T01:16:58.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='split_metrics', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:16:58.196495187Z [2024-05-24T01:16:58.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', 'split_metrics', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:16:58.287245904Z [2024-05-24T01:16:58.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.split_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:16:58.287573169Z [2024-05-24T01:16:58.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:16:58.295804173Z [2024-05-24T01:16:58.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:16:56.800729+00:00, run_end_date=2024-05-24 01:16:57.230067+00:00, run_duration=0.429338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:16:54.654904+00:00, queued_by_job_id=1, pid=10601 2024-05-24T01:16:58.296357419Z [2024-05-24T01:16:58.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8ea36c7-14ec-41ab-9ab8-e6a9b786c456 2024-05-24T01:17:00.582102276Z [2024-05-24T01:17:00.581+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:00.600850503Z [2024-05-24T01:17:00.600+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:00.610931543Z [2024-05-24T01:17:00.610+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:17:00.717758950Z [2024-05-24T01:17:00.717+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:17:00.717798445Z 2024-05-24T01:17:00.717808794Z 2024-05-24T01:17:00.717817208Z 2024-05-24T01:17:00.717825096Z 2024-05-24T01:17:00.718095687Z [2024-05-24T01:17:00.717+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:17:00.718217227Z [2024-05-24T01:17:00.718+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:17:00.718291980Z [2024-05-24T01:17:00.718+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:17:00.718391965Z [2024-05-24T01:17:00.718+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:17:00.718946408Z [2024-05-24T01:17:00.718+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:17:00.718967917Z 2024-05-24T01:17:00.718998014Z 2024-05-24T01:17:00.719006433Z 2024-05-24T01:17:00.719014258Z 2024-05-24T01:17:00.723058716Z [2024-05-24T01:17:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:17:00.723198833Z [2024-05-24T01:17:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', 'collect_metrics', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:17:00.723441788Z [2024-05-24T01:17:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:17:00.723570318Z [2024-05-24T01:17:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:17:00.723797501Z [2024-05-24T01:17:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:17:00.723928648Z [2024-05-24T01:17:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:17:00.725406474Z [2024-05-24T01:17:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:17:00.725539704Z [2024-05-24T01:17:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:17:01.078421759Z [2024-05-24T01:17:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.collect_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:17:01.078554111Z [2024-05-24T01:17:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status queued for try_number 1 2024-05-24T01:17:01.078646669Z [2024-05-24T01:17:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status queued for try_number 1 2024-05-24T01:17:01.078732385Z [2024-05-24T01:17:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status queued for try_number 1 2024-05-24T01:17:01.078831552Z [2024-05-24T01:17:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.split_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:01.088388178Z [2024-05-24T01:17:01.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=split_metrics, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:16:59.760393+00:00, run_end_date=2024-05-24 01:17:00.132029+00:00, run_duration=0.371636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:16:58.190140+00:00, queued_by_job_id=1, pid=10614 2024-05-24T01:17:01.088457153Z [2024-05-24T01:17:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to de8a4f35-5d10-4a31-bc3a-d688129aabdd 2024-05-24T01:17:01.088461083Z [2024-05-24T01:17:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d4566e7-b20a-4e7c-9019-f95453a70c08 2024-05-24T01:17:01.088474002Z [2024-05-24T01:17:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb625bc6-7da5-492c-94b7-d99d280f3d00 2024-05-24T01:17:01.088538919Z [2024-05-24T01:17:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4e0b1e6-9fab-4423-8bfa-929644d150e1 2024-05-24T01:17:03.088970051Z [2024-05-24T01:17:03.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:17:03.089334882Z [2024-05-24T01:17:03.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:16:00+00:00, run_id=scheduled__2024-05-24T01:16:00+00:00, run_start_date=2024-05-24 01:17:00.629141+00:00, run_end_date=2024-05-24 01:17:03.088983+00:00, run_duration=2.459842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:16:00+00:00, data_interval_end=2024-05-24 01:17:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:17:03.110834991Z [2024-05-24T01:17:03.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:03.261764518Z [2024-05-24T01:17:03.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:03.277523186Z [2024-05-24T01:17:03.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:16:00+00:00, map_index=-1, run_start_date=2024-05-24 01:17:01.800185+00:00, run_end_date=2024-05-24 01:17:02.200044+00:00, run_duration=0.399859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:00.719672+00:00, queued_by_job_id=1, pid=10624 2024-05-24T01:17:04.385833235Z [2024-05-24T01:17:04.384+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:17:04.385867954Z 2024-05-24T01:17:04.385874478Z [2024-05-24T01:17:04.385+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:17:04.386448235Z [2024-05-24T01:17:04.386+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:17:04.386459203Z 2024-05-24T01:17:04.390324420Z [2024-05-24T01:17:04.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:17:04.390761358Z [2024-05-24T01:17:04.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb', 'send_prometheus', 'scheduled__2024-05-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:17:04.463084480Z [2024-05-24T01:17:04.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.send_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status queued for try_number 1 2024-05-24T01:17:04.465617236Z [2024-05-24T01:17:04.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.collect_metrics run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:04.471961791Z [2024-05-24T01:17:04.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=0, run_start_date=2024-05-24 01:17:02.847428+00:00, run_end_date=2024-05-24 01:17:03.296852+00:00, run_duration=0.449424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:00.719672+00:00, queued_by_job_id=1, pid=10649 2024-05-24T01:17:04.472201320Z [2024-05-24T01:17:04.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 481d833f-6ce7-45cd-8142-48bf308ce425 2024-05-24T01:17:05.659731634Z [2024-05-24T01:17:05.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:17:05.660329072Z [2024-05-24T01:17:05.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:16:00+00:00, run_id=scheduled__2024-05-24T01:16:00+00:00, run_start_date=2024-05-24 01:17:00.632230+00:00, run_end_date=2024-05-24 01:17:05.659554+00:00, run_duration=5.027324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:16:00+00:00, data_interval_end=2024-05-24 01:17:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:17:05.675439491Z [2024-05-24T01:17:05.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:05.685998799Z [2024-05-24T01:17:05.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:17:05.686574847Z [2024-05-24T01:17:05.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:16:00+00:00, run_id=scheduled__2024-05-24T01:16:00+00:00, run_start_date=2024-05-24 01:17:00.634677+00:00, run_end_date=2024-05-24 01:17:05.685902+00:00, run_duration=5.051225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:16:00+00:00, data_interval_end=2024-05-24 01:17:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:17:05.700988183Z [2024-05-24T01:17:05.700+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:05.778571915Z [2024-05-24T01:17:05.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:05.778940444Z [2024-05-24T01:17:05.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:05.787091977Z [2024-05-24T01:17:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:16:00+00:00, map_index=-1, run_start_date=2024-05-24 01:17:02.798041+00:00, run_end_date=2024-05-24 01:17:05.164495+00:00, run_duration=2.366454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:00.719672+00:00, queued_by_job_id=1, pid=10648 2024-05-24T01:17:05.787563335Z [2024-05-24T01:17:05.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:16:00+00:00, map_index=-1, run_start_date=2024-05-24 01:17:03.037017+00:00, run_end_date=2024-05-24 01:17:04.764823+00:00, run_duration=1.727806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:00.719672+00:00, queued_by_job_id=1, pid=10650 2024-05-24T01:17:07.308200458Z [2024-05-24T01:17:07.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:17:07.308640629Z [2024-05-24T01:17:07.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb, execution_date=2024-05-24 01:10:00+00:00, run_id=scheduled__2024-05-24T01:10:00+00:00, run_start_date=2024-05-24 01:16:54.601866+00:00, run_end_date=2024-05-24 01:17:07.308095+00:00, run_duration=12.706229, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:10:00+00:00, data_interval_end=2024-05-24 01:15:00+00:00, dag_hash=bdce633476f76d9f039be4d68249f85b 2024-05-24T01:17:07.319233960Z [2024-05-24T01:17:07.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:15:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:17:07.364908000Z [2024-05-24T01:17:07.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb.send_prometheus run_id=scheduled__2024-05-24T01:10:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:07.379962487Z [2024-05-24T01:17:07.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:10:00+00:00, map_index=-1, run_start_date=2024-05-24 01:17:06.151548+00:00, run_end_date=2024-05-24 01:17:06.505322+00:00, run_duration=0.353774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:04.387036+00:00, queued_by_job_id=1, pid=10668 2024-05-24T01:17:18.128681504Z [2024-05-24T01:17:18.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:18.184429057Z [2024-05-24T01:17:18.184+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:17:18.184458405Z 2024-05-24T01:17:18.184606486Z [2024-05-24T01:17:18.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:17:18.185592618Z [2024-05-24T01:17:18.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:17:18.185604049Z 2024-05-24T01:17:18.189338044Z [2024-05-24T01:17:18.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:17:18.189577706Z [2024-05-24T01:17:18.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:17:18.331268673Z [2024-05-24T01:17:18.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status queued for try_number 1 2024-05-24T01:17:18.337901190Z [2024-05-24T01:17:18.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2832f54c-4772-423e-8994-9487ec11a7f0 2024-05-24T01:17:19.467678459Z [2024-05-24T01:17:19.467+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:17:19.510549679Z [2024-05-24T01:17:19.510+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:17:19.510572862Z 2024-05-24T01:17:19.511892225Z [2024-05-24T01:17:19.511+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:17:19.513279550Z [2024-05-24T01:17:19.513+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:17:19.513290871Z 2024-05-24T01:17:19.515664110Z [2024-05-24T01:17:19.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:17:19.515826389Z [2024-05-24T01:17:19.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:17:19.590676698Z [2024-05-24T01:17:19.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status queued for try_number 1 2024-05-24T01:17:19.599662652Z [2024-05-24T01:17:19.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b877905-4798-4f84-8232-76f0284b7d20 2024-05-24T01:17:21.398670099Z [2024-05-24T01:17:21.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:17:21.398982758Z [2024-05-24T01:17:21.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, execution_date=2024-05-24 01:16:00+00:00, run_id=scheduled__2024-05-24T01:16:00+00:00, run_start_date=2024-05-24 01:17:18.141036+00:00, run_end_date=2024-05-24 01:17:21.398576+00:00, run_duration=3.25754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:16:00+00:00, data_interval_end=2024-05-24 01:17:00+00:00, dag_hash=ae133e1908392dc7cc310dab6c5d4f1e 2024-05-24T01:17:21.407576137Z [2024-05-24T01:17:21.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:21.441809452Z [2024-05-24T01:17:21.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:21.446386927Z [2024-05-24T01:17:21.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:16:00+00:00, map_index=-1, run_start_date=2024-05-24 01:17:20.026763+00:00, run_end_date=2024-05-24 01:17:21.298252+00:00, run_duration=1.271489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:18.186831+00:00, queued_by_job_id=1, pid=10687 2024-05-24T01:17:23.904243217Z [2024-05-24T01:17:23.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:17:23.904394141Z [2024-05-24T01:17:23.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb, execution_date=2024-05-24 01:16:00+00:00, run_id=scheduled__2024-05-24T01:16:00+00:00, run_start_date=2024-05-24 01:17:19.477648+00:00, run_end_date=2024-05-24 01:17:23.901561+00:00, run_duration=4.423913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:16:00+00:00, data_interval_end=2024-05-24 01:17:00+00:00, dag_hash=3309a600d6d9e1b4bff8bc5a335538b0 2024-05-24T01:17:23.911040397Z [2024-05-24T01:17:23.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:17:00+00:00, run_after=2024-05-24T01:18:00+00:00 2024-05-24T01:17:23.938037795Z [2024-05-24T01:17:23.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status success for try_number 1 2024-05-24T01:17:23.945097113Z [2024-05-24T01:17:23.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:16:00+00:00, map_index=-1, run_start_date=2024-05-24 01:17:21.328925+00:00, run_end_date=2024-05-24 01:17:22.912536+00:00, run_duration=1.583611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:19.513733+00:00, queued_by_job_id=1, pid=10702 2024-05-24T01:17:38.874721357Z [2024-05-24T01:17:38.874+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:17:38.874772155Z 2024-05-24T01:17:38.875301894Z [2024-05-24T01:17:38.874+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-24T01:17:38.876733916Z [2024-05-24T01:17:38.876+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:17:38.876760658Z 2024-05-24T01:17:38.881613957Z [2024-05-24T01:17:38.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240524011737_863572', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:17:38.881981680Z [2024-05-24T01:17:38.881+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240524011737_863572', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-24T01:17:38.958671422Z [2024-05-24T01:17:38.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240524011737_863572 exited with status queued for try_number 1 2024-05-24T01:17:38.974592713Z [2024-05-24T01:17:38.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to e98918cf-cacc-40b6-b3bd-24cc0a6b635e 2024-05-24T01:17:40.134628045Z [2024-05-24T01:17:40.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:17:40.134998669Z [2024-05-24T01:17:40.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-24 01:17:38.009678+00:00, run_id=vdu_down_20240524011737_863572, run_start_date=2024-05-24 01:17:38.827072+00:00, run_end_date=2024-05-24 01:17:40.134431+00:00, run_duration=1.307359, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-24 01:17:38.009678+00:00, data_interval_end=2024-05-24 01:17:38.009678+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-24T01:17:40.138980271Z [2024-05-24T01:17:40.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-24T01:17:40.200339954Z [2024-05-24T01:17:40.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240524011737_863572 exited with status success for try_number 1 2024-05-24T01:17:40.212764418Z [2024-05-24T01:17:40.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240524011737_863572, map_index=-1, run_start_date=2024-05-24 01:17:39.562894+00:00, run_end_date=2024-05-24 01:17:39.973004+00:00, run_duration=0.41011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:17:38.877772+00:00, queued_by_job_id=1, pid=10709 2024-05-24T01:18:00.277611473Z [2024-05-24T01:18:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:18:00.291576211Z [2024-05-24T01:18:00.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:18:00.304820990Z [2024-05-24T01:18:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:18:00.317432823Z [2024-05-24T01:18:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:18:00.325347319Z [2024-05-24T01:18:00.325+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:18:00.342689696Z [2024-05-24T01:18:00.340+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:18:00.482430919Z [2024-05-24T01:18:00.481+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-24T01:18:00.482463803Z 2024-05-24T01:18:00.482473816Z 2024-05-24T01:18:00.482479993Z 2024-05-24T01:18:00.482575501Z 2024-05-24T01:18:00.482583078Z 2024-05-24T01:18:00.482587064Z 2024-05-24T01:18:00.482711893Z [2024-05-24T01:18:00.482+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:18:00.482919466Z [2024-05-24T01:18:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:18:00.483073109Z [2024-05-24T01:18:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:18:00.483308616Z [2024-05-24T01:18:00.483+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:18:00.483532987Z [2024-05-24T01:18:00.483+0000] {scheduler_job.py:425} INFO - DAG vim_status_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:18:00.483833332Z [2024-05-24T01:18:00.483+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:18:00.484974037Z [2024-05-24T01:18:00.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:18:00.484994854Z 2024-05-24T01:18:00.485002157Z 2024-05-24T01:18:00.485008352Z 2024-05-24T01:18:00.485014688Z 2024-05-24T01:18:00.485020819Z 2024-05-24T01:18:00.485027114Z 2024-05-24T01:18:00.491382234Z [2024-05-24T01:18:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:00.491743716Z [2024-05-24T01:18:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:18:00.492241233Z [2024-05-24T01:18:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:00.492485526Z [2024-05-24T01:18:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:18:00.493358394Z [2024-05-24T01:18:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:00.493687713Z [2024-05-24T01:18:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:18:00.494178429Z [2024-05-24T01:18:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:00.494375276Z [2024-05-24T01:18:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:18:00.494904314Z [2024-05-24T01:18:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:00.494918267Z [2024-05-24T01:18:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:18:00.495132998Z [2024-05-24T01:18:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:00.495207445Z [2024-05-24T01:18:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:18:01.148515125Z [2024-05-24T01:18:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status queued for try_number 1 2024-05-24T01:18:01.148685281Z [2024-05-24T01:18:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status queued for try_number 1 2024-05-24T01:18:01.148857340Z [2024-05-24T01:18:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status queued for try_number 1 2024-05-24T01:18:01.149002266Z [2024-05-24T01:18:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status queued for try_number 1 2024-05-24T01:18:01.149134596Z [2024-05-24T01:18:01.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status queued for try_number 1 2024-05-24T01:18:01.149406386Z [2024-05-24T01:18:01.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status queued for try_number 1 2024-05-24T01:18:01.162002467Z [2024-05-24T01:18:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5812e6fd-eaea-48ce-89de-70bf9174e12d 2024-05-24T01:18:01.162160120Z [2024-05-24T01:18:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dbcdf63-b844-4b40-8b39-eba81cfe0eaf 2024-05-24T01:18:01.162283778Z [2024-05-24T01:18:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to e45ac819-b430-4fd9-b152-8f8814d6f11d 2024-05-24T01:18:01.162420353Z [2024-05-24T01:18:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e1ca5fb-6cba-4470-a012-801209bd2ec1 2024-05-24T01:18:01.162610770Z [2024-05-24T01:18:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f0751b4-f209-4a86-b246-4f8ed46b80a7 2024-05-24T01:18:01.162752231Z [2024-05-24T01:18:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4ec5185-0786-4bd0-9618-e97db5753033 2024-05-24T01:18:03.288252868Z [2024-05-24T01:18:03.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:18:03.288518810Z [2024-05-24T01:18:03.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:16:00+00:00, run_id=scheduled__2024-05-24T01:16:00+00:00, run_start_date=2024-05-24 01:18:00.360224+00:00, run_end_date=2024-05-24 01:18:03.288103+00:00, run_duration=2.927879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:16:00+00:00, data_interval_end=2024-05-24 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:18:03.299215496Z [2024-05-24T01:18:03.298+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:18:03.306593760Z [2024-05-24T01:18:03.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:18:03.306656641Z [2024-05-24T01:18:03.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:17:00+00:00, run_id=scheduled__2024-05-24T01:17:00+00:00, run_start_date=2024-05-24 01:18:00.361509+00:00, run_end_date=2024-05-24 01:18:03.306339+00:00, run_duration=2.94483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:17:00+00:00, data_interval_end=2024-05-24 01:18:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:18:03.316472310Z [2024-05-24T01:18:03.316+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:18:03.387321497Z [2024-05-24T01:18:03.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:16:00+00:00 exited with status success for try_number 1 2024-05-24T01:18:03.387406861Z [2024-05-24T01:18:03.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status failed for try_number 1 2024-05-24T01:18:03.388576641Z [2024-05-24T01:18:03.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status failed for try_number 1 2024-05-24T01:18:03.389146828Z [2024-05-24T01:18:03.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status success for try_number 1 2024-05-24T01:18:03.405768902Z [2024-05-24T01:18:03.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:00.487088+00:00, queued_by_job_id=1, pid=None 2024-05-24T01:18:03.406567157Z [2024-05-24T01:18:03.406+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:03.410249988Z [2024-05-24T01:18:03.409+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:03.434465739Z [2024-05-24T01:18:03.434+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T011700, start_date=, end_date=20240524T011803 2024-05-24T01:18:03.445338993Z [2024-05-24T01:18:03.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:00.487088+00:00, queued_by_job_id=1, pid=None 2024-05-24T01:18:03.445650897Z [2024-05-24T01:18:03.445+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:03.448115164Z [2024-05-24T01:18:03.447+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:03.462798506Z [2024-05-24T01:18:03.462+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T011700, start_date=, end_date=20240524T011803 2024-05-24T01:18:03.471269092Z [2024-05-24T01:18:03.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:17:00+00:00, map_index=-1, run_start_date=2024-05-24 01:18:01.680039+00:00, run_end_date=2024-05-24 01:18:02.159993+00:00, run_duration=0.479954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:00.487088+00:00, queued_by_job_id=1, pid=10726 2024-05-24T01:18:03.471423589Z [2024-05-24T01:18:03.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:16:00+00:00, map_index=-1, run_start_date=2024-05-24 01:18:01.673321+00:00, run_end_date=2024-05-24 01:18:02.284784+00:00, run_duration=0.611463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:00.487088+00:00, queued_by_job_id=1, pid=10728 2024-05-24T01:18:04.528580208Z [2024-05-24T01:18:04.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:18:04.529304574Z [2024-05-24T01:18:04.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:17:00+00:00, run_id=scheduled__2024-05-24T01:17:00+00:00, run_start_date=2024-05-24 01:18:00.363677+00:00, run_end_date=2024-05-24 01:18:04.528437+00:00, run_duration=4.16476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:17:00+00:00, data_interval_end=2024-05-24 01:18:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:18:04.566169670Z [2024-05-24T01:18:04.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:18:04.649070095Z [2024-05-24T01:18:04.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status success for try_number 1 2024-05-24T01:18:04.655301241Z [2024-05-24T01:18:04.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:17:00+00:00, map_index=-1, run_start_date=2024-05-24 01:18:02.727545+00:00, run_end_date=2024-05-24 01:18:04.283777+00:00, run_duration=1.556232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:00.487088+00:00, queued_by_job_id=1, pid=10747 2024-05-24T01:18:05.709719951Z [2024-05-24T01:18:05.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:18:05.709903827Z [2024-05-24T01:18:05.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:17:00+00:00, run_id=scheduled__2024-05-24T01:17:00+00:00, run_start_date=2024-05-24 01:18:00.365710+00:00, run_end_date=2024-05-24 01:18:05.709540+00:00, run_duration=5.34383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:17:00+00:00, data_interval_end=2024-05-24 01:18:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:18:05.719008470Z [2024-05-24T01:18:05.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:18:05.778201553Z [2024-05-24T01:18:05.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status success for try_number 1 2024-05-24T01:18:05.787045792Z [2024-05-24T01:18:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:17:00+00:00, map_index=-1, run_start_date=2024-05-24 01:18:03.402132+00:00, run_end_date=2024-05-24 01:18:05.200502+00:00, run_duration=1.79837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:00.487088+00:00, queued_by_job_id=1, pid=10778 2024-05-24T01:18:13.613976366Z [2024-05-24T01:18:13.613+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-24T01:18:13.614051069Z 2024-05-24T01:18:13.614069518Z 2024-05-24T01:18:13.614324208Z [2024-05-24T01:18:13.613+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:18:13.614657019Z [2024-05-24T01:18:13.614+0000] {scheduler_job.py:425} INFO - DAG vim_status_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:18:13.615834265Z [2024-05-24T01:18:13.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:18:13.615855259Z 2024-05-24T01:18:13.615863732Z 2024-05-24T01:18:13.621033262Z [2024-05-24T01:18:13.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:17:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:13.621121619Z [2024-05-24T01:18:13.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:18:13.621345045Z [2024-05-24T01:18:13.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:17:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:18:13.621394154Z [2024-05-24T01:18:13.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:18:13.795386243Z [2024-05-24T01:18:13.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status queued for try_number 2 2024-05-24T01:18:13.795458784Z [2024-05-24T01:18:13.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status queued for try_number 2 2024-05-24T01:18:13.819932456Z [2024-05-24T01:18:13.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to db23c071-9055-4b01-b47b-3fa9d9514943 2024-05-24T01:18:13.820280596Z [2024-05-24T01:18:13.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0711c71d-cac0-4a12-844b-286aaba6d2a5 2024-05-24T01:18:16.196135928Z [2024-05-24T01:18:16.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status failed for try_number 2 2024-05-24T01:18:16.196252583Z [2024-05-24T01:18:16.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:17:00+00:00 exited with status failed for try_number 2 2024-05-24T01:18:16.213643712Z [2024-05-24T01:18:16.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 01:18:03.414988+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:13.616876+00:00, queued_by_job_id=1, pid=None 2024-05-24T01:18:16.215321619Z [2024-05-24T01:18:16.214+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:16.220865692Z [2024-05-24T01:18:16.220+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:16.236905004Z [2024-05-24T01:18:16.236+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T011700, start_date=, end_date=20240524T011816 2024-05-24T01:18:16.245063120Z [2024-05-24T01:18:16.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 01:18:03.451035+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:18:13.616876+00:00, queued_by_job_id=1, pid=None 2024-05-24T01:18:16.245469363Z [2024-05-24T01:18:16.245+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:16.247442217Z [2024-05-24T01:18:16.247+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:18:16.261143893Z [2024-05-24T01:18:16.260+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240524T011700, start_date=, end_date=20240524T011816 2024-05-24T01:18:17.294964525Z [2024-05-24T01:18:17.294+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T01:18:17.295617697Z [2024-05-24T01:18:17.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, execution_date=2024-05-24 01:17:00+00:00, run_id=scheduled__2024-05-24T01:17:00+00:00, run_start_date=2024-05-24 01:18:00.362680+00:00, run_end_date=2024-05-24 01:18:17.294938+00:00, run_duration=16.932258, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:17:00+00:00, data_interval_end=2024-05-24 01:18:00+00:00, dag_hash=ae133e1908392dc7cc310dab6c5d4f1e 2024-05-24T01:18:17.310190503Z [2024-05-24T01:18:17.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:18:17.317925207Z [2024-05-24T01:18:17.317+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T01:18:17.318176821Z [2024-05-24T01:18:17.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb, execution_date=2024-05-24 01:17:00+00:00, run_id=scheduled__2024-05-24T01:17:00+00:00, run_start_date=2024-05-24 01:18:00.364645+00:00, run_end_date=2024-05-24 01:18:17.317904+00:00, run_duration=16.953259, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:17:00+00:00, data_interval_end=2024-05-24 01:18:00+00:00, dag_hash=3309a600d6d9e1b4bff8bc5a335538b0 2024-05-24T01:18:17.328892402Z [2024-05-24T01:18:17.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:18:00+00:00, run_after=2024-05-24T01:19:00+00:00 2024-05-24T01:19:00.372190318Z [2024-05-24T01:19:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:19:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:19:00.384459205Z [2024-05-24T01:19:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:19:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:19:00.397576451Z [2024-05-24T01:19:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:19:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:19:00.404583694Z [2024-05-24T01:19:00.404+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:19:00.488363722Z [2024-05-24T01:19:00.484+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:19:00.488394289Z 2024-05-24T01:19:00.488400522Z 2024-05-24T01:19:00.488405316Z 2024-05-24T01:19:00.488410035Z 2024-05-24T01:19:00.488414583Z [2024-05-24T01:19:00.484+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:19:00.488419162Z [2024-05-24T01:19:00.484+0000] {scheduler_job.py:425} INFO - DAG vim_status_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:19:00.488423629Z [2024-05-24T01:19:00.484+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:19:00.488428069Z [2024-05-24T01:19:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:19:00.488434235Z [2024-05-24T01:19:00.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:19:00.488438842Z 2024-05-24T01:19:00.488443345Z 2024-05-24T01:19:00.488447944Z 2024-05-24T01:19:00.488452440Z 2024-05-24T01:19:00.493299786Z [2024-05-24T01:19:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:19:00.493323538Z [2024-05-24T01:19:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:19:00.493345723Z [2024-05-24T01:19:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:19:00.493350731Z [2024-05-24T01:19:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:19:00.493355100Z [2024-05-24T01:19:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:19:00.493359958Z [2024-05-24T01:19:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:19:00.493364469Z [2024-05-24T01:19:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:19:00.493369129Z [2024-05-24T01:19:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:19:01.139571550Z [2024-05-24T01:19:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status queued for try_number 1 2024-05-24T01:19:01.139755011Z [2024-05-24T01:19:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status queued for try_number 1 2024-05-24T01:19:01.139920235Z [2024-05-24T01:19:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status queued for try_number 1 2024-05-24T01:19:01.140129368Z [2024-05-24T01:19:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status queued for try_number 1 2024-05-24T01:19:01.155671824Z [2024-05-24T01:19:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 522dc912-a721-4c55-93f3-93e3cd4e1de1 2024-05-24T01:19:01.158819050Z [2024-05-24T01:19:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to c442b632-cbf2-4ed8-920f-3afbbe713e01 2024-05-24T01:19:01.159060074Z [2024-05-24T01:19:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9185ce31-52d1-4ac7-933d-4e99e198d38e 2024-05-24T01:19:01.159249824Z [2024-05-24T01:19:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7c70de6-5e0c-4d50-bc69-a2bb9dac2b41 2024-05-24T01:19:02.474407775Z [2024-05-24T01:19:02.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:19:02.474731779Z [2024-05-24T01:19:02.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:18:00+00:00, run_id=scheduled__2024-05-24T01:18:00+00:00, run_start_date=2024-05-24 01:19:00.414250+00:00, run_end_date=2024-05-24 01:19:02.474194+00:00, run_duration=2.059944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:18:00+00:00, data_interval_end=2024-05-24 01:19:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:19:02.486157124Z [2024-05-24T01:19:02.485+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:19:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:19:02.538258600Z [2024-05-24T01:19:02.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status success for try_number 1 2024-05-24T01:19:02.538306424Z [2024-05-24T01:19:02.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status failed for try_number 1 2024-05-24T01:19:02.547431605Z [2024-05-24T01:19:02.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:18:00+00:00, map_index=-1, run_start_date=2024-05-24 01:19:01.548489+00:00, run_end_date=2024-05-24 01:19:02.027047+00:00, run_duration=0.478558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:19:00.487254+00:00, queued_by_job_id=1, pid=10830 2024-05-24T01:19:02.547666325Z [2024-05-24T01:19:02.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:18:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:19:00.487254+00:00, queued_by_job_id=1, pid=None 2024-05-24T01:19:02.548191761Z [2024-05-24T01:19:02.547+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:19:02.551372809Z [2024-05-24T01:19:02.551+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:19:02.563853596Z [2024-05-24T01:19:02.563+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T011800, start_date=, end_date=20240524T011902 2024-05-24T01:19:04.432823267Z [2024-05-24T01:19:04.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:19:04.433110872Z [2024-05-24T01:19:04.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:18:00+00:00, run_id=scheduled__2024-05-24T01:18:00+00:00, run_start_date=2024-05-24 01:19:00.417310+00:00, run_end_date=2024-05-24 01:19:04.432803+00:00, run_duration=4.015493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:18:00+00:00, data_interval_end=2024-05-24 01:19:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:19:04.443475384Z [2024-05-24T01:19:04.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:19:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:19:04.450976926Z [2024-05-24T01:19:04.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:19:04.451220584Z [2024-05-24T01:19:04.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:18:00+00:00, run_id=scheduled__2024-05-24T01:18:00+00:00, run_start_date=2024-05-24 01:19:00.416359+00:00, run_end_date=2024-05-24 01:19:04.450961+00:00, run_duration=4.034602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:18:00+00:00, data_interval_end=2024-05-24 01:19:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:19:04.461392405Z [2024-05-24T01:19:04.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:19:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:19:04.529290628Z [2024-05-24T01:19:04.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status success for try_number 1 2024-05-24T01:19:04.529562350Z [2024-05-24T01:19:04.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status success for try_number 1 2024-05-24T01:19:04.543430552Z [2024-05-24T01:19:04.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:18:00+00:00, map_index=-1, run_start_date=2024-05-24 01:19:02.436313+00:00, run_end_date=2024-05-24 01:19:03.742281+00:00, run_duration=1.305968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:19:00.487254+00:00, queued_by_job_id=1, pid=10859 2024-05-24T01:19:04.544111186Z [2024-05-24T01:19:04.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:18:00+00:00, map_index=-1, run_start_date=2024-05-24 01:19:02.471500+00:00, run_end_date=2024-05-24 01:19:04.239035+00:00, run_duration=1.767535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:19:00.487254+00:00, queued_by_job_id=1, pid=10860 2024-05-24T01:19:12.821753412Z [2024-05-24T01:19:12.821+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:19:12.821790340Z 2024-05-24T01:19:12.821801248Z [2024-05-24T01:19:12.821+0000] {scheduler_job.py:425} INFO - DAG vim_status_11479261-d5be-4ea9-ba3c-099601c758bb has 0/16 running and queued tasks 2024-05-24T01:19:12.822424859Z [2024-05-24T01:19:12.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:19:12.822433381Z 2024-05-24T01:19:12.825501675Z [2024-05-24T01:19:12.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:18:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:19:12.825697117Z [2024-05-24T01:19:12.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_11479261-d5be-4ea9-ba3c-099601c758bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:19:12.938758222Z [2024-05-24T01:19:12.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status queued for try_number 2 2024-05-24T01:19:12.949103066Z [2024-05-24T01:19:12.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42e352fe-40b7-4fc9-9ed2-a83a1cfcc85a 2024-05-24T01:19:14.735629263Z [2024-05-24T01:19:14.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_11479261-d5be-4ea9-ba3c-099601c758bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status failed for try_number 2 2024-05-24T01:19:14.744173470Z [2024-05-24T01:19:14.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:18:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-24 01:19:02.553681+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:19:12.822903+00:00, queued_by_job_id=1, pid=None 2024-05-24T01:19:14.745028701Z [2024-05-24T01:19:14.744+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:19:14.747952893Z [2024-05-24T01:19:14.747+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-24T01:19:14.765089649Z [2024-05-24T01:19:14.764+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240524T011800, start_date=, end_date=20240524T011914 2024-05-24T01:19:15.849242977Z [2024-05-24T01:19:15.848+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-24T01:19:15.849610611Z [2024-05-24T01:19:15.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_11479261-d5be-4ea9-ba3c-099601c758bb, execution_date=2024-05-24 01:18:00+00:00, run_id=scheduled__2024-05-24T01:18:00+00:00, run_start_date=2024-05-24 01:19:00.415405+00:00, run_end_date=2024-05-24 01:19:15.849129+00:00, run_duration=15.433724, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:18:00+00:00, data_interval_end=2024-05-24 01:19:00+00:00, dag_hash=ae133e1908392dc7cc310dab6c5d4f1e 2024-05-24T01:19:15.866077482Z [2024-05-24T01:19:15.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_11479261-d5be-4ea9-ba3c-099601c758bb to 2024-05-24T01:19:00+00:00, run_after=2024-05-24T01:20:00+00:00 2024-05-24T01:20:00.339302295Z [2024-05-24T01:20:00.338+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:20:00.371556977Z [2024-05-24T01:20:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:21:00+00:00 2024-05-24T01:20:00.380246646Z [2024-05-24T01:20:00.379+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:20:00.394596785Z [2024-05-24T01:20:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:21:00+00:00 2024-05-24T01:20:00.410981527Z [2024-05-24T01:20:00.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:25:00+00:00 2024-05-24T01:20:00.544011239Z [2024-05-24T01:20:00.543+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T01:20:00.544104229Z 2024-05-24T01:20:00.544115350Z 2024-05-24T01:20:00.544124952Z 2024-05-24T01:20:00.544134076Z 2024-05-24T01:20:00.544142654Z 2024-05-24T01:20:00.544405280Z [2024-05-24T01:20:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:20:00.544635686Z [2024-05-24T01:20:00.544+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:20:00.544978707Z [2024-05-24T01:20:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:20:00.545274158Z [2024-05-24T01:20:00.545+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:20:00.545703231Z [2024-05-24T01:20:00.545+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:20:00.546683382Z [2024-05-24T01:20:00.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:20:00.546733937Z 2024-05-24T01:20:00.546744453Z 2024-05-24T01:20:00.546782282Z 2024-05-24T01:20:00.546791398Z 2024-05-24T01:20:00.546799875Z 2024-05-24T01:20:00.562583764Z [2024-05-24T01:20:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:20:00.562610453Z [2024-05-24T01:20:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:20:00.562614786Z [2024-05-24T01:20:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:20:00.562618495Z [2024-05-24T01:20:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:20:00.562621976Z [2024-05-24T01:20:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:20:00.562625258Z [2024-05-24T01:20:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:20:00.562628527Z [2024-05-24T01:20:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:20:00.562645311Z [2024-05-24T01:20:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:20:00.562648553Z [2024-05-24T01:20:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:20:00.562651979Z [2024-05-24T01:20:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:20:01.184416137Z [2024-05-24T01:20:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:01.184447191Z [2024-05-24T01:20:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:01.184496469Z [2024-05-24T01:20:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:19:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:01.184569957Z [2024-05-24T01:20:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:19:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:01.184598606Z [2024-05-24T01:20:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:19:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:01.203762963Z [2024-05-24T01:20:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9659eed8-f0ac-4691-abe8-5b0c2e3ce40b 2024-05-24T01:20:01.203819140Z [2024-05-24T01:20:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to e757ad3f-629a-4aaa-99c1-b747f6bfc669 2024-05-24T01:20:01.203919171Z [2024-05-24T01:20:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d584b0b-c7b7-44de-8bcd-4796eb8e1aaa 2024-05-24T01:20:01.204018752Z [2024-05-24T01:20:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5c5cc82-0013-41e7-9b22-bf3ffbf58893 2024-05-24T01:20:01.204097087Z [2024-05-24T01:20:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to d022adca-600e-425c-90d4-af39a18adecd 2024-05-24T01:20:02.436186154Z [2024-05-24T01:20:02.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:20:02.442449127Z [2024-05-24T01:20:02.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:18:00+00:00, run_id=scheduled__2024-05-24T01:18:00+00:00, run_start_date=2024-05-24 01:20:00.429019+00:00, run_end_date=2024-05-24 01:20:02.436103+00:00, run_duration=2.007084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:18:00+00:00, data_interval_end=2024-05-24 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:20:02.463870250Z [2024-05-24T01:20:02.463+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:22:00+00:00 2024-05-24T01:20:02.479992122Z [2024-05-24T01:20:02.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:20:02.480380010Z [2024-05-24T01:20:02.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:19:00+00:00, run_id=scheduled__2024-05-24T01:19:00+00:00, run_start_date=2024-05-24 01:20:00.430200+00:00, run_end_date=2024-05-24 01:20:02.479916+00:00, run_duration=2.049716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:19:00+00:00, data_interval_end=2024-05-24 01:20:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:20:02.502276148Z [2024-05-24T01:20:02.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:21:00+00:00 2024-05-24T01:20:02.621820902Z [2024-05-24T01:20:02.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:18:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:02.621961784Z [2024-05-24T01:20:02.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:19:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:02.630781247Z [2024-05-24T01:20:02.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:19:00+00:00, map_index=-1, run_start_date=2024-05-24 01:20:01.557222+00:00, run_end_date=2024-05-24 01:20:01.988482+00:00, run_duration=0.43126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:00.547714+00:00, queued_by_job_id=1, pid=10905 2024-05-24T01:20:02.631038853Z [2024-05-24T01:20:02.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:18:00+00:00, map_index=-1, run_start_date=2024-05-24 01:20:01.625129+00:00, run_end_date=2024-05-24 01:20:02.029891+00:00, run_duration=0.404762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:00.547714+00:00, queued_by_job_id=1, pid=10906 2024-05-24T01:20:04.383990590Z [2024-05-24T01:20:04.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:20:04.384484874Z [2024-05-24T01:20:04.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:19:00+00:00, run_id=scheduled__2024-05-24T01:19:00+00:00, run_start_date=2024-05-24 01:20:00.431507+00:00, run_end_date=2024-05-24 01:20:04.383792+00:00, run_duration=3.952285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:19:00+00:00, data_interval_end=2024-05-24 01:20:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:20:04.395368469Z [2024-05-24T01:20:04.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:21:00+00:00 2024-05-24T01:20:04.422685227Z [2024-05-24T01:20:04.422+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:20:04.422721753Z 2024-05-24T01:20:04.422730118Z [2024-05-24T01:20:04.422+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:20:04.424707707Z [2024-05-24T01:20:04.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:20:04.424724976Z 2024-05-24T01:20:04.428416310Z [2024-05-24T01:20:04.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:20:04.428762009Z [2024-05-24T01:20:04.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:20:04.485860096Z [2024-05-24T01:20:04.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:04.485893818Z [2024-05-24T01:20:04.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:04.485972390Z [2024-05-24T01:20:04.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:19:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:04.491873508Z [2024-05-24T01:20:04.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:15:00+00:00, map_index=-1, run_start_date=2024-05-24 01:20:03.065728+00:00, run_end_date=2024-05-24 01:20:03.467130+00:00, run_duration=0.401402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:00.547714+00:00, queued_by_job_id=1, pid=10936 2024-05-24T01:20:04.492375454Z [2024-05-24T01:20:04.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:19:00+00:00, map_index=-1, run_start_date=2024-05-24 01:20:02.968179+00:00, run_end_date=2024-05-24 01:20:04.321710+00:00, run_duration=1.353531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:00.547714+00:00, queued_by_job_id=1, pid=10935 2024-05-24T01:20:04.492563645Z [2024-05-24T01:20:04.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c98c4cf-35e3-4788-ae2a-e802994cdb32 2024-05-24T01:20:05.661292593Z [2024-05-24T01:20:05.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:20:05.661441022Z [2024-05-24T01:20:05.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:19:00+00:00, run_id=scheduled__2024-05-24T01:19:00+00:00, run_start_date=2024-05-24 01:20:00.432663+00:00, run_end_date=2024-05-24 01:20:05.661010+00:00, run_duration=5.228347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:19:00+00:00, data_interval_end=2024-05-24 01:20:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:20:05.671743272Z [2024-05-24T01:20:05.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:21:00+00:00 2024-05-24T01:20:05.733403997Z [2024-05-24T01:20:05.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:19:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:05.744345513Z [2024-05-24T01:20:05.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:19:00+00:00, map_index=-1, run_start_date=2024-05-24 01:20:03.162114+00:00, run_end_date=2024-05-24 01:20:04.771397+00:00, run_duration=1.609283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:00.547714+00:00, queued_by_job_id=1, pid=10937 2024-05-24T01:20:06.836369364Z [2024-05-24T01:20:06.836+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:20:06.836396175Z 2024-05-24T01:20:06.836472664Z [2024-05-24T01:20:06.836+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:20:06.837075433Z [2024-05-24T01:20:06.836+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:20:06.837111017Z 2024-05-24T01:20:06.839435183Z [2024-05-24T01:20:06.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:20:06.839616665Z [2024-05-24T01:20:06.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:20:06.911246237Z [2024-05-24T01:20:06.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:06.911535011Z [2024-05-24T01:20:06.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:06.922089342Z [2024-05-24T01:20:06.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62510304-026a-4347-820c-a530bb01eeba 2024-05-24T01:20:06.922443259Z [2024-05-24T01:20:06.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:15:00+00:00, map_index=-1, run_start_date=2024-05-24 01:20:06.032718+00:00, run_end_date=2024-05-24 01:20:06.463544+00:00, run_duration=0.430826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:04.425473+00:00, queued_by_job_id=1, pid=10960 2024-05-24T01:20:09.202274116Z [2024-05-24T01:20:09.201+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:20:09.202320484Z 2024-05-24T01:20:09.202349330Z [2024-05-24T01:20:09.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:20:09.203207556Z [2024-05-24T01:20:09.202+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:20:09.203242208Z 2024-05-24T01:20:09.206539925Z [2024-05-24T01:20:09.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:20:09.206587317Z [2024-05-24T01:20:09.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:20:09.279357490Z [2024-05-24T01:20:09.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status queued for try_number 1 2024-05-24T01:20:09.279700208Z [2024-05-24T01:20:09.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:09.291896766Z [2024-05-24T01:20:09.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to d473ada6-9004-470e-8317-7f43a79ffd00 2024-05-24T01:20:09.292524777Z [2024-05-24T01:20:09.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:15:00+00:00, map_index=0, run_start_date=2024-05-24 01:20:08.411908+00:00, run_end_date=2024-05-24 01:20:08.791754+00:00, run_duration=0.379846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:06.837368+00:00, queued_by_job_id=1, pid=10968 2024-05-24T01:20:11.803461941Z [2024-05-24T01:20:11.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:20:11.803622358Z [2024-05-24T01:20:11.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:15:00+00:00, run_id=scheduled__2024-05-24T01:15:00+00:00, run_start_date=2024-05-24 01:20:00.426894+00:00, run_end_date=2024-05-24 01:20:11.803209+00:00, run_duration=11.376315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:15:00+00:00, data_interval_end=2024-05-24 01:20:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:20:11.810208104Z [2024-05-24T01:20:11.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:20:00+00:00, run_after=2024-05-24T01:25:00+00:00 2024-05-24T01:20:11.867983066Z [2024-05-24T01:20:11.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:15:00+00:00 exited with status success for try_number 1 2024-05-24T01:20:11.879888337Z [2024-05-24T01:20:11.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:15:00+00:00, map_index=-1, run_start_date=2024-05-24 01:20:10.913732+00:00, run_end_date=2024-05-24 01:20:11.257580+00:00, run_duration=0.343848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:20:09.203506+00:00, queued_by_job_id=1, pid=10976 2024-05-24T01:21:00.435114589Z [2024-05-24T01:21:00.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:21:00+00:00, run_after=2024-05-24T01:22:00+00:00 2024-05-24T01:21:00.451601372Z [2024-05-24T01:21:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:21:00+00:00, run_after=2024-05-24T01:22:00+00:00 2024-05-24T01:21:00.458604444Z [2024-05-24T01:21:00.458+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:21:00.546952130Z [2024-05-24T01:21:00.546+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:21:00.546982732Z 2024-05-24T01:21:00.546988645Z 2024-05-24T01:21:00.546993689Z 2024-05-24T01:21:00.547144891Z [2024-05-24T01:21:00.546+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:21:00.548967685Z [2024-05-24T01:21:00.547+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:21:00.550175182Z [2024-05-24T01:21:00.548+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:21:00.551312145Z [2024-05-24T01:21:00.550+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:21:00.551326973Z 2024-05-24T01:21:00.551331969Z 2024-05-24T01:21:00.551337051Z 2024-05-24T01:21:00.555024114Z [2024-05-24T01:21:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:21:00.555196074Z [2024-05-24T01:21:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:21:00.555405546Z [2024-05-24T01:21:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:21:00.555522305Z [2024-05-24T01:21:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:21:00.555711869Z [2024-05-24T01:21:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:21:00.555839337Z [2024-05-24T01:21:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:21:00.816639205Z [2024-05-24T01:21:00.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:21:00.816669851Z [2024-05-24T01:21:00.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:21:00.816781239Z [2024-05-24T01:21:00.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:21:00.824640620Z [2024-05-24T01:21:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21b1a457-f8ac-4a2c-a71d-79e9ab51cb15 2024-05-24T01:21:00.824720053Z [2024-05-24T01:21:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30e68643-5419-4de7-b1e8-57b352c9b310 2024-05-24T01:21:00.824917608Z [2024-05-24T01:21:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fd1413a-6e2d-4a91-9bef-988106743962 2024-05-24T01:21:01.969699024Z [2024-05-24T01:21:01.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:21:01.969956328Z [2024-05-24T01:21:01.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:20:00+00:00, run_id=scheduled__2024-05-24T01:20:00+00:00, run_start_date=2024-05-24 01:21:00.470604+00:00, run_end_date=2024-05-24 01:21:01.969599+00:00, run_duration=1.498995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:20:00+00:00, data_interval_end=2024-05-24 01:21:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:21:01.978536293Z [2024-05-24T01:21:01.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:21:00+00:00, run_after=2024-05-24T01:22:00+00:00 2024-05-24T01:21:02.033687318Z [2024-05-24T01:21:02.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:21:02.039684757Z [2024-05-24T01:21:02.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=-1, run_start_date=2024-05-24 01:21:01.368277+00:00, run_end_date=2024-05-24 01:21:01.734115+00:00, run_duration=0.365838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:21:00.552013+00:00, queued_by_job_id=1, pid=10997 2024-05-24T01:21:03.802281595Z [2024-05-24T01:21:03.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:21:03.802325486Z [2024-05-24T01:21:03.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:20:00+00:00, run_id=scheduled__2024-05-24T01:20:00+00:00, run_start_date=2024-05-24 01:21:00.473491+00:00, run_end_date=2024-05-24 01:21:03.801334+00:00, run_duration=3.327843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:20:00+00:00, data_interval_end=2024-05-24 01:21:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:21:03.819895213Z [2024-05-24T01:21:03.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:21:00+00:00, run_after=2024-05-24T01:22:00+00:00 2024-05-24T01:21:03.830680552Z [2024-05-24T01:21:03.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:21:03.830706742Z [2024-05-24T01:21:03.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:20:00+00:00, run_id=scheduled__2024-05-24T01:20:00+00:00, run_start_date=2024-05-24 01:21:00.475927+00:00, run_end_date=2024-05-24 01:21:03.829884+00:00, run_duration=3.353957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:20:00+00:00, data_interval_end=2024-05-24 01:21:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:21:03.867154052Z [2024-05-24T01:21:03.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:21:00+00:00, run_after=2024-05-24T01:22:00+00:00 2024-05-24T01:21:03.928006566Z [2024-05-24T01:21:03.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:21:03.928112745Z [2024-05-24T01:21:03.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=-1, run_start_date=2024-05-24 01:21:02.264015+00:00, run_end_date=2024-05-24 01:21:03.654004+00:00, run_duration=1.389989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:21:00.552013+00:00, queued_by_job_id=1, pid=11016 2024-05-24T01:21:05.033332877Z [2024-05-24T01:21:05.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:21:05.038268758Z [2024-05-24T01:21:05.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=-1, run_start_date=2024-05-24 01:21:02.232246+00:00, run_end_date=2024-05-24 01:21:03.763952+00:00, run_duration=1.531706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:21:00.552013+00:00, queued_by_job_id=1, pid=11015 2024-05-24T01:21:41.347637767Z [2024-05-24T01:21:41.346+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:22:00.829656616Z [2024-05-24T01:22:00.828+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:22:00.842549409Z [2024-05-24T01:22:00.842+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:22:00.869061557Z [2024-05-24T01:22:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:22:00+00:00, run_after=2024-05-24T01:23:00+00:00 2024-05-24T01:22:00.885069260Z [2024-05-24T01:22:00.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:22:00+00:00, run_after=2024-05-24T01:23:00+00:00 2024-05-24T01:22:01.037069898Z [2024-05-24T01:22:01.036+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:22:01.037102663Z 2024-05-24T01:22:01.037125879Z 2024-05-24T01:22:01.037131587Z 2024-05-24T01:22:01.037136490Z 2024-05-24T01:22:01.037230518Z [2024-05-24T01:22:01.036+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:22:01.037248466Z [2024-05-24T01:22:01.037+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:22:01.037320527Z [2024-05-24T01:22:01.037+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:22:01.037415539Z [2024-05-24T01:22:01.037+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:22:01.038061067Z [2024-05-24T01:22:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:22:01.038085500Z 2024-05-24T01:22:01.038091082Z 2024-05-24T01:22:01.038095516Z 2024-05-24T01:22:01.038100129Z 2024-05-24T01:22:01.043033661Z [2024-05-24T01:22:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:22:01.043170996Z [2024-05-24T01:22:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:22:01.043362933Z [2024-05-24T01:22:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:22:01.043446884Z [2024-05-24T01:22:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:22:01.043626028Z [2024-05-24T01:22:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:22:01.043702769Z [2024-05-24T01:22:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:22:01.043875523Z [2024-05-24T01:22:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:22:01.043949609Z [2024-05-24T01:22:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:22:01.427577789Z [2024-05-24T01:22:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:22:01.428041484Z [2024-05-24T01:22:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:21:00+00:00 exited with status queued for try_number 1 2024-05-24T01:22:01.428299906Z [2024-05-24T01:22:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:21:00+00:00 exited with status queued for try_number 1 2024-05-24T01:22:01.428535602Z [2024-05-24T01:22:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:21:00+00:00 exited with status queued for try_number 1 2024-05-24T01:22:01.439657858Z [2024-05-24T01:22:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9303ad8d-da93-42a4-ae56-fc741d8e3c30 2024-05-24T01:22:01.440730868Z [2024-05-24T01:22:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to b96666d7-a56e-42d2-bf59-a996c743dfaf 2024-05-24T01:22:01.441026425Z [2024-05-24T01:22:01.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91077e34-85c1-4256-8204-e3f15be01d89 2024-05-24T01:22:01.441318122Z [2024-05-24T01:22:01.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7c2faf9-0f57-4869-98ef-f7645f7f91b0 2024-05-24T01:22:02.725171039Z [2024-05-24T01:22:02.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:22:02.725199162Z [2024-05-24T01:22:02.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:20:00+00:00, run_id=scheduled__2024-05-24T01:20:00+00:00, run_start_date=2024-05-24 01:22:00.905087+00:00, run_end_date=2024-05-24 01:22:02.723893+00:00, run_duration=1.818806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:20:00+00:00, data_interval_end=2024-05-24 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:22:02.758004829Z [2024-05-24T01:22:02.755+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:22:00+00:00, run_after=2024-05-24T01:24:00+00:00 2024-05-24T01:22:02.999142583Z [2024-05-24T01:22:02.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:22:02.999515120Z [2024-05-24T01:22:02.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:21:00+00:00 exited with status success for try_number 1 2024-05-24T01:22:03.016748994Z [2024-05-24T01:22:03.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=-1, run_start_date=2024-05-24 01:22:02.081342+00:00, run_end_date=2024-05-24 01:22:02.523785+00:00, run_duration=0.442443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:22:01.040020+00:00, queued_by_job_id=1, pid=11049 2024-05-24T01:22:03.022204752Z [2024-05-24T01:22:03.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:21:00+00:00, map_index=-1, run_start_date=2024-05-24 01:22:02.289485+00:00, run_end_date=2024-05-24 01:22:02.840754+00:00, run_duration=0.551269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:22:01.040020+00:00, queued_by_job_id=1, pid=11051 2024-05-24T01:22:03.595203738Z [2024-05-24T01:22:03.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:22:03.595716873Z [2024-05-24T01:22:03.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:21:00+00:00, run_id=scheduled__2024-05-24T01:21:00+00:00, run_start_date=2024-05-24 01:22:00.910698+00:00, run_end_date=2024-05-24 01:22:03.595106+00:00, run_duration=2.684408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:21:00+00:00, data_interval_end=2024-05-24 01:22:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:22:03.607572546Z [2024-05-24T01:22:03.607+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:22:00+00:00, run_after=2024-05-24T01:23:00+00:00 2024-05-24T01:22:05.502207637Z [2024-05-24T01:22:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:22:05.502596674Z [2024-05-24T01:22:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:21:00+00:00, run_id=scheduled__2024-05-24T01:21:00+00:00, run_start_date=2024-05-24 01:22:00.913546+00:00, run_end_date=2024-05-24 01:22:05.502140+00:00, run_duration=4.588594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:21:00+00:00, data_interval_end=2024-05-24 01:22:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:22:05.514004589Z [2024-05-24T01:22:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:22:00+00:00, run_after=2024-05-24T01:23:00+00:00 2024-05-24T01:22:05.523439563Z [2024-05-24T01:22:05.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:22:05.523753584Z [2024-05-24T01:22:05.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:21:00+00:00, run_id=scheduled__2024-05-24T01:21:00+00:00, run_start_date=2024-05-24 01:22:00.915619+00:00, run_end_date=2024-05-24 01:22:05.523371+00:00, run_duration=4.607752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:21:00+00:00, data_interval_end=2024-05-24 01:22:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:22:05.535252994Z [2024-05-24T01:22:05.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:22:00+00:00, run_after=2024-05-24T01:23:00+00:00 2024-05-24T01:22:05.570826736Z [2024-05-24T01:22:05.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:21:00+00:00 exited with status success for try_number 1 2024-05-24T01:22:05.571248280Z [2024-05-24T01:22:05.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:21:00+00:00 exited with status success for try_number 1 2024-05-24T01:22:05.580308601Z [2024-05-24T01:22:05.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:21:00+00:00, map_index=-1, run_start_date=2024-05-24 01:22:03.087792+00:00, run_end_date=2024-05-24 01:22:04.365015+00:00, run_duration=1.277223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:22:01.040020+00:00, queued_by_job_id=1, pid=11068 2024-05-24T01:22:05.580517113Z [2024-05-24T01:22:05.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:21:00+00:00, map_index=-1, run_start_date=2024-05-24 01:22:03.473623+00:00, run_end_date=2024-05-24 01:22:05.086205+00:00, run_duration=1.612582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:22:01.040020+00:00, queued_by_job_id=1, pid=11079 2024-05-24T01:23:00.664453225Z [2024-05-24T01:23:00.663+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:23:00.688303142Z [2024-05-24T01:23:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:23:00+00:00, run_after=2024-05-24T01:24:00+00:00 2024-05-24T01:23:00.707946931Z [2024-05-24T01:23:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:23:00+00:00, run_after=2024-05-24T01:24:00+00:00 2024-05-24T01:23:00.801733818Z [2024-05-24T01:23:00.801+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:23:00.801776553Z 2024-05-24T01:23:00.801786405Z 2024-05-24T01:23:00.801794836Z 2024-05-24T01:23:00.801816913Z [2024-05-24T01:23:00.801+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:23:00.801953907Z [2024-05-24T01:23:00.801+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:23:00.802072114Z [2024-05-24T01:23:00.801+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:23:00.802679430Z [2024-05-24T01:23:00.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:23:00.802697870Z 2024-05-24T01:23:00.802712388Z 2024-05-24T01:23:00.802720210Z 2024-05-24T01:23:00.806297366Z [2024-05-24T01:23:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:23:00.806463989Z [2024-05-24T01:23:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:23:00.808224938Z [2024-05-24T01:23:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:23:00.808265858Z [2024-05-24T01:23:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:23:00.808278430Z [2024-05-24T01:23:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:23:00.808289935Z [2024-05-24T01:23:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:23:01.047529227Z [2024-05-24T01:23:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status queued for try_number 1 2024-05-24T01:23:01.047915795Z [2024-05-24T01:23:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status queued for try_number 1 2024-05-24T01:23:01.048224508Z [2024-05-24T01:23:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status queued for try_number 1 2024-05-24T01:23:01.057107360Z [2024-05-24T01:23:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f0b837e-431b-4411-bba2-bd8d5461f827 2024-05-24T01:23:01.057355775Z [2024-05-24T01:23:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb0f1cfe-d121-4dbf-af23-a6e987081644 2024-05-24T01:23:01.057621762Z [2024-05-24T01:23:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba522c7b-adc3-4e5a-b5b8-cc8fe706c0a9 2024-05-24T01:23:02.211422168Z [2024-05-24T01:23:02.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:23:02.211881049Z [2024-05-24T01:23:02.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:22:00+00:00, run_id=scheduled__2024-05-24T01:22:00+00:00, run_start_date=2024-05-24 01:23:00.724415+00:00, run_end_date=2024-05-24 01:23:02.211347+00:00, run_duration=1.486932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:22:00+00:00, data_interval_end=2024-05-24 01:23:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:23:02.222666235Z [2024-05-24T01:23:02.222+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:23:00+00:00, run_after=2024-05-24T01:24:00+00:00 2024-05-24T01:23:02.290959956Z [2024-05-24T01:23:02.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status success for try_number 1 2024-05-24T01:23:02.302367645Z [2024-05-24T01:23:02.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:22:00+00:00, map_index=-1, run_start_date=2024-05-24 01:23:01.603788+00:00, run_end_date=2024-05-24 01:23:01.988012+00:00, run_duration=0.384224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:23:00.803285+00:00, queued_by_job_id=1, pid=11105 2024-05-24T01:23:03.907509471Z [2024-05-24T01:23:03.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:23:03.907540062Z [2024-05-24T01:23:03.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:22:00+00:00, run_id=scheduled__2024-05-24T01:22:00+00:00, run_start_date=2024-05-24 01:23:00.725830+00:00, run_end_date=2024-05-24 01:23:03.907197+00:00, run_duration=3.181367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:22:00+00:00, data_interval_end=2024-05-24 01:23:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:23:03.917449240Z [2024-05-24T01:23:03.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:23:00+00:00, run_after=2024-05-24T01:24:00+00:00 2024-05-24T01:23:04.852041058Z [2024-05-24T01:23:04.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:23:04.852842718Z [2024-05-24T01:23:04.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:22:00+00:00, run_id=scheduled__2024-05-24T01:22:00+00:00, run_start_date=2024-05-24 01:23:00.727160+00:00, run_end_date=2024-05-24 01:23:04.852188+00:00, run_duration=4.125028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:22:00+00:00, data_interval_end=2024-05-24 01:23:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:23:04.866076857Z [2024-05-24T01:23:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:23:00+00:00, run_after=2024-05-24T01:24:00+00:00 2024-05-24T01:23:04.917087881Z [2024-05-24T01:23:04.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status success for try_number 1 2024-05-24T01:23:04.917322715Z [2024-05-24T01:23:04.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status success for try_number 1 2024-05-24T01:23:04.928270463Z [2024-05-24T01:23:04.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:22:00+00:00, map_index=-1, run_start_date=2024-05-24 01:23:02.629185+00:00, run_end_date=2024-05-24 01:23:04.188799+00:00, run_duration=1.559614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:23:00.803285+00:00, queued_by_job_id=1, pid=11124 2024-05-24T01:23:04.928770281Z [2024-05-24T01:23:04.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:22:00+00:00, map_index=-1, run_start_date=2024-05-24 01:23:02.562166+00:00, run_end_date=2024-05-24 01:23:03.861227+00:00, run_duration=1.299061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:23:00.803285+00:00, queued_by_job_id=1, pid=11123 2024-05-24T01:24:00.649588996Z [2024-05-24T01:24:00.648+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:24:00+00:00, run_after=2024-05-24T01:25:00+00:00 2024-05-24T01:24:00.659688404Z [2024-05-24T01:24:00.659+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:24:00.668693590Z [2024-05-24T01:24:00.668+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:24:00.683112274Z [2024-05-24T01:24:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:24:00+00:00, run_after=2024-05-24T01:25:00+00:00 2024-05-24T01:24:00.812895865Z [2024-05-24T01:24:00.812+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:24:00.812931319Z 2024-05-24T01:24:00.812955710Z 2024-05-24T01:24:00.812964280Z 2024-05-24T01:24:00.812970214Z 2024-05-24T01:24:00.813086108Z [2024-05-24T01:24:00.812+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:24:00.813477948Z [2024-05-24T01:24:00.813+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:24:00.813642372Z [2024-05-24T01:24:00.813+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:24:00.813825880Z [2024-05-24T01:24:00.813+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:24:00.815084387Z [2024-05-24T01:24:00.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:24:00.815171196Z 2024-05-24T01:24:00.815183991Z 2024-05-24T01:24:00.815192794Z 2024-05-24T01:24:00.815201510Z 2024-05-24T01:24:00.822109852Z [2024-05-24T01:24:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:24:00.822348187Z [2024-05-24T01:24:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:24:00.822963999Z [2024-05-24T01:24:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:24:00.823167759Z [2024-05-24T01:24:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:24:00.823579643Z [2024-05-24T01:24:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:24:00.823646767Z [2024-05-24T01:24:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:24:00.824022218Z [2024-05-24T01:24:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:24:00.824150167Z [2024-05-24T01:24:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:24:01.466135389Z [2024-05-24T01:24:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status queued for try_number 1 2024-05-24T01:24:01.466185152Z [2024-05-24T01:24:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:23:00+00:00 exited with status queued for try_number 1 2024-05-24T01:24:01.466263159Z [2024-05-24T01:24:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:23:00+00:00 exited with status queued for try_number 1 2024-05-24T01:24:01.466300856Z [2024-05-24T01:24:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:23:00+00:00 exited with status queued for try_number 1 2024-05-24T01:24:01.487981697Z [2024-05-24T01:24:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa08b61e-2dac-4c9b-bbf7-3d65dd2c9d0b 2024-05-24T01:24:01.488052550Z [2024-05-24T01:24:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aee28be-7e6a-42b0-8eb7-111f25062739 2024-05-24T01:24:01.488134492Z [2024-05-24T01:24:01.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f360c64-aad4-4fa5-a6c8-ed11a6e3d2c9 2024-05-24T01:24:01.488240439Z [2024-05-24T01:24:01.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04376556-7151-46bd-9075-a24f3029c28c 2024-05-24T01:24:02.671209705Z [2024-05-24T01:24:02.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:24:02.672211791Z [2024-05-24T01:24:02.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:22:00+00:00, run_id=scheduled__2024-05-24T01:22:00+00:00, run_start_date=2024-05-24 01:24:00.695356+00:00, run_end_date=2024-05-24 01:24:02.671095+00:00, run_duration=1.975739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:22:00+00:00, data_interval_end=2024-05-24 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:24:02.688484833Z [2024-05-24T01:24:02.688+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:24:00+00:00, run_after=2024-05-24T01:26:00+00:00 2024-05-24T01:24:02.710683126Z [2024-05-24T01:24:02.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:24:02.710707791Z [2024-05-24T01:24:02.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:23:00+00:00, run_id=scheduled__2024-05-24T01:23:00+00:00, run_start_date=2024-05-24 01:24:00.697132+00:00, run_end_date=2024-05-24 01:24:02.699468+00:00, run_duration=2.002336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:23:00+00:00, data_interval_end=2024-05-24 01:24:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:24:02.727840835Z [2024-05-24T01:24:02.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:24:00+00:00, run_after=2024-05-24T01:25:00+00:00 2024-05-24T01:24:02.864922549Z [2024-05-24T01:24:02.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:22:00+00:00 exited with status success for try_number 1 2024-05-24T01:24:02.867270835Z [2024-05-24T01:24:02.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:23:00+00:00 exited with status success for try_number 1 2024-05-24T01:24:02.885413809Z [2024-05-24T01:24:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:22:00+00:00, map_index=-1, run_start_date=2024-05-24 01:24:01.620587+00:00, run_end_date=2024-05-24 01:24:02.027254+00:00, run_duration=0.406667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:24:00.816377+00:00, queued_by_job_id=1, pid=11157 2024-05-24T01:24:02.885771487Z [2024-05-24T01:24:02.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:23:00+00:00, map_index=-1, run_start_date=2024-05-24 01:24:01.716118+00:00, run_end_date=2024-05-24 01:24:02.201025+00:00, run_duration=0.484907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:24:00.816377+00:00, queued_by_job_id=1, pid=11158 2024-05-24T01:24:05.381299547Z [2024-05-24T01:24:05.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:24:05.381735621Z [2024-05-24T01:24:05.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:23:00+00:00, run_id=scheduled__2024-05-24T01:23:00+00:00, run_start_date=2024-05-24 01:24:00.698427+00:00, run_end_date=2024-05-24 01:24:05.381170+00:00, run_duration=4.682743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:23:00+00:00, data_interval_end=2024-05-24 01:24:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:24:05.395039743Z [2024-05-24T01:24:05.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:24:00+00:00, run_after=2024-05-24T01:25:00+00:00 2024-05-24T01:24:05.402493811Z [2024-05-24T01:24:05.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:24:05.402659172Z [2024-05-24T01:24:05.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:23:00+00:00, run_id=scheduled__2024-05-24T01:23:00+00:00, run_start_date=2024-05-24 01:24:00.699565+00:00, run_end_date=2024-05-24 01:24:05.402335+00:00, run_duration=4.70277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:23:00+00:00, data_interval_end=2024-05-24 01:24:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:24:05.411413145Z [2024-05-24T01:24:05.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:24:00+00:00, run_after=2024-05-24T01:25:00+00:00 2024-05-24T01:24:05.465336908Z [2024-05-24T01:24:05.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:23:00+00:00 exited with status success for try_number 1 2024-05-24T01:24:05.465561807Z [2024-05-24T01:24:05.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:23:00+00:00 exited with status success for try_number 1 2024-05-24T01:24:05.477133234Z [2024-05-24T01:24:05.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:23:00+00:00, map_index=-1, run_start_date=2024-05-24 01:24:02.907131+00:00, run_end_date=2024-05-24 01:24:04.254427+00:00, run_duration=1.347296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:24:00.816377+00:00, queued_by_job_id=1, pid=11187 2024-05-24T01:24:05.477694025Z [2024-05-24T01:24:05.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:23:00+00:00, map_index=-1, run_start_date=2024-05-24 01:24:02.589804+00:00, run_end_date=2024-05-24 01:24:04.488393+00:00, run_duration=1.898589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:24:00.816377+00:00, queued_by_job_id=1, pid=11176 2024-05-24T01:25:00.552956899Z [2024-05-24T01:25:00.552+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:25:00+00:00, run_after=2024-05-24T01:26:00+00:00 2024-05-24T01:25:00.577683225Z [2024-05-24T01:25:00.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:25:00+00:00, run_after=2024-05-24T01:26:00+00:00 2024-05-24T01:25:00.584167628Z [2024-05-24T01:25:00.583+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:25:00.597230220Z [2024-05-24T01:25:00.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:25:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:25:00.755048604Z [2024-05-24T01:25:00.754+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:25:00.755081842Z 2024-05-24T01:25:00.755086437Z 2024-05-24T01:25:00.755090571Z 2024-05-24T01:25:00.755094152Z 2024-05-24T01:25:00.755521135Z [2024-05-24T01:25:00.754+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:25:00.755684167Z [2024-05-24T01:25:00.755+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:25:00.755904931Z [2024-05-24T01:25:00.755+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:25:00.756088467Z [2024-05-24T01:25:00.755+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:25:00.756911910Z [2024-05-24T01:25:00.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:25:00.756925766Z 2024-05-24T01:25:00.756930025Z 2024-05-24T01:25:00.756933754Z 2024-05-24T01:25:00.756937314Z 2024-05-24T01:25:00.761215303Z [2024-05-24T01:25:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:25:00.761511124Z [2024-05-24T01:25:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:25:00.761862278Z [2024-05-24T01:25:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:25:00.762071863Z [2024-05-24T01:25:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:25:00.762402934Z [2024-05-24T01:25:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:25:00.762660838Z [2024-05-24T01:25:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:25:00.762997785Z [2024-05-24T01:25:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:25:00.763211191Z [2024-05-24T01:25:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:25:01.328441319Z [2024-05-24T01:25:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:25:01.328739009Z [2024-05-24T01:25:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status queued for try_number 1 2024-05-24T01:25:01.328984986Z [2024-05-24T01:25:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status queued for try_number 1 2024-05-24T01:25:01.329213291Z [2024-05-24T01:25:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status queued for try_number 1 2024-05-24T01:25:01.350839413Z [2024-05-24T01:25:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc640b0e-c440-426f-b4d3-35d963c421e4 2024-05-24T01:25:01.352179105Z [2024-05-24T01:25:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3c8040a-75e5-4b38-837e-07a447e0244e 2024-05-24T01:25:01.352739685Z [2024-05-24T01:25:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d6bcbf6-eff9-4cd8-8334-16737474ebb5 2024-05-24T01:25:01.353143955Z [2024-05-24T01:25:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6d003da-858e-4b6b-9b76-32513a79a5f6 2024-05-24T01:25:02.679727021Z [2024-05-24T01:25:02.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:25:02.680036011Z [2024-05-24T01:25:02.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:24:00+00:00, run_id=scheduled__2024-05-24T01:24:00+00:00, run_start_date=2024-05-24 01:25:00.610952+00:00, run_end_date=2024-05-24 01:25:02.679714+00:00, run_duration=2.068762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:24:00+00:00, data_interval_end=2024-05-24 01:25:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:25:02.693233910Z [2024-05-24T01:25:02.692+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:25:00+00:00, run_after=2024-05-24T01:26:00+00:00 2024-05-24T01:25:02.826497772Z [2024-05-24T01:25:02.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status success for try_number 1 2024-05-24T01:25:02.831361835Z [2024-05-24T01:25:02.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:24:00+00:00, map_index=-1, run_start_date=2024-05-24 01:25:01.996164+00:00, run_end_date=2024-05-24 01:25:02.514095+00:00, run_duration=0.517931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:25:00.757898+00:00, queued_by_job_id=1, pid=11215 2024-05-24T01:25:04.600462364Z [2024-05-24T01:25:04.600+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:25:04.600520355Z 2024-05-24T01:25:04.600908261Z [2024-05-24T01:25:04.600+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:25:04.601570001Z [2024-05-24T01:25:04.601+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:25:04.601581377Z 2024-05-24T01:25:04.604111265Z [2024-05-24T01:25:04.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:25:04.604443059Z [2024-05-24T01:25:04.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:25:04.689701574Z [2024-05-24T01:25:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:25:04.689722106Z [2024-05-24T01:25:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:25:04.695479776Z [2024-05-24T01:25:04.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeba2c74-f37d-4f21-9b8f-bb816cc62968 2024-05-24T01:25:04.695542910Z [2024-05-24T01:25:04.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=-1, run_start_date=2024-05-24 01:25:03.368221+00:00, run_end_date=2024-05-24 01:25:03.973553+00:00, run_duration=0.605332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:25:00.757898+00:00, queued_by_job_id=1, pid=11229 2024-05-24T01:25:05.887306928Z [2024-05-24T01:25:05.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:25:05.887558616Z [2024-05-24T01:25:05.887+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:24:00+00:00, run_id=scheduled__2024-05-24T01:24:00+00:00, run_start_date=2024-05-24 01:25:00.612755+00:00, run_end_date=2024-05-24 01:25:05.887178+00:00, run_duration=5.274423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:24:00+00:00, data_interval_end=2024-05-24 01:25:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:25:05.899686478Z [2024-05-24T01:25:05.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:25:00+00:00, run_after=2024-05-24T01:26:00+00:00 2024-05-24T01:25:05.972023471Z [2024-05-24T01:25:05.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status success for try_number 1 2024-05-24T01:25:05.981886113Z [2024-05-24T01:25:05.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:24:00+00:00, map_index=-1, run_start_date=2024-05-24 01:25:03.833520+00:00, run_end_date=2024-05-24 01:25:05.371791+00:00, run_duration=1.538271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:25:00.757898+00:00, queued_by_job_id=1, pid=11240 2024-05-24T01:25:07.049744537Z [2024-05-24T01:25:07.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:25:07.049930638Z [2024-05-24T01:25:07.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:24:00+00:00, run_id=scheduled__2024-05-24T01:24:00+00:00, run_start_date=2024-05-24 01:25:00.620397+00:00, run_end_date=2024-05-24 01:25:07.049662+00:00, run_duration=6.429265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:24:00+00:00, data_interval_end=2024-05-24 01:25:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:25:07.058383908Z [2024-05-24T01:25:07.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:25:00+00:00, run_after=2024-05-24T01:26:00+00:00 2024-05-24T01:25:07.149355940Z [2024-05-24T01:25:07.148+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:25:07.149377542Z 2024-05-24T01:25:07.149524295Z [2024-05-24T01:25:07.149+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:25:07.150524293Z [2024-05-24T01:25:07.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:25:07.150537385Z 2024-05-24T01:25:07.159382990Z [2024-05-24T01:25:07.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:25:07.159483559Z [2024-05-24T01:25:07.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:25:07.230649507Z [2024-05-24T01:25:07.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:25:07.230730092Z [2024-05-24T01:25:07.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status success for try_number 1 2024-05-24T01:25:07.239713424Z [2024-05-24T01:25:07.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9159cbdc-3355-488c-b702-12e0908490b3 2024-05-24T01:25:07.240362629Z [2024-05-24T01:25:07.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:24:00+00:00, map_index=-1, run_start_date=2024-05-24 01:25:03.816951+00:00, run_end_date=2024-05-24 01:25:05.912263+00:00, run_duration=2.095312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:25:00.757898+00:00, queued_by_job_id=1, pid=11245 2024-05-24T01:25:07.315751970Z [2024-05-24T01:25:07.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:25:07.320660032Z [2024-05-24T01:25:07.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=-1, run_start_date=2024-05-24 01:25:06.536819+00:00, run_end_date=2024-05-24 01:25:06.960324+00:00, run_duration=0.423505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:25:04.602046+00:00, queued_by_job_id=1, pid=11264 2024-05-24T01:25:09.788186532Z [2024-05-24T01:25:09.787+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:25:09.788216128Z 2024-05-24T01:25:09.788401583Z [2024-05-24T01:25:09.788+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:25:09.789032569Z [2024-05-24T01:25:09.788+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:25:09.789040143Z 2024-05-24T01:25:09.795827834Z [2024-05-24T01:25:09.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:25:09.797312503Z [2024-05-24T01:25:09.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:25:09.846943844Z [2024-05-24T01:25:09.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status queued for try_number 1 2024-05-24T01:25:09.846964680Z [2024-05-24T01:25:09.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:25:09.866720148Z [2024-05-24T01:25:09.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20bd987a-4c1f-419a-86cf-5a6460557909 2024-05-24T01:25:09.866943764Z [2024-05-24T01:25:09.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=0, run_start_date=2024-05-24 01:25:09.182476+00:00, run_end_date=2024-05-24 01:25:09.519039+00:00, run_duration=0.336563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:25:07.152895+00:00, queued_by_job_id=1, pid=11272 2024-05-24T01:25:13.194012996Z [2024-05-24T01:25:13.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:25:13.194517943Z [2024-05-24T01:25:13.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:20:00+00:00, run_id=scheduled__2024-05-24T01:20:00+00:00, run_start_date=2024-05-24 01:25:00.609480+00:00, run_end_date=2024-05-24 01:25:13.193922+00:00, run_duration=12.584442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:20:00+00:00, data_interval_end=2024-05-24 01:25:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:25:13.202809451Z [2024-05-24T01:25:13.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:25:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:25:13.241124422Z [2024-05-24T01:25:13.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:20:00+00:00 exited with status success for try_number 1 2024-05-24T01:25:13.248435450Z [2024-05-24T01:25:13.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:20:00+00:00, map_index=-1, run_start_date=2024-05-24 01:25:11.651921+00:00, run_end_date=2024-05-24 01:25:12.010828+00:00, run_duration=0.358907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:25:09.789388+00:00, queued_by_job_id=1, pid=11280 2024-05-24T01:26:00.602910540Z [2024-05-24T01:26:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:26:00+00:00, run_after=2024-05-24T01:27:00+00:00 2024-05-24T01:26:00.616104549Z [2024-05-24T01:26:00.615+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:26:00+00:00, run_after=2024-05-24T01:27:00+00:00 2024-05-24T01:26:00.624550590Z [2024-05-24T01:26:00.624+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:26:00.633985095Z [2024-05-24T01:26:00.633+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:26:00.740608257Z [2024-05-24T01:26:00.740+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:26:00.740632315Z 2024-05-24T01:26:00.740637105Z 2024-05-24T01:26:00.740640922Z 2024-05-24T01:26:00.740651310Z 2024-05-24T01:26:00.740961021Z [2024-05-24T01:26:00.740+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:26:00.749878831Z [2024-05-24T01:26:00.741+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:26:00.749950967Z [2024-05-24T01:26:00.741+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:26:00.749985487Z [2024-05-24T01:26:00.741+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:26:00.754338896Z [2024-05-24T01:26:00.754+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:26:00.754385230Z 2024-05-24T01:26:00.754392663Z 2024-05-24T01:26:00.754395949Z 2024-05-24T01:26:00.754398909Z 2024-05-24T01:26:00.760191633Z [2024-05-24T01:26:00.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:26:00.760388100Z [2024-05-24T01:26:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:26:00.760685547Z [2024-05-24T01:26:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:26:00.760839899Z [2024-05-24T01:26:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:26:00.761160084Z [2024-05-24T01:26:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:26:00.761285392Z [2024-05-24T01:26:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:26:00.761569008Z [2024-05-24T01:26:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:26:00.761714829Z [2024-05-24T01:26:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:26:01.087344758Z [2024-05-24T01:26:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status queued for try_number 1 2024-05-24T01:26:01.087374976Z [2024-05-24T01:26:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status queued for try_number 1 2024-05-24T01:26:01.087522748Z [2024-05-24T01:26:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status queued for try_number 1 2024-05-24T01:26:01.087579963Z [2024-05-24T01:26:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status queued for try_number 1 2024-05-24T01:26:01.103358389Z [2024-05-24T01:26:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 318e6299-f4a6-4bf6-86fc-97ebb2aafc51 2024-05-24T01:26:01.103430244Z [2024-05-24T01:26:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e211fe3-c362-4397-9cc5-24817581a474 2024-05-24T01:26:01.103510003Z [2024-05-24T01:26:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2f2744b-9a1e-40b0-b171-1cebd2a067cb 2024-05-24T01:26:01.103617958Z [2024-05-24T01:26:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c019764-9077-4fa0-b954-84d0fe6fad1c 2024-05-24T01:26:02.272472287Z [2024-05-24T01:26:02.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:26:02.272940876Z [2024-05-24T01:26:02.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:24:00+00:00, run_id=scheduled__2024-05-24T01:24:00+00:00, run_start_date=2024-05-24 01:26:00.647324+00:00, run_end_date=2024-05-24 01:26:02.272497+00:00, run_duration=1.625173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:24:00+00:00, data_interval_end=2024-05-24 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:26:02.280692075Z [2024-05-24T01:26:02.280+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:26:00+00:00, run_after=2024-05-24T01:28:00+00:00 2024-05-24T01:26:02.287555919Z [2024-05-24T01:26:02.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:26:02.287800785Z [2024-05-24T01:26:02.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:25:00+00:00, run_id=scheduled__2024-05-24T01:25:00+00:00, run_start_date=2024-05-24 01:26:00.648885+00:00, run_end_date=2024-05-24 01:26:02.287528+00:00, run_duration=1.638643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:25:00+00:00, data_interval_end=2024-05-24 01:26:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:26:02.297606923Z [2024-05-24T01:26:02.297+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:26:00+00:00, run_after=2024-05-24T01:27:00+00:00 2024-05-24T01:26:02.349455009Z [2024-05-24T01:26:02.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:24:00+00:00 exited with status success for try_number 1 2024-05-24T01:26:02.349921924Z [2024-05-24T01:26:02.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status success for try_number 1 2024-05-24T01:26:02.362111400Z [2024-05-24T01:26:02.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:25:00+00:00, map_index=-1, run_start_date=2024-05-24 01:26:01.586900+00:00, run_end_date=2024-05-24 01:26:02.102501+00:00, run_duration=0.515601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:26:00.756410+00:00, queued_by_job_id=1, pid=11303 2024-05-24T01:26:02.362700162Z [2024-05-24T01:26:02.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:24:00+00:00, map_index=-1, run_start_date=2024-05-24 01:26:01.638235+00:00, run_end_date=2024-05-24 01:26:02.107732+00:00, run_duration=0.469497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:26:00.756410+00:00, queued_by_job_id=1, pid=11304 2024-05-24T01:26:04.991457075Z [2024-05-24T01:26:04.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:26:04.992019566Z [2024-05-24T01:26:04.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:25:00+00:00, run_id=scheduled__2024-05-24T01:25:00+00:00, run_start_date=2024-05-24 01:26:00.650218+00:00, run_end_date=2024-05-24 01:26:04.991301+00:00, run_duration=4.341083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:25:00+00:00, data_interval_end=2024-05-24 01:26:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:26:05.003690857Z [2024-05-24T01:26:05.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:26:00+00:00, run_after=2024-05-24T01:27:00+00:00 2024-05-24T01:26:05.012762730Z [2024-05-24T01:26:05.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:26:05.013134518Z [2024-05-24T01:26:05.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:25:00+00:00, run_id=scheduled__2024-05-24T01:25:00+00:00, run_start_date=2024-05-24 01:26:00.651521+00:00, run_end_date=2024-05-24 01:26:05.012614+00:00, run_duration=4.361093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:25:00+00:00, data_interval_end=2024-05-24 01:26:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:26:05.022714951Z [2024-05-24T01:26:05.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:26:00+00:00, run_after=2024-05-24T01:27:00+00:00 2024-05-24T01:26:05.062598192Z [2024-05-24T01:26:05.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status success for try_number 1 2024-05-24T01:26:05.062850884Z [2024-05-24T01:26:05.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status success for try_number 1 2024-05-24T01:26:05.070215433Z [2024-05-24T01:26:05.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:25:00+00:00, map_index=-1, run_start_date=2024-05-24 01:26:03.023343+00:00, run_end_date=2024-05-24 01:26:04.631494+00:00, run_duration=1.608151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:26:00.756410+00:00, queued_by_job_id=1, pid=11328 2024-05-24T01:26:05.070536195Z [2024-05-24T01:26:05.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:25:00+00:00, map_index=-1, run_start_date=2024-05-24 01:26:02.875861+00:00, run_end_date=2024-05-24 01:26:04.743476+00:00, run_duration=1.867615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:26:00.756410+00:00, queued_by_job_id=1, pid=11327 2024-05-24T01:26:41.427341104Z [2024-05-24T01:26:41.426+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:27:00.114446929Z [2024-05-24T01:27:00.113+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:27:00.134661959Z [2024-05-24T01:27:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:27:00+00:00, run_after=2024-05-24T01:28:00+00:00 2024-05-24T01:27:00.150656934Z [2024-05-24T01:27:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:27:00+00:00, run_after=2024-05-24T01:28:00+00:00 2024-05-24T01:27:00.254277818Z [2024-05-24T01:27:00.252+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:27:00.254311178Z 2024-05-24T01:27:00.254315387Z 2024-05-24T01:27:00.254318738Z 2024-05-24T01:27:00.254321890Z [2024-05-24T01:27:00.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:27:00.254324908Z [2024-05-24T01:27:00.252+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:27:00.254327898Z [2024-05-24T01:27:00.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:27:00.254331439Z [2024-05-24T01:27:00.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:27:00.254334399Z 2024-05-24T01:27:00.254349113Z 2024-05-24T01:27:00.254352264Z 2024-05-24T01:27:00.257839356Z [2024-05-24T01:27:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:27:00.257854756Z [2024-05-24T01:27:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:27:00.257858136Z [2024-05-24T01:27:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:27:00.257861373Z [2024-05-24T01:27:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:27:00.260648448Z [2024-05-24T01:27:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:27:00.260661007Z [2024-05-24T01:27:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:27:00.689446139Z [2024-05-24T01:27:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status queued for try_number 1 2024-05-24T01:27:00.689476151Z [2024-05-24T01:27:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status queued for try_number 1 2024-05-24T01:27:00.690738625Z [2024-05-24T01:27:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status queued for try_number 1 2024-05-24T01:27:00.707925202Z [2024-05-24T01:27:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b295b6e-07f3-4a9b-9633-81c5aaec9ace 2024-05-24T01:27:00.707995785Z [2024-05-24T01:27:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to e454290f-5bf9-4643-a289-285aef44dc9a 2024-05-24T01:27:00.708061708Z [2024-05-24T01:27:00.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1b02ad9-5c51-4ff7-9169-ea2a89490dcb 2024-05-24T01:27:01.866972985Z [2024-05-24T01:27:01.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:27:01.867007716Z [2024-05-24T01:27:01.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:26:00+00:00, run_id=scheduled__2024-05-24T01:26:00+00:00, run_start_date=2024-05-24 01:27:00.165384+00:00, run_end_date=2024-05-24 01:27:01.866362+00:00, run_duration=1.700978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:26:00+00:00, data_interval_end=2024-05-24 01:27:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:27:01.875927084Z [2024-05-24T01:27:01.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:27:00+00:00, run_after=2024-05-24T01:28:00+00:00 2024-05-24T01:27:01.920030405Z [2024-05-24T01:27:01.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status success for try_number 1 2024-05-24T01:27:01.927396010Z [2024-05-24T01:27:01.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:26:00+00:00, map_index=-1, run_start_date=2024-05-24 01:27:01.224352+00:00, run_end_date=2024-05-24 01:27:01.666623+00:00, run_duration=0.442271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:27:00.254203+00:00, queued_by_job_id=1, pid=11360 2024-05-24T01:27:04.224411104Z [2024-05-24T01:27:04.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:27:04.224784284Z [2024-05-24T01:27:04.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:26:00+00:00, run_id=scheduled__2024-05-24T01:26:00+00:00, run_start_date=2024-05-24 01:27:00.168026+00:00, run_end_date=2024-05-24 01:27:04.224214+00:00, run_duration=4.056188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:26:00+00:00, data_interval_end=2024-05-24 01:27:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:27:04.238915350Z [2024-05-24T01:27:04.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:27:00+00:00, run_after=2024-05-24T01:28:00+00:00 2024-05-24T01:27:04.249132576Z [2024-05-24T01:27:04.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:27:04.249190945Z [2024-05-24T01:27:04.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:26:00+00:00, run_id=scheduled__2024-05-24T01:26:00+00:00, run_start_date=2024-05-24 01:27:00.169726+00:00, run_end_date=2024-05-24 01:27:04.248804+00:00, run_duration=4.079078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:26:00+00:00, data_interval_end=2024-05-24 01:27:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:27:04.260210020Z [2024-05-24T01:27:04.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:27:00+00:00, run_after=2024-05-24T01:28:00+00:00 2024-05-24T01:27:04.315292851Z [2024-05-24T01:27:04.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status success for try_number 1 2024-05-24T01:27:04.315552891Z [2024-05-24T01:27:04.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status success for try_number 1 2024-05-24T01:27:04.325443044Z [2024-05-24T01:27:04.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:26:00+00:00, map_index=-1, run_start_date=2024-05-24 01:27:02.219068+00:00, run_end_date=2024-05-24 01:27:03.924252+00:00, run_duration=1.705184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:27:00.254203+00:00, queued_by_job_id=1, pid=11379 2024-05-24T01:27:04.326223709Z [2024-05-24T01:27:04.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:26:00+00:00, map_index=-1, run_start_date=2024-05-24 01:27:02.171414+00:00, run_end_date=2024-05-24 01:27:03.440781+00:00, run_duration=1.269367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:27:00.254203+00:00, queued_by_job_id=1, pid=11378 2024-05-24T01:28:00.137936074Z [2024-05-24T01:28:00.137+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:28:00.143840566Z [2024-05-24T01:28:00.143+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:28:00.155413342Z [2024-05-24T01:28:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:28:00+00:00, run_after=2024-05-24T01:29:00+00:00 2024-05-24T01:28:00.167656070Z [2024-05-24T01:28:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:28:00+00:00, run_after=2024-05-24T01:29:00+00:00 2024-05-24T01:28:00.249025443Z [2024-05-24T01:28:00.248+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:28:00.249047284Z 2024-05-24T01:28:00.249052360Z 2024-05-24T01:28:00.249055781Z 2024-05-24T01:28:00.249058975Z 2024-05-24T01:28:00.249387472Z [2024-05-24T01:28:00.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:28:00.249675866Z [2024-05-24T01:28:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:28:00.249914946Z [2024-05-24T01:28:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:28:00.250147510Z [2024-05-24T01:28:00.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:28:00.251407186Z [2024-05-24T01:28:00.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:28:00.251417228Z 2024-05-24T01:28:00.251420682Z 2024-05-24T01:28:00.251423871Z 2024-05-24T01:28:00.251426978Z 2024-05-24T01:28:00.254750153Z [2024-05-24T01:28:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:28:00.255004582Z [2024-05-24T01:28:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:28:00.255421954Z [2024-05-24T01:28:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:28:00.255683917Z [2024-05-24T01:28:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:28:00.256056042Z [2024-05-24T01:28:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:28:00.256369066Z [2024-05-24T01:28:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:28:00.256751062Z [2024-05-24T01:28:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:28:00.257024029Z [2024-05-24T01:28:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:28:00.835667207Z [2024-05-24T01:28:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status queued for try_number 1 2024-05-24T01:28:00.849126590Z [2024-05-24T01:28:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:27:00+00:00 exited with status queued for try_number 1 2024-05-24T01:28:00.852742465Z [2024-05-24T01:28:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:27:00+00:00 exited with status queued for try_number 1 2024-05-24T01:28:00.852877014Z [2024-05-24T01:28:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:27:00+00:00 exited with status queued for try_number 1 2024-05-24T01:28:00.880807958Z [2024-05-24T01:28:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fbcf7d7-d4b0-45ae-bc60-d4339f3575e9 2024-05-24T01:28:00.884033334Z [2024-05-24T01:28:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08bc8a6f-8cb4-4d7b-b81f-b4d1665ada33 2024-05-24T01:28:00.884205721Z [2024-05-24T01:28:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f86d17d-7108-49a5-b8f0-9a7147a65eb0 2024-05-24T01:28:00.884359273Z [2024-05-24T01:28:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3439dcb-4aa2-479f-923a-83b41e8f07d4 2024-05-24T01:28:02.199570637Z [2024-05-24T01:28:02.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:28:02.199867244Z [2024-05-24T01:28:02.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:26:00+00:00, run_id=scheduled__2024-05-24T01:26:00+00:00, run_start_date=2024-05-24 01:28:00.177144+00:00, run_end_date=2024-05-24 01:28:02.199359+00:00, run_duration=2.022215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:26:00+00:00, data_interval_end=2024-05-24 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:28:02.208438148Z [2024-05-24T01:28:02.207+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:28:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:28:02.216376180Z [2024-05-24T01:28:02.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:28:02.216620702Z [2024-05-24T01:28:02.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:27:00+00:00, run_id=scheduled__2024-05-24T01:27:00+00:00, run_start_date=2024-05-24 01:28:00.178275+00:00, run_end_date=2024-05-24 01:28:02.216253+00:00, run_duration=2.037978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:27:00+00:00, data_interval_end=2024-05-24 01:28:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:28:02.227692305Z [2024-05-24T01:28:02.227+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:28:00+00:00, run_after=2024-05-24T01:29:00+00:00 2024-05-24T01:28:02.294069675Z [2024-05-24T01:28:02.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:26:00+00:00 exited with status success for try_number 1 2024-05-24T01:28:02.294408929Z [2024-05-24T01:28:02.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:27:00+00:00 exited with status success for try_number 1 2024-05-24T01:28:02.312703240Z [2024-05-24T01:28:02.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:26:00+00:00, map_index=-1, run_start_date=2024-05-24 01:28:01.381922+00:00, run_end_date=2024-05-24 01:28:01.843797+00:00, run_duration=0.461875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:28:00.252313+00:00, queued_by_job_id=1, pid=11412 2024-05-24T01:28:02.315209368Z [2024-05-24T01:28:02.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:27:00+00:00, map_index=-1, run_start_date=2024-05-24 01:28:01.563739+00:00, run_end_date=2024-05-24 01:28:01.952484+00:00, run_duration=0.388745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:28:00.252313+00:00, queued_by_job_id=1, pid=11413 2024-05-24T01:28:04.175011106Z [2024-05-24T01:28:04.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:28:04.175435760Z [2024-05-24T01:28:04.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:27:00+00:00, run_id=scheduled__2024-05-24T01:27:00+00:00, run_start_date=2024-05-24 01:28:00.179214+00:00, run_end_date=2024-05-24 01:28:04.174876+00:00, run_duration=3.995662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:27:00+00:00, data_interval_end=2024-05-24 01:28:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:28:04.189602721Z [2024-05-24T01:28:04.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:28:00+00:00, run_after=2024-05-24T01:29:00+00:00 2024-05-24T01:28:04.230247241Z [2024-05-24T01:28:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:27:00+00:00 exited with status success for try_number 1 2024-05-24T01:28:04.235840449Z [2024-05-24T01:28:04.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:27:00+00:00, map_index=-1, run_start_date=2024-05-24 01:28:02.734400+00:00, run_end_date=2024-05-24 01:28:03.984701+00:00, run_duration=1.250301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:28:00.252313+00:00, queued_by_job_id=1, pid=11437 2024-05-24T01:28:05.667769200Z [2024-05-24T01:28:05.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:28:05.668232077Z [2024-05-24T01:28:05.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:27:00+00:00, run_id=scheduled__2024-05-24T01:27:00+00:00, run_start_date=2024-05-24 01:28:00.180154+00:00, run_end_date=2024-05-24 01:28:05.667592+00:00, run_duration=5.487438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:27:00+00:00, data_interval_end=2024-05-24 01:28:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:28:05.677261276Z [2024-05-24T01:28:05.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:28:00+00:00, run_after=2024-05-24T01:29:00+00:00 2024-05-24T01:28:05.716201492Z [2024-05-24T01:28:05.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:27:00+00:00 exited with status success for try_number 1 2024-05-24T01:28:05.723727609Z [2024-05-24T01:28:05.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:27:00+00:00, map_index=-1, run_start_date=2024-05-24 01:28:02.522305+00:00, run_end_date=2024-05-24 01:28:05.474690+00:00, run_duration=2.952385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:28:00.252313+00:00, queued_by_job_id=1, pid=11436 2024-05-24T01:29:00.059223690Z [2024-05-24T01:29:00.058+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:29:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:29:00.066380301Z [2024-05-24T01:29:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:29:00.079389291Z [2024-05-24T01:29:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:29:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:29:00.158652455Z [2024-05-24T01:29:00.155+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:29:00.158701200Z 2024-05-24T01:29:00.158710222Z 2024-05-24T01:29:00.158718896Z 2024-05-24T01:29:00.158727264Z [2024-05-24T01:29:00.155+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:29:00.158772674Z [2024-05-24T01:29:00.155+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:29:00.158780840Z [2024-05-24T01:29:00.155+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:29:00.158792194Z [2024-05-24T01:29:00.156+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:29:00.158800011Z 2024-05-24T01:29:00.158807804Z 2024-05-24T01:29:00.158815445Z 2024-05-24T01:29:00.159304748Z [2024-05-24T01:29:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:29:00.159381734Z [2024-05-24T01:29:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:29:00.159652547Z [2024-05-24T01:29:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:29:00.159686698Z [2024-05-24T01:29:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:29:00.159821931Z [2024-05-24T01:29:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:29:00.159890632Z [2024-05-24T01:29:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:29:00.662121319Z [2024-05-24T01:29:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status queued for try_number 1 2024-05-24T01:29:00.662331402Z [2024-05-24T01:29:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status queued for try_number 1 2024-05-24T01:29:00.662345553Z [2024-05-24T01:29:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status queued for try_number 1 2024-05-24T01:29:00.676570546Z [2024-05-24T01:29:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4fb6c0f-eca3-4545-888d-8c0929f4fc17 2024-05-24T01:29:00.676609442Z [2024-05-24T01:29:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73e103b2-15cd-4f9d-9207-c7e90426af4b 2024-05-24T01:29:00.676761526Z [2024-05-24T01:29:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to baad89de-b6b1-47d1-8b9a-495be07918ad 2024-05-24T01:29:01.893647316Z [2024-05-24T01:29:01.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:29:01.894052036Z [2024-05-24T01:29:01.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:28:00+00:00, run_id=scheduled__2024-05-24T01:28:00+00:00, run_start_date=2024-05-24 01:29:00.088805+00:00, run_end_date=2024-05-24 01:29:01.893690+00:00, run_duration=1.804885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:28:00+00:00, data_interval_end=2024-05-24 01:29:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:29:01.903240461Z [2024-05-24T01:29:01.902+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:29:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:29:01.951629523Z [2024-05-24T01:29:01.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status success for try_number 1 2024-05-24T01:29:01.958087433Z [2024-05-24T01:29:01.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:28:00+00:00, map_index=-1, run_start_date=2024-05-24 01:29:01.399300+00:00, run_end_date=2024-05-24 01:29:01.780384+00:00, run_duration=0.381084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:29:00.157123+00:00, queued_by_job_id=1, pid=11469 2024-05-24T01:29:04.067652694Z [2024-05-24T01:29:04.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:29:04.067884771Z [2024-05-24T01:29:04.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:28:00+00:00, run_id=scheduled__2024-05-24T01:28:00+00:00, run_start_date=2024-05-24 01:29:00.091137+00:00, run_end_date=2024-05-24 01:29:04.067531+00:00, run_duration=3.976394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:28:00+00:00, data_interval_end=2024-05-24 01:29:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:29:04.086057262Z [2024-05-24T01:29:04.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:29:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:29:04.152585058Z [2024-05-24T01:29:04.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status success for try_number 1 2024-05-24T01:29:04.162663502Z [2024-05-24T01:29:04.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:28:00+00:00, map_index=-1, run_start_date=2024-05-24 01:29:02.239928+00:00, run_end_date=2024-05-24 01:29:03.611994+00:00, run_duration=1.372066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:29:00.157123+00:00, queued_by_job_id=1, pid=11487 2024-05-24T01:29:05.221595928Z [2024-05-24T01:29:05.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:29:05.222584760Z [2024-05-24T01:29:05.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:28:00+00:00, run_id=scheduled__2024-05-24T01:28:00+00:00, run_start_date=2024-05-24 01:29:00.092116+00:00, run_end_date=2024-05-24 01:29:05.221953+00:00, run_duration=5.129837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:28:00+00:00, data_interval_end=2024-05-24 01:29:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:29:05.237646355Z [2024-05-24T01:29:05.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:29:00+00:00, run_after=2024-05-24T01:30:00+00:00 2024-05-24T01:29:05.274670824Z [2024-05-24T01:29:05.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status success for try_number 1 2024-05-24T01:29:05.277824910Z [2024-05-24T01:29:05.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:28:00+00:00, map_index=-1, run_start_date=2024-05-24 01:29:02.315741+00:00, run_end_date=2024-05-24 01:29:04.268675+00:00, run_duration=1.952934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:29:00.157123+00:00, queued_by_job_id=1, pid=11488 2024-05-24T01:30:00.052611304Z [2024-05-24T01:30:00.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:35:00+00:00 2024-05-24T01:30:00.071113854Z [2024-05-24T01:30:00.070+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:30:00.090931581Z [2024-05-24T01:30:00.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:31:00+00:00 2024-05-24T01:30:00.108936195Z [2024-05-24T01:30:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:31:00+00:00 2024-05-24T01:30:00.119871367Z [2024-05-24T01:30:00.119+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:30:00.341797281Z [2024-05-24T01:30:00.339+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T01:30:00.341824289Z 2024-05-24T01:30:00.341828207Z 2024-05-24T01:30:00.341832604Z 2024-05-24T01:30:00.341835792Z 2024-05-24T01:30:00.341838934Z 2024-05-24T01:30:00.341842133Z [2024-05-24T01:30:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:30:00.341846145Z [2024-05-24T01:30:00.339+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:30:00.341849212Z [2024-05-24T01:30:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:30:00.341852489Z [2024-05-24T01:30:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:30:00.341855631Z [2024-05-24T01:30:00.339+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:30:00.343442093Z [2024-05-24T01:30:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:30:00.343456681Z 2024-05-24T01:30:00.343460866Z 2024-05-24T01:30:00.343465088Z 2024-05-24T01:30:00.343468538Z 2024-05-24T01:30:00.343471896Z 2024-05-24T01:30:00.354653578Z [2024-05-24T01:30:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:30:00.354673464Z [2024-05-24T01:30:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:30:00.354766007Z [2024-05-24T01:30:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:30:00.354942891Z [2024-05-24T01:30:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:30:00.356324948Z [2024-05-24T01:30:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:30:00.356396556Z [2024-05-24T01:30:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:30:00.356586950Z [2024-05-24T01:30:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:30:00.356677662Z [2024-05-24T01:30:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:30:00.356822303Z [2024-05-24T01:30:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:30:00.356924591Z [2024-05-24T01:30:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:30:01.026620694Z [2024-05-24T01:30:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:01.026669686Z [2024-05-24T01:30:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:01.026677199Z [2024-05-24T01:30:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:29:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:01.026681061Z [2024-05-24T01:30:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:29:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:01.026684644Z [2024-05-24T01:30:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:29:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:01.043934176Z [2024-05-24T01:30:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to cde5960a-c2e2-45de-8ab5-85d299c013d0 2024-05-24T01:30:01.044351134Z [2024-05-24T01:30:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f128835-3922-4c36-9708-1aa0e5b773b0 2024-05-24T01:30:01.044377204Z [2024-05-24T01:30:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d98c103-682b-43d4-b4a5-4217b5d5ff32 2024-05-24T01:30:01.046660925Z [2024-05-24T01:30:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2783a4c6-a477-4796-8eef-bbc561130862 2024-05-24T01:30:01.046682846Z [2024-05-24T01:30:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39c8cd72-3647-45b8-9168-ab2f3503d24f 2024-05-24T01:30:03.527009208Z [2024-05-24T01:30:03.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:30:03.527328031Z [2024-05-24T01:30:03.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:29:00+00:00, run_id=scheduled__2024-05-24T01:29:00+00:00, run_start_date=2024-05-24 01:30:00.135128+00:00, run_end_date=2024-05-24 01:30:03.526990+00:00, run_duration=3.391862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:29:00+00:00, data_interval_end=2024-05-24 01:30:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:30:03.546441102Z [2024-05-24T01:30:03.546+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:31:00+00:00 2024-05-24T01:30:03.587229006Z [2024-05-24T01:30:03.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:30:03.587716738Z [2024-05-24T01:30:03.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:28:00+00:00, run_id=scheduled__2024-05-24T01:28:00+00:00, run_start_date=2024-05-24 01:30:00.133489+00:00, run_end_date=2024-05-24 01:30:03.587397+00:00, run_duration=3.453908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:28:00+00:00, data_interval_end=2024-05-24 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:30:03.607707422Z [2024-05-24T01:30:03.606+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:32:00+00:00 2024-05-24T01:30:03.718206710Z [2024-05-24T01:30:03.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:28:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:03.718218453Z [2024-05-24T01:30:03.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:29:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:03.736461321Z [2024-05-24T01:30:03.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:28:00+00:00, map_index=-1, run_start_date=2024-05-24 01:30:01.566251+00:00, run_end_date=2024-05-24 01:30:02.347659+00:00, run_duration=0.781408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:00.344080+00:00, queued_by_job_id=1, pid=11522 2024-05-24T01:30:03.736507476Z [2024-05-24T01:30:03.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:29:00+00:00, map_index=-1, run_start_date=2024-05-24 01:30:01.893652+00:00, run_end_date=2024-05-24 01:30:02.831947+00:00, run_duration=0.938295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:00.344080+00:00, queued_by_job_id=1, pid=11523 2024-05-24T01:30:05.986243371Z [2024-05-24T01:30:05.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:30:05.986709852Z [2024-05-24T01:30:05.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:29:00+00:00, run_id=scheduled__2024-05-24T01:29:00+00:00, run_start_date=2024-05-24 01:30:00.136474+00:00, run_end_date=2024-05-24 01:30:05.986137+00:00, run_duration=5.849663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:29:00+00:00, data_interval_end=2024-05-24 01:30:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:30:06.008279835Z [2024-05-24T01:30:06.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:31:00+00:00 2024-05-24T01:30:06.050691209Z [2024-05-24T01:30:06.050+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:30:06.050711935Z 2024-05-24T01:30:06.050854090Z [2024-05-24T01:30:06.050+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:30:06.051497455Z [2024-05-24T01:30:06.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:30:06.051509068Z 2024-05-24T01:30:06.054011277Z [2024-05-24T01:30:06.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:30:06.054223804Z [2024-05-24T01:30:06.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:30:06.114705542Z [2024-05-24T01:30:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:06.116425409Z [2024-05-24T01:30:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:06.116933348Z [2024-05-24T01:30:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:29:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:06.126144843Z [2024-05-24T01:30:06.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:29:00+00:00, map_index=-1, run_start_date=2024-05-24 01:30:03.988492+00:00, run_end_date=2024-05-24 01:30:05.783776+00:00, run_duration=1.795284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:00.344080+00:00, queued_by_job_id=1, pid=11542 2024-05-24T01:30:06.126342644Z [2024-05-24T01:30:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:25:00+00:00, map_index=-1, run_start_date=2024-05-24 01:30:04.758097+00:00, run_end_date=2024-05-24 01:30:05.205938+00:00, run_duration=0.447841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:00.344080+00:00, queued_by_job_id=1, pid=11559 2024-05-24T01:30:06.126654584Z [2024-05-24T01:30:06.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to daaa1abd-0958-421c-802d-e27c3225d6cb 2024-05-24T01:30:07.319033779Z [2024-05-24T01:30:07.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:30:07.319601770Z [2024-05-24T01:30:07.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:29:00+00:00, run_id=scheduled__2024-05-24T01:29:00+00:00, run_start_date=2024-05-24 01:30:00.139922+00:00, run_end_date=2024-05-24 01:30:07.319269+00:00, run_duration=7.179347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:29:00+00:00, data_interval_end=2024-05-24 01:30:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:30:07.358986578Z [2024-05-24T01:30:07.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:31:00+00:00 2024-05-24T01:30:07.426633859Z [2024-05-24T01:30:07.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:29:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:07.438372300Z [2024-05-24T01:30:07.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:29:00+00:00, map_index=-1, run_start_date=2024-05-24 01:30:04.563688+00:00, run_end_date=2024-05-24 01:30:06.388693+00:00, run_duration=1.825005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:00.344080+00:00, queued_by_job_id=1, pid=11553 2024-05-24T01:30:09.484315963Z [2024-05-24T01:30:09.483+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:30:09.484332346Z 2024-05-24T01:30:09.484382281Z [2024-05-24T01:30:09.484+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:30:09.485015051Z [2024-05-24T01:30:09.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:30:09.485024737Z 2024-05-24T01:30:09.488359545Z [2024-05-24T01:30:09.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:30:09.488468356Z [2024-05-24T01:30:09.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:30:09.533281917Z [2024-05-24T01:30:09.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:09.533316468Z [2024-05-24T01:30:09.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:09.538740257Z [2024-05-24T01:30:09.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0807e60e-e7f7-4168-a189-a5a31ade5488 2024-05-24T01:30:09.538863507Z [2024-05-24T01:30:09.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:25:00+00:00, map_index=-1, run_start_date=2024-05-24 01:30:08.003519+00:00, run_end_date=2024-05-24 01:30:08.373464+00:00, run_duration=0.369945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:06.051894+00:00, queued_by_job_id=1, pid=11577 2024-05-24T01:30:12.294833998Z [2024-05-24T01:30:12.294+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:30:12.294899722Z 2024-05-24T01:30:12.294930260Z [2024-05-24T01:30:12.294+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:30:12.297000127Z [2024-05-24T01:30:12.296+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:30:12.297014103Z 2024-05-24T01:30:12.301458149Z [2024-05-24T01:30:12.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:30:12.301642250Z [2024-05-24T01:30:12.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:30:12.366902635Z [2024-05-24T01:30:12.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status queued for try_number 1 2024-05-24T01:30:12.366924247Z [2024-05-24T01:30:12.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:12.376413494Z [2024-05-24T01:30:12.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3cd23af-07ba-40fe-8ec5-4b31c4578a2f 2024-05-24T01:30:12.376513770Z [2024-05-24T01:30:12.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:25:00+00:00, map_index=0, run_start_date=2024-05-24 01:30:11.429699+00:00, run_end_date=2024-05-24 01:30:11.796178+00:00, run_duration=0.366479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:09.485413+00:00, queued_by_job_id=1, pid=11585 2024-05-24T01:30:15.748018022Z [2024-05-24T01:30:15.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:30:15.748244176Z [2024-05-24T01:30:15.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:25:00+00:00, run_id=scheduled__2024-05-24T01:25:00+00:00, run_start_date=2024-05-24 01:30:00.132208+00:00, run_end_date=2024-05-24 01:30:15.747760+00:00, run_duration=15.615552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:25:00+00:00, data_interval_end=2024-05-24 01:30:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:30:15.754918090Z [2024-05-24T01:30:15.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:30:00+00:00, run_after=2024-05-24T01:35:00+00:00 2024-05-24T01:30:15.797014569Z [2024-05-24T01:30:15.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:25:00+00:00 exited with status success for try_number 1 2024-05-24T01:30:15.810580965Z [2024-05-24T01:30:15.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:25:00+00:00, map_index=-1, run_start_date=2024-05-24 01:30:14.082317+00:00, run_end_date=2024-05-24 01:30:14.543989+00:00, run_duration=0.461672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:30:12.297580+00:00, queued_by_job_id=1, pid=11593 2024-05-24T01:31:00.800423491Z [2024-05-24T01:31:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:31:00+00:00, run_after=2024-05-24T01:32:00+00:00 2024-05-24T01:31:00.813056413Z [2024-05-24T01:31:00.812+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:31:00.831113520Z [2024-05-24T01:31:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:31:00+00:00, run_after=2024-05-24T01:32:00+00:00 2024-05-24T01:31:00.913143475Z [2024-05-24T01:31:00.912+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:31:00.913186801Z 2024-05-24T01:31:00.913196304Z 2024-05-24T01:31:00.913211160Z 2024-05-24T01:31:00.913226733Z [2024-05-24T01:31:00.912+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:31:00.913250795Z [2024-05-24T01:31:00.913+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:31:00.913283698Z [2024-05-24T01:31:00.913+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:31:00.914153040Z [2024-05-24T01:31:00.913+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:31:00.914172200Z 2024-05-24T01:31:00.914181172Z 2024-05-24T01:31:00.914189666Z 2024-05-24T01:31:00.919750836Z [2024-05-24T01:31:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:31:00.919780533Z [2024-05-24T01:31:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:31:00.921010204Z [2024-05-24T01:31:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:31:00.921493489Z [2024-05-24T01:31:00.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:31:00.921784349Z [2024-05-24T01:31:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:31:00.921834959Z [2024-05-24T01:31:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:31:01.235773666Z [2024-05-24T01:31:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:31:01.235816246Z [2024-05-24T01:31:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:31:01.236987483Z [2024-05-24T01:31:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:31:01.251952502Z [2024-05-24T01:31:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to f797086b-d9af-4705-be9e-5ad6e8de2d88 2024-05-24T01:31:01.251980743Z [2024-05-24T01:31:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to d71feb4c-c2d3-4bfe-a168-3c8096c68c2d 2024-05-24T01:31:01.252073566Z [2024-05-24T01:31:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07ac3905-6bc2-4c38-83f7-bbfca35d5f38 2024-05-24T01:31:03.128237863Z [2024-05-24T01:31:03.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:31:03.128413008Z [2024-05-24T01:31:03.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:30:00+00:00, run_id=scheduled__2024-05-24T01:30:00+00:00, run_start_date=2024-05-24 01:31:00.844588+00:00, run_end_date=2024-05-24 01:31:03.128099+00:00, run_duration=2.283511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:30:00+00:00, data_interval_end=2024-05-24 01:31:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:31:03.138339018Z [2024-05-24T01:31:03.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:31:00+00:00, run_after=2024-05-24T01:32:00+00:00 2024-05-24T01:31:03.210820065Z [2024-05-24T01:31:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:31:03.220221279Z [2024-05-24T01:31:03.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=-1, run_start_date=2024-05-24 01:31:01.803917+00:00, run_end_date=2024-05-24 01:31:02.141113+00:00, run_duration=0.337196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:31:00.915092+00:00, queued_by_job_id=1, pid=11615 2024-05-24T01:31:05.379831469Z [2024-05-24T01:31:05.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:31:05.380326823Z [2024-05-24T01:31:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:30:00+00:00, run_id=scheduled__2024-05-24T01:30:00+00:00, run_start_date=2024-05-24 01:31:00.846147+00:00, run_end_date=2024-05-24 01:31:05.379734+00:00, run_duration=4.533587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:30:00+00:00, data_interval_end=2024-05-24 01:31:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:31:05.399057367Z [2024-05-24T01:31:05.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:31:00+00:00, run_after=2024-05-24T01:32:00+00:00 2024-05-24T01:31:05.415795845Z [2024-05-24T01:31:05.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:31:05.415868291Z [2024-05-24T01:31:05.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:30:00+00:00, run_id=scheduled__2024-05-24T01:30:00+00:00, run_start_date=2024-05-24 01:31:00.847267+00:00, run_end_date=2024-05-24 01:31:05.415594+00:00, run_duration=4.568327, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:30:00+00:00, data_interval_end=2024-05-24 01:31:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:31:05.426739937Z [2024-05-24T01:31:05.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:31:00+00:00, run_after=2024-05-24T01:32:00+00:00 2024-05-24T01:31:05.471740294Z [2024-05-24T01:31:05.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:31:05.478074651Z [2024-05-24T01:31:05.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=-1, run_start_date=2024-05-24 01:31:02.931410+00:00, run_end_date=2024-05-24 01:31:04.467584+00:00, run_duration=1.536174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:31:00.915092+00:00, queued_by_job_id=1, pid=11633 2024-05-24T01:31:06.544653824Z [2024-05-24T01:31:06.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:31:06.551345012Z [2024-05-24T01:31:06.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=-1, run_start_date=2024-05-24 01:31:02.995367+00:00, run_end_date=2024-05-24 01:31:05.314876+00:00, run_duration=2.319509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:31:00.915092+00:00, queued_by_job_id=1, pid=11634 2024-05-24T01:31:41.504756759Z [2024-05-24T01:31:41.504+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:32:00.176373325Z [2024-05-24T01:32:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:32:00.191579637Z [2024-05-24T01:32:00.190+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:32:00.224519761Z [2024-05-24T01:32:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:32:00+00:00, run_after=2024-05-24T01:33:00+00:00 2024-05-24T01:32:00.255871645Z [2024-05-24T01:32:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:32:00+00:00, run_after=2024-05-24T01:33:00+00:00 2024-05-24T01:32:00.376808346Z [2024-05-24T01:32:00.376+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:32:00.376880106Z 2024-05-24T01:32:00.376886679Z 2024-05-24T01:32:00.376891442Z 2024-05-24T01:32:00.376896180Z 2024-05-24T01:32:00.377095807Z [2024-05-24T01:32:00.376+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:32:00.377372662Z [2024-05-24T01:32:00.377+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:32:00.377681509Z [2024-05-24T01:32:00.377+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:32:00.377911862Z [2024-05-24T01:32:00.377+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:32:00.378738207Z [2024-05-24T01:32:00.378+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:32:00.378754831Z 2024-05-24T01:32:00.378759960Z 2024-05-24T01:32:00.378764868Z 2024-05-24T01:32:00.378790130Z 2024-05-24T01:32:00.384121911Z [2024-05-24T01:32:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:32:00.384333036Z [2024-05-24T01:32:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:32:00.384642526Z [2024-05-24T01:32:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:32:00.384869707Z [2024-05-24T01:32:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:32:00.385200342Z [2024-05-24T01:32:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:32:00.385399506Z [2024-05-24T01:32:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:32:00.385699820Z [2024-05-24T01:32:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:32:00.385876122Z [2024-05-24T01:32:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:32:00.807863915Z [2024-05-24T01:32:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:32:00.808667741Z [2024-05-24T01:32:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:31:00+00:00 exited with status queued for try_number 1 2024-05-24T01:32:00.808968939Z [2024-05-24T01:32:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:31:00+00:00 exited with status queued for try_number 1 2024-05-24T01:32:00.809217972Z [2024-05-24T01:32:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:31:00+00:00 exited with status queued for try_number 1 2024-05-24T01:32:00.842181959Z [2024-05-24T01:32:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d18d7f1-ddc2-4310-b670-b0d020718b7a 2024-05-24T01:32:00.846213763Z [2024-05-24T01:32:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3df599c1-6b32-41d3-a3bc-31ab37796ee4 2024-05-24T01:32:00.847850223Z [2024-05-24T01:32:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06b78b1a-d818-4599-a2ff-ef5580dfc7f0 2024-05-24T01:32:00.848143663Z [2024-05-24T01:32:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2d403d5-fe5b-480a-b70f-f32c3b6a333f 2024-05-24T01:32:02.194956697Z [2024-05-24T01:32:02.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:32:02.196075361Z [2024-05-24T01:32:02.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:30:00+00:00, run_id=scheduled__2024-05-24T01:30:00+00:00, run_start_date=2024-05-24 01:32:00.275644+00:00, run_end_date=2024-05-24 01:32:02.195240+00:00, run_duration=1.919596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:30:00+00:00, data_interval_end=2024-05-24 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:32:02.213249021Z [2024-05-24T01:32:02.212+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:32:00+00:00, run_after=2024-05-24T01:34:00+00:00 2024-05-24T01:32:02.224158700Z [2024-05-24T01:32:02.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:32:02.224606881Z [2024-05-24T01:32:02.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:31:00+00:00, run_id=scheduled__2024-05-24T01:31:00+00:00, run_start_date=2024-05-24 01:32:00.278012+00:00, run_end_date=2024-05-24 01:32:02.224040+00:00, run_duration=1.946028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:31:00+00:00, data_interval_end=2024-05-24 01:32:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:32:02.238016742Z [2024-05-24T01:32:02.237+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:32:00+00:00, run_after=2024-05-24T01:33:00+00:00 2024-05-24T01:32:02.317576731Z [2024-05-24T01:32:02.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:32:02.318061285Z [2024-05-24T01:32:02.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:31:00+00:00 exited with status success for try_number 1 2024-05-24T01:32:02.332796297Z [2024-05-24T01:32:02.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=-1, run_start_date=2024-05-24 01:32:01.329876+00:00, run_end_date=2024-05-24 01:32:01.899851+00:00, run_duration=0.569975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:32:00.379882+00:00, queued_by_job_id=1, pid=11666 2024-05-24T01:32:02.333631759Z [2024-05-24T01:32:02.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:31:00+00:00, map_index=-1, run_start_date=2024-05-24 01:32:01.532714+00:00, run_end_date=2024-05-24 01:32:01.958655+00:00, run_duration=0.425941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:32:00.379882+00:00, queued_by_job_id=1, pid=11667 2024-05-24T01:32:04.198082123Z [2024-05-24T01:32:04.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:32:04.198665762Z [2024-05-24T01:32:04.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:31:00+00:00, run_id=scheduled__2024-05-24T01:31:00+00:00, run_start_date=2024-05-24 01:32:00.279870+00:00, run_end_date=2024-05-24 01:32:04.198000+00:00, run_duration=3.91813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:31:00+00:00, data_interval_end=2024-05-24 01:32:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:32:04.209147635Z [2024-05-24T01:32:04.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:32:00+00:00, run_after=2024-05-24T01:33:00+00:00 2024-05-24T01:32:05.323822304Z [2024-05-24T01:32:05.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:32:05.324071307Z [2024-05-24T01:32:05.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:31:00+00:00, run_id=scheduled__2024-05-24T01:31:00+00:00, run_start_date=2024-05-24 01:32:00.281668+00:00, run_end_date=2024-05-24 01:32:05.323478+00:00, run_duration=5.04181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:31:00+00:00, data_interval_end=2024-05-24 01:32:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:32:05.343603448Z [2024-05-24T01:32:05.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:32:00+00:00, run_after=2024-05-24T01:33:00+00:00 2024-05-24T01:32:05.410693197Z [2024-05-24T01:32:05.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:31:00+00:00 exited with status success for try_number 1 2024-05-24T01:32:05.410893658Z [2024-05-24T01:32:05.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:31:00+00:00 exited with status success for try_number 1 2024-05-24T01:32:05.424872548Z [2024-05-24T01:32:05.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:31:00+00:00, map_index=-1, run_start_date=2024-05-24 01:32:02.749036+00:00, run_end_date=2024-05-24 01:32:04.145053+00:00, run_duration=1.396017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:32:00.379882+00:00, queued_by_job_id=1, pid=11690 2024-05-24T01:32:05.425191776Z [2024-05-24T01:32:05.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:31:00+00:00, map_index=-1, run_start_date=2024-05-24 01:32:02.812613+00:00, run_end_date=2024-05-24 01:32:04.593422+00:00, run_duration=1.780809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:32:00.379882+00:00, queued_by_job_id=1, pid=11691 2024-05-24T01:33:00.577319019Z [2024-05-24T01:33:00.576+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:33:00.591887696Z [2024-05-24T01:33:00.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:33:00+00:00, run_after=2024-05-24T01:34:00+00:00 2024-05-24T01:33:00.606002500Z [2024-05-24T01:33:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:33:00+00:00, run_after=2024-05-24T01:34:00+00:00 2024-05-24T01:33:00.678039652Z [2024-05-24T01:33:00.677+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:33:00.678083682Z 2024-05-24T01:33:00.678089687Z 2024-05-24T01:33:00.678095988Z 2024-05-24T01:33:00.678166092Z [2024-05-24T01:33:00.677+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:33:00.678221670Z [2024-05-24T01:33:00.678+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:33:00.678405401Z [2024-05-24T01:33:00.678+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:33:00.679034027Z [2024-05-24T01:33:00.678+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:33:00.679047028Z 2024-05-24T01:33:00.679052485Z 2024-05-24T01:33:00.679057608Z 2024-05-24T01:33:00.682110593Z [2024-05-24T01:33:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:33:00.682318179Z [2024-05-24T01:33:00.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:33:00.682651046Z [2024-05-24T01:33:00.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:33:00.682836859Z [2024-05-24T01:33:00.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:33:00.683147637Z [2024-05-24T01:33:00.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:33:00.683301766Z [2024-05-24T01:33:00.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:33:00.940033540Z [2024-05-24T01:33:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status queued for try_number 1 2024-05-24T01:33:00.940057389Z [2024-05-24T01:33:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status queued for try_number 1 2024-05-24T01:33:00.940061076Z [2024-05-24T01:33:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status queued for try_number 1 2024-05-24T01:33:00.974624961Z [2024-05-24T01:33:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1df3cf1-b967-4d7a-8d0f-b57e8584d202 2024-05-24T01:33:00.974646612Z [2024-05-24T01:33:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fabc8f0-2d19-4180-a7d2-7bfd335efb18 2024-05-24T01:33:00.974649986Z [2024-05-24T01:33:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 440a6c79-7444-4d44-ad6b-d5905a342261 2024-05-24T01:33:02.164925071Z [2024-05-24T01:33:02.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:33:02.165453814Z [2024-05-24T01:33:02.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:32:00+00:00, run_id=scheduled__2024-05-24T01:32:00+00:00, run_start_date=2024-05-24 01:33:00.618465+00:00, run_end_date=2024-05-24 01:33:02.165022+00:00, run_duration=1.546557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:32:00+00:00, data_interval_end=2024-05-24 01:33:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:33:02.176760586Z [2024-05-24T01:33:02.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:33:00+00:00, run_after=2024-05-24T01:34:00+00:00 2024-05-24T01:33:02.228544202Z [2024-05-24T01:33:02.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status success for try_number 1 2024-05-24T01:33:02.233605132Z [2024-05-24T01:33:02.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:32:00+00:00, map_index=-1, run_start_date=2024-05-24 01:33:01.512254+00:00, run_end_date=2024-05-24 01:33:01.948810+00:00, run_duration=0.436556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:33:00.679681+00:00, queued_by_job_id=1, pid=11722 2024-05-24T01:33:04.220957196Z [2024-05-24T01:33:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:33:04.221308230Z [2024-05-24T01:33:04.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:32:00+00:00, run_id=scheduled__2024-05-24T01:32:00+00:00, run_start_date=2024-05-24 01:33:00.619979+00:00, run_end_date=2024-05-24 01:33:04.220734+00:00, run_duration=3.600755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:32:00+00:00, data_interval_end=2024-05-24 01:33:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:33:04.234275623Z [2024-05-24T01:33:04.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:33:00+00:00, run_after=2024-05-24T01:34:00+00:00 2024-05-24T01:33:04.289974466Z [2024-05-24T01:33:04.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status success for try_number 1 2024-05-24T01:33:04.297624489Z [2024-05-24T01:33:04.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:32:00+00:00, map_index=-1, run_start_date=2024-05-24 01:33:02.536825+00:00, run_end_date=2024-05-24 01:33:03.756042+00:00, run_duration=1.219217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:33:00.679681+00:00, queued_by_job_id=1, pid=11740 2024-05-24T01:33:05.401395106Z [2024-05-24T01:33:05.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:33:05.401815829Z [2024-05-24T01:33:05.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:32:00+00:00, run_id=scheduled__2024-05-24T01:32:00+00:00, run_start_date=2024-05-24 01:33:00.621108+00:00, run_end_date=2024-05-24 01:33:05.401336+00:00, run_duration=4.780228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:32:00+00:00, data_interval_end=2024-05-24 01:33:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:33:05.415082911Z [2024-05-24T01:33:05.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:33:00+00:00, run_after=2024-05-24T01:34:00+00:00 2024-05-24T01:33:05.472886060Z [2024-05-24T01:33:05.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status success for try_number 1 2024-05-24T01:33:05.479552087Z [2024-05-24T01:33:05.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:32:00+00:00, map_index=-1, run_start_date=2024-05-24 01:33:02.668255+00:00, run_end_date=2024-05-24 01:33:04.361403+00:00, run_duration=1.693148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:33:00.679681+00:00, queued_by_job_id=1, pid=11741 2024-05-24T01:34:00.289191041Z [2024-05-24T01:34:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:34:00+00:00, run_after=2024-05-24T01:35:00+00:00 2024-05-24T01:34:00.298723933Z [2024-05-24T01:34:00.298+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:34:00.312462026Z [2024-05-24T01:34:00.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:34:00+00:00, run_after=2024-05-24T01:35:00+00:00 2024-05-24T01:34:00.321794918Z [2024-05-24T01:34:00.321+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:34:00.453335356Z [2024-05-24T01:34:00.452+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:34:00.453376583Z 2024-05-24T01:34:00.453394505Z 2024-05-24T01:34:00.453403798Z 2024-05-24T01:34:00.453412720Z 2024-05-24T01:34:00.454226415Z [2024-05-24T01:34:00.453+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:34:00.454517337Z [2024-05-24T01:34:00.454+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:34:00.454915356Z [2024-05-24T01:34:00.454+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:34:00.455184622Z [2024-05-24T01:34:00.454+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:34:00.456253517Z [2024-05-24T01:34:00.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:34:00.456286138Z 2024-05-24T01:34:00.456297475Z 2024-05-24T01:34:00.456335242Z 2024-05-24T01:34:00.456344153Z 2024-05-24T01:34:00.462968418Z [2024-05-24T01:34:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:34:00.463214485Z [2024-05-24T01:34:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:34:00.463835473Z [2024-05-24T01:34:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:34:00.464110279Z [2024-05-24T01:34:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:34:00.464394922Z [2024-05-24T01:34:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:34:00.464651425Z [2024-05-24T01:34:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:34:00.465136789Z [2024-05-24T01:34:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:34:00.465348082Z [2024-05-24T01:34:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:34:00.835708247Z [2024-05-24T01:34:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status queued for try_number 1 2024-05-24T01:34:00.836832404Z [2024-05-24T01:34:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:33:00+00:00 exited with status queued for try_number 1 2024-05-24T01:34:00.837082837Z [2024-05-24T01:34:00.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:33:00+00:00 exited with status queued for try_number 1 2024-05-24T01:34:00.837821524Z [2024-05-24T01:34:00.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:33:00+00:00 exited with status queued for try_number 1 2024-05-24T01:34:00.856402014Z [2024-05-24T01:34:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d4a544f-43ae-48a2-87ac-5a58b300d1da 2024-05-24T01:34:00.856496092Z [2024-05-24T01:34:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2d6fc23-11a7-4f90-97a8-c4ef74363c26 2024-05-24T01:34:00.856754803Z [2024-05-24T01:34:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 056128ea-2c75-437b-9822-3c29211a0734 2024-05-24T01:34:00.856999471Z [2024-05-24T01:34:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dfc3215-ab71-4bef-8cf5-1e4d7a176308 2024-05-24T01:34:02.069811602Z [2024-05-24T01:34:02.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:34:02.070177108Z [2024-05-24T01:34:02.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:32:00+00:00, run_id=scheduled__2024-05-24T01:32:00+00:00, run_start_date=2024-05-24 01:34:00.335933+00:00, run_end_date=2024-05-24 01:34:02.069702+00:00, run_duration=1.733769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:32:00+00:00, data_interval_end=2024-05-24 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:34:02.080180261Z [2024-05-24T01:34:02.079+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:34:00+00:00, run_after=2024-05-24T01:36:00+00:00 2024-05-24T01:34:02.144769837Z [2024-05-24T01:34:02.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:32:00+00:00 exited with status success for try_number 1 2024-05-24T01:34:02.151039266Z [2024-05-24T01:34:02.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:32:00+00:00, map_index=-1, run_start_date=2024-05-24 01:34:01.441750+00:00, run_end_date=2024-05-24 01:34:01.922337+00:00, run_duration=0.480587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:34:00.458197+00:00, queued_by_job_id=1, pid=11769 2024-05-24T01:34:03.200680101Z [2024-05-24T01:34:03.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:34:03.201055112Z [2024-05-24T01:34:03.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:33:00+00:00, run_id=scheduled__2024-05-24T01:33:00+00:00, run_start_date=2024-05-24 01:34:00.337208+00:00, run_end_date=2024-05-24 01:34:03.200597+00:00, run_duration=2.863389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:33:00+00:00, data_interval_end=2024-05-24 01:34:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:34:03.209311254Z [2024-05-24T01:34:03.208+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:34:00+00:00, run_after=2024-05-24T01:35:00+00:00 2024-05-24T01:34:03.276653554Z [2024-05-24T01:34:03.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:33:00+00:00 exited with status success for try_number 1 2024-05-24T01:34:03.286652768Z [2024-05-24T01:34:03.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:33:00+00:00, map_index=-1, run_start_date=2024-05-24 01:34:01.852154+00:00, run_end_date=2024-05-24 01:34:02.317050+00:00, run_duration=0.464896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:34:00.458197+00:00, queued_by_job_id=1, pid=11781 2024-05-24T01:34:04.344570675Z [2024-05-24T01:34:04.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:34:04.344713867Z [2024-05-24T01:34:04.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:33:00+00:00, run_id=scheduled__2024-05-24T01:33:00+00:00, run_start_date=2024-05-24 01:34:00.338247+00:00, run_end_date=2024-05-24 01:34:04.344472+00:00, run_duration=4.006225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:33:00+00:00, data_interval_end=2024-05-24 01:34:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:34:04.358300690Z [2024-05-24T01:34:04.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:34:00+00:00, run_after=2024-05-24T01:35:00+00:00 2024-05-24T01:34:04.409635319Z [2024-05-24T01:34:04.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:33:00+00:00 exited with status success for try_number 1 2024-05-24T01:34:04.420950997Z [2024-05-24T01:34:04.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:33:00+00:00, map_index=-1, run_start_date=2024-05-24 01:34:02.533291+00:00, run_end_date=2024-05-24 01:34:03.822665+00:00, run_duration=1.289374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:34:00.458197+00:00, queued_by_job_id=1, pid=11795 2024-05-24T01:34:05.478732576Z [2024-05-24T01:34:05.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:34:05.478986401Z [2024-05-24T01:34:05.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:33:00+00:00, run_id=scheduled__2024-05-24T01:33:00+00:00, run_start_date=2024-05-24 01:34:00.339255+00:00, run_end_date=2024-05-24 01:34:05.478615+00:00, run_duration=5.13936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:33:00+00:00, data_interval_end=2024-05-24 01:34:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:34:05.495397318Z [2024-05-24T01:34:05.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:34:00+00:00, run_after=2024-05-24T01:35:00+00:00 2024-05-24T01:34:05.534724731Z [2024-05-24T01:34:05.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:33:00+00:00 exited with status success for try_number 1 2024-05-24T01:34:05.539893778Z [2024-05-24T01:34:05.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:33:00+00:00, map_index=-1, run_start_date=2024-05-24 01:34:02.755912+00:00, run_end_date=2024-05-24 01:34:04.338018+00:00, run_duration=1.582106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:34:00.458197+00:00, queued_by_job_id=1, pid=11799 2024-05-24T01:35:00.364325853Z [2024-05-24T01:35:00.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:35:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:35:00.372483093Z [2024-05-24T01:35:00.371+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:35:00.384772068Z [2024-05-24T01:35:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:35:00+00:00, run_after=2024-05-24T01:36:00+00:00 2024-05-24T01:35:00.403088517Z [2024-05-24T01:35:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:35:00+00:00, run_after=2024-05-24T01:36:00+00:00 2024-05-24T01:35:00.576247361Z [2024-05-24T01:35:00.575+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:35:00.576275093Z 2024-05-24T01:35:00.576279174Z 2024-05-24T01:35:00.576282566Z 2024-05-24T01:35:00.576285710Z 2024-05-24T01:35:00.580384453Z [2024-05-24T01:35:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:35:00.580745735Z [2024-05-24T01:35:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:35:00.580959188Z [2024-05-24T01:35:00.580+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:35:00.581134990Z [2024-05-24T01:35:00.580+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:35:00.593883078Z [2024-05-24T01:35:00.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:35:00.593920082Z 2024-05-24T01:35:00.593924077Z 2024-05-24T01:35:00.593927329Z 2024-05-24T01:35:00.593930463Z 2024-05-24T01:35:00.611485702Z [2024-05-24T01:35:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:35:00.611582385Z [2024-05-24T01:35:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:35:00.611775947Z [2024-05-24T01:35:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:35:00.611869379Z [2024-05-24T01:35:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:35:00.612082855Z [2024-05-24T01:35:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:35:00.612169858Z [2024-05-24T01:35:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:35:00.612350152Z [2024-05-24T01:35:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:35:00.612433395Z [2024-05-24T01:35:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:35:01.303704064Z [2024-05-24T01:35:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:35:01.303790357Z [2024-05-24T01:35:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status queued for try_number 1 2024-05-24T01:35:01.303810050Z [2024-05-24T01:35:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status queued for try_number 1 2024-05-24T01:35:01.303873051Z [2024-05-24T01:35:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status queued for try_number 1 2024-05-24T01:35:01.323559733Z [2024-05-24T01:35:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05e39613-32e5-485b-9d10-8fcc679f17c4 2024-05-24T01:35:01.323655888Z [2024-05-24T01:35:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 427a0510-4288-4553-9e3a-f55c065a7715 2024-05-24T01:35:01.323737208Z [2024-05-24T01:35:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 208b4992-ed98-4ad5-90a9-5cad15c7d279 2024-05-24T01:35:01.323839938Z [2024-05-24T01:35:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to b71eff54-2ba4-45f4-9685-4265ab86f63d 2024-05-24T01:35:03.085308973Z [2024-05-24T01:35:03.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:35:03.085569530Z [2024-05-24T01:35:03.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:34:00+00:00, run_id=scheduled__2024-05-24T01:34:00+00:00, run_start_date=2024-05-24 01:35:00.421215+00:00, run_end_date=2024-05-24 01:35:03.085251+00:00, run_duration=2.664036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:34:00+00:00, data_interval_end=2024-05-24 01:35:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:35:03.097528632Z [2024-05-24T01:35:03.097+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:35:00+00:00, run_after=2024-05-24T01:36:00+00:00 2024-05-24T01:35:03.190565849Z [2024-05-24T01:35:03.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status success for try_number 1 2024-05-24T01:35:03.203243506Z [2024-05-24T01:35:03.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:34:00+00:00, map_index=-1, run_start_date=2024-05-24 01:35:01.777114+00:00, run_end_date=2024-05-24 01:35:02.356577+00:00, run_duration=0.579463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:35:00.602588+00:00, queued_by_job_id=1, pid=11832 2024-05-24T01:35:04.303037620Z [2024-05-24T01:35:04.302+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:35:04.303080023Z 2024-05-24T01:35:04.303718739Z [2024-05-24T01:35:04.303+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:35:04.305903492Z [2024-05-24T01:35:04.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:35:04.305916292Z 2024-05-24T01:35:04.310286526Z [2024-05-24T01:35:04.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:35:04.310609448Z [2024-05-24T01:35:04.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:35:04.396279970Z [2024-05-24T01:35:04.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:35:04.398560846Z [2024-05-24T01:35:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:35:04.405938522Z [2024-05-24T01:35:04.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to 722b8121-48b2-4083-8323-d361b4f595bf 2024-05-24T01:35:04.406296419Z [2024-05-24T01:35:04.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=-1, run_start_date=2024-05-24 01:35:03.288277+00:00, run_end_date=2024-05-24 01:35:03.654769+00:00, run_duration=0.366492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:35:00.602588+00:00, queued_by_job_id=1, pid=11857 2024-05-24T01:35:04.491632909Z [2024-05-24T01:35:04.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:35:04.492213626Z [2024-05-24T01:35:04.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:34:00+00:00, run_id=scheduled__2024-05-24T01:34:00+00:00, run_start_date=2024-05-24 01:35:00.422582+00:00, run_end_date=2024-05-24 01:35:04.491765+00:00, run_duration=4.069183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:34:00+00:00, data_interval_end=2024-05-24 01:35:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:35:04.502344085Z [2024-05-24T01:35:04.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:35:00+00:00, run_after=2024-05-24T01:36:00+00:00 2024-05-24T01:35:05.607688117Z [2024-05-24T01:35:05.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:35:05.608116879Z [2024-05-24T01:35:05.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:34:00+00:00, run_id=scheduled__2024-05-24T01:34:00+00:00, run_start_date=2024-05-24 01:35:00.423891+00:00, run_end_date=2024-05-24 01:35:05.607806+00:00, run_duration=5.183915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:34:00+00:00, data_interval_end=2024-05-24 01:35:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:35:05.618117837Z [2024-05-24T01:35:05.617+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:35:00+00:00, run_after=2024-05-24T01:36:00+00:00 2024-05-24T01:35:05.682692150Z [2024-05-24T01:35:05.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status success for try_number 1 2024-05-24T01:35:05.682924081Z [2024-05-24T01:35:05.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status success for try_number 1 2024-05-24T01:35:05.691155186Z [2024-05-24T01:35:05.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:34:00+00:00, map_index=-1, run_start_date=2024-05-24 01:35:03.085882+00:00, run_end_date=2024-05-24 01:35:04.392647+00:00, run_duration=1.306765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:35:00.602588+00:00, queued_by_job_id=1, pid=11851 2024-05-24T01:35:05.691743789Z [2024-05-24T01:35:05.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:34:00+00:00, map_index=-1, run_start_date=2024-05-24 01:35:03.522407+00:00, run_end_date=2024-05-24 01:35:05.182848+00:00, run_duration=1.660441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:35:00.602588+00:00, queued_by_job_id=1, pid=11863 2024-05-24T01:35:06.789843734Z [2024-05-24T01:35:06.787+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:35:06.789876855Z 2024-05-24T01:35:06.790014687Z [2024-05-24T01:35:06.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:35:06.791126139Z [2024-05-24T01:35:06.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:35:06.791142174Z 2024-05-24T01:35:06.794613160Z [2024-05-24T01:35:06.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:35:06.794903204Z [2024-05-24T01:35:06.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:35:06.908875555Z [2024-05-24T01:35:06.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:35:06.908921744Z [2024-05-24T01:35:06.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:35:06.917028883Z [2024-05-24T01:35:06.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1176bba9-6351-4681-8363-501dc1766e3d 2024-05-24T01:35:06.917353751Z [2024-05-24T01:35:06.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=-1, run_start_date=2024-05-24 01:35:06.134947+00:00, run_end_date=2024-05-24 01:35:06.521874+00:00, run_duration=0.386927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:35:04.306606+00:00, queued_by_job_id=1, pid=11881 2024-05-24T01:35:09.763818629Z [2024-05-24T01:35:09.763+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:35:09.763844513Z 2024-05-24T01:35:09.763866408Z [2024-05-24T01:35:09.763+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:35:09.764566711Z [2024-05-24T01:35:09.764+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:35:09.764578977Z 2024-05-24T01:35:09.766649958Z [2024-05-24T01:35:09.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:35:09.766718207Z [2024-05-24T01:35:09.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:35:09.819121531Z [2024-05-24T01:35:09.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status queued for try_number 1 2024-05-24T01:35:09.819222401Z [2024-05-24T01:35:09.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:35:09.824767526Z [2024-05-24T01:35:09.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dd46453-e7e9-400f-a427-c2b6f8c532cf 2024-05-24T01:35:09.825075145Z [2024-05-24T01:35:09.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=0, run_start_date=2024-05-24 01:35:08.569756+00:00, run_end_date=2024-05-24 01:35:09.093752+00:00, run_duration=0.523996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:35:06.791668+00:00, queued_by_job_id=1, pid=11889 2024-05-24T01:35:13.273651022Z [2024-05-24T01:35:13.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:35:13.274329274Z [2024-05-24T01:35:13.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:30:00+00:00, run_id=scheduled__2024-05-24T01:30:00+00:00, run_start_date=2024-05-24 01:35:00.419478+00:00, run_end_date=2024-05-24 01:35:13.273704+00:00, run_duration=12.854226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:30:00+00:00, data_interval_end=2024-05-24 01:35:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:35:13.282745144Z [2024-05-24T01:35:13.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:35:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:35:13.319445245Z [2024-05-24T01:35:13.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:30:00+00:00 exited with status success for try_number 1 2024-05-24T01:35:13.330601414Z [2024-05-24T01:35:13.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:30:00+00:00, map_index=-1, run_start_date=2024-05-24 01:35:11.831605+00:00, run_end_date=2024-05-24 01:35:12.237801+00:00, run_duration=0.406196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:35:09.764857+00:00, queued_by_job_id=1, pid=11897 2024-05-24T01:36:00.098964481Z [2024-05-24T01:36:00.098+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:36:00.109908937Z [2024-05-24T01:36:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:36:00.127840564Z [2024-05-24T01:36:00.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:36:00+00:00, run_after=2024-05-24T01:37:00+00:00 2024-05-24T01:36:00.149716636Z [2024-05-24T01:36:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:36:00+00:00, run_after=2024-05-24T01:37:00+00:00 2024-05-24T01:36:00.251406119Z [2024-05-24T01:36:00.250+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:36:00.251474119Z 2024-05-24T01:36:00.251493047Z 2024-05-24T01:36:00.251574972Z 2024-05-24T01:36:00.251591356Z 2024-05-24T01:36:00.251649145Z [2024-05-24T01:36:00.251+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:36:00.251683664Z [2024-05-24T01:36:00.251+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:36:00.251787038Z [2024-05-24T01:36:00.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:36:00.251887418Z [2024-05-24T01:36:00.251+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:36:00.252558648Z [2024-05-24T01:36:00.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:36:00.252573535Z 2024-05-24T01:36:00.252578851Z 2024-05-24T01:36:00.252583264Z 2024-05-24T01:36:00.252587797Z 2024-05-24T01:36:00.256804406Z [2024-05-24T01:36:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:36:00.257100828Z [2024-05-24T01:36:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:36:00.257526681Z [2024-05-24T01:36:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:36:00.257794474Z [2024-05-24T01:36:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:36:00.258131679Z [2024-05-24T01:36:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:36:00.258383040Z [2024-05-24T01:36:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:36:00.258809726Z [2024-05-24T01:36:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:36:00.259037276Z [2024-05-24T01:36:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:36:00.724400579Z [2024-05-24T01:36:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status queued for try_number 1 2024-05-24T01:36:00.724725391Z [2024-05-24T01:36:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status queued for try_number 1 2024-05-24T01:36:00.724959731Z [2024-05-24T01:36:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status queued for try_number 1 2024-05-24T01:36:00.725141272Z [2024-05-24T01:36:00.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status queued for try_number 1 2024-05-24T01:36:00.733966714Z [2024-05-24T01:36:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dbef89f-d7a7-457d-90d2-aa091fc0cb25 2024-05-24T01:36:00.734326606Z [2024-05-24T01:36:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1e43f13-54eb-41b7-b219-71fc5193af69 2024-05-24T01:36:00.734655780Z [2024-05-24T01:36:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 696329bb-988d-4db4-85b5-48d57095e231 2024-05-24T01:36:00.734908733Z [2024-05-24T01:36:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7010880b-9909-4d41-8afb-7e7dbfe85ab3 2024-05-24T01:36:01.780628526Z [2024-05-24T01:36:01.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:36:01.781652017Z [2024-05-24T01:36:01.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:34:00+00:00, run_id=scheduled__2024-05-24T01:34:00+00:00, run_start_date=2024-05-24 01:36:00.161366+00:00, run_end_date=2024-05-24 01:36:01.781179+00:00, run_duration=1.619813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:34:00+00:00, data_interval_end=2024-05-24 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:36:01.793451178Z [2024-05-24T01:36:01.793+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:36:00+00:00, run_after=2024-05-24T01:38:00+00:00 2024-05-24T01:36:02.964224661Z [2024-05-24T01:36:02.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:36:02.964592444Z [2024-05-24T01:36:02.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:35:00+00:00, run_id=scheduled__2024-05-24T01:35:00+00:00, run_start_date=2024-05-24 01:36:00.162670+00:00, run_end_date=2024-05-24 01:36:02.964093+00:00, run_duration=2.801423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:35:00+00:00, data_interval_end=2024-05-24 01:36:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:36:02.975752066Z [2024-05-24T01:36:02.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:36:00+00:00, run_after=2024-05-24T01:37:00+00:00 2024-05-24T01:36:03.036010874Z [2024-05-24T01:36:03.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:34:00+00:00 exited with status success for try_number 1 2024-05-24T01:36:03.036072410Z [2024-05-24T01:36:03.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status success for try_number 1 2024-05-24T01:36:03.043880205Z [2024-05-24T01:36:03.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:34:00+00:00, map_index=-1, run_start_date=2024-05-24 01:36:01.163759+00:00, run_end_date=2024-05-24 01:36:01.707518+00:00, run_duration=0.543759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:36:00.253480+00:00, queued_by_job_id=1, pid=11919 2024-05-24T01:36:03.044188409Z [2024-05-24T01:36:03.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:35:00+00:00, map_index=-1, run_start_date=2024-05-24 01:36:01.455247+00:00, run_end_date=2024-05-24 01:36:01.994389+00:00, run_duration=0.539142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:36:00.253480+00:00, queued_by_job_id=1, pid=11920 2024-05-24T01:36:04.113265554Z [2024-05-24T01:36:04.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:36:04.113713044Z [2024-05-24T01:36:04.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:35:00+00:00, run_id=scheduled__2024-05-24T01:35:00+00:00, run_start_date=2024-05-24 01:36:00.163752+00:00, run_end_date=2024-05-24 01:36:04.113143+00:00, run_duration=3.949391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:35:00+00:00, data_interval_end=2024-05-24 01:36:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:36:04.128769820Z [2024-05-24T01:36:04.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:36:00+00:00, run_after=2024-05-24T01:37:00+00:00 2024-05-24T01:36:04.180250887Z [2024-05-24T01:36:04.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status success for try_number 1 2024-05-24T01:36:04.188160358Z [2024-05-24T01:36:04.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:35:00+00:00, map_index=-1, run_start_date=2024-05-24 01:36:02.441082+00:00, run_end_date=2024-05-24 01:36:03.766787+00:00, run_duration=1.325705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:36:00.253480+00:00, queued_by_job_id=1, pid=11943 2024-05-24T01:36:05.250757081Z [2024-05-24T01:36:05.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:36:05.251092297Z [2024-05-24T01:36:05.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:35:00+00:00, run_id=scheduled__2024-05-24T01:35:00+00:00, run_start_date=2024-05-24 01:36:00.164737+00:00, run_end_date=2024-05-24 01:36:05.250557+00:00, run_duration=5.08582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:35:00+00:00, data_interval_end=2024-05-24 01:36:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:36:05.263057523Z [2024-05-24T01:36:05.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:36:00+00:00, run_after=2024-05-24T01:37:00+00:00 2024-05-24T01:36:05.314294316Z [2024-05-24T01:36:05.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status success for try_number 1 2024-05-24T01:36:05.324085453Z [2024-05-24T01:36:05.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:35:00+00:00, map_index=-1, run_start_date=2024-05-24 01:36:02.610401+00:00, run_end_date=2024-05-24 01:36:04.561815+00:00, run_duration=1.951414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:36:00.253480+00:00, queued_by_job_id=1, pid=11944 2024-05-24T01:36:41.597615547Z [2024-05-24T01:36:41.596+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:37:00.028700294Z [2024-05-24T01:37:00.027+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:37:00.051684799Z [2024-05-24T01:37:00.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:37:00+00:00, run_after=2024-05-24T01:38:00+00:00 2024-05-24T01:37:00.078588667Z [2024-05-24T01:37:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:37:00+00:00, run_after=2024-05-24T01:38:00+00:00 2024-05-24T01:37:00.213716021Z [2024-05-24T01:37:00.212+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:37:00.213749182Z 2024-05-24T01:37:00.213755747Z 2024-05-24T01:37:00.213791226Z 2024-05-24T01:37:00.214137257Z [2024-05-24T01:37:00.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:37:00.214728948Z [2024-05-24T01:37:00.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:37:00.218726046Z [2024-05-24T01:37:00.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:37:00.218740771Z [2024-05-24T01:37:00.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:37:00.218744971Z 2024-05-24T01:37:00.218749144Z 2024-05-24T01:37:00.218752846Z 2024-05-24T01:37:00.225070549Z [2024-05-24T01:37:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:37:00.225392457Z [2024-05-24T01:37:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:37:00.225829811Z [2024-05-24T01:37:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:37:00.226072871Z [2024-05-24T01:37:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:37:00.226622912Z [2024-05-24T01:37:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:37:00.227164092Z [2024-05-24T01:37:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:37:00.492067527Z [2024-05-24T01:37:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status queued for try_number 1 2024-05-24T01:37:00.492113146Z [2024-05-24T01:37:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status queued for try_number 1 2024-05-24T01:37:00.494602848Z [2024-05-24T01:37:00.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status queued for try_number 1 2024-05-24T01:37:00.514057765Z [2024-05-24T01:37:00.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to c316b912-1764-476d-86cd-87eda358dfdb 2024-05-24T01:37:00.514191954Z [2024-05-24T01:37:00.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9ebc460-247d-40ff-b8d8-e98bb10160a4 2024-05-24T01:37:00.514396601Z [2024-05-24T01:37:00.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e7a0580-b78a-4454-aaa3-44bcabb6abf5 2024-05-24T01:37:01.783919051Z [2024-05-24T01:37:01.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:37:01.784616722Z [2024-05-24T01:37:01.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:36:00+00:00, run_id=scheduled__2024-05-24T01:36:00+00:00, run_start_date=2024-05-24 01:37:00.117061+00:00, run_end_date=2024-05-24 01:37:01.784143+00:00, run_duration=1.667082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:36:00+00:00, data_interval_end=2024-05-24 01:37:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:37:01.795760636Z [2024-05-24T01:37:01.795+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:37:00+00:00, run_after=2024-05-24T01:38:00+00:00 2024-05-24T01:37:01.906830789Z [2024-05-24T01:37:01.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status success for try_number 1 2024-05-24T01:37:01.912388384Z [2024-05-24T01:37:01.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:36:00+00:00, map_index=-1, run_start_date=2024-05-24 01:37:01.007065+00:00, run_end_date=2024-05-24 01:37:01.413520+00:00, run_duration=0.406455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:37:00.219328+00:00, queued_by_job_id=1, pid=11976 2024-05-24T01:37:04.036012827Z [2024-05-24T01:37:04.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:37:04.036396026Z [2024-05-24T01:37:04.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:36:00+00:00, run_id=scheduled__2024-05-24T01:36:00+00:00, run_start_date=2024-05-24 01:37:00.119595+00:00, run_end_date=2024-05-24 01:37:04.036078+00:00, run_duration=3.916483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:36:00+00:00, data_interval_end=2024-05-24 01:37:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:37:04.045255056Z [2024-05-24T01:37:04.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:37:00+00:00, run_after=2024-05-24T01:38:00+00:00 2024-05-24T01:37:05.148236650Z [2024-05-24T01:37:05.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:37:05.148634441Z [2024-05-24T01:37:05.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:36:00+00:00, run_id=scheduled__2024-05-24T01:36:00+00:00, run_start_date=2024-05-24 01:37:00.121585+00:00, run_end_date=2024-05-24 01:37:05.148222+00:00, run_duration=5.026637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:36:00+00:00, data_interval_end=2024-05-24 01:37:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:37:05.158060692Z [2024-05-24T01:37:05.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:37:00+00:00, run_after=2024-05-24T01:38:00+00:00 2024-05-24T01:37:05.205016439Z [2024-05-24T01:37:05.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status success for try_number 1 2024-05-24T01:37:05.205262580Z [2024-05-24T01:37:05.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status success for try_number 1 2024-05-24T01:37:05.214860429Z [2024-05-24T01:37:05.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:36:00+00:00, map_index=-1, run_start_date=2024-05-24 01:37:02.318268+00:00, run_end_date=2024-05-24 01:37:03.932407+00:00, run_duration=1.614139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:37:00.219328+00:00, queued_by_job_id=1, pid=11994 2024-05-24T01:37:05.215155385Z [2024-05-24T01:37:05.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:36:00+00:00, map_index=-1, run_start_date=2024-05-24 01:37:02.432261+00:00, run_end_date=2024-05-24 01:37:04.724954+00:00, run_duration=2.292693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:37:00.219328+00:00, queued_by_job_id=1, pid=11995 2024-05-24T01:38:00.043090302Z [2024-05-24T01:38:00.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:38:00+00:00, run_after=2024-05-24T01:39:00+00:00 2024-05-24T01:38:00.056867053Z [2024-05-24T01:38:00.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:38:00+00:00, run_after=2024-05-24T01:39:00+00:00 2024-05-24T01:38:00.065954791Z [2024-05-24T01:38:00.065+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:38:00.073256623Z [2024-05-24T01:38:00.072+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:38:00.175962454Z [2024-05-24T01:38:00.175+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:38:00.175988396Z 2024-05-24T01:38:00.175993745Z 2024-05-24T01:38:00.175997845Z 2024-05-24T01:38:00.176002084Z 2024-05-24T01:38:00.176288665Z [2024-05-24T01:38:00.176+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:38:00.176582699Z [2024-05-24T01:38:00.176+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:38:00.176842578Z [2024-05-24T01:38:00.176+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:38:00.177119896Z [2024-05-24T01:38:00.176+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:38:00.177960602Z [2024-05-24T01:38:00.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:38:00.177975093Z 2024-05-24T01:38:00.177980045Z 2024-05-24T01:38:00.177994580Z 2024-05-24T01:38:00.177999352Z 2024-05-24T01:38:00.182251976Z [2024-05-24T01:38:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:38:00.182649753Z [2024-05-24T01:38:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:38:00.182995867Z [2024-05-24T01:38:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:38:00.183257598Z [2024-05-24T01:38:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:38:00.183620264Z [2024-05-24T01:38:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:38:00.183804742Z [2024-05-24T01:38:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:38:00.184101357Z [2024-05-24T01:38:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:38:00.184296215Z [2024-05-24T01:38:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:38:00.628891709Z [2024-05-24T01:38:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status queued for try_number 1 2024-05-24T01:38:00.628927880Z [2024-05-24T01:38:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:37:00+00:00 exited with status queued for try_number 1 2024-05-24T01:38:00.629245027Z [2024-05-24T01:38:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:37:00+00:00 exited with status queued for try_number 1 2024-05-24T01:38:00.629491388Z [2024-05-24T01:38:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:37:00+00:00 exited with status queued for try_number 1 2024-05-24T01:38:00.644639583Z [2024-05-24T01:38:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 390b89b5-babd-4247-a557-78d1b8320b0c 2024-05-24T01:38:00.644885782Z [2024-05-24T01:38:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 500c8009-2b49-48d7-8bef-e335b92ba57f 2024-05-24T01:38:00.645092537Z [2024-05-24T01:38:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18f4c373-8175-4ae7-abca-4170a4b60d26 2024-05-24T01:38:00.645264915Z [2024-05-24T01:38:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9187f2b-feee-4ec2-b4bd-9bd103fe8ba1 2024-05-24T01:38:01.935748255Z [2024-05-24T01:38:01.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:38:01.935970192Z [2024-05-24T01:38:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:36:00+00:00, run_id=scheduled__2024-05-24T01:36:00+00:00, run_start_date=2024-05-24 01:38:00.084045+00:00, run_end_date=2024-05-24 01:38:01.935538+00:00, run_duration=1.851493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:36:00+00:00, data_interval_end=2024-05-24 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:38:01.943206694Z [2024-05-24T01:38:01.942+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:38:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:38:01.949672217Z [2024-05-24T01:38:01.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:38:01.949830976Z [2024-05-24T01:38:01.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:37:00+00:00, run_id=scheduled__2024-05-24T01:37:00+00:00, run_start_date=2024-05-24 01:38:00.085219+00:00, run_end_date=2024-05-24 01:38:01.949511+00:00, run_duration=1.864292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:37:00+00:00, data_interval_end=2024-05-24 01:38:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:38:01.959224168Z [2024-05-24T01:38:01.958+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:38:00+00:00, run_after=2024-05-24T01:39:00+00:00 2024-05-24T01:38:02.035088185Z [2024-05-24T01:38:02.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:36:00+00:00 exited with status success for try_number 1 2024-05-24T01:38:02.035826389Z [2024-05-24T01:38:02.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:37:00+00:00 exited with status success for try_number 1 2024-05-24T01:38:02.049883396Z [2024-05-24T01:38:02.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:36:00+00:00, map_index=-1, run_start_date=2024-05-24 01:38:01.162566+00:00, run_end_date=2024-05-24 01:38:01.559360+00:00, run_duration=0.396794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:38:00.179093+00:00, queued_by_job_id=1, pid=12028 2024-05-24T01:38:02.050602875Z [2024-05-24T01:38:02.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:37:00+00:00, map_index=-1, run_start_date=2024-05-24 01:38:01.310162+00:00, run_end_date=2024-05-24 01:38:01.796410+00:00, run_duration=0.486248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:38:00.179093+00:00, queued_by_job_id=1, pid=12029 2024-05-24T01:38:03.978329256Z [2024-05-24T01:38:03.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:38:03.978950313Z [2024-05-24T01:38:03.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:37:00+00:00, run_id=scheduled__2024-05-24T01:37:00+00:00, run_start_date=2024-05-24 01:38:00.086232+00:00, run_end_date=2024-05-24 01:38:03.978571+00:00, run_duration=3.892339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:37:00+00:00, data_interval_end=2024-05-24 01:38:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:38:03.987892129Z [2024-05-24T01:38:03.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:38:00+00:00, run_after=2024-05-24T01:39:00+00:00 2024-05-24T01:38:05.101761222Z [2024-05-24T01:38:05.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:38:05.102120334Z [2024-05-24T01:38:05.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:37:00+00:00, run_id=scheduled__2024-05-24T01:37:00+00:00, run_start_date=2024-05-24 01:38:00.087599+00:00, run_end_date=2024-05-24 01:38:05.101753+00:00, run_duration=5.014154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:37:00+00:00, data_interval_end=2024-05-24 01:38:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:38:05.114890907Z [2024-05-24T01:38:05.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:38:00+00:00, run_after=2024-05-24T01:39:00+00:00 2024-05-24T01:38:05.161400266Z [2024-05-24T01:38:05.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:37:00+00:00 exited with status success for try_number 1 2024-05-24T01:38:05.161582483Z [2024-05-24T01:38:05.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:37:00+00:00 exited with status success for try_number 1 2024-05-24T01:38:05.173076064Z [2024-05-24T01:38:05.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:37:00+00:00, map_index=-1, run_start_date=2024-05-24 01:38:02.561123+00:00, run_end_date=2024-05-24 01:38:03.961645+00:00, run_duration=1.400522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:38:00.179093+00:00, queued_by_job_id=1, pid=12053 2024-05-24T01:38:05.174252816Z [2024-05-24T01:38:05.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:37:00+00:00, map_index=-1, run_start_date=2024-05-24 01:38:02.426007+00:00, run_end_date=2024-05-24 01:38:04.080729+00:00, run_duration=1.654722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:38:00.179093+00:00, queued_by_job_id=1, pid=12052 2024-05-24T01:39:00.822982454Z [2024-05-24T01:39:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:39:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:39:00.833285702Z [2024-05-24T01:39:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:39:00.846932269Z [2024-05-24T01:39:00.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:39:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:39:00.942574275Z [2024-05-24T01:39:00.936+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:39:00.942603898Z 2024-05-24T01:39:00.942607467Z 2024-05-24T01:39:00.942610595Z 2024-05-24T01:39:00.942613798Z [2024-05-24T01:39:00.936+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:39:00.942616918Z [2024-05-24T01:39:00.936+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:39:00.942620250Z [2024-05-24T01:39:00.937+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:39:00.942624527Z [2024-05-24T01:39:00.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:39:00.942627575Z 2024-05-24T01:39:00.942630525Z 2024-05-24T01:39:00.942633433Z 2024-05-24T01:39:00.950761283Z [2024-05-24T01:39:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:39:00.950782430Z [2024-05-24T01:39:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:39:00.951170535Z [2024-05-24T01:39:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:39:00.951177211Z [2024-05-24T01:39:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:39:00.954952226Z [2024-05-24T01:39:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:39:00.954968178Z [2024-05-24T01:39:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:39:01.278252167Z [2024-05-24T01:39:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status queued for try_number 1 2024-05-24T01:39:01.278279210Z [2024-05-24T01:39:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status queued for try_number 1 2024-05-24T01:39:01.278283374Z [2024-05-24T01:39:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status queued for try_number 1 2024-05-24T01:39:01.303393410Z [2024-05-24T01:39:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5904b60d-aa8d-491f-8c46-ac54fe41e975 2024-05-24T01:39:01.303490260Z [2024-05-24T01:39:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to f77faeed-707c-48a0-b83a-201328298102 2024-05-24T01:39:01.303589605Z [2024-05-24T01:39:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97778701-1fd8-4fe1-b9c8-f343373e4bfd 2024-05-24T01:39:02.781051917Z [2024-05-24T01:39:02.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:39:02.781524135Z [2024-05-24T01:39:02.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:38:00+00:00, run_id=scheduled__2024-05-24T01:38:00+00:00, run_start_date=2024-05-24 01:39:00.859671+00:00, run_end_date=2024-05-24 01:39:02.781005+00:00, run_duration=1.921334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:38:00+00:00, data_interval_end=2024-05-24 01:39:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:39:02.793074668Z [2024-05-24T01:39:02.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:39:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:39:02.894847311Z [2024-05-24T01:39:02.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status success for try_number 1 2024-05-24T01:39:02.918236850Z [2024-05-24T01:39:02.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:38:00+00:00, map_index=-1, run_start_date=2024-05-24 01:39:02.013345+00:00, run_end_date=2024-05-24 01:39:02.409850+00:00, run_duration=0.396505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:39:00.938288+00:00, queued_by_job_id=1, pid=12085 2024-05-24T01:39:05.567498529Z [2024-05-24T01:39:05.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:39:05.567751074Z [2024-05-24T01:39:05.567+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:38:00+00:00, run_id=scheduled__2024-05-24T01:38:00+00:00, run_start_date=2024-05-24 01:39:00.861304+00:00, run_end_date=2024-05-24 01:39:05.567231+00:00, run_duration=4.705927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:38:00+00:00, data_interval_end=2024-05-24 01:39:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:39:05.581149916Z [2024-05-24T01:39:05.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:39:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:39:05.590410157Z [2024-05-24T01:39:05.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:39:05.590633101Z [2024-05-24T01:39:05.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:38:00+00:00, run_id=scheduled__2024-05-24T01:38:00+00:00, run_start_date=2024-05-24 01:39:00.862437+00:00, run_end_date=2024-05-24 01:39:05.590200+00:00, run_duration=4.727763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:38:00+00:00, data_interval_end=2024-05-24 01:39:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:39:05.600093642Z [2024-05-24T01:39:05.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:39:00+00:00, run_after=2024-05-24T01:40:00+00:00 2024-05-24T01:39:05.649479770Z [2024-05-24T01:39:05.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status success for try_number 1 2024-05-24T01:39:05.649612118Z [2024-05-24T01:39:05.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status success for try_number 1 2024-05-24T01:39:05.662319567Z [2024-05-24T01:39:05.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:38:00+00:00, map_index=-1, run_start_date=2024-05-24 01:39:03.107971+00:00, run_end_date=2024-05-24 01:39:04.670255+00:00, run_duration=1.562284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:39:00.938288+00:00, queued_by_job_id=1, pid=12104 2024-05-24T01:39:05.662658676Z [2024-05-24T01:39:05.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:38:00+00:00, map_index=-1, run_start_date=2024-05-24 01:39:03.002553+00:00, run_end_date=2024-05-24 01:39:05.310431+00:00, run_duration=2.307878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:39:00.938288+00:00, queued_by_job_id=1, pid=12103 2024-05-24T01:40:00.722723762Z [2024-05-24T01:40:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:45:00+00:00 2024-05-24T01:40:00.733680208Z [2024-05-24T01:40:00.733+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:40:00.741625548Z [2024-05-24T01:40:00.741+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:40:00.754814714Z [2024-05-24T01:40:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:41:00+00:00 2024-05-24T01:40:00.768167125Z [2024-05-24T01:40:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:41:00+00:00 2024-05-24T01:40:00.894982866Z [2024-05-24T01:40:00.894+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T01:40:00.895092191Z 2024-05-24T01:40:00.895103220Z 2024-05-24T01:40:00.895117094Z 2024-05-24T01:40:00.895173359Z 2024-05-24T01:40:00.895183385Z 2024-05-24T01:40:00.895220819Z [2024-05-24T01:40:00.894+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:40:00.896465815Z [2024-05-24T01:40:00.896+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:40:00.896602845Z [2024-05-24T01:40:00.896+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:40:00.896776359Z [2024-05-24T01:40:00.896+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:40:00.896994758Z [2024-05-24T01:40:00.896+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:40:00.898114164Z [2024-05-24T01:40:00.897+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:40:00.898129213Z 2024-05-24T01:40:00.898137666Z 2024-05-24T01:40:00.898145383Z 2024-05-24T01:40:00.898152339Z 2024-05-24T01:40:00.898182146Z 2024-05-24T01:40:00.906621218Z [2024-05-24T01:40:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:40:00.906671506Z [2024-05-24T01:40:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:40:00.906944445Z [2024-05-24T01:40:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:40:00.907022691Z [2024-05-24T01:40:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:40:00.907354855Z [2024-05-24T01:40:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:40:00.907482571Z [2024-05-24T01:40:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:40:00.907744039Z [2024-05-24T01:40:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:40:00.907851398Z [2024-05-24T01:40:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:40:00.908095029Z [2024-05-24T01:40:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:40:00.908125681Z [2024-05-24T01:40:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:40:01.461537433Z [2024-05-24T01:40:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:01.464735629Z [2024-05-24T01:40:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:01.464987202Z [2024-05-24T01:40:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:39:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:01.465153858Z [2024-05-24T01:40:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:39:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:01.465309014Z [2024-05-24T01:40:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:39:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:01.481180813Z [2024-05-24T01:40:01.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddeb7122-2481-4e25-8a09-9398a1a846be 2024-05-24T01:40:01.482820128Z [2024-05-24T01:40:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 462d9031-abdd-429e-82a3-3114c7de974d 2024-05-24T01:40:01.483058070Z [2024-05-24T01:40:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to a759abf6-38b6-49ee-89da-532abafff35b 2024-05-24T01:40:01.486200924Z [2024-05-24T01:40:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c40bbc1-26bd-4b5b-892e-4e2b1369467d 2024-05-24T01:40:01.486409057Z [2024-05-24T01:40:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 472bb862-9853-4572-a58f-14d5417941be 2024-05-24T01:40:03.805454313Z [2024-05-24T01:40:03.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:40:03.806407881Z [2024-05-24T01:40:03.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:38:00+00:00, run_id=scheduled__2024-05-24T01:38:00+00:00, run_start_date=2024-05-24 01:40:00.787151+00:00, run_end_date=2024-05-24 01:40:03.805998+00:00, run_duration=3.018847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:38:00+00:00, data_interval_end=2024-05-24 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:40:03.825703638Z [2024-05-24T01:40:03.825+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:42:00+00:00 2024-05-24T01:40:03.856749870Z [2024-05-24T01:40:03.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:40:03.856996673Z [2024-05-24T01:40:03.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:39:00+00:00, run_id=scheduled__2024-05-24T01:39:00+00:00, run_start_date=2024-05-24 01:40:00.788671+00:00, run_end_date=2024-05-24 01:40:03.856673+00:00, run_duration=3.068002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:39:00+00:00, data_interval_end=2024-05-24 01:40:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:40:03.890880122Z [2024-05-24T01:40:03.886+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:41:00+00:00 2024-05-24T01:40:03.943738529Z [2024-05-24T01:40:03.943+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:40:03.943773307Z 2024-05-24T01:40:03.943832041Z [2024-05-24T01:40:03.943+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:40:03.944411908Z [2024-05-24T01:40:03.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:40:03.944426123Z 2024-05-24T01:40:03.948222079Z [2024-05-24T01:40:03.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:40:03.948386986Z [2024-05-24T01:40:03.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:40:04.034477124Z [2024-05-24T01:40:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:04.034594293Z [2024-05-24T01:40:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:38:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:04.035361529Z [2024-05-24T01:40:04.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:39:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:04.051997763Z [2024-05-24T01:40:04.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:38:00+00:00, map_index=-1, run_start_date=2024-05-24 01:40:02.242868+00:00, run_end_date=2024-05-24 01:40:02.915291+00:00, run_duration=0.672423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:00.901569+00:00, queued_by_job_id=1, pid=12138 2024-05-24T01:40:04.052223351Z [2024-05-24T01:40:04.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:39:00+00:00, map_index=-1, run_start_date=2024-05-24 01:40:02.087124+00:00, run_end_date=2024-05-24 01:40:02.638010+00:00, run_duration=0.550886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:00.901569+00:00, queued_by_job_id=1, pid=12137 2024-05-24T01:40:04.052414343Z [2024-05-24T01:40:04.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69a2f873-73da-4404-8523-c6361538ad61 2024-05-24T01:40:04.211002609Z [2024-05-24T01:40:04.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:04.220115301Z [2024-05-24T01:40:04.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:35:00+00:00, map_index=-1, run_start_date=2024-05-24 01:40:03.332291+00:00, run_end_date=2024-05-24 01:40:03.791862+00:00, run_duration=0.459571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:00.901569+00:00, queued_by_job_id=1, pid=12167 2024-05-24T01:40:05.266391400Z [2024-05-24T01:40:05.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:40:05.266544188Z [2024-05-24T01:40:05.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:39:00+00:00, run_id=scheduled__2024-05-24T01:39:00+00:00, run_start_date=2024-05-24 01:40:00.789938+00:00, run_end_date=2024-05-24 01:40:05.266301+00:00, run_duration=4.476363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:39:00+00:00, data_interval_end=2024-05-24 01:40:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:40:05.282957132Z [2024-05-24T01:40:05.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:41:00+00:00 2024-05-24T01:40:05.291963096Z [2024-05-24T01:40:05.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:40:05.292311624Z [2024-05-24T01:40:05.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:39:00+00:00, run_id=scheduled__2024-05-24T01:39:00+00:00, run_start_date=2024-05-24 01:40:00.791149+00:00, run_end_date=2024-05-24 01:40:05.291887+00:00, run_duration=4.500738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:39:00+00:00, data_interval_end=2024-05-24 01:40:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:40:05.304958553Z [2024-05-24T01:40:05.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:41:00+00:00 2024-05-24T01:40:05.386328435Z [2024-05-24T01:40:05.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:39:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:05.393773527Z [2024-05-24T01:40:05.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:39:00+00:00, map_index=-1, run_start_date=2024-05-24 01:40:03.516219+00:00, run_end_date=2024-05-24 01:40:04.958892+00:00, run_duration=1.442673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:00.901569+00:00, queued_by_job_id=1, pid=12169 2024-05-24T01:40:06.474838203Z [2024-05-24T01:40:06.474+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:40:06.474879233Z 2024-05-24T01:40:06.475198113Z [2024-05-24T01:40:06.474+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:40:06.476006578Z [2024-05-24T01:40:06.475+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:40:06.476021379Z 2024-05-24T01:40:06.479441602Z [2024-05-24T01:40:06.478+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:40:06.479809365Z [2024-05-24T01:40:06.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:40:06.535023333Z [2024-05-24T01:40:06.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:06.535299081Z [2024-05-24T01:40:06.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:39:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:06.536745290Z [2024-05-24T01:40:06.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:06.551728508Z [2024-05-24T01:40:06.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf2f2ef6-7bbc-429d-91b0-fb1df752faed 2024-05-24T01:40:06.552294330Z [2024-05-24T01:40:06.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:39:00+00:00, map_index=-1, run_start_date=2024-05-24 01:40:03.347182+00:00, run_end_date=2024-05-24 01:40:05.180114+00:00, run_duration=1.832932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:00.901569+00:00, queued_by_job_id=1, pid=12168 2024-05-24T01:40:06.552854993Z [2024-05-24T01:40:06.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:35:00+00:00, map_index=-1, run_start_date=2024-05-24 01:40:05.907542+00:00, run_end_date=2024-05-24 01:40:06.292995+00:00, run_duration=0.385453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:03.944802+00:00, queued_by_job_id=1, pid=12192 2024-05-24T01:40:09.031793284Z [2024-05-24T01:40:09.031+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:40:09.031818130Z 2024-05-24T01:40:09.031869562Z [2024-05-24T01:40:09.031+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:40:09.032371102Z [2024-05-24T01:40:09.032+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:40:09.032377799Z 2024-05-24T01:40:09.034896564Z [2024-05-24T01:40:09.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:40:09.034959607Z [2024-05-24T01:40:09.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:40:09.139314699Z [2024-05-24T01:40:09.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status queued for try_number 1 2024-05-24T01:40:09.139386102Z [2024-05-24T01:40:09.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:09.147148199Z [2024-05-24T01:40:09.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to fad84c22-1282-45d6-a1bc-ca263134f56e 2024-05-24T01:40:09.147288240Z [2024-05-24T01:40:09.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:35:00+00:00, map_index=0, run_start_date=2024-05-24 01:40:08.205027+00:00, run_end_date=2024-05-24 01:40:08.603376+00:00, run_duration=0.398349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:06.476605+00:00, queued_by_job_id=1, pid=12200 2024-05-24T01:40:11.418351733Z [2024-05-24T01:40:11.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:40:11.418817254Z [2024-05-24T01:40:11.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:35:00+00:00, run_id=scheduled__2024-05-24T01:35:00+00:00, run_start_date=2024-05-24 01:40:00.782929+00:00, run_end_date=2024-05-24 01:40:11.418358+00:00, run_duration=10.635429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:35:00+00:00, data_interval_end=2024-05-24 01:40:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:40:11.427118216Z [2024-05-24T01:40:11.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:40:00+00:00, run_after=2024-05-24T01:45:00+00:00 2024-05-24T01:40:11.474587577Z [2024-05-24T01:40:11.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:35:00+00:00 exited with status success for try_number 1 2024-05-24T01:40:11.485291122Z [2024-05-24T01:40:11.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:35:00+00:00, map_index=-1, run_start_date=2024-05-24 01:40:10.729351+00:00, run_end_date=2024-05-24 01:40:11.126391+00:00, run_duration=0.39704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:40:09.032767+00:00, queued_by_job_id=1, pid=12208 2024-05-24T01:41:00.889961202Z [2024-05-24T01:41:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:41:00+00:00, run_after=2024-05-24T01:42:00+00:00 2024-05-24T01:41:00.907480000Z [2024-05-24T01:41:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:41:00+00:00, run_after=2024-05-24T01:42:00+00:00 2024-05-24T01:41:00.916974766Z [2024-05-24T01:41:00.916+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:41:00.994214674Z [2024-05-24T01:41:00.993+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:41:00.994259778Z 2024-05-24T01:41:00.994264229Z 2024-05-24T01:41:00.994267783Z 2024-05-24T01:41:00.994547069Z [2024-05-24T01:41:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:41:00.994582596Z [2024-05-24T01:41:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:41:00.994820415Z [2024-05-24T01:41:00.994+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:41:00.995279631Z [2024-05-24T01:41:00.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:41:00.995289662Z 2024-05-24T01:41:00.995292917Z 2024-05-24T01:41:00.995296200Z 2024-05-24T01:41:00.998378669Z [2024-05-24T01:41:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:41:00.998545862Z [2024-05-24T01:41:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:41:00.998797269Z [2024-05-24T01:41:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:41:00.998932943Z [2024-05-24T01:41:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:41:00.999154250Z [2024-05-24T01:41:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:41:00.999287350Z [2024-05-24T01:41:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:41:01.295505157Z [2024-05-24T01:41:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:41:01.295711630Z [2024-05-24T01:41:01.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:41:01.295867857Z [2024-05-24T01:41:01.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:41:01.307811266Z [2024-05-24T01:41:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed9cdde0-93ba-4021-ad4e-dd1816b20a79 2024-05-24T01:41:01.307845807Z [2024-05-24T01:41:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 966b5fcb-ff94-44d3-99f2-03688f1a4936 2024-05-24T01:41:01.307957388Z [2024-05-24T01:41:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97060d79-94e4-411d-8780-fddd3150a0a4 2024-05-24T01:41:02.477156395Z [2024-05-24T01:41:02.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:41:02.477236649Z [2024-05-24T01:41:02.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:40:00+00:00, run_id=scheduled__2024-05-24T01:40:00+00:00, run_start_date=2024-05-24 01:41:00.936690+00:00, run_end_date=2024-05-24 01:41:02.476903+00:00, run_duration=1.540213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:40:00+00:00, data_interval_end=2024-05-24 01:41:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:41:02.488966881Z [2024-05-24T01:41:02.488+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:41:00+00:00, run_after=2024-05-24T01:42:00+00:00 2024-05-24T01:41:02.546672657Z [2024-05-24T01:41:02.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:41:02.553929281Z [2024-05-24T01:41:02.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=-1, run_start_date=2024-05-24 01:41:01.809548+00:00, run_end_date=2024-05-24 01:41:02.261538+00:00, run_duration=0.45199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:41:00.995878+00:00, queued_by_job_id=1, pid=12230 2024-05-24T01:41:04.503815894Z [2024-05-24T01:41:04.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:41:04.504355068Z [2024-05-24T01:41:04.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:40:00+00:00, run_id=scheduled__2024-05-24T01:40:00+00:00, run_start_date=2024-05-24 01:41:00.938084+00:00, run_end_date=2024-05-24 01:41:04.503849+00:00, run_duration=3.565765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:40:00+00:00, data_interval_end=2024-05-24 01:41:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:41:04.517142961Z [2024-05-24T01:41:04.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:41:00+00:00, run_after=2024-05-24T01:42:00+00:00 2024-05-24T01:41:05.639227291Z [2024-05-24T01:41:05.638+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:41:05.639551476Z [2024-05-24T01:41:05.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:40:00+00:00, run_id=scheduled__2024-05-24T01:40:00+00:00, run_start_date=2024-05-24 01:41:00.939148+00:00, run_end_date=2024-05-24 01:41:05.639134+00:00, run_duration=4.699986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:40:00+00:00, data_interval_end=2024-05-24 01:41:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:41:05.659103353Z [2024-05-24T01:41:05.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:41:00+00:00, run_after=2024-05-24T01:42:00+00:00 2024-05-24T01:41:05.708118890Z [2024-05-24T01:41:05.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:41:05.708292028Z [2024-05-24T01:41:05.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:41:05.717428701Z [2024-05-24T01:41:05.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=-1, run_start_date=2024-05-24 01:41:02.679655+00:00, run_end_date=2024-05-24 01:41:04.406193+00:00, run_duration=1.726538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:41:00.995878+00:00, queued_by_job_id=1, pid=12248 2024-05-24T01:41:05.717598158Z [2024-05-24T01:41:05.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=-1, run_start_date=2024-05-24 01:41:02.895729+00:00, run_end_date=2024-05-24 01:41:04.978914+00:00, run_duration=2.083185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:41:00.995878+00:00, queued_by_job_id=1, pid=12249 2024-05-24T01:41:41.693866234Z [2024-05-24T01:41:41.692+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:42:00.768249448Z [2024-05-24T01:42:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:42:00.776463602Z [2024-05-24T01:42:00.776+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:42:00.788555711Z [2024-05-24T01:42:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:42:00+00:00, run_after=2024-05-24T01:43:00+00:00 2024-05-24T01:42:00.814412395Z [2024-05-24T01:42:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:42:00+00:00, run_after=2024-05-24T01:43:00+00:00 2024-05-24T01:42:00.930077704Z [2024-05-24T01:42:00.929+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:42:00.930102594Z 2024-05-24T01:42:00.930108415Z 2024-05-24T01:42:00.930113572Z 2024-05-24T01:42:00.930117940Z 2024-05-24T01:42:00.931334818Z [2024-05-24T01:42:00.929+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:42:00.931349547Z [2024-05-24T01:42:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:42:00.931956010Z [2024-05-24T01:42:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:42:00.931984014Z [2024-05-24T01:42:00.931+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:42:00.936404771Z [2024-05-24T01:42:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:42:00.936423640Z 2024-05-24T01:42:00.936429172Z 2024-05-24T01:42:00.936433514Z 2024-05-24T01:42:00.936437695Z 2024-05-24T01:42:00.942706482Z [2024-05-24T01:42:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:42:00.942728211Z [2024-05-24T01:42:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:42:00.943793698Z [2024-05-24T01:42:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:42:00.958607189Z [2024-05-24T01:42:00.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:42:00.958627860Z [2024-05-24T01:42:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:42:00.958631597Z [2024-05-24T01:42:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:42:00.958640907Z [2024-05-24T01:42:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:42:00.958644594Z [2024-05-24T01:42:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:42:01.432551568Z [2024-05-24T01:42:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:42:01.432739953Z [2024-05-24T01:42:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:41:00+00:00 exited with status queued for try_number 1 2024-05-24T01:42:01.432839992Z [2024-05-24T01:42:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:41:00+00:00 exited with status queued for try_number 1 2024-05-24T01:42:01.432948765Z [2024-05-24T01:42:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:41:00+00:00 exited with status queued for try_number 1 2024-05-24T01:42:01.449246454Z [2024-05-24T01:42:01.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc54c57d-aec6-459d-b02b-da5f35feff65 2024-05-24T01:42:01.449424533Z [2024-05-24T01:42:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 020df863-b4ae-4561-82a1-39945d9fb5a7 2024-05-24T01:42:01.449603641Z [2024-05-24T01:42:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdb4d162-192b-42ba-bd76-ea50fb4325dc 2024-05-24T01:42:01.449780831Z [2024-05-24T01:42:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 637a67d6-eead-42c1-b465-65fbfa634052 2024-05-24T01:42:02.619624897Z [2024-05-24T01:42:02.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:42:02.620125188Z [2024-05-24T01:42:02.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:40:00+00:00, run_id=scheduled__2024-05-24T01:40:00+00:00, run_start_date=2024-05-24 01:42:00.831056+00:00, run_end_date=2024-05-24 01:42:02.619571+00:00, run_duration=1.788515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:40:00+00:00, data_interval_end=2024-05-24 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:42:02.636828425Z [2024-05-24T01:42:02.636+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:42:00+00:00, run_after=2024-05-24T01:44:00+00:00 2024-05-24T01:42:02.649612222Z [2024-05-24T01:42:02.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:42:02.650027686Z [2024-05-24T01:42:02.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:41:00+00:00, run_id=scheduled__2024-05-24T01:41:00+00:00, run_start_date=2024-05-24 01:42:00.832694+00:00, run_end_date=2024-05-24 01:42:02.649644+00:00, run_duration=1.81695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:41:00+00:00, data_interval_end=2024-05-24 01:42:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:42:02.661023597Z [2024-05-24T01:42:02.660+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:42:00+00:00, run_after=2024-05-24T01:43:00+00:00 2024-05-24T01:42:02.741177402Z [2024-05-24T01:42:02.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:42:02.746240459Z [2024-05-24T01:42:02.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=-1, run_start_date=2024-05-24 01:42:01.966594+00:00, run_end_date=2024-05-24 01:42:02.431678+00:00, run_duration=0.465084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:42:00.934655+00:00, queued_by_job_id=1, pid=12282 2024-05-24T01:42:03.838234268Z [2024-05-24T01:42:03.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:41:00+00:00 exited with status success for try_number 1 2024-05-24T01:42:03.843250863Z [2024-05-24T01:42:03.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:41:00+00:00, map_index=-1, run_start_date=2024-05-24 01:42:02.052738+00:00, run_end_date=2024-05-24 01:42:02.577186+00:00, run_duration=0.524448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:42:00.934655+00:00, queued_by_job_id=1, pid=12283 2024-05-24T01:42:05.060899076Z [2024-05-24T01:42:05.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:42:05.061367485Z [2024-05-24T01:42:05.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:41:00+00:00, run_id=scheduled__2024-05-24T01:41:00+00:00, run_start_date=2024-05-24 01:42:00.834658+00:00, run_end_date=2024-05-24 01:42:05.060719+00:00, run_duration=4.226061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:41:00+00:00, data_interval_end=2024-05-24 01:42:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:42:05.072144147Z [2024-05-24T01:42:05.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:42:00+00:00, run_after=2024-05-24T01:43:00+00:00 2024-05-24T01:42:05.134225218Z [2024-05-24T01:42:05.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:41:00+00:00 exited with status success for try_number 1 2024-05-24T01:42:05.143821984Z [2024-05-24T01:42:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:41:00+00:00, map_index=-1, run_start_date=2024-05-24 01:42:03.473924+00:00, run_end_date=2024-05-24 01:42:04.790129+00:00, run_duration=1.316205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:42:00.934655+00:00, queued_by_job_id=1, pid=12307 2024-05-24T01:42:06.214284777Z [2024-05-24T01:42:06.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:42:06.215043537Z [2024-05-24T01:42:06.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:41:00+00:00, run_id=scheduled__2024-05-24T01:41:00+00:00, run_start_date=2024-05-24 01:42:00.835571+00:00, run_end_date=2024-05-24 01:42:06.214468+00:00, run_duration=5.378897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:41:00+00:00, data_interval_end=2024-05-24 01:42:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:42:06.236039480Z [2024-05-24T01:42:06.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:42:00+00:00, run_after=2024-05-24T01:43:00+00:00 2024-05-24T01:42:06.301978356Z [2024-05-24T01:42:06.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:41:00+00:00 exited with status success for try_number 1 2024-05-24T01:42:06.308942383Z [2024-05-24T01:42:06.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:41:00+00:00, map_index=-1, run_start_date=2024-05-24 01:42:03.454272+00:00, run_end_date=2024-05-24 01:42:05.101579+00:00, run_duration=1.647307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:42:00.934655+00:00, queued_by_job_id=1, pid=12306 2024-05-24T01:43:00.738538191Z [2024-05-24T01:43:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:43:00+00:00, run_after=2024-05-24T01:44:00+00:00 2024-05-24T01:43:00.750585587Z [2024-05-24T01:43:00.750+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:43:00.786137945Z [2024-05-24T01:43:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:43:00+00:00, run_after=2024-05-24T01:44:00+00:00 2024-05-24T01:43:00.886628392Z [2024-05-24T01:43:00.886+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:43:00.886660028Z 2024-05-24T01:43:00.886666260Z 2024-05-24T01:43:00.886671939Z 2024-05-24T01:43:00.887168704Z [2024-05-24T01:43:00.886+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:43:00.887465691Z [2024-05-24T01:43:00.887+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:43:00.887746638Z [2024-05-24T01:43:00.887+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:43:00.888749851Z [2024-05-24T01:43:00.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:43:00.888792435Z 2024-05-24T01:43:00.888820028Z 2024-05-24T01:43:00.888825868Z 2024-05-24T01:43:00.893656037Z [2024-05-24T01:43:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:43:00.893896224Z [2024-05-24T01:43:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:43:00.894234157Z [2024-05-24T01:43:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:43:00.894441622Z [2024-05-24T01:43:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:43:00.894832689Z [2024-05-24T01:43:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:43:00.895061215Z [2024-05-24T01:43:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:43:01.143628838Z [2024-05-24T01:43:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status queued for try_number 1 2024-05-24T01:43:01.143797823Z [2024-05-24T01:43:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status queued for try_number 1 2024-05-24T01:43:01.143971286Z [2024-05-24T01:43:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status queued for try_number 1 2024-05-24T01:43:01.152412114Z [2024-05-24T01:43:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8559335-01e8-4a8e-a36e-90a40c157f59 2024-05-24T01:43:01.152666257Z [2024-05-24T01:43:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7337ff3b-4ff9-465a-b232-ff1bc9645e48 2024-05-24T01:43:01.152878849Z [2024-05-24T01:43:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29096e2f-3ee2-4299-bde9-3d52c2e72e8d 2024-05-24T01:43:02.299438351Z [2024-05-24T01:43:02.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:43:02.299763445Z [2024-05-24T01:43:02.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:42:00+00:00, run_id=scheduled__2024-05-24T01:42:00+00:00, run_start_date=2024-05-24 01:43:00.801327+00:00, run_end_date=2024-05-24 01:43:02.299330+00:00, run_duration=1.498003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:42:00+00:00, data_interval_end=2024-05-24 01:43:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:43:02.310057918Z [2024-05-24T01:43:02.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:43:00+00:00, run_after=2024-05-24T01:44:00+00:00 2024-05-24T01:43:02.388737354Z [2024-05-24T01:43:02.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status success for try_number 1 2024-05-24T01:43:02.401432814Z [2024-05-24T01:43:02.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:42:00+00:00, map_index=-1, run_start_date=2024-05-24 01:43:01.649363+00:00, run_end_date=2024-05-24 01:43:02.100739+00:00, run_duration=0.451376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:43:00.890141+00:00, queued_by_job_id=1, pid=12339 2024-05-24T01:43:05.573143454Z [2024-05-24T01:43:05.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:43:05.574376794Z [2024-05-24T01:43:05.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:42:00+00:00, run_id=scheduled__2024-05-24T01:42:00+00:00, run_start_date=2024-05-24 01:43:00.803025+00:00, run_end_date=2024-05-24 01:43:05.573337+00:00, run_duration=4.770312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:42:00+00:00, data_interval_end=2024-05-24 01:43:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:43:05.592172137Z [2024-05-24T01:43:05.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:43:00+00:00, run_after=2024-05-24T01:44:00+00:00 2024-05-24T01:43:05.604723804Z [2024-05-24T01:43:05.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:43:05.605095446Z [2024-05-24T01:43:05.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:42:00+00:00, run_id=scheduled__2024-05-24T01:42:00+00:00, run_start_date=2024-05-24 01:43:00.804536+00:00, run_end_date=2024-05-24 01:43:05.604564+00:00, run_duration=4.800028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:42:00+00:00, data_interval_end=2024-05-24 01:43:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:43:05.618285409Z [2024-05-24T01:43:05.617+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:43:00+00:00, run_after=2024-05-24T01:44:00+00:00 2024-05-24T01:43:05.660662237Z [2024-05-24T01:43:05.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status success for try_number 1 2024-05-24T01:43:05.660697450Z [2024-05-24T01:43:05.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status success for try_number 1 2024-05-24T01:43:05.670023614Z [2024-05-24T01:43:05.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:42:00+00:00, map_index=-1, run_start_date=2024-05-24 01:43:02.903938+00:00, run_end_date=2024-05-24 01:43:04.992383+00:00, run_duration=2.088445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:43:00.890141+00:00, queued_by_job_id=1, pid=12358 2024-05-24T01:43:05.670451551Z [2024-05-24T01:43:05.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:42:00+00:00, map_index=-1, run_start_date=2024-05-24 01:43:02.751876+00:00, run_end_date=2024-05-24 01:43:04.975905+00:00, run_duration=2.224029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:43:00.890141+00:00, queued_by_job_id=1, pid=12357 2024-05-24T01:44:00.230815407Z [2024-05-24T01:44:00.230+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:44:00.244150591Z [2024-05-24T01:44:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:44:00+00:00, run_after=2024-05-24T01:45:00+00:00 2024-05-24T01:44:00.255674841Z [2024-05-24T01:44:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:44:00+00:00, run_after=2024-05-24T01:45:00+00:00 2024-05-24T01:44:00.261257552Z [2024-05-24T01:44:00.261+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:44:00.323503282Z [2024-05-24T01:44:00.323+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:44:00.323524149Z 2024-05-24T01:44:00.323528050Z 2024-05-24T01:44:00.323531510Z 2024-05-24T01:44:00.323535420Z 2024-05-24T01:44:00.323962196Z [2024-05-24T01:44:00.323+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:44:00.324288169Z [2024-05-24T01:44:00.323+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:44:00.324555860Z [2024-05-24T01:44:00.324+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:44:00.324788051Z [2024-05-24T01:44:00.324+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:44:00.325335790Z [2024-05-24T01:44:00.325+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:44:00.325352222Z 2024-05-24T01:44:00.325356050Z 2024-05-24T01:44:00.325359171Z 2024-05-24T01:44:00.325362234Z 2024-05-24T01:44:00.328783948Z [2024-05-24T01:44:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:44:00.328840008Z [2024-05-24T01:44:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:44:00.329043632Z [2024-05-24T01:44:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:44:00.329115483Z [2024-05-24T01:44:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:44:00.329347774Z [2024-05-24T01:44:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:44:00.329430333Z [2024-05-24T01:44:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:44:00.329708770Z [2024-05-24T01:44:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:44:00.329809712Z [2024-05-24T01:44:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:44:00.852184344Z [2024-05-24T01:44:00.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status queued for try_number 1 2024-05-24T01:44:00.852426809Z [2024-05-24T01:44:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:43:00+00:00 exited with status queued for try_number 1 2024-05-24T01:44:00.852691917Z [2024-05-24T01:44:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:43:00+00:00 exited with status queued for try_number 1 2024-05-24T01:44:00.858387176Z [2024-05-24T01:44:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:43:00+00:00 exited with status queued for try_number 1 2024-05-24T01:44:00.879411000Z [2024-05-24T01:44:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfb549f4-1945-47fb-8f26-b0908677a79a 2024-05-24T01:44:00.879814889Z [2024-05-24T01:44:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81653330-5b1d-4ec1-8517-e0e9f48166ec 2024-05-24T01:44:00.880213274Z [2024-05-24T01:44:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f904d74-348b-46ab-8b94-1e1909ceb61a 2024-05-24T01:44:00.880728225Z [2024-05-24T01:44:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0f5ee67-2ad1-4f5a-980e-bc0683d19500 2024-05-24T01:44:02.147974814Z [2024-05-24T01:44:02.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:44:02.149375332Z [2024-05-24T01:44:02.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:42:00+00:00, run_id=scheduled__2024-05-24T01:42:00+00:00, run_start_date=2024-05-24 01:44:00.269574+00:00, run_end_date=2024-05-24 01:44:02.148155+00:00, run_duration=1.878581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:42:00+00:00, data_interval_end=2024-05-24 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:44:02.174007649Z [2024-05-24T01:44:02.173+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:44:00+00:00, run_after=2024-05-24T01:46:00+00:00 2024-05-24T01:44:02.181508017Z [2024-05-24T01:44:02.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:44:02.181737207Z [2024-05-24T01:44:02.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:43:00+00:00, run_id=scheduled__2024-05-24T01:43:00+00:00, run_start_date=2024-05-24 01:44:00.270793+00:00, run_end_date=2024-05-24 01:44:02.181424+00:00, run_duration=1.910631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:43:00+00:00, data_interval_end=2024-05-24 01:44:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:44:02.190785336Z [2024-05-24T01:44:02.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:44:00+00:00, run_after=2024-05-24T01:45:00+00:00 2024-05-24T01:44:02.235219130Z [2024-05-24T01:44:02.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:42:00+00:00 exited with status success for try_number 1 2024-05-24T01:44:02.240312231Z [2024-05-24T01:44:02.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:42:00+00:00, map_index=-1, run_start_date=2024-05-24 01:44:01.306992+00:00, run_end_date=2024-05-24 01:44:01.778611+00:00, run_duration=0.471619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:44:00.326133+00:00, queued_by_job_id=1, pid=12392 2024-05-24T01:44:03.384989362Z [2024-05-24T01:44:03.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:43:00+00:00 exited with status success for try_number 1 2024-05-24T01:44:03.396161734Z [2024-05-24T01:44:03.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:43:00+00:00, map_index=-1, run_start_date=2024-05-24 01:44:01.439032+00:00, run_end_date=2024-05-24 01:44:02.101604+00:00, run_duration=0.662572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:44:00.326133+00:00, queued_by_job_id=1, pid=12393 2024-05-24T01:44:04.456637311Z [2024-05-24T01:44:04.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:44:04.456812593Z [2024-05-24T01:44:04.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:43:00+00:00, run_id=scheduled__2024-05-24T01:43:00+00:00, run_start_date=2024-05-24 01:44:00.271744+00:00, run_end_date=2024-05-24 01:44:04.456548+00:00, run_duration=4.184804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:43:00+00:00, data_interval_end=2024-05-24 01:44:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:44:04.466669020Z [2024-05-24T01:44:04.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:44:00+00:00, run_after=2024-05-24T01:45:00+00:00 2024-05-24T01:44:05.565610585Z [2024-05-24T01:44:05.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:44:05.566607771Z [2024-05-24T01:44:05.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:43:00+00:00, run_id=scheduled__2024-05-24T01:43:00+00:00, run_start_date=2024-05-24 01:44:00.272680+00:00, run_end_date=2024-05-24 01:44:05.565832+00:00, run_duration=5.293152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:43:00+00:00, data_interval_end=2024-05-24 01:44:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:44:05.584458200Z [2024-05-24T01:44:05.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:44:00+00:00, run_after=2024-05-24T01:45:00+00:00 2024-05-24T01:44:05.636420143Z [2024-05-24T01:44:05.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:43:00+00:00 exited with status success for try_number 1 2024-05-24T01:44:05.636764113Z [2024-05-24T01:44:05.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:43:00+00:00 exited with status success for try_number 1 2024-05-24T01:44:05.645341994Z [2024-05-24T01:44:05.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:43:00+00:00, map_index=-1, run_start_date=2024-05-24 01:44:02.649426+00:00, run_end_date=2024-05-24 01:44:04.408697+00:00, run_duration=1.759271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:44:00.326133+00:00, queued_by_job_id=1, pid=12417 2024-05-24T01:44:05.645737730Z [2024-05-24T01:44:05.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:43:00+00:00, map_index=-1, run_start_date=2024-05-24 01:44:02.643516+00:00, run_end_date=2024-05-24 01:44:05.119017+00:00, run_duration=2.475501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:44:00.326133+00:00, queued_by_job_id=1, pid=12416 2024-05-24T01:45:00.228548378Z [2024-05-24T01:45:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:45:00+00:00, run_after=2024-05-24T01:46:00+00:00 2024-05-24T01:45:00.250211723Z [2024-05-24T01:45:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:45:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:45:00.259461509Z [2024-05-24T01:45:00.259+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:45:00.279369894Z [2024-05-24T01:45:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:45:00+00:00, run_after=2024-05-24T01:46:00+00:00 2024-05-24T01:45:00.390348784Z [2024-05-24T01:45:00.389+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:45:00.390368429Z 2024-05-24T01:45:00.390374450Z 2024-05-24T01:45:00.390377760Z 2024-05-24T01:45:00.390391432Z 2024-05-24T01:45:00.390394556Z [2024-05-24T01:45:00.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:45:00.390398080Z [2024-05-24T01:45:00.389+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:45:00.390401230Z [2024-05-24T01:45:00.389+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:45:00.390404352Z [2024-05-24T01:45:00.390+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:45:00.391679373Z [2024-05-24T01:45:00.391+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:45:00.391774980Z 2024-05-24T01:45:00.391790502Z 2024-05-24T01:45:00.391796778Z 2024-05-24T01:45:00.391803074Z 2024-05-24T01:45:00.400023851Z [2024-05-24T01:45:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:45:00.400218322Z [2024-05-24T01:45:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:45:00.400529175Z [2024-05-24T01:45:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:45:00.400675058Z [2024-05-24T01:45:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:45:00.401283273Z [2024-05-24T01:45:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:45:00.401294409Z [2024-05-24T01:45:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:45:00.401558032Z [2024-05-24T01:45:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:45:00.401846275Z [2024-05-24T01:45:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:45:00.862133615Z [2024-05-24T01:45:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:45:00.862181524Z [2024-05-24T01:45:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status queued for try_number 1 2024-05-24T01:45:00.862219891Z [2024-05-24T01:45:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status queued for try_number 1 2024-05-24T01:45:00.862307850Z [2024-05-24T01:45:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status queued for try_number 1 2024-05-24T01:45:00.877502315Z [2024-05-24T01:45:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9ca966e-e332-420d-ba10-33ffff28a16f 2024-05-24T01:45:00.877527403Z [2024-05-24T01:45:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64e9ca91-537b-4702-a847-84e42160a43b 2024-05-24T01:45:00.877648851Z [2024-05-24T01:45:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f03e6b5-7bb2-4263-bd24-8a008228fe87 2024-05-24T01:45:00.877743037Z [2024-05-24T01:45:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17677e8b-a824-4652-9db8-acd2aa4fc1c0 2024-05-24T01:45:03.307943753Z [2024-05-24T01:45:03.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status success for try_number 1 2024-05-24T01:45:03.321294206Z [2024-05-24T01:45:03.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:44:00+00:00, map_index=-1, run_start_date=2024-05-24 01:45:02.187272+00:00, run_end_date=2024-05-24 01:45:02.967856+00:00, run_duration=0.780584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:45:00.393564+00:00, queued_by_job_id=1, pid=12449 2024-05-24T01:45:04.450205090Z [2024-05-24T01:45:04.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:45:04.451035479Z [2024-05-24T01:45:04.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:44:00+00:00, run_id=scheduled__2024-05-24T01:44:00+00:00, run_start_date=2024-05-24 01:45:00.292636+00:00, run_end_date=2024-05-24 01:45:04.450654+00:00, run_duration=4.158018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:44:00+00:00, data_interval_end=2024-05-24 01:45:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:45:04.485958817Z [2024-05-24T01:45:04.485+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:45:00+00:00, run_after=2024-05-24T01:46:00+00:00 2024-05-24T01:45:05.773333899Z [2024-05-24T01:45:05.772+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:45:05.773365500Z 2024-05-24T01:45:05.773369954Z [2024-05-24T01:45:05.773+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:45:05.774020607Z [2024-05-24T01:45:05.773+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:45:05.774041686Z 2024-05-24T01:45:05.776846744Z [2024-05-24T01:45:05.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:45:05.777067157Z [2024-05-24T01:45:05.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:45:05.829495035Z [2024-05-24T01:45:05.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:45:05.829616303Z [2024-05-24T01:45:05.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:45:05.835610068Z [2024-05-24T01:45:05.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed33b0d2-c928-48d7-b4b9-93e65d7ae3dc 2024-05-24T01:45:05.835835923Z [2024-05-24T01:45:05.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=-1, run_start_date=2024-05-24 01:45:03.975249+00:00, run_end_date=2024-05-24 01:45:04.679536+00:00, run_duration=0.704287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:45:00.393564+00:00, queued_by_job_id=1, pid=12463 2024-05-24T01:45:06.619279869Z [2024-05-24T01:45:06.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:45:06.620613452Z [2024-05-24T01:45:06.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:44:00+00:00, run_id=scheduled__2024-05-24T01:44:00+00:00, run_start_date=2024-05-24 01:45:00.293712+00:00, run_end_date=2024-05-24 01:45:06.618883+00:00, run_duration=6.325171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:44:00+00:00, data_interval_end=2024-05-24 01:45:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:45:06.640046123Z [2024-05-24T01:45:06.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:45:00+00:00, run_after=2024-05-24T01:46:00+00:00 2024-05-24T01:45:06.735015126Z [2024-05-24T01:45:06.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status success for try_number 1 2024-05-24T01:45:06.760235668Z [2024-05-24T01:45:06.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:44:00+00:00, map_index=-1, run_start_date=2024-05-24 01:45:04.709563+00:00, run_end_date=2024-05-24 01:45:06.182101+00:00, run_duration=1.472538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:45:00.393564+00:00, queued_by_job_id=1, pid=12479 2024-05-24T01:45:08.439096804Z [2024-05-24T01:45:08.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:45:08.439667713Z [2024-05-24T01:45:08.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:44:00+00:00, run_id=scheduled__2024-05-24T01:44:00+00:00, run_start_date=2024-05-24 01:45:00.294783+00:00, run_end_date=2024-05-24 01:45:08.439129+00:00, run_duration=8.144346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:44:00+00:00, data_interval_end=2024-05-24 01:45:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:45:08.451650306Z [2024-05-24T01:45:08.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:45:00+00:00, run_after=2024-05-24T01:46:00+00:00 2024-05-24T01:45:08.484740297Z [2024-05-24T01:45:08.484+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:45:08.484773667Z 2024-05-24T01:45:08.485267065Z [2024-05-24T01:45:08.485+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:45:08.485995750Z [2024-05-24T01:45:08.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:45:08.486010992Z 2024-05-24T01:45:08.488819883Z [2024-05-24T01:45:08.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:45:08.489115040Z [2024-05-24T01:45:08.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:45:08.555630130Z [2024-05-24T01:45:08.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:45:08.556402110Z [2024-05-24T01:45:08.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status success for try_number 1 2024-05-24T01:45:08.556620519Z [2024-05-24T01:45:08.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:45:08.563589491Z [2024-05-24T01:45:08.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:44:00+00:00, map_index=-1, run_start_date=2024-05-24 01:45:04.963946+00:00, run_end_date=2024-05-24 01:45:07.917146+00:00, run_duration=2.9532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:45:00.393564+00:00, queued_by_job_id=1, pid=12480 2024-05-24T01:45:08.563816924Z [2024-05-24T01:45:08.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=-1, run_start_date=2024-05-24 01:45:07.548498+00:00, run_end_date=2024-05-24 01:45:07.965538+00:00, run_duration=0.41704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:45:05.774455+00:00, queued_by_job_id=1, pid=12498 2024-05-24T01:45:08.564098154Z [2024-05-24T01:45:08.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef9960e5-1f30-4f9e-8ea0-913545a8e149 2024-05-24T01:45:11.813146316Z [2024-05-24T01:45:11.812+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:45:11.813186151Z 2024-05-24T01:45:11.813231454Z [2024-05-24T01:45:11.813+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:45:11.813631426Z [2024-05-24T01:45:11.813+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:45:11.813644602Z 2024-05-24T01:45:11.815695802Z [2024-05-24T01:45:11.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:45:11.815858210Z [2024-05-24T01:45:11.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:45:11.904326520Z [2024-05-24T01:45:11.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status queued for try_number 1 2024-05-24T01:45:11.905123138Z [2024-05-24T01:45:11.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:45:11.922031601Z [2024-05-24T01:45:11.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90a12b0c-5461-441c-9ac3-b966ca608fe0 2024-05-24T01:45:11.922941274Z [2024-05-24T01:45:11.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=0, run_start_date=2024-05-24 01:45:10.660823+00:00, run_end_date=2024-05-24 01:45:11.078127+00:00, run_duration=0.417304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:45:08.486446+00:00, queued_by_job_id=1, pid=12506 2024-05-24T01:45:14.816193293Z [2024-05-24T01:45:14.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:45:14.816485677Z [2024-05-24T01:45:14.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:40:00+00:00, run_id=scheduled__2024-05-24T01:40:00+00:00, run_start_date=2024-05-24 01:45:00.291291+00:00, run_end_date=2024-05-24 01:45:14.815982+00:00, run_duration=14.524691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:40:00+00:00, data_interval_end=2024-05-24 01:45:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:45:14.823511446Z [2024-05-24T01:45:14.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:45:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:45:14.889490644Z [2024-05-24T01:45:14.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:40:00+00:00 exited with status success for try_number 1 2024-05-24T01:45:14.896516009Z [2024-05-24T01:45:14.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:40:00+00:00, map_index=-1, run_start_date=2024-05-24 01:45:13.603507+00:00, run_end_date=2024-05-24 01:45:14.055409+00:00, run_duration=0.451902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:45:11.813929+00:00, queued_by_job_id=1, pid=12514 2024-05-24T01:46:00.491745768Z [2024-05-24T01:46:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:46:00+00:00, run_after=2024-05-24T01:47:00+00:00 2024-05-24T01:46:00.498824564Z [2024-05-24T01:46:00.498+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:46:00.504935746Z [2024-05-24T01:46:00.504+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:46:00.515485726Z [2024-05-24T01:46:00.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:46:00+00:00, run_after=2024-05-24T01:47:00+00:00 2024-05-24T01:46:00.619175348Z [2024-05-24T01:46:00.618+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:46:00.619204419Z 2024-05-24T01:46:00.619210910Z 2024-05-24T01:46:00.619215397Z 2024-05-24T01:46:00.619220072Z 2024-05-24T01:46:00.619536617Z [2024-05-24T01:46:00.619+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:46:00.619975423Z [2024-05-24T01:46:00.619+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:46:00.620006037Z [2024-05-24T01:46:00.619+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:46:00.620203155Z [2024-05-24T01:46:00.620+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:46:00.621265427Z [2024-05-24T01:46:00.620+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:46:00.621308299Z 2024-05-24T01:46:00.621316804Z 2024-05-24T01:46:00.621322170Z 2024-05-24T01:46:00.621327521Z 2024-05-24T01:46:00.627515960Z [2024-05-24T01:46:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:46:00.627889512Z [2024-05-24T01:46:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:46:00.628397232Z [2024-05-24T01:46:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:46:00.628739743Z [2024-05-24T01:46:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:46:00.629225540Z [2024-05-24T01:46:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:46:00.629508694Z [2024-05-24T01:46:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:46:00.629909583Z [2024-05-24T01:46:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:46:00.630188778Z [2024-05-24T01:46:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:46:01.174183935Z [2024-05-24T01:46:01.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status queued for try_number 1 2024-05-24T01:46:01.174223119Z [2024-05-24T01:46:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status queued for try_number 1 2024-05-24T01:46:01.174226699Z [2024-05-24T01:46:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status queued for try_number 1 2024-05-24T01:46:01.176350340Z [2024-05-24T01:46:01.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status queued for try_number 1 2024-05-24T01:46:01.206618973Z [2024-05-24T01:46:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8450ead9-803f-4e90-8f18-521a36b7dd0b 2024-05-24T01:46:01.206657981Z [2024-05-24T01:46:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9e9cf34-e53f-4ed3-b098-62deb053385a 2024-05-24T01:46:01.207902324Z [2024-05-24T01:46:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to d740bd09-d253-45d2-bc61-fd258c1b14fb 2024-05-24T01:46:01.207912370Z [2024-05-24T01:46:01.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5709e848-7c92-49b4-944a-d4b2f51644e2 2024-05-24T01:46:02.427213847Z [2024-05-24T01:46:02.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:46:02.427604870Z [2024-05-24T01:46:02.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:44:00+00:00, run_id=scheduled__2024-05-24T01:44:00+00:00, run_start_date=2024-05-24 01:46:00.526609+00:00, run_end_date=2024-05-24 01:46:02.427159+00:00, run_duration=1.90055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:44:00+00:00, data_interval_end=2024-05-24 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:46:02.435726153Z [2024-05-24T01:46:02.435+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:46:00+00:00, run_after=2024-05-24T01:48:00+00:00 2024-05-24T01:46:02.445709962Z [2024-05-24T01:46:02.445+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:46:02.446160914Z [2024-05-24T01:46:02.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:45:00+00:00, run_id=scheduled__2024-05-24T01:45:00+00:00, run_start_date=2024-05-24 01:46:00.529232+00:00, run_end_date=2024-05-24 01:46:02.445854+00:00, run_duration=1.916622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:45:00+00:00, data_interval_end=2024-05-24 01:46:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:46:02.457555823Z [2024-05-24T01:46:02.457+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:46:00+00:00, run_after=2024-05-24T01:47:00+00:00 2024-05-24T01:46:02.536641652Z [2024-05-24T01:46:02.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:44:00+00:00 exited with status success for try_number 1 2024-05-24T01:46:02.536799651Z [2024-05-24T01:46:02.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status success for try_number 1 2024-05-24T01:46:02.548597097Z [2024-05-24T01:46:02.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:44:00+00:00, map_index=-1, run_start_date=2024-05-24 01:46:01.620610+00:00, run_end_date=2024-05-24 01:46:02.109864+00:00, run_duration=0.489254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:46:00.623131+00:00, queued_by_job_id=1, pid=12537 2024-05-24T01:46:02.548660796Z [2024-05-24T01:46:02.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:45:00+00:00, map_index=-1, run_start_date=2024-05-24 01:46:01.673064+00:00, run_end_date=2024-05-24 01:46:02.165668+00:00, run_duration=0.492604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:46:00.623131+00:00, queued_by_job_id=1, pid=12538 2024-05-24T01:46:05.640804221Z [2024-05-24T01:46:05.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:46:05.641354377Z [2024-05-24T01:46:05.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:45:00+00:00, run_id=scheduled__2024-05-24T01:45:00+00:00, run_start_date=2024-05-24 01:46:00.531521+00:00, run_end_date=2024-05-24 01:46:05.640966+00:00, run_duration=5.109445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:45:00+00:00, data_interval_end=2024-05-24 01:46:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:46:05.650307280Z [2024-05-24T01:46:05.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:46:00+00:00, run_after=2024-05-24T01:47:00+00:00 2024-05-24T01:46:05.658716119Z [2024-05-24T01:46:05.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:46:05.658957927Z [2024-05-24T01:46:05.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:45:00+00:00, run_id=scheduled__2024-05-24T01:45:00+00:00, run_start_date=2024-05-24 01:46:00.535202+00:00, run_end_date=2024-05-24 01:46:05.658473+00:00, run_duration=5.123271, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:45:00+00:00, data_interval_end=2024-05-24 01:46:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:46:05.668308018Z [2024-05-24T01:46:05.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:46:00+00:00, run_after=2024-05-24T01:47:00+00:00 2024-05-24T01:46:05.719510362Z [2024-05-24T01:46:05.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status success for try_number 1 2024-05-24T01:46:05.719983548Z [2024-05-24T01:46:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status success for try_number 1 2024-05-24T01:46:05.732731167Z [2024-05-24T01:46:05.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:45:00+00:00, map_index=-1, run_start_date=2024-05-24 01:46:03.039394+00:00, run_end_date=2024-05-24 01:46:05.058867+00:00, run_duration=2.019473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:46:00.623131+00:00, queued_by_job_id=1, pid=12561 2024-05-24T01:46:05.733154661Z [2024-05-24T01:46:05.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:45:00+00:00, map_index=-1, run_start_date=2024-05-24 01:46:03.099466+00:00, run_end_date=2024-05-24 01:46:04.656859+00:00, run_duration=1.557393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:46:00.623131+00:00, queued_by_job_id=1, pid=12562 2024-05-24T01:46:41.778298591Z [2024-05-24T01:46:41.777+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:47:00.448124550Z [2024-05-24T01:47:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:47:00+00:00, run_after=2024-05-24T01:48:00+00:00 2024-05-24T01:47:00.462478937Z [2024-05-24T01:47:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:47:00+00:00, run_after=2024-05-24T01:48:00+00:00 2024-05-24T01:47:00.472463475Z [2024-05-24T01:47:00.471+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:47:00.558537848Z [2024-05-24T01:47:00.558+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:47:00.558580169Z 2024-05-24T01:47:00.558589424Z 2024-05-24T01:47:00.558597900Z 2024-05-24T01:47:00.558620971Z [2024-05-24T01:47:00.558+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:47:00.558961167Z [2024-05-24T01:47:00.558+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:47:00.559114387Z [2024-05-24T01:47:00.558+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:47:00.559890582Z [2024-05-24T01:47:00.559+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:47:00.559914046Z 2024-05-24T01:47:00.559927168Z 2024-05-24T01:47:00.559940063Z 2024-05-24T01:47:00.564525648Z [2024-05-24T01:47:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:47:00.564749137Z [2024-05-24T01:47:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:47:00.565117635Z [2024-05-24T01:47:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:47:00.565317499Z [2024-05-24T01:47:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:47:00.565632788Z [2024-05-24T01:47:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:47:00.565825507Z [2024-05-24T01:47:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:47:00.805488042Z [2024-05-24T01:47:00.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status queued for try_number 1 2024-05-24T01:47:00.805521804Z [2024-05-24T01:47:00.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status queued for try_number 1 2024-05-24T01:47:00.805561216Z [2024-05-24T01:47:00.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status queued for try_number 1 2024-05-24T01:47:00.812861803Z [2024-05-24T01:47:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0ff5365-4f5e-4066-9f68-93083d74e9a9 2024-05-24T01:47:00.812894928Z [2024-05-24T01:47:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a5e2de2-40e8-47d2-b709-0a00e72a685e 2024-05-24T01:47:00.813035477Z [2024-05-24T01:47:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to b14259af-9927-438b-b073-15dd25407db5 2024-05-24T01:47:02.047554440Z [2024-05-24T01:47:02.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status success for try_number 1 2024-05-24T01:47:02.055419482Z [2024-05-24T01:47:02.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:46:00+00:00, map_index=-1, run_start_date=2024-05-24 01:47:01.448535+00:00, run_end_date=2024-05-24 01:47:01.891998+00:00, run_duration=0.443463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:47:00.561087+00:00, queued_by_job_id=1, pid=12594 2024-05-24T01:47:03.114103999Z [2024-05-24T01:47:03.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:47:03.114881802Z [2024-05-24T01:47:03.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:46:00+00:00, run_id=scheduled__2024-05-24T01:46:00+00:00, run_start_date=2024-05-24 01:47:00.485233+00:00, run_end_date=2024-05-24 01:47:03.114172+00:00, run_duration=2.628939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:46:00+00:00, data_interval_end=2024-05-24 01:47:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:47:03.125530223Z [2024-05-24T01:47:03.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:47:00+00:00, run_after=2024-05-24T01:48:00+00:00 2024-05-24T01:47:04.228939172Z [2024-05-24T01:47:04.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:47:04.229027689Z [2024-05-24T01:47:04.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:46:00+00:00, run_id=scheduled__2024-05-24T01:46:00+00:00, run_start_date=2024-05-24 01:47:00.486855+00:00, run_end_date=2024-05-24 01:47:04.228351+00:00, run_duration=3.741496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:46:00+00:00, data_interval_end=2024-05-24 01:47:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:47:04.261816666Z [2024-05-24T01:47:04.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:47:00+00:00, run_after=2024-05-24T01:48:00+00:00 2024-05-24T01:47:04.296992852Z [2024-05-24T01:47:04.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status success for try_number 1 2024-05-24T01:47:04.302244298Z [2024-05-24T01:47:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:46:00+00:00, map_index=-1, run_start_date=2024-05-24 01:47:02.361571+00:00, run_end_date=2024-05-24 01:47:03.693740+00:00, run_duration=1.332169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:47:00.561087+00:00, queued_by_job_id=1, pid=12609 2024-05-24T01:47:05.366107578Z [2024-05-24T01:47:05.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:47:05.366599767Z [2024-05-24T01:47:05.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:46:00+00:00, run_id=scheduled__2024-05-24T01:46:00+00:00, run_start_date=2024-05-24 01:47:00.488533+00:00, run_end_date=2024-05-24 01:47:05.365935+00:00, run_duration=4.877402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:46:00+00:00, data_interval_end=2024-05-24 01:47:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:47:05.378477446Z [2024-05-24T01:47:05.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:47:00+00:00, run_after=2024-05-24T01:48:00+00:00 2024-05-24T01:47:05.423287995Z [2024-05-24T01:47:05.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status success for try_number 1 2024-05-24T01:47:05.435482875Z [2024-05-24T01:47:05.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:46:00+00:00, map_index=-1, run_start_date=2024-05-24 01:47:02.591758+00:00, run_end_date=2024-05-24 01:47:04.365071+00:00, run_duration=1.773313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:47:00.561087+00:00, queued_by_job_id=1, pid=12613 2024-05-24T01:48:01.053553191Z [2024-05-24T01:48:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:48:00+00:00, run_after=2024-05-24T01:49:00+00:00 2024-05-24T01:48:01.065594506Z [2024-05-24T01:48:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:48:00+00:00, run_after=2024-05-24T01:49:00+00:00 2024-05-24T01:48:01.071887130Z [2024-05-24T01:48:01.071+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:48:01.077709277Z [2024-05-24T01:48:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:48:01.196506076Z [2024-05-24T01:48:01.195+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:48:01.196544688Z 2024-05-24T01:48:01.196553682Z 2024-05-24T01:48:01.196561086Z 2024-05-24T01:48:01.196568483Z 2024-05-24T01:48:01.197201618Z [2024-05-24T01:48:01.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:48:01.197560072Z [2024-05-24T01:48:01.197+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:48:01.197906938Z [2024-05-24T01:48:01.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:48:01.198808965Z [2024-05-24T01:48:01.198+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:48:01.200938978Z [2024-05-24T01:48:01.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:48:01.201012481Z 2024-05-24T01:48:01.201031400Z 2024-05-24T01:48:01.201044257Z 2024-05-24T01:48:01.201056601Z 2024-05-24T01:48:01.208686307Z [2024-05-24T01:48:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:48:01.209060360Z [2024-05-24T01:48:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:48:01.209728117Z [2024-05-24T01:48:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:48:01.210181942Z [2024-05-24T01:48:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:48:01.210679661Z [2024-05-24T01:48:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:48:01.210941847Z [2024-05-24T01:48:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:48:01.211253597Z [2024-05-24T01:48:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:48:01.211429995Z [2024-05-24T01:48:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:48:01.773947198Z [2024-05-24T01:48:01.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status queued for try_number 1 2024-05-24T01:48:01.774242583Z [2024-05-24T01:48:01.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:47:00+00:00 exited with status queued for try_number 1 2024-05-24T01:48:01.774415612Z [2024-05-24T01:48:01.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:47:00+00:00 exited with status queued for try_number 1 2024-05-24T01:48:01.774587072Z [2024-05-24T01:48:01.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:47:00+00:00 exited with status queued for try_number 1 2024-05-24T01:48:01.795762726Z [2024-05-24T01:48:01.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to d90cc670-dcde-4814-b722-555cbe616ed3 2024-05-24T01:48:01.797258759Z [2024-05-24T01:48:01.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8c56e2e-61e4-4179-9444-f89ac02a3ab0 2024-05-24T01:48:01.797546900Z [2024-05-24T01:48:01.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62d9bce4-f717-46a7-8ec8-d2375a2c8938 2024-05-24T01:48:01.797856487Z [2024-05-24T01:48:01.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75a781ae-a3b3-4305-b59a-419cc5791a65 2024-05-24T01:48:03.125442619Z [2024-05-24T01:48:03.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:48:03.127041209Z [2024-05-24T01:48:03.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:46:00+00:00, run_id=scheduled__2024-05-24T01:46:00+00:00, run_start_date=2024-05-24 01:48:01.087102+00:00, run_end_date=2024-05-24 01:48:03.125360+00:00, run_duration=2.038258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:46:00+00:00, data_interval_end=2024-05-24 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:48:03.144128827Z [2024-05-24T01:48:03.143+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:48:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:48:03.165703573Z [2024-05-24T01:48:03.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:48:03.166145868Z [2024-05-24T01:48:03.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:47:00+00:00, run_id=scheduled__2024-05-24T01:47:00+00:00, run_start_date=2024-05-24 01:48:01.088350+00:00, run_end_date=2024-05-24 01:48:03.165634+00:00, run_duration=2.077284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:47:00+00:00, data_interval_end=2024-05-24 01:48:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:48:03.195682314Z [2024-05-24T01:48:03.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:48:00+00:00, run_after=2024-05-24T01:49:00+00:00 2024-05-24T01:48:03.302090437Z [2024-05-24T01:48:03.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:46:00+00:00 exited with status success for try_number 1 2024-05-24T01:48:03.314352015Z [2024-05-24T01:48:03.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:46:00+00:00, map_index=-1, run_start_date=2024-05-24 01:48:01.869933+00:00, run_end_date=2024-05-24 01:48:02.506064+00:00, run_duration=0.636131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:48:01.203765+00:00, queued_by_job_id=1, pid=12641 2024-05-24T01:48:04.419536906Z [2024-05-24T01:48:04.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:47:00+00:00 exited with status success for try_number 1 2024-05-24T01:48:04.430336699Z [2024-05-24T01:48:04.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:47:00+00:00, map_index=-1, run_start_date=2024-05-24 01:48:02.492621+00:00, run_end_date=2024-05-24 01:48:03.119148+00:00, run_duration=0.626527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:48:01.203765+00:00, queued_by_job_id=1, pid=12652 2024-05-24T01:48:05.477672117Z [2024-05-24T01:48:05.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:48:05.478126978Z [2024-05-24T01:48:05.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:47:00+00:00, run_id=scheduled__2024-05-24T01:47:00+00:00, run_start_date=2024-05-24 01:48:01.089613+00:00, run_end_date=2024-05-24 01:48:05.477797+00:00, run_duration=4.388184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:47:00+00:00, data_interval_end=2024-05-24 01:48:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:48:05.492206188Z [2024-05-24T01:48:05.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:48:00+00:00, run_after=2024-05-24T01:49:00+00:00 2024-05-24T01:48:06.624047543Z [2024-05-24T01:48:06.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:48:06.624104634Z [2024-05-24T01:48:06.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:47:00+00:00, run_id=scheduled__2024-05-24T01:47:00+00:00, run_start_date=2024-05-24 01:48:01.090990+00:00, run_end_date=2024-05-24 01:48:06.623862+00:00, run_duration=5.532872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:47:00+00:00, data_interval_end=2024-05-24 01:48:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:48:06.635777120Z [2024-05-24T01:48:06.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:48:00+00:00, run_after=2024-05-24T01:49:00+00:00 2024-05-24T01:48:06.697341600Z [2024-05-24T01:48:06.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:47:00+00:00 exited with status success for try_number 1 2024-05-24T01:48:06.698093644Z [2024-05-24T01:48:06.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:47:00+00:00 exited with status success for try_number 1 2024-05-24T01:48:06.705514804Z [2024-05-24T01:48:06.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:47:00+00:00, map_index=-1, run_start_date=2024-05-24 01:48:04.011822+00:00, run_end_date=2024-05-24 01:48:05.425704+00:00, run_duration=1.413882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:48:01.203765+00:00, queued_by_job_id=1, pid=12671 2024-05-24T01:48:06.705875223Z [2024-05-24T01:48:06.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:47:00+00:00, map_index=-1, run_start_date=2024-05-24 01:48:03.873231+00:00, run_end_date=2024-05-24 01:48:05.520694+00:00, run_duration=1.647463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:48:01.203765+00:00, queued_by_job_id=1, pid=12670 2024-05-24T01:49:00.447116240Z [2024-05-24T01:49:00.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:49:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:49:00.458981206Z [2024-05-24T01:49:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:49:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:49:00.466466550Z [2024-05-24T01:49:00.466+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:49:00.556192280Z [2024-05-24T01:49:00.552+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:49:00.556221793Z 2024-05-24T01:49:00.556231663Z 2024-05-24T01:49:00.556237371Z 2024-05-24T01:49:00.556243141Z [2024-05-24T01:49:00.552+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:49:00.559319174Z [2024-05-24T01:49:00.552+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:49:00.559347424Z [2024-05-24T01:49:00.552+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:49:00.559352604Z [2024-05-24T01:49:00.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:49:00.559356498Z 2024-05-24T01:49:00.559360286Z 2024-05-24T01:49:00.559364198Z 2024-05-24T01:49:00.560362416Z [2024-05-24T01:49:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:49:00.560617581Z [2024-05-24T01:49:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:49:00.560913596Z [2024-05-24T01:49:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:49:00.561095553Z [2024-05-24T01:49:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:49:00.561330569Z [2024-05-24T01:49:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:49:00.561463638Z [2024-05-24T01:49:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:49:00.897041845Z [2024-05-24T01:49:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status queued for try_number 1 2024-05-24T01:49:00.897340464Z [2024-05-24T01:49:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status queued for try_number 1 2024-05-24T01:49:00.897536216Z [2024-05-24T01:49:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status queued for try_number 1 2024-05-24T01:49:00.907610657Z [2024-05-24T01:49:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63de01e2-5a4f-4cd8-8390-93ceb67a84b9 2024-05-24T01:49:00.907826506Z [2024-05-24T01:49:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad3bd767-26cd-4203-baf1-8ad6e7dea741 2024-05-24T01:49:00.908036426Z [2024-05-24T01:49:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba618825-c38d-4939-b71c-bc5df8ec2dbd 2024-05-24T01:49:02.093790593Z [2024-05-24T01:49:02.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:49:02.094133726Z [2024-05-24T01:49:02.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:48:00+00:00, run_id=scheduled__2024-05-24T01:48:00+00:00, run_start_date=2024-05-24 01:49:00.476112+00:00, run_end_date=2024-05-24 01:49:02.093663+00:00, run_duration=1.617551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:48:00+00:00, data_interval_end=2024-05-24 01:49:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:49:02.108013923Z [2024-05-24T01:49:02.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:49:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:49:02.159336929Z [2024-05-24T01:49:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status success for try_number 1 2024-05-24T01:49:02.164766220Z [2024-05-24T01:49:02.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:48:00+00:00, map_index=-1, run_start_date=2024-05-24 01:49:01.493536+00:00, run_end_date=2024-05-24 01:49:01.888072+00:00, run_duration=0.394536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:49:00.553951+00:00, queued_by_job_id=1, pid=12703 2024-05-24T01:49:03.970866927Z [2024-05-24T01:49:03.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:49:03.971055320Z [2024-05-24T01:49:03.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:48:00+00:00, run_id=scheduled__2024-05-24T01:48:00+00:00, run_start_date=2024-05-24 01:49:00.477440+00:00, run_end_date=2024-05-24 01:49:03.970796+00:00, run_duration=3.493356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:48:00+00:00, data_interval_end=2024-05-24 01:49:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:49:03.979947166Z [2024-05-24T01:49:03.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:49:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:49:05.098368280Z [2024-05-24T01:49:05.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:49:05.098797556Z [2024-05-24T01:49:05.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:48:00+00:00, run_id=scheduled__2024-05-24T01:48:00+00:00, run_start_date=2024-05-24 01:49:00.478479+00:00, run_end_date=2024-05-24 01:49:05.098274+00:00, run_duration=4.619795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:48:00+00:00, data_interval_end=2024-05-24 01:49:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:49:05.112887045Z [2024-05-24T01:49:05.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:49:00+00:00, run_after=2024-05-24T01:50:00+00:00 2024-05-24T01:49:05.159443732Z [2024-05-24T01:49:05.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status success for try_number 1 2024-05-24T01:49:05.159790951Z [2024-05-24T01:49:05.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status success for try_number 1 2024-05-24T01:49:05.172219768Z [2024-05-24T01:49:05.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:48:00+00:00, map_index=-1, run_start_date=2024-05-24 01:49:02.481718+00:00, run_end_date=2024-05-24 01:49:03.922897+00:00, run_duration=1.441179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:49:00.553951+00:00, queued_by_job_id=1, pid=12722 2024-05-24T01:49:05.172877183Z [2024-05-24T01:49:05.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:48:00+00:00, map_index=-1, run_start_date=2024-05-24 01:49:02.401343+00:00, run_end_date=2024-05-24 01:49:04.325256+00:00, run_duration=1.923913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:49:00.553951+00:00, queued_by_job_id=1, pid=12721 2024-05-24T01:50:00.927958349Z [2024-05-24T01:50:00.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:55:00+00:00 2024-05-24T01:50:00.941936185Z [2024-05-24T01:50:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:51:00+00:00 2024-05-24T01:50:00.966672879Z [2024-05-24T01:50:00.965+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:50:00.979857335Z [2024-05-24T01:50:00.979+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:50:01.010601306Z [2024-05-24T01:50:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:51:00+00:00 2024-05-24T01:50:01.145330377Z [2024-05-24T01:50:01.144+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T01:50:01.145367132Z 2024-05-24T01:50:01.145374730Z 2024-05-24T01:50:01.145381580Z 2024-05-24T01:50:01.145388034Z 2024-05-24T01:50:01.145394265Z 2024-05-24T01:50:01.145648034Z [2024-05-24T01:50:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:50:01.145917194Z [2024-05-24T01:50:01.145+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:50:01.146137683Z [2024-05-24T01:50:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:50:01.146348259Z [2024-05-24T01:50:01.146+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:50:01.146576342Z [2024-05-24T01:50:01.146+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:50:01.147418083Z [2024-05-24T01:50:01.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:50:01.147432699Z 2024-05-24T01:50:01.147440487Z 2024-05-24T01:50:01.147444945Z 2024-05-24T01:50:01.147448961Z 2024-05-24T01:50:01.147453026Z 2024-05-24T01:50:01.153329038Z [2024-05-24T01:50:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:50:01.153699162Z [2024-05-24T01:50:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:50:01.154117679Z [2024-05-24T01:50:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:50:01.154317192Z [2024-05-24T01:50:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:50:01.154667265Z [2024-05-24T01:50:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:50:01.154907298Z [2024-05-24T01:50:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:50:01.155290703Z [2024-05-24T01:50:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:50:01.155553975Z [2024-05-24T01:50:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:50:01.155896853Z [2024-05-24T01:50:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:50:01.156108516Z [2024-05-24T01:50:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:50:01.880453386Z [2024-05-24T01:50:01.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:01.880493522Z [2024-05-24T01:50:01.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:01.880558167Z [2024-05-24T01:50:01.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:49:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:01.880622876Z [2024-05-24T01:50:01.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:49:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:01.880674936Z [2024-05-24T01:50:01.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:49:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:01.900308731Z [2024-05-24T01:50:01.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 037a3d66-df56-4f79-8dcb-00431a1d846b 2024-05-24T01:50:01.900344286Z [2024-05-24T01:50:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 006e9ac4-b50d-45df-80ae-d47b8b53dd38 2024-05-24T01:50:01.900466106Z [2024-05-24T01:50:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to b613898a-9e5e-4455-9c8c-0f888a739db4 2024-05-24T01:50:01.900546814Z [2024-05-24T01:50:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4785466e-a554-41fc-bbc9-9ab853228bd8 2024-05-24T01:50:01.900637970Z [2024-05-24T01:50:01.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92518a6d-f927-4f2e-bd48-8929596508a8 2024-05-24T01:50:03.184158300Z [2024-05-24T01:50:03.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:50:03.184430976Z [2024-05-24T01:50:03.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:48:00+00:00, run_id=scheduled__2024-05-24T01:48:00+00:00, run_start_date=2024-05-24 01:50:01.029907+00:00, run_end_date=2024-05-24 01:50:03.184091+00:00, run_duration=2.154184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:48:00+00:00, data_interval_end=2024-05-24 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:50:03.197933041Z [2024-05-24T01:50:03.197+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:52:00+00:00 2024-05-24T01:50:03.277432683Z [2024-05-24T01:50:03.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:48:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:03.284440607Z [2024-05-24T01:50:03.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:48:00+00:00, map_index=-1, run_start_date=2024-05-24 01:50:01.955669+00:00, run_end_date=2024-05-24 01:50:02.444181+00:00, run_duration=0.488512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:01.148755+00:00, queued_by_job_id=1, pid=12751 2024-05-24T01:50:03.904841708Z [2024-05-24T01:50:03.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:50:03.905272182Z [2024-05-24T01:50:03.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:49:00+00:00, run_id=scheduled__2024-05-24T01:49:00+00:00, run_start_date=2024-05-24 01:50:01.031507+00:00, run_end_date=2024-05-24 01:50:03.904880+00:00, run_duration=2.873373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:49:00+00:00, data_interval_end=2024-05-24 01:50:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:50:03.922607416Z [2024-05-24T01:50:03.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:51:00+00:00 2024-05-24T01:50:04.050683432Z [2024-05-24T01:50:04.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:49:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:04.057785870Z [2024-05-24T01:50:04.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:49:00+00:00, map_index=-1, run_start_date=2024-05-24 01:50:02.731466+00:00, run_end_date=2024-05-24 01:50:03.269386+00:00, run_duration=0.53792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:01.148755+00:00, queued_by_job_id=1, pid=12764 2024-05-24T01:50:05.212820683Z [2024-05-24T01:50:05.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:50:05.212847748Z 2024-05-24T01:50:05.213451606Z [2024-05-24T01:50:05.212+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:50:05.214890289Z [2024-05-24T01:50:05.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:50:05.214924098Z 2024-05-24T01:50:05.219881404Z [2024-05-24T01:50:05.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:50:05.220242569Z [2024-05-24T01:50:05.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:50:05.322528982Z [2024-05-24T01:50:05.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:05.322703085Z [2024-05-24T01:50:05.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:05.328818840Z [2024-05-24T01:50:05.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 572a1759-04de-432f-92a8-98666e92cd87 2024-05-24T01:50:05.329104916Z [2024-05-24T01:50:05.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:45:00+00:00, map_index=-1, run_start_date=2024-05-24 01:50:03.938034+00:00, run_end_date=2024-05-24 01:50:04.398642+00:00, run_duration=0.460608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:01.148755+00:00, queued_by_job_id=1, pid=12788 2024-05-24T01:50:05.363555665Z [2024-05-24T01:50:05.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:50:05.364010905Z [2024-05-24T01:50:05.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:49:00+00:00, run_id=scheduled__2024-05-24T01:49:00+00:00, run_start_date=2024-05-24 01:50:01.033164+00:00, run_end_date=2024-05-24 01:50:05.363432+00:00, run_duration=4.330268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:49:00+00:00, data_interval_end=2024-05-24 01:50:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:50:05.372366286Z [2024-05-24T01:50:05.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:51:00+00:00 2024-05-24T01:50:05.449117713Z [2024-05-24T01:50:05.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:49:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:05.457786155Z [2024-05-24T01:50:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:49:00+00:00, map_index=-1, run_start_date=2024-05-24 01:50:03.790055+00:00, run_end_date=2024-05-24 01:50:05.204213+00:00, run_duration=1.414158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:01.148755+00:00, queued_by_job_id=1, pid=12787 2024-05-24T01:50:07.674203593Z [2024-05-24T01:50:07.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:50:07.674329154Z [2024-05-24T01:50:07.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:49:00+00:00, run_id=scheduled__2024-05-24T01:49:00+00:00, run_start_date=2024-05-24 01:50:01.034774+00:00, run_end_date=2024-05-24 01:50:07.674095+00:00, run_duration=6.639321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:49:00+00:00, data_interval_end=2024-05-24 01:50:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:50:07.685488946Z [2024-05-24T01:50:07.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:51:00+00:00 2024-05-24T01:50:07.785830494Z [2024-05-24T01:50:07.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:49:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:07.798901984Z [2024-05-24T01:50:07.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:49:00+00:00, map_index=-1, run_start_date=2024-05-24 01:50:03.776270+00:00, run_end_date=2024-05-24 01:50:06.838843+00:00, run_duration=3.062573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:01.148755+00:00, queued_by_job_id=1, pid=12786 2024-05-24T01:50:09.019566302Z [2024-05-24T01:50:09.011+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:50:09.019603903Z 2024-05-24T01:50:09.019607728Z [2024-05-24T01:50:09.011+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:50:09.019611184Z [2024-05-24T01:50:09.012+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:50:09.019614650Z 2024-05-24T01:50:09.060960372Z [2024-05-24T01:50:09.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:50:09.070583551Z [2024-05-24T01:50:09.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:50:09.170861386Z [2024-05-24T01:50:09.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:09.170901537Z [2024-05-24T01:50:09.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:09.187637750Z [2024-05-24T01:50:09.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d5f912-dff8-4c06-ae86-3832b6ed631d 2024-05-24T01:50:09.187723460Z [2024-05-24T01:50:09.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:45:00+00:00, map_index=-1, run_start_date=2024-05-24 01:50:07.025202+00:00, run_end_date=2024-05-24 01:50:07.677725+00:00, run_duration=0.652523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:05.215842+00:00, queued_by_job_id=1, pid=12811 2024-05-24T01:50:13.046029376Z [2024-05-24T01:50:13.044+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:50:13.046052021Z 2024-05-24T01:50:13.046370985Z [2024-05-24T01:50:13.046+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:50:13.047019391Z [2024-05-24T01:50:13.046+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:50:13.047027284Z 2024-05-24T01:50:13.052671564Z [2024-05-24T01:50:13.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:50:13.052781259Z [2024-05-24T01:50:13.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:50:13.111994458Z [2024-05-24T01:50:13.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status queued for try_number 1 2024-05-24T01:50:13.112033172Z [2024-05-24T01:50:13.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:13.121307555Z [2024-05-24T01:50:13.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to f66866f8-a82b-4d02-aed7-212bb3b6cdde 2024-05-24T01:50:13.121673511Z [2024-05-24T01:50:13.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:45:00+00:00, map_index=0, run_start_date=2024-05-24 01:50:12.115892+00:00, run_end_date=2024-05-24 01:50:12.443024+00:00, run_duration=0.327132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:09.012673+00:00, queued_by_job_id=1, pid=12819 2024-05-24T01:50:16.526386071Z [2024-05-24T01:50:16.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:50:16.526995813Z [2024-05-24T01:50:16.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:45:00+00:00, run_id=scheduled__2024-05-24T01:45:00+00:00, run_start_date=2024-05-24 01:50:01.027878+00:00, run_end_date=2024-05-24 01:50:16.526239+00:00, run_duration=15.498361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:45:00+00:00, data_interval_end=2024-05-24 01:50:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:50:16.534602260Z [2024-05-24T01:50:16.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:50:00+00:00, run_after=2024-05-24T01:55:00+00:00 2024-05-24T01:50:16.587028404Z [2024-05-24T01:50:16.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:45:00+00:00 exited with status success for try_number 1 2024-05-24T01:50:16.597642552Z [2024-05-24T01:50:16.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:45:00+00:00, map_index=-1, run_start_date=2024-05-24 01:50:15.090248+00:00, run_end_date=2024-05-24 01:50:15.472492+00:00, run_duration=0.382244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:50:13.049331+00:00, queued_by_job_id=1, pid=12827 2024-05-24T01:51:00.032883106Z [2024-05-24T01:51:00.032+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:51:00+00:00, run_after=2024-05-24T01:52:00+00:00 2024-05-24T01:51:00.044874859Z [2024-05-24T01:51:00.044+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:51:00.068702668Z [2024-05-24T01:51:00.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:51:00+00:00, run_after=2024-05-24T01:52:00+00:00 2024-05-24T01:51:00.147926762Z [2024-05-24T01:51:00.147+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:51:00.147975363Z 2024-05-24T01:51:00.147984991Z 2024-05-24T01:51:00.147994240Z 2024-05-24T01:51:00.148537631Z [2024-05-24T01:51:00.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:51:00.149251676Z [2024-05-24T01:51:00.148+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:51:00.149798038Z [2024-05-24T01:51:00.149+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:51:00.151333246Z [2024-05-24T01:51:00.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:51:00.151345681Z 2024-05-24T01:51:00.151348972Z 2024-05-24T01:51:00.151351923Z 2024-05-24T01:51:00.157988375Z [2024-05-24T01:51:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:51:00.158291372Z [2024-05-24T01:51:00.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:51:00.158758058Z [2024-05-24T01:51:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:51:00.158959925Z [2024-05-24T01:51:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:51:00.159451236Z [2024-05-24T01:51:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:51:00.159815209Z [2024-05-24T01:51:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:51:00.477608632Z [2024-05-24T01:51:00.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:51:00.479989294Z [2024-05-24T01:51:00.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:51:00.480086650Z [2024-05-24T01:51:00.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:51:00.494609200Z [2024-05-24T01:51:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4efda97d-661c-4086-9637-eac095c36ade 2024-05-24T01:51:00.495690027Z [2024-05-24T01:51:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6ac9198-5eb3-4076-9c1d-a73b1c3d9553 2024-05-24T01:51:00.495852299Z [2024-05-24T01:51:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 381651ae-e906-4026-a94f-b8758c50c9de 2024-05-24T01:51:01.809287286Z [2024-05-24T01:51:01.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:51:01.815569567Z [2024-05-24T01:51:01.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=-1, run_start_date=2024-05-24 01:51:01.276467+00:00, run_end_date=2024-05-24 01:51:01.699652+00:00, run_duration=0.423185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:51:00.152924+00:00, queued_by_job_id=1, pid=12849 2024-05-24T01:51:02.878475208Z [2024-05-24T01:51:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:51:02.878857988Z [2024-05-24T01:51:02.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:50:00+00:00, run_id=scheduled__2024-05-24T01:50:00+00:00, run_start_date=2024-05-24 01:51:00.081031+00:00, run_end_date=2024-05-24 01:51:02.878356+00:00, run_duration=2.797325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:50:00+00:00, data_interval_end=2024-05-24 01:51:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:51:02.889064084Z [2024-05-24T01:51:02.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:51:00+00:00, run_after=2024-05-24T01:52:00+00:00 2024-05-24T01:51:04.010074118Z [2024-05-24T01:51:04.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:51:04.010811990Z [2024-05-24T01:51:04.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:50:00+00:00, run_id=scheduled__2024-05-24T01:50:00+00:00, run_start_date=2024-05-24 01:51:00.082302+00:00, run_end_date=2024-05-24 01:51:04.009966+00:00, run_duration=3.927664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:50:00+00:00, data_interval_end=2024-05-24 01:51:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:51:04.029315212Z [2024-05-24T01:51:04.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:51:00+00:00, run_after=2024-05-24T01:52:00+00:00 2024-05-24T01:51:04.039447332Z [2024-05-24T01:51:04.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:51:04.040153522Z [2024-05-24T01:51:04.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:50:00+00:00, run_id=scheduled__2024-05-24T01:50:00+00:00, run_start_date=2024-05-24 01:51:00.083353+00:00, run_end_date=2024-05-24 01:51:04.039647+00:00, run_duration=3.956294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:50:00+00:00, data_interval_end=2024-05-24 01:51:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:51:04.056005682Z [2024-05-24T01:51:04.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:51:00+00:00, run_after=2024-05-24T01:52:00+00:00 2024-05-24T01:51:04.112065684Z [2024-05-24T01:51:04.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:51:04.112134520Z [2024-05-24T01:51:04.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:51:04.122331123Z [2024-05-24T01:51:04.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=-1, run_start_date=2024-05-24 01:51:02.150760+00:00, run_end_date=2024-05-24 01:51:03.487839+00:00, run_duration=1.337079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:51:00.152924+00:00, queued_by_job_id=1, pid=12868 2024-05-24T01:51:04.122642507Z [2024-05-24T01:51:04.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=-1, run_start_date=2024-05-24 01:51:02.105010+00:00, run_end_date=2024-05-24 01:51:03.815057+00:00, run_duration=1.710047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:51:00.152924+00:00, queued_by_job_id=1, pid=12867 2024-05-24T01:51:41.869762228Z [2024-05-24T01:51:41.868+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:52:00.127363912Z [2024-05-24T01:52:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:52:00+00:00, run_after=2024-05-24T01:53:00+00:00 2024-05-24T01:52:00.134660573Z [2024-05-24T01:52:00.134+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:52:00.147708377Z [2024-05-24T01:52:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:52:00+00:00, run_after=2024-05-24T01:53:00+00:00 2024-05-24T01:52:00.154458544Z [2024-05-24T01:52:00.154+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:52:00.236576207Z [2024-05-24T01:52:00.236+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:52:00.236683060Z 2024-05-24T01:52:00.236698394Z 2024-05-24T01:52:00.236701862Z 2024-05-24T01:52:00.236705064Z 2024-05-24T01:52:00.236829717Z [2024-05-24T01:52:00.236+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:52:00.237015319Z [2024-05-24T01:52:00.236+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:52:00.237180877Z [2024-05-24T01:52:00.237+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:52:00.237359805Z [2024-05-24T01:52:00.237+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:52:00.238006623Z [2024-05-24T01:52:00.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:52:00.238243628Z 2024-05-24T01:52:00.238251516Z 2024-05-24T01:52:00.238255158Z 2024-05-24T01:52:00.238258400Z 2024-05-24T01:52:00.242110108Z [2024-05-24T01:52:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:52:00.242344364Z [2024-05-24T01:52:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:52:00.242690398Z [2024-05-24T01:52:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:52:00.242877722Z [2024-05-24T01:52:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:52:00.243284857Z [2024-05-24T01:52:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:52:00.243574468Z [2024-05-24T01:52:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:52:00.243880441Z [2024-05-24T01:52:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:52:00.244054008Z [2024-05-24T01:52:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:52:00.697695758Z [2024-05-24T01:52:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:52:00.698574222Z [2024-05-24T01:52:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:51:00+00:00 exited with status queued for try_number 1 2024-05-24T01:52:00.698843259Z [2024-05-24T01:52:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:51:00+00:00 exited with status queued for try_number 1 2024-05-24T01:52:00.699157859Z [2024-05-24T01:52:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:51:00+00:00 exited with status queued for try_number 1 2024-05-24T01:52:00.722264912Z [2024-05-24T01:52:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0044b1d-e312-408b-bdab-6c062b745635 2024-05-24T01:52:00.722821467Z [2024-05-24T01:52:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b4d3069-852b-4f4b-a39d-81a259f7482d 2024-05-24T01:52:00.723151305Z [2024-05-24T01:52:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56bc227c-f04b-4c9a-a915-d2636a6c9378 2024-05-24T01:52:00.723444440Z [2024-05-24T01:52:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to b34da6a3-9497-4458-a561-6abcc8138d76 2024-05-24T01:52:02.737103466Z [2024-05-24T01:52:02.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:52:02.737142902Z [2024-05-24T01:52:02.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:50:00+00:00, run_id=scheduled__2024-05-24T01:50:00+00:00, run_start_date=2024-05-24 01:52:00.169588+00:00, run_end_date=2024-05-24 01:52:02.727411+00:00, run_duration=2.557823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:50:00+00:00, data_interval_end=2024-05-24 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:52:02.738722122Z [2024-05-24T01:52:02.736+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:52:00+00:00, run_after=2024-05-24T01:54:00+00:00 2024-05-24T01:52:02.754634131Z [2024-05-24T01:52:02.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:52:02.758713811Z [2024-05-24T01:52:02.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:51:00+00:00, run_id=scheduled__2024-05-24T01:51:00+00:00, run_start_date=2024-05-24 01:52:00.172868+00:00, run_end_date=2024-05-24 01:52:02.754447+00:00, run_duration=2.581579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:51:00+00:00, data_interval_end=2024-05-24 01:52:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:52:02.770742919Z [2024-05-24T01:52:02.765+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:52:00+00:00, run_after=2024-05-24T01:53:00+00:00 2024-05-24T01:52:02.840813669Z [2024-05-24T01:52:02.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:52:02.841132586Z [2024-05-24T01:52:02.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:51:00+00:00 exited with status success for try_number 1 2024-05-24T01:52:02.848642507Z [2024-05-24T01:52:02.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:51:00+00:00, map_index=-1, run_start_date=2024-05-24 01:52:01.572945+00:00, run_end_date=2024-05-24 01:52:02.155794+00:00, run_duration=0.582849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:52:00.239142+00:00, queued_by_job_id=1, pid=12900 2024-05-24T01:52:02.851070067Z [2024-05-24T01:52:02.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=-1, run_start_date=2024-05-24 01:52:01.761418+00:00, run_end_date=2024-05-24 01:52:02.194786+00:00, run_duration=0.433368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:52:00.239142+00:00, queued_by_job_id=1, pid=12902 2024-05-24T01:52:05.028880247Z [2024-05-24T01:52:05.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:52:05.029363084Z [2024-05-24T01:52:05.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:51:00+00:00, run_id=scheduled__2024-05-24T01:51:00+00:00, run_start_date=2024-05-24 01:52:00.176747+00:00, run_end_date=2024-05-24 01:52:05.028827+00:00, run_duration=4.85208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:51:00+00:00, data_interval_end=2024-05-24 01:52:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:52:05.047240919Z [2024-05-24T01:52:05.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:52:00+00:00, run_after=2024-05-24T01:53:00+00:00 2024-05-24T01:52:05.056453231Z [2024-05-24T01:52:05.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:52:05.056599201Z [2024-05-24T01:52:05.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:51:00+00:00, run_id=scheduled__2024-05-24T01:51:00+00:00, run_start_date=2024-05-24 01:52:00.178306+00:00, run_end_date=2024-05-24 01:52:05.056251+00:00, run_duration=4.877945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:51:00+00:00, data_interval_end=2024-05-24 01:52:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:52:05.066616972Z [2024-05-24T01:52:05.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:52:00+00:00, run_after=2024-05-24T01:53:00+00:00 2024-05-24T01:52:05.121011886Z [2024-05-24T01:52:05.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:51:00+00:00 exited with status success for try_number 1 2024-05-24T01:52:05.129420815Z [2024-05-24T01:52:05.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:51:00+00:00, map_index=-1, run_start_date=2024-05-24 01:52:02.854337+00:00, run_end_date=2024-05-24 01:52:04.122946+00:00, run_duration=1.268609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:52:00.239142+00:00, queued_by_job_id=1, pid=12919 2024-05-24T01:52:06.214139032Z [2024-05-24T01:52:06.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:51:00+00:00 exited with status success for try_number 1 2024-05-24T01:52:06.224387406Z [2024-05-24T01:52:06.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:51:00+00:00, map_index=-1, run_start_date=2024-05-24 01:52:03.206153+00:00, run_end_date=2024-05-24 01:52:04.929720+00:00, run_duration=1.723567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:52:00.239142+00:00, queued_by_job_id=1, pid=12930 2024-05-24T01:53:00.874351923Z [2024-05-24T01:53:00.873+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:53:00.894965655Z [2024-05-24T01:53:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:53:00+00:00, run_after=2024-05-24T01:54:00+00:00 2024-05-24T01:53:00.911143031Z [2024-05-24T01:53:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:53:00+00:00, run_after=2024-05-24T01:54:00+00:00 2024-05-24T01:53:01.015765373Z [2024-05-24T01:53:01.015+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:53:01.015805097Z 2024-05-24T01:53:01.015821484Z 2024-05-24T01:53:01.015824951Z 2024-05-24T01:53:01.015875792Z [2024-05-24T01:53:01.015+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:53:01.016052068Z [2024-05-24T01:53:01.015+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:53:01.016078910Z [2024-05-24T01:53:01.015+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:53:01.017082963Z [2024-05-24T01:53:01.016+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:53:01.017090256Z 2024-05-24T01:53:01.017094406Z 2024-05-24T01:53:01.017098894Z 2024-05-24T01:53:01.020089684Z [2024-05-24T01:53:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:53:01.020225062Z [2024-05-24T01:53:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:53:01.020456547Z [2024-05-24T01:53:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:53:01.020489569Z [2024-05-24T01:53:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:53:01.020740557Z [2024-05-24T01:53:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:53:01.020761355Z [2024-05-24T01:53:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:53:01.264248698Z [2024-05-24T01:53:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status queued for try_number 1 2024-05-24T01:53:01.264504534Z [2024-05-24T01:53:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status queued for try_number 1 2024-05-24T01:53:01.264677260Z [2024-05-24T01:53:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status queued for try_number 1 2024-05-24T01:53:01.272631119Z [2024-05-24T01:53:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20016af1-418a-48f2-a180-b542d66f81b0 2024-05-24T01:53:01.272842503Z [2024-05-24T01:53:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07fc7406-f464-49b4-99b7-ead3e0758faa 2024-05-24T01:53:01.273130389Z [2024-05-24T01:53:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2dcbde0-6e9a-4db6-b5c7-68549186e726 2024-05-24T01:53:02.461596365Z [2024-05-24T01:53:02.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:53:02.462222879Z [2024-05-24T01:53:02.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:52:00+00:00, run_id=scheduled__2024-05-24T01:52:00+00:00, run_start_date=2024-05-24 01:53:00.929880+00:00, run_end_date=2024-05-24 01:53:02.461337+00:00, run_duration=1.531457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:52:00+00:00, data_interval_end=2024-05-24 01:53:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:53:02.473086226Z [2024-05-24T01:53:02.472+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:53:00+00:00, run_after=2024-05-24T01:54:00+00:00 2024-05-24T01:53:02.549611840Z [2024-05-24T01:53:02.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status success for try_number 1 2024-05-24T01:53:02.556256448Z [2024-05-24T01:53:02.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:52:00+00:00, map_index=-1, run_start_date=2024-05-24 01:53:01.752998+00:00, run_end_date=2024-05-24 01:53:02.100726+00:00, run_duration=0.347728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:53:01.017202+00:00, queued_by_job_id=1, pid=12957 2024-05-24T01:53:04.730447619Z [2024-05-24T01:53:04.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:53:04.730639587Z [2024-05-24T01:53:04.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:52:00+00:00, run_id=scheduled__2024-05-24T01:52:00+00:00, run_start_date=2024-05-24 01:53:00.931379+00:00, run_end_date=2024-05-24 01:53:04.730202+00:00, run_duration=3.798823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:52:00+00:00, data_interval_end=2024-05-24 01:53:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:53:04.740572853Z [2024-05-24T01:53:04.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:53:00+00:00, run_after=2024-05-24T01:54:00+00:00 2024-05-24T01:53:04.793495192Z [2024-05-24T01:53:04.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status success for try_number 1 2024-05-24T01:53:04.800210728Z [2024-05-24T01:53:04.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:52:00+00:00, map_index=-1, run_start_date=2024-05-24 01:53:02.883425+00:00, run_end_date=2024-05-24 01:53:04.384400+00:00, run_duration=1.500975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:53:01.017202+00:00, queued_by_job_id=1, pid=12976 2024-05-24T01:53:06.974422615Z [2024-05-24T01:53:06.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:53:06.974755655Z [2024-05-24T01:53:06.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:52:00+00:00, run_id=scheduled__2024-05-24T01:52:00+00:00, run_start_date=2024-05-24 01:53:00.932722+00:00, run_end_date=2024-05-24 01:53:06.974390+00:00, run_duration=6.041668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:52:00+00:00, data_interval_end=2024-05-24 01:53:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:53:06.983428016Z [2024-05-24T01:53:06.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:53:00+00:00, run_after=2024-05-24T01:54:00+00:00 2024-05-24T01:53:07.026998094Z [2024-05-24T01:53:07.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status success for try_number 1 2024-05-24T01:53:07.037202013Z [2024-05-24T01:53:07.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:52:00+00:00, map_index=-1, run_start_date=2024-05-24 01:53:02.811360+00:00, run_end_date=2024-05-24 01:53:06.074638+00:00, run_duration=3.263278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:53:01.017202+00:00, queued_by_job_id=1, pid=12975 2024-05-24T01:54:00.558677208Z [2024-05-24T01:54:00.557+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:54:00.571799853Z [2024-05-24T01:54:00.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:54:00+00:00, run_after=2024-05-24T01:55:00+00:00 2024-05-24T01:54:00.585073513Z [2024-05-24T01:54:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:54:00+00:00, run_after=2024-05-24T01:55:00+00:00 2024-05-24T01:54:00.592426700Z [2024-05-24T01:54:00.591+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:54:00.662715358Z [2024-05-24T01:54:00.662+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:54:00.662745619Z 2024-05-24T01:54:00.662761279Z 2024-05-24T01:54:00.662770199Z 2024-05-24T01:54:00.662779040Z 2024-05-24T01:54:00.662900781Z [2024-05-24T01:54:00.662+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:54:00.663124757Z [2024-05-24T01:54:00.662+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:54:00.663435160Z [2024-05-24T01:54:00.663+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:54:00.663541609Z [2024-05-24T01:54:00.663+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:54:00.664198994Z [2024-05-24T01:54:00.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:54:00.664257138Z 2024-05-24T01:54:00.664272711Z 2024-05-24T01:54:00.664288630Z 2024-05-24T01:54:00.664297957Z 2024-05-24T01:54:00.670104946Z [2024-05-24T01:54:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:54:00.670454232Z [2024-05-24T01:54:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:54:00.671064407Z [2024-05-24T01:54:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:54:00.671506122Z [2024-05-24T01:54:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:54:00.671692602Z [2024-05-24T01:54:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:54:00.671987731Z [2024-05-24T01:54:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:54:00.672372845Z [2024-05-24T01:54:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:54:00.672665404Z [2024-05-24T01:54:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:54:01.027722853Z [2024-05-24T01:54:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status queued for try_number 1 2024-05-24T01:54:01.027838848Z [2024-05-24T01:54:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:53:00+00:00 exited with status queued for try_number 1 2024-05-24T01:54:01.027958632Z [2024-05-24T01:54:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:53:00+00:00 exited with status queued for try_number 1 2024-05-24T01:54:01.028066083Z [2024-05-24T01:54:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:53:00+00:00 exited with status queued for try_number 1 2024-05-24T01:54:01.048236243Z [2024-05-24T01:54:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12466eea-3df6-462f-b67e-ea579e7198a1 2024-05-24T01:54:01.050851877Z [2024-05-24T01:54:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 693dfabf-cf50-4037-9c85-d67a3742fb87 2024-05-24T01:54:01.051042240Z [2024-05-24T01:54:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70d91c38-2732-442c-82b6-afe5a55af677 2024-05-24T01:54:01.051193864Z [2024-05-24T01:54:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to d407b4f8-8f12-4e69-88e0-e4140d17e522 2024-05-24T01:54:02.891525533Z [2024-05-24T01:54:02.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:54:02.892034938Z [2024-05-24T01:54:02.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:52:00+00:00, run_id=scheduled__2024-05-24T01:52:00+00:00, run_start_date=2024-05-24 01:54:00.602755+00:00, run_end_date=2024-05-24 01:54:02.891660+00:00, run_duration=2.288905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:52:00+00:00, data_interval_end=2024-05-24 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:54:02.899811678Z [2024-05-24T01:54:02.899+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:54:00+00:00, run_after=2024-05-24T01:56:00+00:00 2024-05-24T01:54:02.906551927Z [2024-05-24T01:54:02.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:54:02.906965910Z [2024-05-24T01:54:02.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:53:00+00:00, run_id=scheduled__2024-05-24T01:53:00+00:00, run_start_date=2024-05-24 01:54:00.603990+00:00, run_end_date=2024-05-24 01:54:02.906638+00:00, run_duration=2.302648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:53:00+00:00, data_interval_end=2024-05-24 01:54:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:54:02.920086899Z [2024-05-24T01:54:02.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:54:00+00:00, run_after=2024-05-24T01:55:00+00:00 2024-05-24T01:54:02.988949574Z [2024-05-24T01:54:02.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:52:00+00:00 exited with status success for try_number 1 2024-05-24T01:54:02.989087696Z [2024-05-24T01:54:02.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:53:00+00:00 exited with status success for try_number 1 2024-05-24T01:54:02.995819818Z [2024-05-24T01:54:02.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:52:00+00:00, map_index=-1, run_start_date=2024-05-24 01:54:01.522614+00:00, run_end_date=2024-05-24 01:54:01.917142+00:00, run_duration=0.394528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:54:00.665399+00:00, queued_by_job_id=1, pid=13009 2024-05-24T01:54:02.996182048Z [2024-05-24T01:54:02.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:53:00+00:00, map_index=-1, run_start_date=2024-05-24 01:54:01.588688+00:00, run_end_date=2024-05-24 01:54:02.078269+00:00, run_duration=0.489581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:54:00.665399+00:00, queued_by_job_id=1, pid=13010 2024-05-24T01:54:04.601376725Z [2024-05-24T01:54:04.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:54:04.602105042Z [2024-05-24T01:54:04.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:53:00+00:00, run_id=scheduled__2024-05-24T01:53:00+00:00, run_start_date=2024-05-24 01:54:00.604977+00:00, run_end_date=2024-05-24 01:54:04.601196+00:00, run_duration=3.996219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:53:00+00:00, data_interval_end=2024-05-24 01:54:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:54:04.619187678Z [2024-05-24T01:54:04.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:54:00+00:00, run_after=2024-05-24T01:55:00+00:00 2024-05-24T01:54:04.629741523Z [2024-05-24T01:54:04.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:54:04.630114891Z [2024-05-24T01:54:04.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:53:00+00:00, run_id=scheduled__2024-05-24T01:53:00+00:00, run_start_date=2024-05-24 01:54:00.605968+00:00, run_end_date=2024-05-24 01:54:04.629556+00:00, run_duration=4.023588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:53:00+00:00, data_interval_end=2024-05-24 01:54:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:54:04.640411912Z [2024-05-24T01:54:04.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:54:00+00:00, run_after=2024-05-24T01:55:00+00:00 2024-05-24T01:54:04.687986106Z [2024-05-24T01:54:04.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:53:00+00:00 exited with status success for try_number 1 2024-05-24T01:54:04.688179057Z [2024-05-24T01:54:04.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:53:00+00:00 exited with status success for try_number 1 2024-05-24T01:54:04.702653245Z [2024-05-24T01:54:04.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:53:00+00:00, map_index=-1, run_start_date=2024-05-24 01:54:02.662676+00:00, run_end_date=2024-05-24 01:54:04.400251+00:00, run_duration=1.737575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:54:00.665399+00:00, queued_by_job_id=1, pid=13033 2024-05-24T01:54:04.703773625Z [2024-05-24T01:54:04.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:53:00+00:00, map_index=-1, run_start_date=2024-05-24 01:54:02.793515+00:00, run_end_date=2024-05-24 01:54:04.038681+00:00, run_duration=1.245166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:54:00.665399+00:00, queued_by_job_id=1, pid=13034 2024-05-24T01:55:00.485701116Z [2024-05-24T01:55:00.484+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:55:00.497473215Z [2024-05-24T01:55:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:55:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:55:00.515895602Z [2024-05-24T01:55:00.513+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:55:00+00:00, run_after=2024-05-24T01:56:00+00:00 2024-05-24T01:55:00.530403890Z [2024-05-24T01:55:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:55:00+00:00, run_after=2024-05-24T01:56:00+00:00 2024-05-24T01:55:00.642996209Z [2024-05-24T01:55:00.642+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:55:00.643048192Z 2024-05-24T01:55:00.643059393Z 2024-05-24T01:55:00.643069108Z 2024-05-24T01:55:00.643079216Z 2024-05-24T01:55:00.643458706Z [2024-05-24T01:55:00.642+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:55:00.643882234Z [2024-05-24T01:55:00.643+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:55:00.645064919Z [2024-05-24T01:55:00.643+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:55:00.645457082Z [2024-05-24T01:55:00.644+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:55:00.646916046Z [2024-05-24T01:55:00.646+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:55:00.646943556Z 2024-05-24T01:55:00.646954879Z 2024-05-24T01:55:00.646964905Z 2024-05-24T01:55:00.646974485Z 2024-05-24T01:55:00.655250555Z [2024-05-24T01:55:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T01:55:00.655309194Z [2024-05-24T01:55:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:55:00.655763111Z [2024-05-24T01:55:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:55:00.655840266Z [2024-05-24T01:55:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:55:00.656247109Z [2024-05-24T01:55:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:55:00.656344853Z [2024-05-24T01:55:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:55:00.656741479Z [2024-05-24T01:55:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:55:00.656840919Z [2024-05-24T01:55:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:55:01.365183445Z [2024-05-24T01:55:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:55:01.365224582Z [2024-05-24T01:55:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status queued for try_number 1 2024-05-24T01:55:01.365229866Z [2024-05-24T01:55:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status queued for try_number 1 2024-05-24T01:55:01.365286971Z [2024-05-24T01:55:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status queued for try_number 1 2024-05-24T01:55:01.388019652Z [2024-05-24T01:55:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8faad58f-986b-4279-a977-409fdd4d706d 2024-05-24T01:55:01.390982382Z [2024-05-24T01:55:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d74d281-4a67-4a15-b075-9fef6c8c5284 2024-05-24T01:55:01.391131835Z [2024-05-24T01:55:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 464bb70b-b64a-4c55-9ea8-ca6adb9135b1 2024-05-24T01:55:01.391281093Z [2024-05-24T01:55:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 631481a4-098c-4f60-990a-803851a538b2 2024-05-24T01:55:02.284743465Z [2024-05-24T01:55:02.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:55:02.285330435Z [2024-05-24T01:55:02.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:54:00+00:00, run_id=scheduled__2024-05-24T01:54:00+00:00, run_start_date=2024-05-24 01:55:00.545267+00:00, run_end_date=2024-05-24 01:55:02.284925+00:00, run_duration=1.739658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:54:00+00:00, data_interval_end=2024-05-24 01:55:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:55:02.303124917Z [2024-05-24T01:55:02.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:55:00+00:00, run_after=2024-05-24T01:56:00+00:00 2024-05-24T01:55:03.490105709Z [2024-05-24T01:55:03.488+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:55:03.490122950Z 2024-05-24T01:55:03.490138709Z [2024-05-24T01:55:03.488+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:55:03.490661951Z [2024-05-24T01:55:03.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:55:03.490674730Z 2024-05-24T01:55:03.496988010Z [2024-05-24T01:55:03.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T01:55:03.497180575Z [2024-05-24T01:55:03.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:55:03.587312761Z [2024-05-24T01:55:03.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:55:03.587480989Z [2024-05-24T01:55:03.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:55:03.587666640Z [2024-05-24T01:55:03.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status success for try_number 1 2024-05-24T01:55:03.596415660Z [2024-05-24T01:55:03.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=-1, run_start_date=2024-05-24 01:55:02.981808+00:00, run_end_date=2024-05-24 01:55:03.352793+00:00, run_duration=0.370985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:55:00.649379+00:00, queued_by_job_id=1, pid=13093 2024-05-24T01:55:03.596911495Z [2024-05-24T01:55:03.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:54:00+00:00, map_index=-1, run_start_date=2024-05-24 01:55:01.774651+00:00, run_end_date=2024-05-24 01:55:02.252951+00:00, run_duration=0.4783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:55:00.649379+00:00, queued_by_job_id=1, pid=13068 2024-05-24T01:55:03.597337929Z [2024-05-24T01:55:03.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79cea805-30d2-4798-a9a1-4b2a5170560d 2024-05-24T01:55:04.503903723Z [2024-05-24T01:55:04.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:55:04.504350317Z [2024-05-24T01:55:04.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:54:00+00:00, run_id=scheduled__2024-05-24T01:54:00+00:00, run_start_date=2024-05-24 01:55:00.546377+00:00, run_end_date=2024-05-24 01:55:04.503779+00:00, run_duration=3.957402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:54:00+00:00, data_interval_end=2024-05-24 01:55:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:55:04.514462300Z [2024-05-24T01:55:04.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:55:00+00:00, run_after=2024-05-24T01:56:00+00:00 2024-05-24T01:55:04.593922171Z [2024-05-24T01:55:04.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status success for try_number 1 2024-05-24T01:55:04.602717431Z [2024-05-24T01:55:04.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:54:00+00:00, map_index=-1, run_start_date=2024-05-24 01:55:02.762995+00:00, run_end_date=2024-05-24 01:55:04.064751+00:00, run_duration=1.301756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:55:00.649379+00:00, queued_by_job_id=1, pid=13087 2024-05-24T01:55:05.660954786Z [2024-05-24T01:55:05.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:55:05.661199248Z [2024-05-24T01:55:05.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:54:00+00:00, run_id=scheduled__2024-05-24T01:54:00+00:00, run_start_date=2024-05-24 01:55:00.547634+00:00, run_end_date=2024-05-24 01:55:05.660754+00:00, run_duration=5.11312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:54:00+00:00, data_interval_end=2024-05-24 01:55:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:55:05.671175705Z [2024-05-24T01:55:05.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:55:00+00:00, run_after=2024-05-24T01:56:00+00:00 2024-05-24T01:55:05.730593553Z [2024-05-24T01:55:05.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status success for try_number 1 2024-05-24T01:55:05.749041184Z [2024-05-24T01:55:05.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:54:00+00:00, map_index=-1, run_start_date=2024-05-24 01:55:03.165256+00:00, run_end_date=2024-05-24 01:55:04.754767+00:00, run_duration=1.589511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:55:00.649379+00:00, queued_by_job_id=1, pid=13099 2024-05-24T01:55:06.834112208Z [2024-05-24T01:55:06.833+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:55:06.834146694Z 2024-05-24T01:55:06.834212410Z [2024-05-24T01:55:06.833+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:55:06.834973643Z [2024-05-24T01:55:06.834+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:55:06.834990598Z 2024-05-24T01:55:06.838497280Z [2024-05-24T01:55:06.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T01:55:06.838823851Z [2024-05-24T01:55:06.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T01:55:06.911113021Z [2024-05-24T01:55:06.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:55:06.911286897Z [2024-05-24T01:55:06.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:55:06.917676083Z [2024-05-24T01:55:06.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b9e11eb-4b08-4b1b-a616-d113ec3e44a5 2024-05-24T01:55:06.917987153Z [2024-05-24T01:55:06.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=-1, run_start_date=2024-05-24 01:55:05.339225+00:00, run_end_date=2024-05-24 01:55:05.742905+00:00, run_duration=0.40368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:55:03.491354+00:00, queued_by_job_id=1, pid=13117 2024-05-24T01:55:09.694791529Z [2024-05-24T01:55:09.690+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T01:55:09.694825689Z 2024-05-24T01:55:09.698372775Z [2024-05-24T01:55:09.697+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:55:09.700663802Z [2024-05-24T01:55:09.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:55:09.700677114Z 2024-05-24T01:55:09.706883969Z [2024-05-24T01:55:09.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:55:09.707025127Z [2024-05-24T01:55:09.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T01:55:09.772608332Z [2024-05-24T01:55:09.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status queued for try_number 1 2024-05-24T01:55:09.772662340Z [2024-05-24T01:55:09.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:55:09.778209765Z [2024-05-24T01:55:09.777+0000] {scheduler_job.py:635} INFO - Setting external_id for to c31845b6-07bd-4260-a3c8-50e6ae0bfbf6 2024-05-24T01:55:09.778392706Z [2024-05-24T01:55:09.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=0, run_start_date=2024-05-24 01:55:08.588919+00:00, run_end_date=2024-05-24 01:55:09.031242+00:00, run_duration=0.442323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:55:06.835446+00:00, queued_by_job_id=1, pid=13125 2024-05-24T01:55:12.060139578Z [2024-05-24T01:55:12.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:55:12.060207157Z [2024-05-24T01:55:12.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:50:00+00:00, run_id=scheduled__2024-05-24T01:50:00+00:00, run_start_date=2024-05-24 01:55:00.543946+00:00, run_end_date=2024-05-24 01:55:12.059851+00:00, run_duration=11.515905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:50:00+00:00, data_interval_end=2024-05-24 01:55:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T01:55:12.069120955Z [2024-05-24T01:55:12.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:55:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:55:12.126149813Z [2024-05-24T01:55:12.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:50:00+00:00 exited with status success for try_number 1 2024-05-24T01:55:12.136600305Z [2024-05-24T01:55:12.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:50:00+00:00, map_index=-1, run_start_date=2024-05-24 01:55:11.420830+00:00, run_end_date=2024-05-24 01:55:11.794215+00:00, run_duration=0.373385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:55:09.702044+00:00, queued_by_job_id=1, pid=13133 2024-05-24T01:56:00.631038828Z [2024-05-24T01:56:00.630+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:56:00+00:00, run_after=2024-05-24T01:57:00+00:00 2024-05-24T01:56:00.644406051Z [2024-05-24T01:56:00.644+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:56:00.660255129Z [2024-05-24T01:56:00.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:56:00+00:00, run_after=2024-05-24T01:57:00+00:00 2024-05-24T01:56:00.670495242Z [2024-05-24T01:56:00.670+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:56:00.778870092Z [2024-05-24T01:56:00.778+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:56:00.778912090Z 2024-05-24T01:56:00.778947411Z 2024-05-24T01:56:00.778957319Z 2024-05-24T01:56:00.778966151Z 2024-05-24T01:56:00.779005325Z [2024-05-24T01:56:00.778+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:56:00.779283909Z [2024-05-24T01:56:00.779+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:56:00.779514614Z [2024-05-24T01:56:00.779+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:56:00.779771621Z [2024-05-24T01:56:00.779+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:56:00.780543923Z [2024-05-24T01:56:00.780+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:56:00.780565988Z 2024-05-24T01:56:00.780575594Z 2024-05-24T01:56:00.780584254Z 2024-05-24T01:56:00.780617600Z 2024-05-24T01:56:00.786083086Z [2024-05-24T01:56:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:56:00.786360074Z [2024-05-24T01:56:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:56:00.786846283Z [2024-05-24T01:56:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:56:00.787074785Z [2024-05-24T01:56:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:56:00.787542665Z [2024-05-24T01:56:00.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:56:00.787758545Z [2024-05-24T01:56:00.787+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:56:00.788111419Z [2024-05-24T01:56:00.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:56:00.788237119Z [2024-05-24T01:56:00.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:56:01.136043683Z [2024-05-24T01:56:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status queued for try_number 1 2024-05-24T01:56:01.136155974Z [2024-05-24T01:56:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status queued for try_number 1 2024-05-24T01:56:01.136359647Z [2024-05-24T01:56:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status queued for try_number 1 2024-05-24T01:56:01.136548335Z [2024-05-24T01:56:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status queued for try_number 1 2024-05-24T01:56:01.147505414Z [2024-05-24T01:56:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64a2bbaf-5ca6-41b0-8d9d-6321463540f0 2024-05-24T01:56:01.147666997Z [2024-05-24T01:56:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to e447b419-1956-4643-9e00-ac4e558e5ec5 2024-05-24T01:56:01.147821963Z [2024-05-24T01:56:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to f57d6faa-a5da-415c-b08e-ab8517336247 2024-05-24T01:56:01.150911396Z [2024-05-24T01:56:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9b5c757-ef78-48c7-8c48-b6dd8606d4b9 2024-05-24T01:56:02.432321039Z [2024-05-24T01:56:02.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:56:02.432710455Z [2024-05-24T01:56:02.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:55:00+00:00, run_id=scheduled__2024-05-24T01:55:00+00:00, run_start_date=2024-05-24 01:56:00.691315+00:00, run_end_date=2024-05-24 01:56:02.432332+00:00, run_duration=1.741017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:55:00+00:00, data_interval_end=2024-05-24 01:56:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:56:02.457589875Z [2024-05-24T01:56:02.457+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:56:00+00:00, run_after=2024-05-24T01:57:00+00:00 2024-05-24T01:56:02.577407781Z [2024-05-24T01:56:02.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status success for try_number 1 2024-05-24T01:56:02.589242780Z [2024-05-24T01:56:02.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:55:00+00:00, map_index=-1, run_start_date=2024-05-24 01:56:01.945619+00:00, run_end_date=2024-05-24 01:56:02.354774+00:00, run_duration=0.409155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:56:00.781994+00:00, queued_by_job_id=1, pid=13155 2024-05-24T01:56:02.846644336Z [2024-05-24T01:56:02.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:56:02.846673480Z [2024-05-24T01:56:02.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:54:00+00:00, run_id=scheduled__2024-05-24T01:54:00+00:00, run_start_date=2024-05-24 01:56:00.688583+00:00, run_end_date=2024-05-24 01:56:02.843489+00:00, run_duration=2.154906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:54:00+00:00, data_interval_end=2024-05-24 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:56:02.853612415Z [2024-05-24T01:56:02.853+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:56:00+00:00, run_after=2024-05-24T01:58:00+00:00 2024-05-24T01:56:02.900439322Z [2024-05-24T01:56:02.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:54:00+00:00 exited with status success for try_number 1 2024-05-24T01:56:02.910628465Z [2024-05-24T01:56:02.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:54:00+00:00, map_index=-1, run_start_date=2024-05-24 01:56:02.128178+00:00, run_end_date=2024-05-24 01:56:02.481932+00:00, run_duration=0.353754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:56:00.781994+00:00, queued_by_job_id=1, pid=13156 2024-05-24T01:56:06.222595079Z [2024-05-24T01:56:06.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:56:06.222912325Z [2024-05-24T01:56:06.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:55:00+00:00, run_id=scheduled__2024-05-24T01:55:00+00:00, run_start_date=2024-05-24 01:56:00.694459+00:00, run_end_date=2024-05-24 01:56:06.222465+00:00, run_duration=5.528006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:55:00+00:00, data_interval_end=2024-05-24 01:56:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:56:06.232466509Z [2024-05-24T01:56:06.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:56:00+00:00, run_after=2024-05-24T01:57:00+00:00 2024-05-24T01:56:06.242213097Z [2024-05-24T01:56:06.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:56:06.242467374Z [2024-05-24T01:56:06.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:55:00+00:00, run_id=scheduled__2024-05-24T01:55:00+00:00, run_start_date=2024-05-24 01:56:00.697458+00:00, run_end_date=2024-05-24 01:56:06.242109+00:00, run_duration=5.544651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:55:00+00:00, data_interval_end=2024-05-24 01:56:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:56:06.255573873Z [2024-05-24T01:56:06.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:56:00+00:00, run_after=2024-05-24T01:57:00+00:00 2024-05-24T01:56:06.300391136Z [2024-05-24T01:56:06.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status success for try_number 1 2024-05-24T01:56:06.300521852Z [2024-05-24T01:56:06.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status success for try_number 1 2024-05-24T01:56:06.312201583Z [2024-05-24T01:56:06.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:55:00+00:00, map_index=-1, run_start_date=2024-05-24 01:56:03.541010+00:00, run_end_date=2024-05-24 01:56:05.547294+00:00, run_duration=2.006284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:56:00.781994+00:00, queued_by_job_id=1, pid=13180 2024-05-24T01:56:06.312526014Z [2024-05-24T01:56:06.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:55:00+00:00, map_index=-1, run_start_date=2024-05-24 01:56:03.325172+00:00, run_end_date=2024-05-24 01:56:05.605446+00:00, run_duration=2.280274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:56:00.781994+00:00, queued_by_job_id=1, pid=13177 2024-05-24T01:56:41.942187643Z [2024-05-24T01:56:41.941+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T01:57:00.994343926Z [2024-05-24T01:57:00.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:57:00+00:00, run_after=2024-05-24T01:58:00+00:00 2024-05-24T01:57:01.003257471Z [2024-05-24T01:57:01.002+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:57:01.016185507Z [2024-05-24T01:57:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:57:00+00:00, run_after=2024-05-24T01:58:00+00:00 2024-05-24T01:57:01.112253473Z [2024-05-24T01:57:01.111+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:57:01.112287477Z 2024-05-24T01:57:01.112293640Z 2024-05-24T01:57:01.112299319Z 2024-05-24T01:57:01.112314510Z [2024-05-24T01:57:01.112+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:57:01.112391115Z [2024-05-24T01:57:01.112+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:57:01.112488189Z [2024-05-24T01:57:01.112+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:57:01.113203471Z [2024-05-24T01:57:01.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:57:01.113218077Z 2024-05-24T01:57:01.113223603Z 2024-05-24T01:57:01.113239094Z 2024-05-24T01:57:01.117862919Z [2024-05-24T01:57:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:57:01.117918180Z [2024-05-24T01:57:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:57:01.118324180Z [2024-05-24T01:57:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:57:01.118426354Z [2024-05-24T01:57:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:57:01.118686817Z [2024-05-24T01:57:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:57:01.118758690Z [2024-05-24T01:57:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:57:01.319343286Z [2024-05-24T01:57:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status queued for try_number 1 2024-05-24T01:57:01.319607292Z [2024-05-24T01:57:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status queued for try_number 1 2024-05-24T01:57:01.319761329Z [2024-05-24T01:57:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status queued for try_number 1 2024-05-24T01:57:01.330030460Z [2024-05-24T01:57:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67327502-898e-4023-919e-a687af355ec8 2024-05-24T01:57:01.330316087Z [2024-05-24T01:57:01.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1d5b522-0c36-482c-a804-61bbc7c29d8e 2024-05-24T01:57:01.330501709Z [2024-05-24T01:57:01.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29912ada-87e8-413f-b71f-8f85c9b9f730 2024-05-24T01:57:03.337653169Z [2024-05-24T01:57:03.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:57:03.338192035Z [2024-05-24T01:57:03.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:56:00+00:00, run_id=scheduled__2024-05-24T01:56:00+00:00, run_start_date=2024-05-24 01:57:01.025793+00:00, run_end_date=2024-05-24 01:57:03.337549+00:00, run_duration=2.311756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:56:00+00:00, data_interval_end=2024-05-24 01:57:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:57:03.356757549Z [2024-05-24T01:57:03.356+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:57:00+00:00, run_after=2024-05-24T01:58:00+00:00 2024-05-24T01:57:03.431635253Z [2024-05-24T01:57:03.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status success for try_number 1 2024-05-24T01:57:03.439620532Z [2024-05-24T01:57:03.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:56:00+00:00, map_index=-1, run_start_date=2024-05-24 01:57:01.980849+00:00, run_end_date=2024-05-24 01:57:02.378997+00:00, run_duration=0.398148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:57:01.114012+00:00, queued_by_job_id=1, pid=13211 2024-05-24T01:57:05.612987769Z [2024-05-24T01:57:05.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:57:05.613539927Z [2024-05-24T01:57:05.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:56:00+00:00, run_id=scheduled__2024-05-24T01:56:00+00:00, run_start_date=2024-05-24 01:57:01.027015+00:00, run_end_date=2024-05-24 01:57:05.612829+00:00, run_duration=4.585814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:56:00+00:00, data_interval_end=2024-05-24 01:57:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:57:05.626320193Z [2024-05-24T01:57:05.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:57:00+00:00, run_after=2024-05-24T01:58:00+00:00 2024-05-24T01:57:05.670950786Z [2024-05-24T01:57:05.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status success for try_number 1 2024-05-24T01:57:05.677750625Z [2024-05-24T01:57:05.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:56:00+00:00, map_index=-1, run_start_date=2024-05-24 01:57:03.084288+00:00, run_end_date=2024-05-24 01:57:05.254268+00:00, run_duration=2.16998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:57:01.114012+00:00, queued_by_job_id=1, pid=13230 2024-05-24T01:57:06.761389919Z [2024-05-24T01:57:06.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:57:06.761667140Z [2024-05-24T01:57:06.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:56:00+00:00, run_id=scheduled__2024-05-24T01:56:00+00:00, run_start_date=2024-05-24 01:57:01.028000+00:00, run_end_date=2024-05-24 01:57:06.761289+00:00, run_duration=5.733289, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:56:00+00:00, data_interval_end=2024-05-24 01:57:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:57:06.770536482Z [2024-05-24T01:57:06.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:57:00+00:00, run_after=2024-05-24T01:58:00+00:00 2024-05-24T01:57:06.805355037Z [2024-05-24T01:57:06.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status success for try_number 1 2024-05-24T01:57:06.813168737Z [2024-05-24T01:57:06.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:56:00+00:00, map_index=-1, run_start_date=2024-05-24 01:57:03.044463+00:00, run_end_date=2024-05-24 01:57:05.612968+00:00, run_duration=2.568505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:57:01.114012+00:00, queued_by_job_id=1, pid=13229 2024-05-24T01:58:00.213685161Z [2024-05-24T01:58:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:58:00+00:00, run_after=2024-05-24T01:59:00+00:00 2024-05-24T01:58:00.233887474Z [2024-05-24T01:58:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:58:00+00:00, run_after=2024-05-24T01:59:00+00:00 2024-05-24T01:58:00.244188943Z [2024-05-24T01:58:00.243+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:58:00.252033056Z [2024-05-24T01:58:00.251+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:58:00.356692429Z [2024-05-24T01:58:00.356+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T01:58:00.356722476Z 2024-05-24T01:58:00.356731384Z 2024-05-24T01:58:00.356736527Z 2024-05-24T01:58:00.356741394Z 2024-05-24T01:58:00.356841017Z [2024-05-24T01:58:00.356+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T01:58:00.356974630Z [2024-05-24T01:58:00.356+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:58:00.357044959Z [2024-05-24T01:58:00.356+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:58:00.357203712Z [2024-05-24T01:58:00.357+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:58:00.357785270Z [2024-05-24T01:58:00.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:58:00.357798418Z 2024-05-24T01:58:00.357807023Z 2024-05-24T01:58:00.357815729Z 2024-05-24T01:58:00.357824041Z 2024-05-24T01:58:00.361725232Z [2024-05-24T01:58:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:58:00.361873071Z [2024-05-24T01:58:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T01:58:00.362181278Z [2024-05-24T01:58:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:58:00.362349476Z [2024-05-24T01:58:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:58:00.362715392Z [2024-05-24T01:58:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:58:00.362888868Z [2024-05-24T01:58:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:58:00.363192002Z [2024-05-24T01:58:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:58:00.363357656Z [2024-05-24T01:58:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:58:00.934589196Z [2024-05-24T01:58:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status queued for try_number 1 2024-05-24T01:58:00.934612796Z [2024-05-24T01:58:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:57:00+00:00 exited with status queued for try_number 1 2024-05-24T01:58:00.934628240Z [2024-05-24T01:58:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:57:00+00:00 exited with status queued for try_number 1 2024-05-24T01:58:00.934631618Z [2024-05-24T01:58:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:57:00+00:00 exited with status queued for try_number 1 2024-05-24T01:58:00.951846175Z [2024-05-24T01:58:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad63b21e-7cb5-4e12-a71e-c5cf8b65d314 2024-05-24T01:58:00.954580723Z [2024-05-24T01:58:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d75ebc1-a46b-4a4b-a351-d151f36ca27e 2024-05-24T01:58:00.954598850Z [2024-05-24T01:58:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to ded6e53b-c991-4f51-b11b-3f5065d131b6 2024-05-24T01:58:00.954602974Z [2024-05-24T01:58:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7ad5379-90a4-43ba-818b-fff85556fe01 2024-05-24T01:58:02.269289733Z [2024-05-24T01:58:02.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:58:02.269597587Z [2024-05-24T01:58:02.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:56:00+00:00, run_id=scheduled__2024-05-24T01:56:00+00:00, run_start_date=2024-05-24 01:58:00.264279+00:00, run_end_date=2024-05-24 01:58:02.269216+00:00, run_duration=2.004937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:56:00+00:00, data_interval_end=2024-05-24 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T01:58:02.280025513Z [2024-05-24T01:58:02.279+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T01:58:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:58:02.293649599Z [2024-05-24T01:58:02.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:58:02.293965707Z [2024-05-24T01:58:02.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:57:00+00:00, run_id=scheduled__2024-05-24T01:57:00+00:00, run_start_date=2024-05-24 01:58:00.265753+00:00, run_end_date=2024-05-24 01:58:02.293606+00:00, run_duration=2.027853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:57:00+00:00, data_interval_end=2024-05-24 01:58:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:58:02.306958438Z [2024-05-24T01:58:02.306+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:58:00+00:00, run_after=2024-05-24T01:59:00+00:00 2024-05-24T01:58:02.376323751Z [2024-05-24T01:58:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:56:00+00:00 exited with status success for try_number 1 2024-05-24T01:58:02.376541509Z [2024-05-24T01:58:02.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:57:00+00:00 exited with status success for try_number 1 2024-05-24T01:58:02.385915407Z [2024-05-24T01:58:02.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:56:00+00:00, map_index=-1, run_start_date=2024-05-24 01:58:01.145126+00:00, run_end_date=2024-05-24 01:58:01.561617+00:00, run_duration=0.416491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:58:00.358585+00:00, queued_by_job_id=1, pid=13258 2024-05-24T01:58:02.386133057Z [2024-05-24T01:58:02.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:57:00+00:00, map_index=-1, run_start_date=2024-05-24 01:58:01.432298+00:00, run_end_date=2024-05-24 01:58:01.817337+00:00, run_duration=0.385039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:58:00.358585+00:00, queued_by_job_id=1, pid=13264 2024-05-24T01:58:03.882408621Z [2024-05-24T01:58:03.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:58:03.882566678Z [2024-05-24T01:58:03.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:57:00+00:00, run_id=scheduled__2024-05-24T01:57:00+00:00, run_start_date=2024-05-24 01:58:00.266947+00:00, run_end_date=2024-05-24 01:58:03.882279+00:00, run_duration=3.615332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:57:00+00:00, data_interval_end=2024-05-24 01:58:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:58:03.892773251Z [2024-05-24T01:58:03.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:58:00+00:00, run_after=2024-05-24T01:59:00+00:00 2024-05-24T01:58:03.956751959Z [2024-05-24T01:58:03.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:57:00+00:00 exited with status success for try_number 1 2024-05-24T01:58:03.975954290Z [2024-05-24T01:58:03.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:57:00+00:00, map_index=-1, run_start_date=2024-05-24 01:58:02.419980+00:00, run_end_date=2024-05-24 01:58:03.773037+00:00, run_duration=1.353057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:58:00.358585+00:00, queued_by_job_id=1, pid=13288 2024-05-24T01:58:05.039960392Z [2024-05-24T01:58:05.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:58:05.040278457Z [2024-05-24T01:58:05.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:57:00+00:00, run_id=scheduled__2024-05-24T01:57:00+00:00, run_start_date=2024-05-24 01:58:00.268075+00:00, run_end_date=2024-05-24 01:58:05.039759+00:00, run_duration=4.771684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:57:00+00:00, data_interval_end=2024-05-24 01:58:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:58:05.049618656Z [2024-05-24T01:58:05.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:58:00+00:00, run_after=2024-05-24T01:59:00+00:00 2024-05-24T01:58:05.093270142Z [2024-05-24T01:58:05.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:57:00+00:00 exited with status success for try_number 1 2024-05-24T01:58:05.104953258Z [2024-05-24T01:58:05.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:57:00+00:00, map_index=-1, run_start_date=2024-05-24 01:58:02.283083+00:00, run_end_date=2024-05-24 01:58:04.120571+00:00, run_duration=1.837488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:58:00.358585+00:00, queued_by_job_id=1, pid=13287 2024-05-24T01:59:00.481882547Z [2024-05-24T01:59:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:59:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:59:00.495127830Z [2024-05-24T01:59:00.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:59:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:59:00.501823049Z [2024-05-24T01:59:00.501+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T01:59:00.596736623Z [2024-05-24T01:59:00.596+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T01:59:00.596823388Z 2024-05-24T01:59:00.596835819Z 2024-05-24T01:59:00.596845146Z 2024-05-24T01:59:00.598897460Z [2024-05-24T01:59:00.598+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:59:00.599291521Z [2024-05-24T01:59:00.599+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T01:59:00.599647498Z [2024-05-24T01:59:00.599+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T01:59:00.607401666Z [2024-05-24T01:59:00.606+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T01:59:00.607421332Z 2024-05-24T01:59:00.607436880Z 2024-05-24T01:59:00.607440421Z 2024-05-24T01:59:00.612017896Z [2024-05-24T01:59:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:59:00.612076019Z [2024-05-24T01:59:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T01:59:00.612394542Z [2024-05-24T01:59:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:59:00.612399386Z [2024-05-24T01:59:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T01:59:00.612716653Z [2024-05-24T01:59:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T01:59:00.612884552Z [2024-05-24T01:59:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T01:59:00.844328866Z [2024-05-24T01:59:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status queued for try_number 1 2024-05-24T01:59:00.844370825Z [2024-05-24T01:59:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status queued for try_number 1 2024-05-24T01:59:00.844420835Z [2024-05-24T01:59:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status queued for try_number 1 2024-05-24T01:59:00.861774170Z [2024-05-24T01:59:00.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39303aa6-d3f4-465c-bab9-20d65090fa22 2024-05-24T01:59:00.861889438Z [2024-05-24T01:59:00.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81dc5022-3b0d-4403-81eb-5d78b1649676 2024-05-24T01:59:00.862135296Z [2024-05-24T01:59:00.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30a1777c-54a7-4ce4-aecb-cb0bf90a23fa 2024-05-24T01:59:03.186675286Z [2024-05-24T01:59:03.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:59:03.187197327Z [2024-05-24T01:59:03.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:58:00+00:00, run_id=scheduled__2024-05-24T01:58:00+00:00, run_start_date=2024-05-24 01:59:00.511590+00:00, run_end_date=2024-05-24 01:59:03.186595+00:00, run_duration=2.675005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:58:00+00:00, data_interval_end=2024-05-24 01:59:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T01:59:03.197492390Z [2024-05-24T01:59:03.197+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T01:59:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:59:03.272028401Z [2024-05-24T01:59:03.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status success for try_number 1 2024-05-24T01:59:03.283095841Z [2024-05-24T01:59:03.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:58:00+00:00, map_index=-1, run_start_date=2024-05-24 01:59:01.794901+00:00, run_end_date=2024-05-24 01:59:02.221715+00:00, run_duration=0.426814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:59:00.608131+00:00, queued_by_job_id=1, pid=13320 2024-05-24T01:59:04.344295942Z [2024-05-24T01:59:04.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:59:04.344511102Z [2024-05-24T01:59:04.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:58:00+00:00, run_id=scheduled__2024-05-24T01:58:00+00:00, run_start_date=2024-05-24 01:59:00.514367+00:00, run_end_date=2024-05-24 01:59:04.344222+00:00, run_duration=3.829855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:58:00+00:00, data_interval_end=2024-05-24 01:59:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T01:59:04.354669476Z [2024-05-24T01:59:04.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:59:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:59:05.499217781Z [2024-05-24T01:59:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T01:59:05.499685076Z [2024-05-24T01:59:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:58:00+00:00, run_id=scheduled__2024-05-24T01:58:00+00:00, run_start_date=2024-05-24 01:59:00.513055+00:00, run_end_date=2024-05-24 01:59:05.499110+00:00, run_duration=4.986055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:58:00+00:00, data_interval_end=2024-05-24 01:59:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T01:59:05.510478859Z [2024-05-24T01:59:05.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T01:59:00+00:00, run_after=2024-05-24T02:00:00+00:00 2024-05-24T01:59:05.548854202Z [2024-05-24T01:59:05.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status success for try_number 1 2024-05-24T01:59:05.549291349Z [2024-05-24T01:59:05.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status success for try_number 1 2024-05-24T01:59:05.557834390Z [2024-05-24T01:59:05.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:58:00+00:00, map_index=-1, run_start_date=2024-05-24 01:59:02.630639+00:00, run_end_date=2024-05-24 01:59:04.278046+00:00, run_duration=1.647407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:59:00.608131+00:00, queued_by_job_id=1, pid=13338 2024-05-24T01:59:05.558314976Z [2024-05-24T01:59:05.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:58:00+00:00, map_index=-1, run_start_date=2024-05-24 01:59:02.897772+00:00, run_end_date=2024-05-24 01:59:04.345043+00:00, run_duration=1.447271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 01:59:00.608131+00:00, queued_by_job_id=1, pid=13339 2024-05-24T02:00:00.388532375Z [2024-05-24T02:00:00.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:05:00+00:00 2024-05-24T02:00:00.400871984Z [2024-05-24T02:00:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:01:00+00:00 2024-05-24T02:00:00.414933374Z [2024-05-24T02:00:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:01:00+00:00 2024-05-24T02:00:00.423563655Z [2024-05-24T02:00:00.423+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:00:00.430176599Z [2024-05-24T02:00:00.429+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:00:00.552171172Z [2024-05-24T02:00:00.551+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T02:00:00.552206496Z 2024-05-24T02:00:00.552214794Z 2024-05-24T02:00:00.552243292Z 2024-05-24T02:00:00.552249955Z 2024-05-24T02:00:00.552256617Z 2024-05-24T02:00:00.553670495Z [2024-05-24T02:00:00.552+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:00:00.553694625Z [2024-05-24T02:00:00.552+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:00:00.553702492Z [2024-05-24T02:00:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:00:00.553709590Z [2024-05-24T02:00:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:00:00.553716620Z [2024-05-24T02:00:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:00:00.554352387Z [2024-05-24T02:00:00.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:00:00.554360811Z 2024-05-24T02:00:00.554367086Z 2024-05-24T02:00:00.554373238Z 2024-05-24T02:00:00.554379091Z 2024-05-24T02:00:00.554384893Z 2024-05-24T02:00:00.568409370Z [2024-05-24T02:00:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:00:00.568666018Z [2024-05-24T02:00:00.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:00:00.569379209Z [2024-05-24T02:00:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:00:00.569650116Z [2024-05-24T02:00:00.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:00:00.570403877Z [2024-05-24T02:00:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:00:00.570684024Z [2024-05-24T02:00:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:00:00.571133280Z [2024-05-24T02:00:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:00:00.571360181Z [2024-05-24T02:00:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:00:00.571811055Z [2024-05-24T02:00:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:00:00.572274254Z [2024-05-24T02:00:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:00:00.942584010Z [2024-05-24T02:00:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:00.942609821Z [2024-05-24T02:00:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:00.942623530Z [2024-05-24T02:00:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:59:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:00.942627406Z [2024-05-24T02:00:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:59:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:00.942630743Z [2024-05-24T02:00:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:59:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:00.966306928Z [2024-05-24T02:00:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b9035ea-d983-48ad-b949-9ca2d8ec4a69 2024-05-24T02:00:00.966334231Z [2024-05-24T02:00:00.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to a25469a6-59e9-4651-858c-14d6fd85728c 2024-05-24T02:00:00.966337937Z [2024-05-24T02:00:00.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14b9713e-bd88-4592-a63e-6448b0b56b7f 2024-05-24T02:00:00.966354374Z [2024-05-24T02:00:00.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec62edd7-9a78-4fa5-83b0-81f429c109e7 2024-05-24T02:00:00.966357711Z [2024-05-24T02:00:00.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7de272b9-efe1-4036-838e-8b23f04c1434 2024-05-24T02:00:02.394682510Z [2024-05-24T02:00:02.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:59:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:02.408421730Z [2024-05-24T02:00:02.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:59:00+00:00, map_index=-1, run_start_date=2024-05-24 02:00:01.685261+00:00, run_end_date=2024-05-24 02:00:02.114172+00:00, run_duration=0.428911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:00.563131+00:00, queued_by_job_id=1, pid=13373 2024-05-24T02:00:03.488619428Z [2024-05-24T02:00:03.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:00:03.488859656Z [2024-05-24T02:00:03.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 01:58:00+00:00, run_id=scheduled__2024-05-24T01:58:00+00:00, run_start_date=2024-05-24 02:00:00.441843+00:00, run_end_date=2024-05-24 02:00:03.488535+00:00, run_duration=3.046692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:58:00+00:00, data_interval_end=2024-05-24 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:00:03.498354079Z [2024-05-24T02:00:03.498+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:02:00+00:00 2024-05-24T02:00:03.511102467Z [2024-05-24T02:00:03.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:00:03.511247357Z [2024-05-24T02:00:03.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 01:59:00+00:00, run_id=scheduled__2024-05-24T01:59:00+00:00, run_start_date=2024-05-24 02:00:00.443183+00:00, run_end_date=2024-05-24 02:00:03.511024+00:00, run_duration=3.067841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:59:00+00:00, data_interval_end=2024-05-24 02:00:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:00:03.524663955Z [2024-05-24T02:00:03.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:01:00+00:00 2024-05-24T02:00:03.612933504Z [2024-05-24T02:00:03.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T01:58:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:03.618548596Z [2024-05-24T02:00:03.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T01:58:00+00:00, map_index=-1, run_start_date=2024-05-24 02:00:02.035893+00:00, run_end_date=2024-05-24 02:00:02.562397+00:00, run_duration=0.526504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:00.563131+00:00, queued_by_job_id=1, pid=13379 2024-05-24T02:00:04.742652496Z [2024-05-24T02:00:04.742+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:00:04.742701064Z 2024-05-24T02:00:04.742712151Z [2024-05-24T02:00:04.742+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:00:04.743415017Z [2024-05-24T02:00:04.743+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:00:04.743462985Z 2024-05-24T02:00:04.747260162Z [2024-05-24T02:00:04.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:00:04.747337798Z [2024-05-24T02:00:04.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:00:04.845926636Z [2024-05-24T02:00:04.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:04.846020494Z [2024-05-24T02:00:04.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:04.856443561Z [2024-05-24T02:00:04.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1208c99f-2ff9-4f0a-97f4-4418f7f1a00c 2024-05-24T02:00:04.863095998Z [2024-05-24T02:00:04.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T01:55:00+00:00, map_index=-1, run_start_date=2024-05-24 02:00:03.415902+00:00, run_end_date=2024-05-24 02:00:03.814791+00:00, run_duration=0.398889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:00.563131+00:00, queued_by_job_id=1, pid=13398 2024-05-24T02:00:06.069727418Z [2024-05-24T02:00:06.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:00:06.069990563Z [2024-05-24T02:00:06.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:59:00+00:00, run_id=scheduled__2024-05-24T01:59:00+00:00, run_start_date=2024-05-24 02:00:00.444395+00:00, run_end_date=2024-05-24 02:00:06.069607+00:00, run_duration=5.625212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:59:00+00:00, data_interval_end=2024-05-24 02:00:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:00:06.086054345Z [2024-05-24T02:00:06.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:01:00+00:00 2024-05-24T02:00:06.097633099Z [2024-05-24T02:00:06.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:00:06.098001037Z [2024-05-24T02:00:06.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:59:00+00:00, run_id=scheduled__2024-05-24T01:59:00+00:00, run_start_date=2024-05-24 02:00:00.445452+00:00, run_end_date=2024-05-24 02:00:06.097521+00:00, run_duration=5.652069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:59:00+00:00, data_interval_end=2024-05-24 02:00:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:00:06.112381354Z [2024-05-24T02:00:06.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:01:00+00:00 2024-05-24T02:00:06.180510084Z [2024-05-24T02:00:06.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:59:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:06.180995823Z [2024-05-24T02:00:06.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T01:59:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:06.203316553Z [2024-05-24T02:00:06.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:59:00+00:00, map_index=-1, run_start_date=2024-05-24 02:00:03.620732+00:00, run_end_date=2024-05-24 02:00:05.025382+00:00, run_duration=1.40465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:00.563131+00:00, queued_by_job_id=1, pid=13404 2024-05-24T02:00:06.203376023Z [2024-05-24T02:00:06.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T01:59:00+00:00, map_index=-1, run_start_date=2024-05-24 02:00:03.737923+00:00, run_end_date=2024-05-24 02:00:05.338189+00:00, run_duration=1.600266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:00.563131+00:00, queued_by_job_id=1, pid=13410 2024-05-24T02:00:07.291616117Z [2024-05-24T02:00:07.291+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:00:07.291644061Z 2024-05-24T02:00:07.291688295Z [2024-05-24T02:00:07.291+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:00:07.292630174Z [2024-05-24T02:00:07.292+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:00:07.292642865Z 2024-05-24T02:00:07.295594383Z [2024-05-24T02:00:07.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:00:07.295995824Z [2024-05-24T02:00:07.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:00:07.376528614Z [2024-05-24T02:00:07.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:07.376719778Z [2024-05-24T02:00:07.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:07.385017325Z [2024-05-24T02:00:07.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a424c95-f567-48b3-85be-799cbd82f694 2024-05-24T02:00:07.385630319Z [2024-05-24T02:00:07.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T01:55:00+00:00, map_index=-1, run_start_date=2024-05-24 02:00:06.442146+00:00, run_end_date=2024-05-24 02:00:06.830467+00:00, run_duration=0.388321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:04.743840+00:00, queued_by_job_id=1, pid=13428 2024-05-24T02:00:10.713600850Z [2024-05-24T02:00:10.713+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:00:10.713626756Z 2024-05-24T02:00:10.715204794Z [2024-05-24T02:00:10.714+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:00:10.716962879Z [2024-05-24T02:00:10.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:00:10.716976365Z 2024-05-24T02:00:10.723941952Z [2024-05-24T02:00:10.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:00:10.724178221Z [2024-05-24T02:00:10.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:00:10.772955518Z [2024-05-24T02:00:10.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status queued for try_number 1 2024-05-24T02:00:10.773213835Z [2024-05-24T02:00:10.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:10.777966759Z [2024-05-24T02:00:10.777+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81cc5e0a-82b0-4aea-9998-7228074e5aad 2024-05-24T02:00:10.778228545Z [2024-05-24T02:00:10.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T01:55:00+00:00, map_index=0, run_start_date=2024-05-24 02:00:09.053708+00:00, run_end_date=2024-05-24 02:00:10.343121+00:00, run_duration=1.289413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:07.292972+00:00, queued_by_job_id=1, pid=13436 2024-05-24T02:00:13.500075341Z [2024-05-24T02:00:13.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:00:13.500412685Z [2024-05-24T02:00:13.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 01:55:00+00:00, run_id=scheduled__2024-05-24T01:55:00+00:00, run_start_date=2024-05-24 02:00:00.440443+00:00, run_end_date=2024-05-24 02:00:13.499862+00:00, run_duration=13.059419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 01:55:00+00:00, data_interval_end=2024-05-24 02:00:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:00:13.506210141Z [2024-05-24T02:00:13.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:00:00+00:00, run_after=2024-05-24T02:05:00+00:00 2024-05-24T02:00:13.535002073Z [2024-05-24T02:00:13.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T01:55:00+00:00 exited with status success for try_number 1 2024-05-24T02:00:13.542533264Z [2024-05-24T02:00:13.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T01:55:00+00:00, map_index=-1, run_start_date=2024-05-24 02:00:12.401084+00:00, run_end_date=2024-05-24 02:00:12.819834+00:00, run_duration=0.41875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:00:10.718042+00:00, queued_by_job_id=1, pid=13449 2024-05-24T02:01:00.961998051Z [2024-05-24T02:01:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:01:00+00:00, run_after=2024-05-24T02:02:00+00:00 2024-05-24T02:01:00.980066171Z [2024-05-24T02:01:00.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:01:00+00:00, run_after=2024-05-24T02:02:00+00:00 2024-05-24T02:01:00.986467395Z [2024-05-24T02:01:00.986+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:01:01.068223895Z [2024-05-24T02:01:01.067+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:01:01.068281734Z 2024-05-24T02:01:01.068314203Z 2024-05-24T02:01:01.068324355Z 2024-05-24T02:01:01.069013732Z [2024-05-24T02:01:01.068+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:01:01.069789639Z [2024-05-24T02:01:01.069+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:01:01.070380616Z [2024-05-24T02:01:01.070+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:01:01.072317782Z [2024-05-24T02:01:01.071+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:01:01.072346355Z 2024-05-24T02:01:01.072355194Z 2024-05-24T02:01:01.072363765Z 2024-05-24T02:01:01.078408233Z [2024-05-24T02:01:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:01:01.079072326Z [2024-05-24T02:01:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:01:01.079660388Z [2024-05-24T02:01:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:01:01.080022410Z [2024-05-24T02:01:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:01:01.080632650Z [2024-05-24T02:01:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:01:01.081041857Z [2024-05-24T02:01:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:01:01.348398639Z [2024-05-24T02:01:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:01:01.348578968Z [2024-05-24T02:01:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:01:01.348708120Z [2024-05-24T02:01:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:01:01.357829085Z [2024-05-24T02:01:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 585f0306-a318-4529-8b7a-18fab2e9e48b 2024-05-24T02:01:01.357967156Z [2024-05-24T02:01:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ad5b82c-892a-498c-bb2b-d291850bfb2f 2024-05-24T02:01:01.358132755Z [2024-05-24T02:01:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b43fbc7-d96f-49d8-bf01-a3db4809fddc 2024-05-24T02:01:03.327875021Z [2024-05-24T02:01:03.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:01:03.328250284Z [2024-05-24T02:01:03.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:00:00+00:00, run_id=scheduled__2024-05-24T02:00:00+00:00, run_start_date=2024-05-24 02:01:01.008651+00:00, run_end_date=2024-05-24 02:01:03.327799+00:00, run_duration=2.319148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:00:00+00:00, data_interval_end=2024-05-24 02:01:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:01:03.337365185Z [2024-05-24T02:01:03.337+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:01:00+00:00, run_after=2024-05-24T02:02:00+00:00 2024-05-24T02:01:03.392448170Z [2024-05-24T02:01:03.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:01:03.399458704Z [2024-05-24T02:01:03.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=-1, run_start_date=2024-05-24 02:01:01.978991+00:00, run_end_date=2024-05-24 02:01:02.382054+00:00, run_duration=0.403063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:01:01.073919+00:00, queued_by_job_id=1, pid=13471 2024-05-24T02:01:05.306052538Z [2024-05-24T02:01:05.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:01:05.306675970Z [2024-05-24T02:01:05.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:00:00+00:00, run_id=scheduled__2024-05-24T02:00:00+00:00, run_start_date=2024-05-24 02:01:01.011709+00:00, run_end_date=2024-05-24 02:01:05.305928+00:00, run_duration=4.294219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:00:00+00:00, data_interval_end=2024-05-24 02:01:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:01:05.321950429Z [2024-05-24T02:01:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:01:00+00:00, run_after=2024-05-24T02:02:00+00:00 2024-05-24T02:01:05.332499824Z [2024-05-24T02:01:05.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:01:05.332947099Z [2024-05-24T02:01:05.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:00:00+00:00, run_id=scheduled__2024-05-24T02:00:00+00:00, run_start_date=2024-05-24 02:01:01.010183+00:00, run_end_date=2024-05-24 02:01:05.332378+00:00, run_duration=4.322195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:00:00+00:00, data_interval_end=2024-05-24 02:01:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:01:05.353379321Z [2024-05-24T02:01:05.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:01:00+00:00, run_after=2024-05-24T02:02:00+00:00 2024-05-24T02:01:05.403163171Z [2024-05-24T02:01:05.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:01:05.403469186Z [2024-05-24T02:01:05.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:01:05.415744416Z [2024-05-24T02:01:05.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=-1, run_start_date=2024-05-24 02:01:03.262374+00:00, run_end_date=2024-05-24 02:01:04.628254+00:00, run_duration=1.36588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:01:01.073919+00:00, queued_by_job_id=1, pid=13490 2024-05-24T02:01:05.416142096Z [2024-05-24T02:01:05.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=-1, run_start_date=2024-05-24 02:01:03.040001+00:00, run_end_date=2024-05-24 02:01:04.898737+00:00, run_duration=1.858736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:01:01.073919+00:00, queued_by_job_id=1, pid=13484 2024-05-24T02:01:42.031330824Z [2024-05-24T02:01:42.030+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:02:00.174427656Z [2024-05-24T02:02:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:02:00+00:00, run_after=2024-05-24T02:03:00+00:00 2024-05-24T02:02:00.186124038Z [2024-05-24T02:02:00.185+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:02:00.198148344Z [2024-05-24T02:02:00.197+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:02:00.230995935Z [2024-05-24T02:02:00.230+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:02:00+00:00, run_after=2024-05-24T02:03:00+00:00 2024-05-24T02:02:00.371471086Z [2024-05-24T02:02:00.370+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:02:00.371548882Z 2024-05-24T02:02:00.371558954Z 2024-05-24T02:02:00.371567203Z 2024-05-24T02:02:00.371575094Z 2024-05-24T02:02:00.372054406Z [2024-05-24T02:02:00.371+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:02:00.372511188Z [2024-05-24T02:02:00.372+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:02:00.372852383Z [2024-05-24T02:02:00.372+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:02:00.373151275Z [2024-05-24T02:02:00.372+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:02:00.374249439Z [2024-05-24T02:02:00.373+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:02:00.374264258Z 2024-05-24T02:02:00.374269812Z 2024-05-24T02:02:00.374274513Z 2024-05-24T02:02:00.374279192Z 2024-05-24T02:02:00.390560537Z [2024-05-24T02:02:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:02:00.390581301Z [2024-05-24T02:02:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:02:00.390587193Z [2024-05-24T02:02:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:02:00.390610173Z [2024-05-24T02:02:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:02:00.390649675Z [2024-05-24T02:02:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:02:00.390652773Z [2024-05-24T02:02:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:02:00.390655791Z [2024-05-24T02:02:00.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:02:00.390706009Z [2024-05-24T02:02:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:02:00.871803579Z [2024-05-24T02:02:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:02:00.871833607Z [2024-05-24T02:02:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:01:00+00:00 exited with status queued for try_number 1 2024-05-24T02:02:00.871912358Z [2024-05-24T02:02:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:01:00+00:00 exited with status queued for try_number 1 2024-05-24T02:02:00.871982650Z [2024-05-24T02:02:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:01:00+00:00 exited with status queued for try_number 1 2024-05-24T02:02:00.895947593Z [2024-05-24T02:02:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82fe1011-02fd-49ad-9c86-f076d914c81f 2024-05-24T02:02:00.895976272Z [2024-05-24T02:02:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to eed3a324-873d-48bd-bb91-e74de84b3067 2024-05-24T02:02:00.896090117Z [2024-05-24T02:02:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f9e30e4-e428-4998-8c0c-1d8284f06ecd 2024-05-24T02:02:00.896159857Z [2024-05-24T02:02:00.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4644c333-3422-49f4-babe-eda0762323ed 2024-05-24T02:02:02.110850560Z [2024-05-24T02:02:02.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:02:02.111228788Z [2024-05-24T02:02:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:00:00+00:00, run_id=scheduled__2024-05-24T02:00:00+00:00, run_start_date=2024-05-24 02:02:00.247144+00:00, run_end_date=2024-05-24 02:02:02.110875+00:00, run_duration=1.863731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:00:00+00:00, data_interval_end=2024-05-24 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:02:02.119096620Z [2024-05-24T02:02:02.118+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:02:00+00:00, run_after=2024-05-24T02:04:00+00:00 2024-05-24T02:02:02.125328888Z [2024-05-24T02:02:02.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:02:02.125626448Z [2024-05-24T02:02:02.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:01:00+00:00, run_id=scheduled__2024-05-24T02:01:00+00:00, run_start_date=2024-05-24 02:02:00.254671+00:00, run_end_date=2024-05-24 02:02:02.125355+00:00, run_duration=1.870684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:01:00+00:00, data_interval_end=2024-05-24 02:02:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:02:02.137517918Z [2024-05-24T02:02:02.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:02:00+00:00, run_after=2024-05-24T02:03:00+00:00 2024-05-24T02:02:02.179912083Z [2024-05-24T02:02:02.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:02:02.180202280Z [2024-05-24T02:02:02.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:01:00+00:00 exited with status success for try_number 1 2024-05-24T02:02:02.186987768Z [2024-05-24T02:02:02.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:01:00+00:00, map_index=-1, run_start_date=2024-05-24 02:02:01.309131+00:00, run_end_date=2024-05-24 02:02:01.801184+00:00, run_duration=0.492053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:02:00.375651+00:00, queued_by_job_id=1, pid=13524 2024-05-24T02:02:02.187392610Z [2024-05-24T02:02:02.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=-1, run_start_date=2024-05-24 02:02:01.350622+00:00, run_end_date=2024-05-24 02:02:01.728944+00:00, run_duration=0.378322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:02:00.375651+00:00, queued_by_job_id=1, pid=13525 2024-05-24T02:02:04.326981324Z [2024-05-24T02:02:04.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:02:04.327257682Z [2024-05-24T02:02:04.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:01:00+00:00, run_id=scheduled__2024-05-24T02:01:00+00:00, run_start_date=2024-05-24 02:02:00.258340+00:00, run_end_date=2024-05-24 02:02:04.326855+00:00, run_duration=4.068515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:01:00+00:00, data_interval_end=2024-05-24 02:02:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:02:04.343559004Z [2024-05-24T02:02:04.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:02:00+00:00, run_after=2024-05-24T02:03:00+00:00 2024-05-24T02:02:05.444390593Z [2024-05-24T02:02:05.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:02:05.444767367Z [2024-05-24T02:02:05.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:01:00+00:00, run_id=scheduled__2024-05-24T02:01:00+00:00, run_start_date=2024-05-24 02:02:00.262847+00:00, run_end_date=2024-05-24 02:02:05.444283+00:00, run_duration=5.181436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:01:00+00:00, data_interval_end=2024-05-24 02:02:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:02:05.455943496Z [2024-05-24T02:02:05.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:02:00+00:00, run_after=2024-05-24T02:03:00+00:00 2024-05-24T02:02:05.500947174Z [2024-05-24T02:02:05.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:01:00+00:00 exited with status success for try_number 1 2024-05-24T02:02:05.501132099Z [2024-05-24T02:02:05.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:01:00+00:00 exited with status success for try_number 1 2024-05-24T02:02:05.508472631Z [2024-05-24T02:02:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:01:00+00:00, map_index=-1, run_start_date=2024-05-24 02:02:02.470442+00:00, run_end_date=2024-05-24 02:02:04.270596+00:00, run_duration=1.800154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:02:00.375651+00:00, queued_by_job_id=1, pid=13549 2024-05-24T02:02:05.508608549Z [2024-05-24T02:02:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:01:00+00:00, map_index=-1, run_start_date=2024-05-24 02:02:02.415119+00:00, run_end_date=2024-05-24 02:02:05.315890+00:00, run_duration=2.900771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:02:00.375651+00:00, queued_by_job_id=1, pid=13548 2024-05-24T02:03:00.176915073Z [2024-05-24T02:03:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:03:00+00:00, run_after=2024-05-24T02:04:00+00:00 2024-05-24T02:03:00.183216197Z [2024-05-24T02:03:00.182+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:03:00.193643738Z [2024-05-24T02:03:00.193+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:03:00+00:00, run_after=2024-05-24T02:04:00+00:00 2024-05-24T02:03:00.291210124Z [2024-05-24T02:03:00.290+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:03:00.291241446Z 2024-05-24T02:03:00.291246339Z 2024-05-24T02:03:00.291250291Z 2024-05-24T02:03:00.291254337Z [2024-05-24T02:03:00.291+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:03:00.291290119Z [2024-05-24T02:03:00.291+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:03:00.291373383Z [2024-05-24T02:03:00.291+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:03:00.291958855Z [2024-05-24T02:03:00.291+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:03:00.291966466Z 2024-05-24T02:03:00.291970664Z 2024-05-24T02:03:00.291974704Z 2024-05-24T02:03:00.295170179Z [2024-05-24T02:03:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:03:00.295196328Z [2024-05-24T02:03:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:03:00.295418252Z [2024-05-24T02:03:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:03:00.295494597Z [2024-05-24T02:03:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:03:00.295674905Z [2024-05-24T02:03:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:03:00.295719502Z [2024-05-24T02:03:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:03:00.632854383Z [2024-05-24T02:03:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status queued for try_number 1 2024-05-24T02:03:00.632884645Z [2024-05-24T02:03:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status queued for try_number 1 2024-05-24T02:03:00.633033568Z [2024-05-24T02:03:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status queued for try_number 1 2024-05-24T02:03:00.646022286Z [2024-05-24T02:03:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to fda0f477-a7b3-48de-814b-aee1e91828a8 2024-05-24T02:03:00.646236028Z [2024-05-24T02:03:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0524416-5578-47aa-ac6b-e6c649e0ffc4 2024-05-24T02:03:00.646494166Z [2024-05-24T02:03:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to df986409-d1d4-4ea7-a104-16bd07d5c0f7 2024-05-24T02:03:02.337787756Z [2024-05-24T02:03:02.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:03:02.341255821Z [2024-05-24T02:03:02.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:02:00+00:00, run_id=scheduled__2024-05-24T02:02:00+00:00, run_start_date=2024-05-24 02:03:00.212039+00:00, run_end_date=2024-05-24 02:03:02.337903+00:00, run_duration=2.125864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:02:00+00:00, data_interval_end=2024-05-24 02:03:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:03:02.349979820Z [2024-05-24T02:03:02.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:03:00+00:00, run_after=2024-05-24T02:04:00+00:00 2024-05-24T02:03:02.405440911Z [2024-05-24T02:03:02.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status success for try_number 1 2024-05-24T02:03:02.415612470Z [2024-05-24T02:03:02.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:02:00+00:00, map_index=-1, run_start_date=2024-05-24 02:03:01.161149+00:00, run_end_date=2024-05-24 02:03:01.532248+00:00, run_duration=0.371099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:03:00.292542+00:00, queued_by_job_id=1, pid=13582 2024-05-24T02:03:03.482902799Z [2024-05-24T02:03:03.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:03:03.483515820Z [2024-05-24T02:03:03.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:02:00+00:00, run_id=scheduled__2024-05-24T02:02:00+00:00, run_start_date=2024-05-24 02:03:00.213569+00:00, run_end_date=2024-05-24 02:03:03.482859+00:00, run_duration=3.26929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:02:00+00:00, data_interval_end=2024-05-24 02:03:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:03:03.497411041Z [2024-05-24T02:03:03.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:03:00+00:00, run_after=2024-05-24T02:04:00+00:00 2024-05-24T02:03:04.224232474Z [2024-05-24T02:03:04.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status success for try_number 1 2024-05-24T02:03:04.231049374Z [2024-05-24T02:03:04.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:02:00+00:00, map_index=-1, run_start_date=2024-05-24 02:03:02.066974+00:00, run_end_date=2024-05-24 02:03:03.386276+00:00, run_duration=1.319302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:03:00.292542+00:00, queued_by_job_id=1, pid=13600 2024-05-24T02:03:05.288247776Z [2024-05-24T02:03:05.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:03:05.288333084Z [2024-05-24T02:03:05.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:02:00+00:00, run_id=scheduled__2024-05-24T02:02:00+00:00, run_start_date=2024-05-24 02:03:00.215441+00:00, run_end_date=2024-05-24 02:03:05.287968+00:00, run_duration=5.072527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:02:00+00:00, data_interval_end=2024-05-24 02:03:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:03:05.297768995Z [2024-05-24T02:03:05.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:03:00+00:00, run_after=2024-05-24T02:04:00+00:00 2024-05-24T02:03:05.340328041Z [2024-05-24T02:03:05.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status success for try_number 1 2024-05-24T02:03:05.348119808Z [2024-05-24T02:03:05.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:02:00+00:00, map_index=-1, run_start_date=2024-05-24 02:03:02.118218+00:00, run_end_date=2024-05-24 02:03:05.107880+00:00, run_duration=2.989662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:03:00.292542+00:00, queued_by_job_id=1, pid=13601 2024-05-24T02:04:01.041965254Z [2024-05-24T02:04:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:04:00+00:00, run_after=2024-05-24T02:05:00+00:00 2024-05-24T02:04:01.052055792Z [2024-05-24T02:04:01.051+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:04:01.060598953Z [2024-05-24T02:04:01.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:04:01.073372022Z [2024-05-24T02:04:01.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:04:00+00:00, run_after=2024-05-24T02:05:00+00:00 2024-05-24T02:04:01.173273959Z [2024-05-24T02:04:01.172+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:04:01.173304848Z 2024-05-24T02:04:01.173318194Z 2024-05-24T02:04:01.173322948Z 2024-05-24T02:04:01.173327459Z 2024-05-24T02:04:01.173563034Z [2024-05-24T02:04:01.173+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:04:01.173935332Z [2024-05-24T02:04:01.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:04:01.174306120Z [2024-05-24T02:04:01.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:04:01.174597129Z [2024-05-24T02:04:01.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:04:01.175718349Z [2024-05-24T02:04:01.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:04:01.175748017Z 2024-05-24T02:04:01.175755215Z 2024-05-24T02:04:01.175761108Z 2024-05-24T02:04:01.175767389Z 2024-05-24T02:04:01.182712195Z [2024-05-24T02:04:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:04:01.183159983Z [2024-05-24T02:04:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:04:01.183725906Z [2024-05-24T02:04:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:04:01.184107118Z [2024-05-24T02:04:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:04:01.184492515Z [2024-05-24T02:04:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:04:01.184802886Z [2024-05-24T02:04:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:04:01.185309996Z [2024-05-24T02:04:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:04:01.185636723Z [2024-05-24T02:04:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:04:01.654096739Z [2024-05-24T02:04:01.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status queued for try_number 1 2024-05-24T02:04:01.654451126Z [2024-05-24T02:04:01.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:03:00+00:00 exited with status queued for try_number 1 2024-05-24T02:04:01.655244065Z [2024-05-24T02:04:01.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:03:00+00:00 exited with status queued for try_number 1 2024-05-24T02:04:01.655466129Z [2024-05-24T02:04:01.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:03:00+00:00 exited with status queued for try_number 1 2024-05-24T02:04:01.674404596Z [2024-05-24T02:04:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f38bb3b-56e7-4dec-8ce1-6a9984aae313 2024-05-24T02:04:01.674947088Z [2024-05-24T02:04:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54667a24-ce9b-4bbc-9e05-1812f9a597d7 2024-05-24T02:04:01.675140776Z [2024-05-24T02:04:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2aa0dd27-b56f-46d3-a307-01900859d064 2024-05-24T02:04:01.675902952Z [2024-05-24T02:04:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to e77c7efc-e84f-4576-aadb-46b1325c53d9 2024-05-24T02:04:02.960065252Z [2024-05-24T02:04:02.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:04:02.960300052Z [2024-05-24T02:04:02.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:02:00+00:00, run_id=scheduled__2024-05-24T02:02:00+00:00, run_start_date=2024-05-24 02:04:01.089483+00:00, run_end_date=2024-05-24 02:04:02.959936+00:00, run_duration=1.870453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:02:00+00:00, data_interval_end=2024-05-24 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:04:02.969071479Z [2024-05-24T02:04:02.968+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:04:00+00:00, run_after=2024-05-24T02:06:00+00:00 2024-05-24T02:04:02.977534894Z [2024-05-24T02:04:02.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:04:02.977666591Z [2024-05-24T02:04:02.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:03:00+00:00, run_id=scheduled__2024-05-24T02:03:00+00:00, run_start_date=2024-05-24 02:04:01.091012+00:00, run_end_date=2024-05-24 02:04:02.977392+00:00, run_duration=1.88638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:03:00+00:00, data_interval_end=2024-05-24 02:04:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:04:03.005137439Z [2024-05-24T02:04:03.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:04:00+00:00, run_after=2024-05-24T02:05:00+00:00 2024-05-24T02:04:03.120798289Z [2024-05-24T02:04:03.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:02:00+00:00 exited with status success for try_number 1 2024-05-24T02:04:03.123501752Z [2024-05-24T02:04:03.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:03:00+00:00 exited with status success for try_number 1 2024-05-24T02:04:03.130474128Z [2024-05-24T02:04:03.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:02:00+00:00, map_index=-1, run_start_date=2024-05-24 02:04:01.943110+00:00, run_end_date=2024-05-24 02:04:02.267031+00:00, run_duration=0.323921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:04:01.177325+00:00, queued_by_job_id=1, pid=13634 2024-05-24T02:04:03.130948207Z [2024-05-24T02:04:03.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:03:00+00:00, map_index=-1, run_start_date=2024-05-24 02:04:02.036550+00:00, run_end_date=2024-05-24 02:04:02.478826+00:00, run_duration=0.442276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:04:01.177325+00:00, queued_by_job_id=1, pid=13635 2024-05-24T02:04:05.042583672Z [2024-05-24T02:04:05.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:04:05.042922460Z [2024-05-24T02:04:05.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:03:00+00:00, run_id=scheduled__2024-05-24T02:03:00+00:00, run_start_date=2024-05-24 02:04:01.093291+00:00, run_end_date=2024-05-24 02:04:05.042248+00:00, run_duration=3.948957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:03:00+00:00, data_interval_end=2024-05-24 02:04:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:04:05.053443599Z [2024-05-24T02:04:05.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:04:00+00:00, run_after=2024-05-24T02:05:00+00:00 2024-05-24T02:04:05.061587725Z [2024-05-24T02:04:05.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:04:05.061921774Z [2024-05-24T02:04:05.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:03:00+00:00, run_id=scheduled__2024-05-24T02:03:00+00:00, run_start_date=2024-05-24 02:04:01.092161+00:00, run_end_date=2024-05-24 02:04:05.061477+00:00, run_duration=3.969316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:03:00+00:00, data_interval_end=2024-05-24 02:04:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:04:05.071520424Z [2024-05-24T02:04:05.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:04:00+00:00, run_after=2024-05-24T02:05:00+00:00 2024-05-24T02:04:05.123631692Z [2024-05-24T02:04:05.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:03:00+00:00 exited with status success for try_number 1 2024-05-24T02:04:05.123672855Z [2024-05-24T02:04:05.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:03:00+00:00 exited with status success for try_number 1 2024-05-24T02:04:05.133187389Z [2024-05-24T02:04:05.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:03:00+00:00, map_index=-1, run_start_date=2024-05-24 02:04:03.285743+00:00, run_end_date=2024-05-24 02:04:04.651805+00:00, run_duration=1.366062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:04:01.177325+00:00, queued_by_job_id=1, pid=13659 2024-05-24T02:04:05.133298953Z [2024-05-24T02:04:05.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:03:00+00:00, map_index=-1, run_start_date=2024-05-24 02:04:03.148976+00:00, run_end_date=2024-05-24 02:04:04.790238+00:00, run_duration=1.641262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:04:01.177325+00:00, queued_by_job_id=1, pid=13658 2024-05-24T02:05:00.256324450Z [2024-05-24T02:05:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:05:00+00:00, run_after=2024-05-24T02:06:00+00:00 2024-05-24T02:05:00.270456039Z [2024-05-24T02:05:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:05:00+00:00, run_after=2024-05-24T02:06:00+00:00 2024-05-24T02:05:00.277729128Z [2024-05-24T02:05:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:05:00.289475052Z [2024-05-24T02:05:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:05:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:05:00.381448590Z [2024-05-24T02:05:00.381+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:05:00.381488465Z 2024-05-24T02:05:00.381492589Z 2024-05-24T02:05:00.381495799Z 2024-05-24T02:05:00.381499014Z 2024-05-24T02:05:00.381780949Z [2024-05-24T02:05:00.381+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:05:00.382033586Z [2024-05-24T02:05:00.381+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:05:00.382208256Z [2024-05-24T02:05:00.382+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:05:00.382343229Z [2024-05-24T02:05:00.382+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:05:00.382976160Z [2024-05-24T02:05:00.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:05:00.383029392Z 2024-05-24T02:05:00.383037569Z 2024-05-24T02:05:00.383043563Z 2024-05-24T02:05:00.383070278Z 2024-05-24T02:05:00.395260499Z [2024-05-24T02:05:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:05:00.395573391Z [2024-05-24T02:05:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:05:00.395982120Z [2024-05-24T02:05:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:05:00.396214627Z [2024-05-24T02:05:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:05:00.396594706Z [2024-05-24T02:05:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:05:00.396842948Z [2024-05-24T02:05:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:05:00.397280874Z [2024-05-24T02:05:00.397+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:05:00.397529252Z [2024-05-24T02:05:00.397+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:05:01.003610850Z [2024-05-24T02:05:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:05:01.003843373Z [2024-05-24T02:05:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status queued for try_number 1 2024-05-24T02:05:01.004936536Z [2024-05-24T02:05:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status queued for try_number 1 2024-05-24T02:05:01.005114682Z [2024-05-24T02:05:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status queued for try_number 1 2024-05-24T02:05:01.040039170Z [2024-05-24T02:05:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aade2ef-3aad-4bd7-9fd3-4d89c0dc28c0 2024-05-24T02:05:01.040569487Z [2024-05-24T02:05:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7377aa2b-b694-4ac1-9f49-33391043e249 2024-05-24T02:05:01.040863402Z [2024-05-24T02:05:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to 642eac3a-7f52-40ac-bea0-f6cac35351e1 2024-05-24T02:05:01.041109596Z [2024-05-24T02:05:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c23f297-e3ad-4265-9bad-d29284e79bb3 2024-05-24T02:05:01.961881417Z [2024-05-24T02:05:01.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:05:01.962445758Z [2024-05-24T02:05:01.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:04:00+00:00, run_id=scheduled__2024-05-24T02:04:00+00:00, run_start_date=2024-05-24 02:05:00.300500+00:00, run_end_date=2024-05-24 02:05:01.962029+00:00, run_duration=1.661529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:04:00+00:00, data_interval_end=2024-05-24 02:05:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:05:01.971821885Z [2024-05-24T02:05:01.971+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:05:00+00:00, run_after=2024-05-24T02:06:00+00:00 2024-05-24T02:05:02.047387984Z [2024-05-24T02:05:02.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status success for try_number 1 2024-05-24T02:05:02.060270093Z [2024-05-24T02:05:02.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:04:00+00:00, map_index=-1, run_start_date=2024-05-24 02:05:01.341456+00:00, run_end_date=2024-05-24 02:05:01.839118+00:00, run_duration=0.497662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:05:00.383746+00:00, queued_by_job_id=1, pid=13692 2024-05-24T02:05:04.325616148Z [2024-05-24T02:05:04.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:05:04.326366473Z [2024-05-24T02:05:04.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:04:00+00:00, run_id=scheduled__2024-05-24T02:04:00+00:00, run_start_date=2024-05-24 02:05:00.301451+00:00, run_end_date=2024-05-24 02:05:04.325706+00:00, run_duration=4.024255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:04:00+00:00, data_interval_end=2024-05-24 02:05:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:05:04.344354952Z [2024-05-24T02:05:04.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:05:00+00:00, run_after=2024-05-24T02:06:00+00:00 2024-05-24T02:05:04.387335938Z [2024-05-24T02:05:04.386+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:05:04.387369119Z 2024-05-24T02:05:04.387514799Z [2024-05-24T02:05:04.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:05:04.388233164Z [2024-05-24T02:05:04.387+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:05:04.388248018Z 2024-05-24T02:05:04.391248075Z [2024-05-24T02:05:04.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:05:04.391475911Z [2024-05-24T02:05:04.391+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:05:04.453243569Z [2024-05-24T02:05:04.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:05:04.453855464Z [2024-05-24T02:05:04.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:05:04.454336864Z [2024-05-24T02:05:04.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status success for try_number 1 2024-05-24T02:05:04.471912280Z [2024-05-24T02:05:04.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e111bc6-6562-4db7-85e6-812a07100350 2024-05-24T02:05:04.472395226Z [2024-05-24T02:05:04.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:04:00+00:00, map_index=-1, run_start_date=2024-05-24 02:05:02.722662+00:00, run_end_date=2024-05-24 02:05:04.132438+00:00, run_duration=1.409776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:05:00.383746+00:00, queued_by_job_id=1, pid=13712 2024-05-24T02:05:04.472952047Z [2024-05-24T02:05:04.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=-1, run_start_date=2024-05-24 02:05:03.128021+00:00, run_end_date=2024-05-24 02:05:03.595586+00:00, run_duration=0.467565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:05:00.383746+00:00, queued_by_job_id=1, pid=13723 2024-05-24T02:05:05.624439008Z [2024-05-24T02:05:05.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:05:05.624839932Z [2024-05-24T02:05:05.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:04:00+00:00, run_id=scheduled__2024-05-24T02:04:00+00:00, run_start_date=2024-05-24 02:05:00.302477+00:00, run_end_date=2024-05-24 02:05:05.624205+00:00, run_duration=5.321728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:04:00+00:00, data_interval_end=2024-05-24 02:05:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:05:05.635980909Z [2024-05-24T02:05:05.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:05:00+00:00, run_after=2024-05-24T02:06:00+00:00 2024-05-24T02:05:05.708812218Z [2024-05-24T02:05:05.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status success for try_number 1 2024-05-24T02:05:05.717639794Z [2024-05-24T02:05:05.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:04:00+00:00, map_index=-1, run_start_date=2024-05-24 02:05:02.480231+00:00, run_end_date=2024-05-24 02:05:04.505204+00:00, run_duration=2.024973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:05:00.383746+00:00, queued_by_job_id=1, pid=13710 2024-05-24T02:05:07.173856936Z [2024-05-24T02:05:07.173+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:05:07.173895280Z 2024-05-24T02:05:07.174169090Z [2024-05-24T02:05:07.173+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:05:07.175227226Z [2024-05-24T02:05:07.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:05:07.175239042Z 2024-05-24T02:05:07.178369266Z [2024-05-24T02:05:07.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:05:07.178639592Z [2024-05-24T02:05:07.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:05:07.271703080Z [2024-05-24T02:05:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:05:07.271969634Z [2024-05-24T02:05:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:05:07.279579549Z [2024-05-24T02:05:07.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67bd4535-353f-4782-ae42-f8746ef28d87 2024-05-24T02:05:07.279864729Z [2024-05-24T02:05:07.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=-1, run_start_date=2024-05-24 02:05:06.071574+00:00, run_end_date=2024-05-24 02:05:06.526933+00:00, run_duration=0.455359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:05:04.388663+00:00, queued_by_job_id=1, pid=13741 2024-05-24T02:05:10.684417863Z [2024-05-24T02:05:10.684+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:05:10.684445348Z 2024-05-24T02:05:10.684578062Z [2024-05-24T02:05:10.684+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:05:10.685519751Z [2024-05-24T02:05:10.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:05:10.685532448Z 2024-05-24T02:05:10.688153675Z [2024-05-24T02:05:10.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:05:10.688345632Z [2024-05-24T02:05:10.688+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:05:10.742418032Z [2024-05-24T02:05:10.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status queued for try_number 1 2024-05-24T02:05:10.742684029Z [2024-05-24T02:05:10.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:05:10.751326400Z [2024-05-24T02:05:10.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf090491-556b-4286-94ae-005de517bb40 2024-05-24T02:05:10.751660102Z [2024-05-24T02:05:10.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=0, run_start_date=2024-05-24 02:05:08.771915+00:00, run_end_date=2024-05-24 02:05:10.171243+00:00, run_duration=1.399328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:05:07.175742+00:00, queued_by_job_id=1, pid=13749 2024-05-24T02:05:13.536164814Z [2024-05-24T02:05:13.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:05:13.536835150Z [2024-05-24T02:05:13.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:00:00+00:00, run_id=scheduled__2024-05-24T02:00:00+00:00, run_start_date=2024-05-24 02:05:00.299365+00:00, run_end_date=2024-05-24 02:05:13.536443+00:00, run_duration=13.237078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:00:00+00:00, data_interval_end=2024-05-24 02:05:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:05:13.544124749Z [2024-05-24T02:05:13.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:05:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:05:13.578802703Z [2024-05-24T02:05:13.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:00:00+00:00 exited with status success for try_number 1 2024-05-24T02:05:13.584872830Z [2024-05-24T02:05:13.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:00:00+00:00, map_index=-1, run_start_date=2024-05-24 02:05:12.470359+00:00, run_end_date=2024-05-24 02:05:12.979582+00:00, run_duration=0.509223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:05:10.686005+00:00, queued_by_job_id=1, pid=13762 2024-05-24T02:06:00.875793073Z [2024-05-24T02:06:00.875+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:06:00.898182416Z [2024-05-24T02:06:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:06:00+00:00, run_after=2024-05-24T02:07:00+00:00 2024-05-24T02:06:00.913249312Z [2024-05-24T02:06:00.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:06:00+00:00, run_after=2024-05-24T02:07:00+00:00 2024-05-24T02:06:00.925308171Z [2024-05-24T02:06:00.924+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:06:01.014730746Z [2024-05-24T02:06:01.003+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:06:01.014763384Z 2024-05-24T02:06:01.014778125Z 2024-05-24T02:06:01.014785114Z 2024-05-24T02:06:01.014791653Z 2024-05-24T02:06:01.014801049Z [2024-05-24T02:06:01.003+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:06:01.014826616Z [2024-05-24T02:06:01.003+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:06:01.014833946Z [2024-05-24T02:06:01.003+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:06:01.014840542Z [2024-05-24T02:06:01.004+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:06:01.014847076Z [2024-05-24T02:06:01.004+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:06:01.014853616Z 2024-05-24T02:06:01.014860046Z 2024-05-24T02:06:01.014866486Z 2024-05-24T02:06:01.014872871Z 2024-05-24T02:06:01.014881796Z [2024-05-24T02:06:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:06:01.014890597Z [2024-05-24T02:06:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:06:01.014899291Z [2024-05-24T02:06:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:06:01.014905968Z [2024-05-24T02:06:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:06:01.014912401Z [2024-05-24T02:06:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:06:01.014918802Z [2024-05-24T02:06:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:06:01.014925205Z [2024-05-24T02:06:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:06:01.014936820Z [2024-05-24T02:06:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:06:01.595806968Z [2024-05-24T02:06:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status queued for try_number 1 2024-05-24T02:06:01.595914767Z [2024-05-24T02:06:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status queued for try_number 1 2024-05-24T02:06:01.595923092Z [2024-05-24T02:06:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status queued for try_number 1 2024-05-24T02:06:01.595928562Z [2024-05-24T02:06:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status queued for try_number 1 2024-05-24T02:06:01.611136477Z [2024-05-24T02:06:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae8cc6a4-5fc9-4f53-bae1-70159ab33bc8 2024-05-24T02:06:01.611220370Z [2024-05-24T02:06:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c52cb13-ea6e-4819-a383-542dc5b7065f 2024-05-24T02:06:01.611338573Z [2024-05-24T02:06:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4b71e37-22b8-4517-bc2d-9998b33c3a3e 2024-05-24T02:06:01.611436966Z [2024-05-24T02:06:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cf0c9f0-852a-49a4-b144-47c626c2366a 2024-05-24T02:06:03.435904412Z [2024-05-24T02:06:03.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:06:03.436124565Z [2024-05-24T02:06:03.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:04:00+00:00, run_id=scheduled__2024-05-24T02:04:00+00:00, run_start_date=2024-05-24 02:06:00.937850+00:00, run_end_date=2024-05-24 02:06:03.435822+00:00, run_duration=2.497972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:04:00+00:00, data_interval_end=2024-05-24 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:06:03.443754214Z [2024-05-24T02:06:03.443+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:06:00+00:00, run_after=2024-05-24T02:08:00+00:00 2024-05-24T02:06:03.456478905Z [2024-05-24T02:06:03.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:06:03.456621430Z [2024-05-24T02:06:03.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:05:00+00:00, run_id=scheduled__2024-05-24T02:05:00+00:00, run_start_date=2024-05-24 02:06:00.939245+00:00, run_end_date=2024-05-24 02:06:03.456394+00:00, run_duration=2.517149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:05:00+00:00, data_interval_end=2024-05-24 02:06:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:06:03.466841582Z [2024-05-24T02:06:03.466+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:06:00+00:00, run_after=2024-05-24T02:07:00+00:00 2024-05-24T02:06:03.526651649Z [2024-05-24T02:06:03.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:04:00+00:00 exited with status success for try_number 1 2024-05-24T02:06:03.526854762Z [2024-05-24T02:06:03.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status success for try_number 1 2024-05-24T02:06:03.534776915Z [2024-05-24T02:06:03.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:04:00+00:00, map_index=-1, run_start_date=2024-05-24 02:06:01.835919+00:00, run_end_date=2024-05-24 02:06:02.289900+00:00, run_duration=0.453981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:06:01.005920+00:00, queued_by_job_id=1, pid=13785 2024-05-24T02:06:03.534931932Z [2024-05-24T02:06:03.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:05:00+00:00, map_index=-1, run_start_date=2024-05-24 02:06:01.998054+00:00, run_end_date=2024-05-24 02:06:02.371521+00:00, run_duration=0.373467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:06:01.005920+00:00, queued_by_job_id=1, pid=13786 2024-05-24T02:06:05.683897810Z [2024-05-24T02:06:05.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:06:05.684137025Z [2024-05-24T02:06:05.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:05:00+00:00, run_id=scheduled__2024-05-24T02:05:00+00:00, run_start_date=2024-05-24 02:06:00.940411+00:00, run_end_date=2024-05-24 02:06:05.683579+00:00, run_duration=4.743168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:05:00+00:00, data_interval_end=2024-05-24 02:06:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:06:05.694014508Z [2024-05-24T02:06:05.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:06:00+00:00, run_after=2024-05-24T02:07:00+00:00 2024-05-24T02:06:05.703060805Z [2024-05-24T02:06:05.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:06:05.703510002Z [2024-05-24T02:06:05.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:05:00+00:00, run_id=scheduled__2024-05-24T02:05:00+00:00, run_start_date=2024-05-24 02:06:00.941557+00:00, run_end_date=2024-05-24 02:06:05.702972+00:00, run_duration=4.761415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:05:00+00:00, data_interval_end=2024-05-24 02:06:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:06:05.714108936Z [2024-05-24T02:06:05.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:06:00+00:00, run_after=2024-05-24T02:07:00+00:00 2024-05-24T02:06:05.756513234Z [2024-05-24T02:06:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status success for try_number 1 2024-05-24T02:06:05.756545228Z [2024-05-24T02:06:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status success for try_number 1 2024-05-24T02:06:05.762640927Z [2024-05-24T02:06:05.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:05:00+00:00, map_index=-1, run_start_date=2024-05-24 02:06:03.414528+00:00, run_end_date=2024-05-24 02:06:05.017665+00:00, run_duration=1.603137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:06:01.005920+00:00, queued_by_job_id=1, pid=13810 2024-05-24T02:06:05.762962239Z [2024-05-24T02:06:05.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:05:00+00:00, map_index=-1, run_start_date=2024-05-24 02:06:03.284563+00:00, run_end_date=2024-05-24 02:06:04.485867+00:00, run_duration=1.201304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:06:01.005920+00:00, queued_by_job_id=1, pid=13809 2024-05-24T02:06:42.123597041Z [2024-05-24T02:06:42.122+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:07:00.359137294Z [2024-05-24T02:07:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:07:00+00:00, run_after=2024-05-24T02:08:00+00:00 2024-05-24T02:07:00.366084613Z [2024-05-24T02:07:00.365+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:07:00.378094276Z [2024-05-24T02:07:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:07:00+00:00, run_after=2024-05-24T02:08:00+00:00 2024-05-24T02:07:00.483515054Z [2024-05-24T02:07:00.480+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:07:00.483538489Z 2024-05-24T02:07:00.483542341Z 2024-05-24T02:07:00.483545500Z 2024-05-24T02:07:00.483548681Z [2024-05-24T02:07:00.480+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:07:00.483551849Z [2024-05-24T02:07:00.480+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:07:00.483570632Z [2024-05-24T02:07:00.480+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:07:00.483574896Z [2024-05-24T02:07:00.481+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:07:00.483577926Z 2024-05-24T02:07:00.483580941Z 2024-05-24T02:07:00.483584072Z 2024-05-24T02:07:00.493511039Z [2024-05-24T02:07:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:07:00.493534744Z [2024-05-24T02:07:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:07:00.493539384Z [2024-05-24T02:07:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:07:00.493543612Z [2024-05-24T02:07:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:07:00.493548057Z [2024-05-24T02:07:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:07:00.493554640Z [2024-05-24T02:07:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:07:00.739615965Z [2024-05-24T02:07:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status queued for try_number 1 2024-05-24T02:07:00.739842692Z [2024-05-24T02:07:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status queued for try_number 1 2024-05-24T02:07:00.740075098Z [2024-05-24T02:07:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status queued for try_number 1 2024-05-24T02:07:00.751235468Z [2024-05-24T02:07:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff1c3195-6534-401a-819c-c94c5e0b0772 2024-05-24T02:07:00.751382747Z [2024-05-24T02:07:00.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37f11fe0-af62-4628-8de4-d017a4c399db 2024-05-24T02:07:00.751544297Z [2024-05-24T02:07:00.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6794905e-f54a-48a0-a219-2ef26af9b70d 2024-05-24T02:07:01.914951499Z [2024-05-24T02:07:01.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:07:01.915251394Z [2024-05-24T02:07:01.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:06:00+00:00, run_id=scheduled__2024-05-24T02:06:00+00:00, run_start_date=2024-05-24 02:07:00.389190+00:00, run_end_date=2024-05-24 02:07:01.914809+00:00, run_duration=1.525619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:06:00+00:00, data_interval_end=2024-05-24 02:07:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:07:01.925070262Z [2024-05-24T02:07:01.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:07:00+00:00, run_after=2024-05-24T02:08:00+00:00 2024-05-24T02:07:01.987365053Z [2024-05-24T02:07:01.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status success for try_number 1 2024-05-24T02:07:01.996549602Z [2024-05-24T02:07:01.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:06:00+00:00, map_index=-1, run_start_date=2024-05-24 02:07:01.371054+00:00, run_end_date=2024-05-24 02:07:01.769967+00:00, run_duration=0.398913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:07:00.482191+00:00, queued_by_job_id=1, pid=13841 2024-05-24T02:07:04.476878662Z [2024-05-24T02:07:04.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:07:04.477355393Z [2024-05-24T02:07:04.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:06:00+00:00, run_id=scheduled__2024-05-24T02:06:00+00:00, run_start_date=2024-05-24 02:07:00.390481+00:00, run_end_date=2024-05-24 02:07:04.476570+00:00, run_duration=4.086089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:06:00+00:00, data_interval_end=2024-05-24 02:07:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:07:04.488078144Z [2024-05-24T02:07:04.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:07:00+00:00, run_after=2024-05-24T02:08:00+00:00 2024-05-24T02:07:04.527332558Z [2024-05-24T02:07:04.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:07:04.527777514Z [2024-05-24T02:07:04.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:06:00+00:00, run_id=scheduled__2024-05-24T02:06:00+00:00, run_start_date=2024-05-24 02:07:00.391555+00:00, run_end_date=2024-05-24 02:07:04.527198+00:00, run_duration=4.135643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:06:00+00:00, data_interval_end=2024-05-24 02:07:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:07:04.537218388Z [2024-05-24T02:07:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:07:00+00:00, run_after=2024-05-24T02:08:00+00:00 2024-05-24T02:07:04.578828660Z [2024-05-24T02:07:04.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status success for try_number 1 2024-05-24T02:07:04.579113435Z [2024-05-24T02:07:04.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status success for try_number 1 2024-05-24T02:07:04.591159344Z [2024-05-24T02:07:04.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:06:00+00:00, map_index=-1, run_start_date=2024-05-24 02:07:02.364458+00:00, run_end_date=2024-05-24 02:07:04.084071+00:00, run_duration=1.719613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:07:00.482191+00:00, queued_by_job_id=1, pid=13859 2024-05-24T02:07:04.591893074Z [2024-05-24T02:07:04.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:06:00+00:00, map_index=-1, run_start_date=2024-05-24 02:07:02.387835+00:00, run_end_date=2024-05-24 02:07:03.763914+00:00, run_duration=1.376079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:07:00.482191+00:00, queued_by_job_id=1, pid=13860 2024-05-24T02:08:00.393354142Z [2024-05-24T02:08:00.392+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:08:00.400088297Z [2024-05-24T02:08:00.399+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:08:00.414518675Z [2024-05-24T02:08:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:08:00+00:00, run_after=2024-05-24T02:09:00+00:00 2024-05-24T02:08:00.432622042Z [2024-05-24T02:08:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:08:00+00:00, run_after=2024-05-24T02:09:00+00:00 2024-05-24T02:08:00.539735314Z [2024-05-24T02:08:00.539+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:08:00.539796288Z 2024-05-24T02:08:00.539812710Z 2024-05-24T02:08:00.539821370Z 2024-05-24T02:08:00.539829695Z 2024-05-24T02:08:00.540040392Z [2024-05-24T02:08:00.539+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:08:00.540726750Z [2024-05-24T02:08:00.540+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:08:00.540754793Z [2024-05-24T02:08:00.540+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:08:00.540822326Z [2024-05-24T02:08:00.540+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:08:00.541891968Z [2024-05-24T02:08:00.541+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:08:00.541912212Z 2024-05-24T02:08:00.541916473Z 2024-05-24T02:08:00.541919877Z 2024-05-24T02:08:00.541923134Z 2024-05-24T02:08:00.548865942Z [2024-05-24T02:08:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:08:00.549199306Z [2024-05-24T02:08:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:08:00.549616379Z [2024-05-24T02:08:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:08:00.549866836Z [2024-05-24T02:08:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:08:00.550331836Z [2024-05-24T02:08:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:08:00.550576747Z [2024-05-24T02:08:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:08:00.551438891Z [2024-05-24T02:08:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:08:00.551448740Z [2024-05-24T02:08:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:08:00.827997015Z [2024-05-24T02:08:00.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status queued for try_number 1 2024-05-24T02:08:00.830773214Z [2024-05-24T02:08:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:07:00+00:00 exited with status queued for try_number 1 2024-05-24T02:08:00.830794737Z [2024-05-24T02:08:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:07:00+00:00 exited with status queued for try_number 1 2024-05-24T02:08:00.830897774Z [2024-05-24T02:08:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:07:00+00:00 exited with status queued for try_number 1 2024-05-24T02:08:00.844700451Z [2024-05-24T02:08:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to e52dacc2-e16a-4e69-97db-08b4c90dace8 2024-05-24T02:08:00.845126189Z [2024-05-24T02:08:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cf7749e-57d4-49ea-99b9-898a2054a1d3 2024-05-24T02:08:00.845363550Z [2024-05-24T02:08:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d336860-ea5d-4693-bae3-684ca7dba0b4 2024-05-24T02:08:00.845574032Z [2024-05-24T02:08:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8d5dd5d-0445-4004-a55d-266d277d5d77 2024-05-24T02:08:02.090383666Z [2024-05-24T02:08:02.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:08:02.090699532Z [2024-05-24T02:08:02.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:06:00+00:00, run_id=scheduled__2024-05-24T02:06:00+00:00, run_start_date=2024-05-24 02:08:00.445587+00:00, run_end_date=2024-05-24 02:08:02.090258+00:00, run_duration=1.644671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:06:00+00:00, data_interval_end=2024-05-24 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:08:02.098345244Z [2024-05-24T02:08:02.098+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:08:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:08:02.112384108Z [2024-05-24T02:08:02.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:08:02.112648627Z [2024-05-24T02:08:02.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:07:00+00:00, run_id=scheduled__2024-05-24T02:07:00+00:00, run_start_date=2024-05-24 02:08:00.446899+00:00, run_end_date=2024-05-24 02:08:02.112354+00:00, run_duration=1.665455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:07:00+00:00, data_interval_end=2024-05-24 02:08:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:08:02.122303980Z [2024-05-24T02:08:02.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:08:00+00:00, run_after=2024-05-24T02:09:00+00:00 2024-05-24T02:08:02.180207508Z [2024-05-24T02:08:02.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:06:00+00:00 exited with status success for try_number 1 2024-05-24T02:08:02.191490796Z [2024-05-24T02:08:02.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:06:00+00:00, map_index=-1, run_start_date=2024-05-24 02:08:01.425741+00:00, run_end_date=2024-05-24 02:08:01.776152+00:00, run_duration=0.350411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:08:00.543464+00:00, queued_by_job_id=1, pid=13893 2024-05-24T02:08:03.037569163Z [2024-05-24T02:08:03.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:07:00+00:00 exited with status success for try_number 1 2024-05-24T02:08:03.042959235Z [2024-05-24T02:08:03.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:07:00+00:00, map_index=-1, run_start_date=2024-05-24 02:08:01.578380+00:00, run_end_date=2024-05-24 02:08:02.057683+00:00, run_duration=0.479303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:08:00.543464+00:00, queued_by_job_id=1, pid=13894 2024-05-24T02:08:04.400987900Z [2024-05-24T02:08:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:08:04.401252496Z [2024-05-24T02:08:04.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:07:00+00:00, run_id=scheduled__2024-05-24T02:07:00+00:00, run_start_date=2024-05-24 02:08:00.448113+00:00, run_end_date=2024-05-24 02:08:04.400883+00:00, run_duration=3.95277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:07:00+00:00, data_interval_end=2024-05-24 02:08:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:08:04.413593303Z [2024-05-24T02:08:04.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:08:00+00:00, run_after=2024-05-24T02:09:00+00:00 2024-05-24T02:08:04.426282073Z [2024-05-24T02:08:04.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:08:04.426894082Z [2024-05-24T02:08:04.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:07:00+00:00, run_id=scheduled__2024-05-24T02:07:00+00:00, run_start_date=2024-05-24 02:08:00.449229+00:00, run_end_date=2024-05-24 02:08:04.426370+00:00, run_duration=3.977141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:07:00+00:00, data_interval_end=2024-05-24 02:08:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:08:04.443524127Z [2024-05-24T02:08:04.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:08:00+00:00, run_after=2024-05-24T02:09:00+00:00 2024-05-24T02:08:05.615891444Z [2024-05-24T02:08:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:07:00+00:00 exited with status success for try_number 1 2024-05-24T02:08:05.615935922Z [2024-05-24T02:08:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:07:00+00:00 exited with status success for try_number 1 2024-05-24T02:08:05.623840018Z [2024-05-24T02:08:05.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:07:00+00:00, map_index=-1, run_start_date=2024-05-24 02:08:02.664963+00:00, run_end_date=2024-05-24 02:08:04.318546+00:00, run_duration=1.653583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:08:00.543464+00:00, queued_by_job_id=1, pid=13918 2024-05-24T02:08:05.624022307Z [2024-05-24T02:08:05.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:07:00+00:00, map_index=-1, run_start_date=2024-05-24 02:08:02.562956+00:00, run_end_date=2024-05-24 02:08:04.288499+00:00, run_duration=1.725543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:08:00.543464+00:00, queued_by_job_id=1, pid=13917 2024-05-24T02:09:00.060327174Z [2024-05-24T02:09:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:09:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:09:00.077354956Z [2024-05-24T02:09:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:09:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:09:00.086404259Z [2024-05-24T02:09:00.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:09:00.165194256Z [2024-05-24T02:09:00.164+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:09:00.165221733Z 2024-05-24T02:09:00.165238109Z 2024-05-24T02:09:00.165241191Z 2024-05-24T02:09:00.165885086Z [2024-05-24T02:09:00.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:09:00.166531786Z [2024-05-24T02:09:00.166+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:09:00.166999117Z [2024-05-24T02:09:00.166+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:09:00.168802299Z [2024-05-24T02:09:00.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:09:00.168816495Z 2024-05-24T02:09:00.168820819Z 2024-05-24T02:09:00.168824281Z 2024-05-24T02:09:00.176317007Z [2024-05-24T02:09:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:09:00.176531334Z [2024-05-24T02:09:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:09:00.176955766Z [2024-05-24T02:09:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:09:00.177231280Z [2024-05-24T02:09:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:09:00.177650820Z [2024-05-24T02:09:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:09:00.177879741Z [2024-05-24T02:09:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:09:00.518707339Z [2024-05-24T02:09:00.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status queued for try_number 1 2024-05-24T02:09:00.520246519Z [2024-05-24T02:09:00.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status queued for try_number 1 2024-05-24T02:09:00.520259465Z [2024-05-24T02:09:00.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status queued for try_number 1 2024-05-24T02:09:00.542672900Z [2024-05-24T02:09:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07460cda-29cb-4a6e-b351-38d002946dcd 2024-05-24T02:09:00.542693090Z [2024-05-24T02:09:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to af2a7ad5-bd9b-46dd-9328-fc3c8403fe7c 2024-05-24T02:09:00.542696876Z [2024-05-24T02:09:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4a9d084-ce2f-45ed-a478-0580e9c697ae 2024-05-24T02:09:01.711850948Z [2024-05-24T02:09:01.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:09:01.712262393Z [2024-05-24T02:09:01.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:08:00+00:00, run_id=scheduled__2024-05-24T02:08:00+00:00, run_start_date=2024-05-24 02:09:00.103224+00:00, run_end_date=2024-05-24 02:09:01.711909+00:00, run_duration=1.608685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:08:00+00:00, data_interval_end=2024-05-24 02:09:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:09:01.721489394Z [2024-05-24T02:09:01.721+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:09:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:09:01.775254472Z [2024-05-24T02:09:01.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status success for try_number 1 2024-05-24T02:09:01.780788621Z [2024-05-24T02:09:01.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:08:00+00:00, map_index=-1, run_start_date=2024-05-24 02:09:01.143433+00:00, run_end_date=2024-05-24 02:09:01.508600+00:00, run_duration=0.365167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:09:00.171065+00:00, queued_by_job_id=1, pid=13950 2024-05-24T02:09:03.350989219Z [2024-05-24T02:09:03.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:09:03.351191343Z [2024-05-24T02:09:03.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:08:00+00:00, run_id=scheduled__2024-05-24T02:08:00+00:00, run_start_date=2024-05-24 02:09:00.106139+00:00, run_end_date=2024-05-24 02:09:03.350816+00:00, run_duration=3.244677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:08:00+00:00, data_interval_end=2024-05-24 02:09:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:09:03.364213493Z [2024-05-24T02:09:03.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:09:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:09:04.497670176Z [2024-05-24T02:09:04.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:09:04.498474641Z [2024-05-24T02:09:04.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:08:00+00:00, run_id=scheduled__2024-05-24T02:08:00+00:00, run_start_date=2024-05-24 02:09:00.111512+00:00, run_end_date=2024-05-24 02:09:04.497773+00:00, run_duration=4.386261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:08:00+00:00, data_interval_end=2024-05-24 02:09:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:09:04.515167155Z [2024-05-24T02:09:04.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:09:00+00:00, run_after=2024-05-24T02:10:00+00:00 2024-05-24T02:09:04.550083839Z [2024-05-24T02:09:04.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status success for try_number 1 2024-05-24T02:09:04.550122885Z [2024-05-24T02:09:04.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status success for try_number 1 2024-05-24T02:09:04.556837466Z [2024-05-24T02:09:04.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:08:00+00:00, map_index=-1, run_start_date=2024-05-24 02:09:02.025360+00:00, run_end_date=2024-05-24 02:09:03.276999+00:00, run_duration=1.251639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:09:00.171065+00:00, queued_by_job_id=1, pid=13969 2024-05-24T02:09:04.557569746Z [2024-05-24T02:09:04.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:08:00+00:00, map_index=-1, run_start_date=2024-05-24 02:09:01.975823+00:00, run_end_date=2024-05-24 02:09:03.558783+00:00, run_duration=1.58296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:09:00.171065+00:00, queued_by_job_id=1, pid=13968 2024-05-24T02:10:00.543032241Z [2024-05-24T02:10:00.542+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:11:00+00:00 2024-05-24T02:10:00.553577586Z [2024-05-24T02:10:00.553+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:10:00.575159589Z [2024-05-24T02:10:00.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:11:00+00:00 2024-05-24T02:10:00.580482874Z [2024-05-24T02:10:00.580+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:10:00.593564016Z [2024-05-24T02:10:00.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:15:00+00:00 2024-05-24T02:10:00.732691424Z [2024-05-24T02:10:00.732+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T02:10:00.732746248Z 2024-05-24T02:10:00.732756783Z 2024-05-24T02:10:00.732766858Z 2024-05-24T02:10:00.732775299Z 2024-05-24T02:10:00.732783654Z 2024-05-24T02:10:00.732837081Z [2024-05-24T02:10:00.732+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:10:00.733141987Z [2024-05-24T02:10:00.732+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:10:00.733558050Z [2024-05-24T02:10:00.733+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:10:00.733878062Z [2024-05-24T02:10:00.733+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:10:00.734210257Z [2024-05-24T02:10:00.733+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:10:00.736178625Z [2024-05-24T02:10:00.735+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:10:00.736228207Z 2024-05-24T02:10:00.736240030Z 2024-05-24T02:10:00.736249634Z 2024-05-24T02:10:00.736258189Z 2024-05-24T02:10:00.736266827Z 2024-05-24T02:10:00.743577808Z [2024-05-24T02:10:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:10:00.743833279Z [2024-05-24T02:10:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:10:00.744261872Z [2024-05-24T02:10:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:10:00.744467101Z [2024-05-24T02:10:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:10:00.744883425Z [2024-05-24T02:10:00.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:10:00.745264642Z [2024-05-24T02:10:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:10:00.745692431Z [2024-05-24T02:10:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:10:00.745920474Z [2024-05-24T02:10:00.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:10:00.746301959Z [2024-05-24T02:10:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:10:00.746588005Z [2024-05-24T02:10:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:10:01.436019494Z [2024-05-24T02:10:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:01.436462174Z [2024-05-24T02:10:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:01.436753121Z [2024-05-24T02:10:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:09:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:01.436986626Z [2024-05-24T02:10:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:09:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:01.437223906Z [2024-05-24T02:10:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:09:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:01.460584667Z [2024-05-24T02:10:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e46bd83-7918-4bec-a51d-f4547ee62854 2024-05-24T02:10:01.460960167Z [2024-05-24T02:10:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5448b42-53af-415e-b10e-e585bf637ec0 2024-05-24T02:10:01.461308255Z [2024-05-24T02:10:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a52a63f-a80a-46bc-8aff-1210375f0f05 2024-05-24T02:10:01.461594718Z [2024-05-24T02:10:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36a4b576-21da-496d-ad50-4c498d22a2f9 2024-05-24T02:10:01.461871750Z [2024-05-24T02:10:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8bf32cc-0df5-4e07-9fb8-44c467919f9e 2024-05-24T02:10:02.852805770Z [2024-05-24T02:10:02.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:10:02.853216399Z [2024-05-24T02:10:02.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:08:00+00:00, run_id=scheduled__2024-05-24T02:08:00+00:00, run_start_date=2024-05-24 02:10:00.607713+00:00, run_end_date=2024-05-24 02:10:02.852756+00:00, run_duration=2.245043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:08:00+00:00, data_interval_end=2024-05-24 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:10:02.862151186Z [2024-05-24T02:10:02.861+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:12:00+00:00 2024-05-24T02:10:02.869433848Z [2024-05-24T02:10:02.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:10:02.869813719Z [2024-05-24T02:10:02.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:09:00+00:00, run_id=scheduled__2024-05-24T02:09:00+00:00, run_start_date=2024-05-24 02:10:00.608876+00:00, run_end_date=2024-05-24 02:10:02.869408+00:00, run_duration=2.260532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:09:00+00:00, data_interval_end=2024-05-24 02:10:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:10:02.886003669Z [2024-05-24T02:10:02.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:11:00+00:00 2024-05-24T02:10:02.962287477Z [2024-05-24T02:10:02.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:08:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:02.962559902Z [2024-05-24T02:10:02.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:09:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:02.971157035Z [2024-05-24T02:10:02.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:08:00+00:00, map_index=-1, run_start_date=2024-05-24 02:10:01.601642+00:00, run_end_date=2024-05-24 02:10:02.090542+00:00, run_duration=0.4889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:00.738130+00:00, queued_by_job_id=1, pid=13999 2024-05-24T02:10:02.971513603Z [2024-05-24T02:10:02.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:09:00+00:00, map_index=-1, run_start_date=2024-05-24 02:10:02.140651+00:00, run_end_date=2024-05-24 02:10:02.565706+00:00, run_duration=0.425055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:00.738130+00:00, queued_by_job_id=1, pid=14011 2024-05-24T02:10:04.857346474Z [2024-05-24T02:10:04.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:10:04.857672525Z [2024-05-24T02:10:04.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:09:00+00:00, run_id=scheduled__2024-05-24T02:09:00+00:00, run_start_date=2024-05-24 02:10:00.610292+00:00, run_end_date=2024-05-24 02:10:04.857204+00:00, run_duration=4.246912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:09:00+00:00, data_interval_end=2024-05-24 02:10:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:10:04.871871182Z [2024-05-24T02:10:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:11:00+00:00 2024-05-24T02:10:04.903740119Z [2024-05-24T02:10:04.903+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:10:04.903772463Z 2024-05-24T02:10:04.903789730Z [2024-05-24T02:10:04.903+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:10:04.904527127Z [2024-05-24T02:10:04.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:10:04.904546285Z 2024-05-24T02:10:04.907480166Z [2024-05-24T02:10:04.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:10:04.907825662Z [2024-05-24T02:10:04.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:10:04.971336337Z [2024-05-24T02:10:04.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:04.971546891Z [2024-05-24T02:10:04.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:04.971698115Z [2024-05-24T02:10:04.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:09:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:04.986081437Z [2024-05-24T02:10:04.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca2916fa-799b-4077-a351-fcf780f6cbfc 2024-05-24T02:10:04.986639683Z [2024-05-24T02:10:04.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:05:00+00:00, map_index=-1, run_start_date=2024-05-24 02:10:03.294668+00:00, run_end_date=2024-05-24 02:10:03.717841+00:00, run_duration=0.423173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:00.738130+00:00, queued_by_job_id=1, pid=14041 2024-05-24T02:10:04.987203849Z [2024-05-24T02:10:04.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:09:00+00:00, map_index=-1, run_start_date=2024-05-24 02:10:02.814352+00:00, run_end_date=2024-05-24 02:10:04.407322+00:00, run_duration=1.59297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:00.738130+00:00, queued_by_job_id=1, pid=14024 2024-05-24T02:10:06.155798701Z [2024-05-24T02:10:06.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:10:06.156484388Z [2024-05-24T02:10:06.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:09:00+00:00, run_id=scheduled__2024-05-24T02:09:00+00:00, run_start_date=2024-05-24 02:10:00.615070+00:00, run_end_date=2024-05-24 02:10:06.155679+00:00, run_duration=5.540609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:09:00+00:00, data_interval_end=2024-05-24 02:10:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:10:06.170494317Z [2024-05-24T02:10:06.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:11:00+00:00 2024-05-24T02:10:06.244936046Z [2024-05-24T02:10:06.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:09:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:06.250630702Z [2024-05-24T02:10:06.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:09:00+00:00, map_index=-1, run_start_date=2024-05-24 02:10:03.143156+00:00, run_end_date=2024-05-24 02:10:05.103085+00:00, run_duration=1.959929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:00.738130+00:00, queued_by_job_id=1, pid=14035 2024-05-24T02:10:07.944191251Z [2024-05-24T02:10:07.943+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:10:07.944236188Z 2024-05-24T02:10:07.944416515Z [2024-05-24T02:10:07.944+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:10:07.945361483Z [2024-05-24T02:10:07.945+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:10:07.945379969Z 2024-05-24T02:10:07.950089726Z [2024-05-24T02:10:07.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:10:07.950373378Z [2024-05-24T02:10:07.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:10:08.051375175Z [2024-05-24T02:10:08.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:08.051480823Z [2024-05-24T02:10:08.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:08.058104139Z [2024-05-24T02:10:08.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5079c9af-e084-464a-9a8a-5c0112a01691 2024-05-24T02:10:08.058289231Z [2024-05-24T02:10:08.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:05:00+00:00, map_index=-1, run_start_date=2024-05-24 02:10:06.590798+00:00, run_end_date=2024-05-24 02:10:07.027481+00:00, run_duration=0.436683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:04.904978+00:00, queued_by_job_id=1, pid=14059 2024-05-24T02:10:11.725446556Z [2024-05-24T02:10:11.724+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:10:11.725479581Z 2024-05-24T02:10:11.725747833Z [2024-05-24T02:10:11.725+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:10:11.727356455Z [2024-05-24T02:10:11.726+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:10:11.727371283Z 2024-05-24T02:10:11.731927133Z [2024-05-24T02:10:11.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:10:11.732364927Z [2024-05-24T02:10:11.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:10:11.810141417Z [2024-05-24T02:10:11.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status queued for try_number 1 2024-05-24T02:10:11.810611055Z [2024-05-24T02:10:11.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:11.818101533Z [2024-05-24T02:10:11.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e5a8e57-cefc-43b2-bc64-c0be3fa47250 2024-05-24T02:10:11.818450323Z [2024-05-24T02:10:11.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:05:00+00:00, map_index=0, run_start_date=2024-05-24 02:10:09.737218+00:00, run_end_date=2024-05-24 02:10:11.074665+00:00, run_duration=1.337447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:07.945992+00:00, queued_by_job_id=1, pid=14067 2024-05-24T02:10:14.105082736Z [2024-05-24T02:10:14.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:10:14.111403636Z [2024-05-24T02:10:14.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:05:00+00:00, run_id=scheduled__2024-05-24T02:05:00+00:00, run_start_date=2024-05-24 02:10:00.605961+00:00, run_end_date=2024-05-24 02:10:14.104744+00:00, run_duration=13.498783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:05:00+00:00, data_interval_end=2024-05-24 02:10:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:10:14.124883787Z [2024-05-24T02:10:14.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:10:00+00:00, run_after=2024-05-24T02:15:00+00:00 2024-05-24T02:10:14.182259420Z [2024-05-24T02:10:14.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:05:00+00:00 exited with status success for try_number 1 2024-05-24T02:10:14.198049109Z [2024-05-24T02:10:14.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:05:00+00:00, map_index=-1, run_start_date=2024-05-24 02:10:13.409954+00:00, run_end_date=2024-05-24 02:10:13.821894+00:00, run_duration=0.41194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:10:11.728270+00:00, queued_by_job_id=1, pid=14080 2024-05-24T02:11:00.958701303Z [2024-05-24T02:11:00.954+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:11:00.978243546Z [2024-05-24T02:11:00.977+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:11:00+00:00, run_after=2024-05-24T02:12:00+00:00 2024-05-24T02:11:01.001323685Z [2024-05-24T02:11:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:11:00+00:00, run_after=2024-05-24T02:12:00+00:00 2024-05-24T02:11:01.089734618Z [2024-05-24T02:11:01.089+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:11:01.089782812Z 2024-05-24T02:11:01.089793396Z 2024-05-24T02:11:01.089801847Z 2024-05-24T02:11:01.090007170Z [2024-05-24T02:11:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:11:01.090255252Z [2024-05-24T02:11:01.090+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:11:01.090461286Z [2024-05-24T02:11:01.090+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:11:01.091784015Z [2024-05-24T02:11:01.091+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:11:01.091802851Z 2024-05-24T02:11:01.091812026Z 2024-05-24T02:11:01.091820399Z 2024-05-24T02:11:01.097122743Z [2024-05-24T02:11:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:11:01.097686921Z [2024-05-24T02:11:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:11:01.098324794Z [2024-05-24T02:11:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:11:01.098669656Z [2024-05-24T02:11:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:11:01.100827682Z [2024-05-24T02:11:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:11:01.101098804Z [2024-05-24T02:11:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:11:01.389987934Z [2024-05-24T02:11:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:11:01.390239160Z [2024-05-24T02:11:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:11:01.390399759Z [2024-05-24T02:11:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:11:01.399834457Z [2024-05-24T02:11:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c88fca5-bfa0-411d-a88a-44f3859314a6 2024-05-24T02:11:01.400057059Z [2024-05-24T02:11:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3d8930e-99cd-49c3-90c0-0420ebb948f0 2024-05-24T02:11:01.400253526Z [2024-05-24T02:11:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to 434dc1b1-1529-48eb-b202-e1e27d90e45e 2024-05-24T02:11:02.569319392Z [2024-05-24T02:11:02.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:11:02.569384282Z [2024-05-24T02:11:02.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:10:00+00:00, run_id=scheduled__2024-05-24T02:10:00+00:00, run_start_date=2024-05-24 02:11:01.016028+00:00, run_end_date=2024-05-24 02:11:02.569013+00:00, run_duration=1.552985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:10:00+00:00, data_interval_end=2024-05-24 02:11:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:11:02.580227997Z [2024-05-24T02:11:02.579+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:11:00+00:00, run_after=2024-05-24T02:12:00+00:00 2024-05-24T02:11:02.635866638Z [2024-05-24T02:11:02.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:11:02.645812194Z [2024-05-24T02:11:02.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=-1, run_start_date=2024-05-24 02:11:01.954396+00:00, run_end_date=2024-05-24 02:11:02.343276+00:00, run_duration=0.38888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:11:01.092989+00:00, queued_by_job_id=1, pid=14101 2024-05-24T02:11:05.138320737Z [2024-05-24T02:11:05.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:11:05.138661076Z [2024-05-24T02:11:05.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:10:00+00:00, run_id=scheduled__2024-05-24T02:10:00+00:00, run_start_date=2024-05-24 02:11:01.018079+00:00, run_end_date=2024-05-24 02:11:05.138175+00:00, run_duration=4.120096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:10:00+00:00, data_interval_end=2024-05-24 02:11:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:11:05.148647283Z [2024-05-24T02:11:05.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:11:00+00:00, run_after=2024-05-24T02:12:00+00:00 2024-05-24T02:11:05.202324092Z [2024-05-24T02:11:05.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:11:05.209408037Z [2024-05-24T02:11:05.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=-1, run_start_date=2024-05-24 02:11:02.999065+00:00, run_end_date=2024-05-24 02:11:04.761412+00:00, run_duration=1.762347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:11:01.092989+00:00, queued_by_job_id=1, pid=14120 2024-05-24T02:11:06.263231014Z [2024-05-24T02:11:06.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:11:06.263709254Z [2024-05-24T02:11:06.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:10:00+00:00, run_id=scheduled__2024-05-24T02:10:00+00:00, run_start_date=2024-05-24 02:11:01.019905+00:00, run_end_date=2024-05-24 02:11:06.263189+00:00, run_duration=5.243284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:10:00+00:00, data_interval_end=2024-05-24 02:11:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:11:06.272303894Z [2024-05-24T02:11:06.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:11:00+00:00, run_after=2024-05-24T02:12:00+00:00 2024-05-24T02:11:06.313284757Z [2024-05-24T02:11:06.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:11:06.323791704Z [2024-05-24T02:11:06.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=-1, run_start_date=2024-05-24 02:11:02.978033+00:00, run_end_date=2024-05-24 02:11:06.085128+00:00, run_duration=3.107095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:11:01.092989+00:00, queued_by_job_id=1, pid=14119 2024-05-24T02:11:42.228238787Z [2024-05-24T02:11:42.227+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:12:00.333590934Z [2024-05-24T02:12:00.333+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:12:00+00:00, run_after=2024-05-24T02:13:00+00:00 2024-05-24T02:12:00.341308473Z [2024-05-24T02:12:00.340+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:12:00.347672022Z [2024-05-24T02:12:00.347+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:12:00.358864925Z [2024-05-24T02:12:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:12:00+00:00, run_after=2024-05-24T02:13:00+00:00 2024-05-24T02:12:00.442390656Z [2024-05-24T02:12:00.441+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:12:00.442408789Z 2024-05-24T02:12:00.442464604Z 2024-05-24T02:12:00.442468594Z 2024-05-24T02:12:00.442471739Z 2024-05-24T02:12:00.442694433Z [2024-05-24T02:12:00.442+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:12:00.442829862Z [2024-05-24T02:12:00.442+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:12:00.442933506Z [2024-05-24T02:12:00.442+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:12:00.443310416Z [2024-05-24T02:12:00.442+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:12:00.445719161Z [2024-05-24T02:12:00.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:12:00.445735231Z 2024-05-24T02:12:00.445740566Z 2024-05-24T02:12:00.445759208Z 2024-05-24T02:12:00.445763750Z 2024-05-24T02:12:00.451517283Z [2024-05-24T02:12:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:12:00.452006037Z [2024-05-24T02:12:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:12:00.452560922Z [2024-05-24T02:12:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:12:00.452780437Z [2024-05-24T02:12:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:12:00.453311034Z [2024-05-24T02:12:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:12:00.453535774Z [2024-05-24T02:12:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:12:00.454135544Z [2024-05-24T02:12:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:12:00.454413890Z [2024-05-24T02:12:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:12:01.135886475Z [2024-05-24T02:12:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:12:01.137363134Z [2024-05-24T02:12:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:11:00+00:00 exited with status queued for try_number 1 2024-05-24T02:12:01.137541519Z [2024-05-24T02:12:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:11:00+00:00 exited with status queued for try_number 1 2024-05-24T02:12:01.137670725Z [2024-05-24T02:12:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:11:00+00:00 exited with status queued for try_number 1 2024-05-24T02:12:01.154439603Z [2024-05-24T02:12:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to dee40f52-6104-4433-bf7c-ec1dd8703af7 2024-05-24T02:12:01.157507459Z [2024-05-24T02:12:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8849f47c-7428-4d1f-9349-f2d9094a7f88 2024-05-24T02:12:01.157648403Z [2024-05-24T02:12:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb8b377c-3222-445a-838e-1c4a8dee99ad 2024-05-24T02:12:01.157794944Z [2024-05-24T02:12:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to b92edf0e-37fa-4571-bc02-47781b75e187 2024-05-24T02:12:02.432215463Z [2024-05-24T02:12:02.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:12:02.432764254Z [2024-05-24T02:12:02.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:10:00+00:00, run_id=scheduled__2024-05-24T02:10:00+00:00, run_start_date=2024-05-24 02:12:00.369399+00:00, run_end_date=2024-05-24 02:12:02.432319+00:00, run_duration=2.06292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:10:00+00:00, data_interval_end=2024-05-24 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:12:02.447145031Z [2024-05-24T02:12:02.446+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:12:00+00:00, run_after=2024-05-24T02:14:00+00:00 2024-05-24T02:12:02.459835761Z [2024-05-24T02:12:02.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:12:02.461364405Z [2024-05-24T02:12:02.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:11:00+00:00, run_id=scheduled__2024-05-24T02:11:00+00:00, run_start_date=2024-05-24 02:12:00.370696+00:00, run_end_date=2024-05-24 02:12:02.459951+00:00, run_duration=2.089255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:11:00+00:00, data_interval_end=2024-05-24 02:12:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:12:02.474189293Z [2024-05-24T02:12:02.473+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:12:00+00:00, run_after=2024-05-24T02:13:00+00:00 2024-05-24T02:12:02.503553666Z [2024-05-24T02:12:02.503+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:12:02.503571822Z 2024-05-24T02:12:02.503806833Z [2024-05-24T02:12:02.503+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-24T02:12:02.504702694Z [2024-05-24T02:12:02.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:12:02.504725600Z 2024-05-24T02:12:02.507499500Z [2024-05-24T02:12:02.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240524021201_869807', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:12:02.507723190Z [2024-05-24T02:12:02.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240524021201_869807', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-24T02:12:02.571532673Z [2024-05-24T02:12:02.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240524021201_869807 exited with status queued for try_number 1 2024-05-24T02:12:02.571769242Z [2024-05-24T02:12:02.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:12:02.571945990Z [2024-05-24T02:12:02.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:11:00+00:00 exited with status success for try_number 1 2024-05-24T02:12:02.581997156Z [2024-05-24T02:12:02.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to e66db6e8-cdd1-492d-9c45-ad8e8cb30f57 2024-05-24T02:12:02.585917535Z [2024-05-24T02:12:02.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=-1, run_start_date=2024-05-24 02:12:01.250160+00:00, run_end_date=2024-05-24 02:12:01.657796+00:00, run_duration=0.407636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:12:00.446627+00:00, queued_by_job_id=1, pid=14153 2024-05-24T02:12:02.586261317Z [2024-05-24T02:12:02.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:11:00+00:00, map_index=-1, run_start_date=2024-05-24 02:12:01.511227+00:00, run_end_date=2024-05-24 02:12:01.955920+00:00, run_duration=0.444693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:12:00.446627+00:00, queued_by_job_id=1, pid=14154 2024-05-24T02:12:04.372370000Z [2024-05-24T02:12:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:12:04.372752836Z [2024-05-24T02:12:04.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-24 02:12:01.680275+00:00, run_id=scaleout_vdu_20240524021201_869807, run_start_date=2024-05-24 02:12:02.404283+00:00, run_end_date=2024-05-24 02:12:04.372133+00:00, run_duration=1.96785, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-24 02:12:01.680275+00:00, data_interval_end=2024-05-24 02:12:01.680275+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-24T02:12:04.378173291Z [2024-05-24T02:12:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-24T02:12:04.458909599Z [2024-05-24T02:12:04.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240524021201_869807 exited with status success for try_number 1 2024-05-24T02:12:04.466561713Z [2024-05-24T02:12:04.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240524021201_869807, map_index=-1, run_start_date=2024-05-24 02:12:03.376827+00:00, run_end_date=2024-05-24 02:12:03.886001+00:00, run_duration=0.509174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:12:02.505339+00:00, queued_by_job_id=1, pid=14190 2024-05-24T02:12:05.530484584Z [2024-05-24T02:12:05.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:12:05.530955337Z [2024-05-24T02:12:05.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:11:00+00:00, run_id=scheduled__2024-05-24T02:11:00+00:00, run_start_date=2024-05-24 02:12:00.372718+00:00, run_end_date=2024-05-24 02:12:05.530319+00:00, run_duration=5.157601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:11:00+00:00, data_interval_end=2024-05-24 02:12:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:12:05.542876411Z [2024-05-24T02:12:05.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:12:00+00:00, run_after=2024-05-24T02:13:00+00:00 2024-05-24T02:12:05.552585784Z [2024-05-24T02:12:05.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:12:05.552675232Z [2024-05-24T02:12:05.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:11:00+00:00, run_id=scheduled__2024-05-24T02:11:00+00:00, run_start_date=2024-05-24 02:12:00.371710+00:00, run_end_date=2024-05-24 02:12:05.552346+00:00, run_duration=5.180636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:11:00+00:00, data_interval_end=2024-05-24 02:12:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:12:05.562863266Z [2024-05-24T02:12:05.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:12:00+00:00, run_after=2024-05-24T02:13:00+00:00 2024-05-24T02:12:05.606362212Z [2024-05-24T02:12:05.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:11:00+00:00 exited with status success for try_number 1 2024-05-24T02:12:05.611615570Z [2024-05-24T02:12:05.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:11:00+00:00, map_index=-1, run_start_date=2024-05-24 02:12:02.611158+00:00, run_end_date=2024-05-24 02:12:04.555824+00:00, run_duration=1.944666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:12:00.446627+00:00, queued_by_job_id=1, pid=14178 2024-05-24T02:12:06.705118712Z [2024-05-24T02:12:06.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:11:00+00:00 exited with status success for try_number 1 2024-05-24T02:12:06.710023866Z [2024-05-24T02:12:06.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:11:00+00:00, map_index=-1, run_start_date=2024-05-24 02:12:02.776770+00:00, run_end_date=2024-05-24 02:12:05.497536+00:00, run_duration=2.720766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:12:00.446627+00:00, queued_by_job_id=1, pid=14179 2024-05-24T02:13:00.499690985Z [2024-05-24T02:13:00.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:13:00+00:00, run_after=2024-05-24T02:14:00+00:00 2024-05-24T02:13:00.509711147Z [2024-05-24T02:13:00.509+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:13:00.524040061Z [2024-05-24T02:13:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:13:00+00:00, run_after=2024-05-24T02:14:00+00:00 2024-05-24T02:13:00.621235936Z [2024-05-24T02:13:00.620+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:13:00.621260291Z 2024-05-24T02:13:00.621263884Z 2024-05-24T02:13:00.621267026Z 2024-05-24T02:13:00.621414478Z [2024-05-24T02:13:00.621+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:13:00.621616066Z [2024-05-24T02:13:00.621+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:13:00.621801366Z [2024-05-24T02:13:00.621+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:13:00.622627004Z [2024-05-24T02:13:00.622+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:13:00.622634766Z 2024-05-24T02:13:00.622637997Z 2024-05-24T02:13:00.622641195Z 2024-05-24T02:13:00.627500659Z [2024-05-24T02:13:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:13:00.627997387Z [2024-05-24T02:13:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:13:00.628496523Z [2024-05-24T02:13:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:13:00.628812768Z [2024-05-24T02:13:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:13:00.629512192Z [2024-05-24T02:13:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:13:00.629774985Z [2024-05-24T02:13:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:13:00.853460837Z [2024-05-24T02:13:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status queued for try_number 1 2024-05-24T02:13:00.853658090Z [2024-05-24T02:13:00.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status queued for try_number 1 2024-05-24T02:13:00.853858068Z [2024-05-24T02:13:00.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status queued for try_number 1 2024-05-24T02:13:00.865841048Z [2024-05-24T02:13:00.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73c93120-da58-49d6-b614-70df4d94218e 2024-05-24T02:13:00.866172109Z [2024-05-24T02:13:00.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d5eb6e2-f948-404f-ae85-45525de022de 2024-05-24T02:13:00.866402286Z [2024-05-24T02:13:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f6bad62-3e75-4294-bf73-d4cba8385297 2024-05-24T02:13:02.763320299Z [2024-05-24T02:13:02.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:13:02.763370679Z [2024-05-24T02:13:02.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:12:00+00:00, run_id=scheduled__2024-05-24T02:12:00+00:00, run_start_date=2024-05-24 02:13:00.541794+00:00, run_end_date=2024-05-24 02:13:02.754907+00:00, run_duration=2.213113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:12:00+00:00, data_interval_end=2024-05-24 02:13:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:13:02.765655384Z [2024-05-24T02:13:02.765+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:13:00+00:00, run_after=2024-05-24T02:14:00+00:00 2024-05-24T02:13:02.826315160Z [2024-05-24T02:13:02.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status success for try_number 1 2024-05-24T02:13:02.831694032Z [2024-05-24T02:13:02.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:12:00+00:00, map_index=-1, run_start_date=2024-05-24 02:13:01.437275+00:00, run_end_date=2024-05-24 02:13:01.781995+00:00, run_duration=0.34472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:13:00.624026+00:00, queued_by_job_id=1, pid=14218 2024-05-24T02:13:04.513603547Z [2024-05-24T02:13:04.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:13:04.514344105Z [2024-05-24T02:13:04.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:12:00+00:00, run_id=scheduled__2024-05-24T02:12:00+00:00, run_start_date=2024-05-24 02:13:00.543624+00:00, run_end_date=2024-05-24 02:13:04.513442+00:00, run_duration=3.969818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:12:00+00:00, data_interval_end=2024-05-24 02:13:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:13:04.533540039Z [2024-05-24T02:13:04.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:13:00+00:00, run_after=2024-05-24T02:14:00+00:00 2024-05-24T02:13:04.603324532Z [2024-05-24T02:13:04.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status success for try_number 1 2024-05-24T02:13:04.610915788Z [2024-05-24T02:13:04.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:12:00+00:00, map_index=-1, run_start_date=2024-05-24 02:13:02.379690+00:00, run_end_date=2024-05-24 02:13:04.143800+00:00, run_duration=1.76411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:13:00.624026+00:00, queued_by_job_id=1, pid=14236 2024-05-24T02:13:05.831566639Z [2024-05-24T02:13:05.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:13:05.831899281Z [2024-05-24T02:13:05.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:12:00+00:00, run_id=scheduled__2024-05-24T02:12:00+00:00, run_start_date=2024-05-24 02:13:00.544890+00:00, run_end_date=2024-05-24 02:13:05.831299+00:00, run_duration=5.286409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:12:00+00:00, data_interval_end=2024-05-24 02:13:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:13:05.845267735Z [2024-05-24T02:13:05.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:13:00+00:00, run_after=2024-05-24T02:14:00+00:00 2024-05-24T02:13:05.891198312Z [2024-05-24T02:13:05.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status success for try_number 1 2024-05-24T02:13:05.898305967Z [2024-05-24T02:13:05.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:12:00+00:00, map_index=-1, run_start_date=2024-05-24 02:13:02.470983+00:00, run_end_date=2024-05-24 02:13:05.140634+00:00, run_duration=2.669651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:13:00.624026+00:00, queued_by_job_id=1, pid=14237 2024-05-24T02:14:00.388301580Z [2024-05-24T02:14:00.387+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:14:00.406034106Z [2024-05-24T02:14:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:14:00+00:00, run_after=2024-05-24T02:15:00+00:00 2024-05-24T02:14:00.415153145Z [2024-05-24T02:14:00.414+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:14:00.433375509Z [2024-05-24T02:14:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:14:00+00:00, run_after=2024-05-24T02:15:00+00:00 2024-05-24T02:14:00.526595221Z [2024-05-24T02:14:00.523+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:14:00.526618619Z 2024-05-24T02:14:00.526623246Z 2024-05-24T02:14:00.526626392Z 2024-05-24T02:14:00.526629765Z 2024-05-24T02:14:00.526634073Z [2024-05-24T02:14:00.524+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:14:00.526637426Z [2024-05-24T02:14:00.524+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:14:00.526640399Z [2024-05-24T02:14:00.524+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:14:00.526643418Z [2024-05-24T02:14:00.524+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:14:00.526646404Z [2024-05-24T02:14:00.525+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:14:00.526649368Z 2024-05-24T02:14:00.526663545Z 2024-05-24T02:14:00.526666761Z 2024-05-24T02:14:00.526669655Z 2024-05-24T02:14:00.536085450Z [2024-05-24T02:14:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:14:00.536118795Z [2024-05-24T02:14:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:14:00.536288831Z [2024-05-24T02:14:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:14:00.536386410Z [2024-05-24T02:14:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:14:00.536691382Z [2024-05-24T02:14:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:14:00.536853512Z [2024-05-24T02:14:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:14:00.537138725Z [2024-05-24T02:14:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:14:00.537295561Z [2024-05-24T02:14:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:14:01.083058114Z [2024-05-24T02:14:01.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status queued for try_number 1 2024-05-24T02:14:01.083300311Z [2024-05-24T02:14:01.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:13:00+00:00 exited with status queued for try_number 1 2024-05-24T02:14:01.083489643Z [2024-05-24T02:14:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:13:00+00:00 exited with status queued for try_number 1 2024-05-24T02:14:01.083681739Z [2024-05-24T02:14:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:13:00+00:00 exited with status queued for try_number 1 2024-05-24T02:14:01.092783257Z [2024-05-24T02:14:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0476e64c-cf29-4d56-8e81-174dd370a9d0 2024-05-24T02:14:01.093071334Z [2024-05-24T02:14:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81df55b4-8eb7-47ee-a690-6bcafe80fa72 2024-05-24T02:14:01.093339289Z [2024-05-24T02:14:01.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94e347d2-e452-46c9-a115-8199820f2832 2024-05-24T02:14:01.093570551Z [2024-05-24T02:14:01.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53f4aeca-2368-440d-82d3-f1247b9c1274 2024-05-24T02:14:02.092870146Z [2024-05-24T02:14:02.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:14:02.093189670Z [2024-05-24T02:14:02.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:12:00+00:00, run_id=scheduled__2024-05-24T02:12:00+00:00, run_start_date=2024-05-24 02:14:00.447796+00:00, run_end_date=2024-05-24 02:14:02.092797+00:00, run_duration=1.645001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:12:00+00:00, data_interval_end=2024-05-24 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:14:02.102212933Z [2024-05-24T02:14:02.101+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:14:00+00:00, run_after=2024-05-24T02:16:00+00:00 2024-05-24T02:14:02.109129495Z [2024-05-24T02:14:02.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:14:02.109294013Z [2024-05-24T02:14:02.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:13:00+00:00, run_id=scheduled__2024-05-24T02:13:00+00:00, run_start_date=2024-05-24 02:14:00.450571+00:00, run_end_date=2024-05-24 02:14:02.109023+00:00, run_duration=1.658452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:13:00+00:00, data_interval_end=2024-05-24 02:14:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:14:02.120013612Z [2024-05-24T02:14:02.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:14:00+00:00, run_after=2024-05-24T02:15:00+00:00 2024-05-24T02:14:02.162859676Z [2024-05-24T02:14:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:12:00+00:00 exited with status success for try_number 1 2024-05-24T02:14:02.162895306Z [2024-05-24T02:14:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:13:00+00:00 exited with status success for try_number 1 2024-05-24T02:14:02.169252222Z [2024-05-24T02:14:02.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:12:00+00:00, map_index=-1, run_start_date=2024-05-24 02:14:01.315737+00:00, run_end_date=2024-05-24 02:14:01.624415+00:00, run_duration=0.308678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:14:00.527033+00:00, queued_by_job_id=1, pid=14270 2024-05-24T02:14:02.169372500Z [2024-05-24T02:14:02.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:13:00+00:00, map_index=-1, run_start_date=2024-05-24 02:14:01.463759+00:00, run_end_date=2024-05-24 02:14:01.880949+00:00, run_duration=0.41719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:14:00.527033+00:00, queued_by_job_id=1, pid=14271 2024-05-24T02:14:04.323875321Z [2024-05-24T02:14:04.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:14:04.324361628Z [2024-05-24T02:14:04.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:13:00+00:00, run_id=scheduled__2024-05-24T02:13:00+00:00, run_start_date=2024-05-24 02:14:00.451847+00:00, run_end_date=2024-05-24 02:14:04.323830+00:00, run_duration=3.871983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:13:00+00:00, data_interval_end=2024-05-24 02:14:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:14:04.336295635Z [2024-05-24T02:14:04.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:14:00+00:00, run_after=2024-05-24T02:15:00+00:00 2024-05-24T02:14:04.393463404Z [2024-05-24T02:14:04.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:13:00+00:00 exited with status success for try_number 1 2024-05-24T02:14:04.399272250Z [2024-05-24T02:14:04.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:13:00+00:00, map_index=-1, run_start_date=2024-05-24 02:14:02.618721+00:00, run_end_date=2024-05-24 02:14:03.964718+00:00, run_duration=1.345997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:14:00.527033+00:00, queued_by_job_id=1, pid=14295 2024-05-24T02:14:06.129588460Z [2024-05-24T02:14:06.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:14:06.130053941Z [2024-05-24T02:14:06.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:13:00+00:00, run_id=scheduled__2024-05-24T02:13:00+00:00, run_start_date=2024-05-24 02:14:00.453445+00:00, run_end_date=2024-05-24 02:14:06.129415+00:00, run_duration=5.67597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:13:00+00:00, data_interval_end=2024-05-24 02:14:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:14:06.140479816Z [2024-05-24T02:14:06.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:14:00+00:00, run_after=2024-05-24T02:15:00+00:00 2024-05-24T02:14:06.189975309Z [2024-05-24T02:14:06.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:13:00+00:00 exited with status success for try_number 1 2024-05-24T02:14:06.203347970Z [2024-05-24T02:14:06.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:13:00+00:00, map_index=-1, run_start_date=2024-05-24 02:14:02.556262+00:00, run_end_date=2024-05-24 02:14:05.185833+00:00, run_duration=2.629571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:14:00.527033+00:00, queued_by_job_id=1, pid=14294 2024-05-24T02:15:00.266914988Z [2024-05-24T02:15:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:15:00+00:00, run_after=2024-05-24T02:16:00+00:00 2024-05-24T02:15:00.284593525Z [2024-05-24T02:15:00.283+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:15:00.301515393Z [2024-05-24T02:15:00.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:15:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:15:00.322706122Z [2024-05-24T02:15:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:15:00+00:00, run_after=2024-05-24T02:16:00+00:00 2024-05-24T02:15:00.399709651Z [2024-05-24T02:15:00.399+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:15:00.399766680Z 2024-05-24T02:15:00.399778921Z 2024-05-24T02:15:00.399785332Z 2024-05-24T02:15:00.399790707Z 2024-05-24T02:15:00.399813239Z [2024-05-24T02:15:00.399+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:15:00.399841291Z [2024-05-24T02:15:00.399+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:15:00.399852379Z [2024-05-24T02:15:00.399+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:15:00.399898091Z [2024-05-24T02:15:00.399+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:15:00.400456935Z [2024-05-24T02:15:00.400+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:15:00.400483198Z 2024-05-24T02:15:00.400489409Z 2024-05-24T02:15:00.400492657Z 2024-05-24T02:15:00.400495818Z 2024-05-24T02:15:00.403990141Z [2024-05-24T02:15:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:15:00.404078894Z [2024-05-24T02:15:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:15:00.404253035Z [2024-05-24T02:15:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:15:00.404331900Z [2024-05-24T02:15:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:15:00.404592743Z [2024-05-24T02:15:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:15:00.404665017Z [2024-05-24T02:15:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:15:00.404884077Z [2024-05-24T02:15:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:15:00.404989473Z [2024-05-24T02:15:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:15:01.037796329Z [2024-05-24T02:15:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:15:01.037834977Z [2024-05-24T02:15:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status queued for try_number 1 2024-05-24T02:15:01.037878631Z [2024-05-24T02:15:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status queued for try_number 1 2024-05-24T02:15:01.037950533Z [2024-05-24T02:15:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status queued for try_number 1 2024-05-24T02:15:01.060204382Z [2024-05-24T02:15:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3574f39a-f3f8-46b4-8e31-352172cce226 2024-05-24T02:15:01.060233037Z [2024-05-24T02:15:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1a1976f-321b-4683-9442-6f00e17c904a 2024-05-24T02:15:01.060236476Z [2024-05-24T02:15:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5389075a-6e88-420c-850e-59a65262dfa1 2024-05-24T02:15:01.060245912Z [2024-05-24T02:15:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 694c9750-4087-43e8-b685-d5ca26cacd50 2024-05-24T02:15:02.632762669Z [2024-05-24T02:15:02.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:15:02.633393563Z [2024-05-24T02:15:02.633+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:14:00+00:00, run_id=scheduled__2024-05-24T02:14:00+00:00, run_start_date=2024-05-24 02:15:00.334665+00:00, run_end_date=2024-05-24 02:15:02.632836+00:00, run_duration=2.298171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:14:00+00:00, data_interval_end=2024-05-24 02:15:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:15:02.660606355Z [2024-05-24T02:15:02.660+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:15:00+00:00, run_after=2024-05-24T02:16:00+00:00 2024-05-24T02:15:02.842892141Z [2024-05-24T02:15:02.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status success for try_number 1 2024-05-24T02:15:02.849598125Z [2024-05-24T02:15:02.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:14:00+00:00, map_index=-1, run_start_date=2024-05-24 02:15:01.670174+00:00, run_end_date=2024-05-24 02:15:02.356693+00:00, run_duration=0.686519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:15:00.401229+00:00, queued_by_job_id=1, pid=14327 2024-05-24T02:15:03.956836329Z [2024-05-24T02:15:03.956+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:15:03.956917086Z 2024-05-24T02:15:03.957016552Z [2024-05-24T02:15:03.956+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:15:03.957944363Z [2024-05-24T02:15:03.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:15:03.957960959Z 2024-05-24T02:15:03.961789256Z [2024-05-24T02:15:03.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:15:03.962082039Z [2024-05-24T02:15:03.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:15:04.057053826Z [2024-05-24T02:15:04.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:15:04.057348811Z [2024-05-24T02:15:04.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:15:04.066017867Z [2024-05-24T02:15:04.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40b8a4e4-7027-4486-bdb7-953f89d9145b 2024-05-24T02:15:04.066248180Z [2024-05-24T02:15:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=-1, run_start_date=2024-05-24 02:15:02.822920+00:00, run_end_date=2024-05-24 02:15:03.205849+00:00, run_duration=0.382929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:15:00.401229+00:00, queued_by_job_id=1, pid=14341 2024-05-24T02:15:05.242594794Z [2024-05-24T02:15:05.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:15:05.243003272Z [2024-05-24T02:15:05.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:14:00+00:00, run_id=scheduled__2024-05-24T02:14:00+00:00, run_start_date=2024-05-24 02:15:00.335713+00:00, run_end_date=2024-05-24 02:15:05.242611+00:00, run_duration=4.906898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:14:00+00:00, data_interval_end=2024-05-24 02:15:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:15:05.252492711Z [2024-05-24T02:15:05.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:15:00+00:00, run_after=2024-05-24T02:16:00+00:00 2024-05-24T02:15:05.320276980Z [2024-05-24T02:15:05.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status success for try_number 1 2024-05-24T02:15:05.327396736Z [2024-05-24T02:15:05.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:14:00+00:00, map_index=-1, run_start_date=2024-05-24 02:15:03.147384+00:00, run_end_date=2024-05-24 02:15:04.346689+00:00, run_duration=1.199305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:15:00.401229+00:00, queued_by_job_id=1, pid=14352 2024-05-24T02:15:06.391119631Z [2024-05-24T02:15:06.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:15:06.391533770Z [2024-05-24T02:15:06.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:14:00+00:00, run_id=scheduled__2024-05-24T02:14:00+00:00, run_start_date=2024-05-24 02:15:00.336629+00:00, run_end_date=2024-05-24 02:15:06.391218+00:00, run_duration=6.054589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:14:00+00:00, data_interval_end=2024-05-24 02:15:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:15:06.401673146Z [2024-05-24T02:15:06.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:15:00+00:00, run_after=2024-05-24T02:16:00+00:00 2024-05-24T02:15:06.442259362Z [2024-05-24T02:15:06.441+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:15:06.442290881Z 2024-05-24T02:15:06.442657571Z [2024-05-24T02:15:06.442+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:15:06.443446133Z [2024-05-24T02:15:06.443+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:15:06.443478530Z 2024-05-24T02:15:06.446716657Z [2024-05-24T02:15:06.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:15:06.446960853Z [2024-05-24T02:15:06.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:15:06.536263953Z [2024-05-24T02:15:06.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:15:06.536506834Z [2024-05-24T02:15:06.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status success for try_number 1 2024-05-24T02:15:06.536858294Z [2024-05-24T02:15:06.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:15:06.548336701Z [2024-05-24T02:15:06.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8620d7ba-1369-4f77-8ebc-2fc3e70160f9 2024-05-24T02:15:06.548689652Z [2024-05-24T02:15:06.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=-1, run_start_date=2024-05-24 02:15:05.720368+00:00, run_end_date=2024-05-24 02:15:06.132397+00:00, run_duration=0.412029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:15:03.958470+00:00, queued_by_job_id=1, pid=14376 2024-05-24T02:15:06.549417133Z [2024-05-24T02:15:06.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:14:00+00:00, map_index=-1, run_start_date=2024-05-24 02:15:03.426945+00:00, run_end_date=2024-05-24 02:15:06.325503+00:00, run_duration=2.898558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:15:00.401229+00:00, queued_by_job_id=1, pid=14363 2024-05-24T02:15:10.594880697Z [2024-05-24T02:15:10.592+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:15:10.594932165Z 2024-05-24T02:15:10.594947351Z [2024-05-24T02:15:10.593+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:15:10.594958103Z [2024-05-24T02:15:10.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:15:10.594967021Z 2024-05-24T02:15:10.600015038Z [2024-05-24T02:15:10.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:15:10.600032168Z [2024-05-24T02:15:10.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:15:10.667251223Z [2024-05-24T02:15:10.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status queued for try_number 1 2024-05-24T02:15:10.667404950Z [2024-05-24T02:15:10.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:15:10.672832979Z [2024-05-24T02:15:10.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d845fed-42e7-4e14-b8fd-a3a8e67d227c 2024-05-24T02:15:10.672925076Z [2024-05-24T02:15:10.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=0, run_start_date=2024-05-24 02:15:08.181992+00:00, run_end_date=2024-05-24 02:15:09.833332+00:00, run_duration=1.65134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:15:06.444034+00:00, queued_by_job_id=1, pid=14384 2024-05-24T02:15:12.912711028Z [2024-05-24T02:15:12.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:15:12.913043143Z [2024-05-24T02:15:12.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:10:00+00:00, run_id=scheduled__2024-05-24T02:10:00+00:00, run_start_date=2024-05-24 02:15:00.333381+00:00, run_end_date=2024-05-24 02:15:12.912526+00:00, run_duration=12.579145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:10:00+00:00, data_interval_end=2024-05-24 02:15:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:15:12.930944565Z [2024-05-24T02:15:12.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:15:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:15:12.966045951Z [2024-05-24T02:15:12.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:10:00+00:00 exited with status success for try_number 1 2024-05-24T02:15:12.976118194Z [2024-05-24T02:15:12.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:10:00+00:00, map_index=-1, run_start_date=2024-05-24 02:15:12.278309+00:00, run_end_date=2024-05-24 02:15:12.652169+00:00, run_duration=0.37386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:15:10.594059+00:00, queued_by_job_id=1, pid=14397 2024-05-24T02:16:00.342811001Z [2024-05-24T02:16:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:16:00+00:00, run_after=2024-05-24T02:17:00+00:00 2024-05-24T02:16:00.359409807Z [2024-05-24T02:16:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:16:00+00:00, run_after=2024-05-24T02:17:00+00:00 2024-05-24T02:16:00.366820783Z [2024-05-24T02:16:00.366+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:16:00.375080934Z [2024-05-24T02:16:00.374+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:16:00.455338690Z [2024-05-24T02:16:00.454+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:16:00.455410712Z 2024-05-24T02:16:00.455426716Z 2024-05-24T02:16:00.455463101Z 2024-05-24T02:16:00.455472611Z 2024-05-24T02:16:00.455498293Z [2024-05-24T02:16:00.455+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:16:00.455507565Z [2024-05-24T02:16:00.455+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:16:00.455717374Z [2024-05-24T02:16:00.455+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:16:00.455787125Z [2024-05-24T02:16:00.455+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:16:00.456616467Z [2024-05-24T02:16:00.456+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:16:00.456631047Z 2024-05-24T02:16:00.456639729Z 2024-05-24T02:16:00.456648105Z 2024-05-24T02:16:00.456656627Z 2024-05-24T02:16:00.460271592Z [2024-05-24T02:16:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:16:00.460311719Z [2024-05-24T02:16:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:16:00.460337006Z [2024-05-24T02:16:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:16:00.460355003Z [2024-05-24T02:16:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:16:00.460576087Z [2024-05-24T02:16:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:16:00.460597113Z [2024-05-24T02:16:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:16:00.460794068Z [2024-05-24T02:16:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:16:00.460911097Z [2024-05-24T02:16:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:16:00.895669948Z [2024-05-24T02:16:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status queued for try_number 1 2024-05-24T02:16:00.895890254Z [2024-05-24T02:16:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status queued for try_number 1 2024-05-24T02:16:00.896049612Z [2024-05-24T02:16:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status queued for try_number 1 2024-05-24T02:16:00.896221310Z [2024-05-24T02:16:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status queued for try_number 1 2024-05-24T02:16:00.906077688Z [2024-05-24T02:16:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cb81c04-7e98-4bd6-b221-3b66a6d37574 2024-05-24T02:16:00.906147177Z [2024-05-24T02:16:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39519ec7-cf6a-4d4e-83aa-1414785fed66 2024-05-24T02:16:00.906364790Z [2024-05-24T02:16:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67db9061-1102-4813-9122-8862a5b14777 2024-05-24T02:16:00.906491645Z [2024-05-24T02:16:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62f16229-cffa-41c6-9f81-bd16e739b758 2024-05-24T02:16:02.093729041Z [2024-05-24T02:16:02.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:16:02.095542168Z [2024-05-24T02:16:02.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:15:00+00:00, run_id=scheduled__2024-05-24T02:15:00+00:00, run_start_date=2024-05-24 02:16:00.389016+00:00, run_end_date=2024-05-24 02:16:02.094882+00:00, run_duration=1.705866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:15:00+00:00, data_interval_end=2024-05-24 02:16:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:16:02.110421040Z [2024-05-24T02:16:02.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:16:00+00:00, run_after=2024-05-24T02:17:00+00:00 2024-05-24T02:16:03.230863245Z [2024-05-24T02:16:03.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:16:03.230945719Z [2024-05-24T02:16:03.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:14:00+00:00, run_id=scheduled__2024-05-24T02:14:00+00:00, run_start_date=2024-05-24 02:16:00.387700+00:00, run_end_date=2024-05-24 02:16:03.230662+00:00, run_duration=2.842962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:14:00+00:00, data_interval_end=2024-05-24 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:16:03.239072866Z [2024-05-24T02:16:03.238+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:16:00+00:00, run_after=2024-05-24T02:18:00+00:00 2024-05-24T02:16:03.310902552Z [2024-05-24T02:16:03.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:14:00+00:00 exited with status success for try_number 1 2024-05-24T02:16:03.311028440Z [2024-05-24T02:16:03.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status success for try_number 1 2024-05-24T02:16:03.324449042Z [2024-05-24T02:16:03.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:15:00+00:00, map_index=-1, run_start_date=2024-05-24 02:16:01.547475+00:00, run_end_date=2024-05-24 02:16:02.003144+00:00, run_duration=0.455669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:16:00.457376+00:00, queued_by_job_id=1, pid=14420 2024-05-24T02:16:03.324667978Z [2024-05-24T02:16:03.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:14:00+00:00, map_index=-1, run_start_date=2024-05-24 02:16:01.682292+00:00, run_end_date=2024-05-24 02:16:02.087632+00:00, run_duration=0.40534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:16:00.457376+00:00, queued_by_job_id=1, pid=14423 2024-05-24T02:16:05.509441558Z [2024-05-24T02:16:05.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:16:05.509811243Z [2024-05-24T02:16:05.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:15:00+00:00, run_id=scheduled__2024-05-24T02:15:00+00:00, run_start_date=2024-05-24 02:16:00.391756+00:00, run_end_date=2024-05-24 02:16:05.509248+00:00, run_duration=5.117492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:15:00+00:00, data_interval_end=2024-05-24 02:16:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:16:05.542016513Z [2024-05-24T02:16:05.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:16:00+00:00, run_after=2024-05-24T02:17:00+00:00 2024-05-24T02:16:05.591170737Z [2024-05-24T02:16:05.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status success for try_number 1 2024-05-24T02:16:05.602722309Z [2024-05-24T02:16:05.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:15:00+00:00, map_index=-1, run_start_date=2024-05-24 02:16:02.709398+00:00, run_end_date=2024-05-24 02:16:05.005962+00:00, run_duration=2.296564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:16:00.457376+00:00, queued_by_job_id=1, pid=14444 2024-05-24T02:16:06.662277559Z [2024-05-24T02:16:06.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:16:06.662331132Z [2024-05-24T02:16:06.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:15:00+00:00, run_id=scheduled__2024-05-24T02:15:00+00:00, run_start_date=2024-05-24 02:16:00.393619+00:00, run_end_date=2024-05-24 02:16:06.661046+00:00, run_duration=6.267427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:15:00+00:00, data_interval_end=2024-05-24 02:16:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:16:06.670566500Z [2024-05-24T02:16:06.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:16:00+00:00, run_after=2024-05-24T02:17:00+00:00 2024-05-24T02:16:06.725804817Z [2024-05-24T02:16:06.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status success for try_number 1 2024-05-24T02:16:06.731835348Z [2024-05-24T02:16:06.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:15:00+00:00, map_index=-1, run_start_date=2024-05-24 02:16:02.878759+00:00, run_end_date=2024-05-24 02:16:05.783478+00:00, run_duration=2.904719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:16:00.457376+00:00, queued_by_job_id=1, pid=14445 2024-05-24T02:16:42.322393522Z [2024-05-24T02:16:42.321+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:17:00.146343068Z [2024-05-24T02:17:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:17:00+00:00, run_after=2024-05-24T02:18:00+00:00 2024-05-24T02:17:00.159963243Z [2024-05-24T02:17:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:17:00+00:00, run_after=2024-05-24T02:18:00+00:00 2024-05-24T02:17:00.167664591Z [2024-05-24T02:17:00.167+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:17:00.243610459Z [2024-05-24T02:17:00.243+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:17:00.243664680Z 2024-05-24T02:17:00.243740371Z 2024-05-24T02:17:00.243753715Z 2024-05-24T02:17:00.243766552Z [2024-05-24T02:17:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:17:00.243800734Z [2024-05-24T02:17:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:17:00.243813706Z [2024-05-24T02:17:00.243+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:17:00.244494274Z [2024-05-24T02:17:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:17:00.244516769Z 2024-05-24T02:17:00.244530282Z 2024-05-24T02:17:00.244542494Z 2024-05-24T02:17:00.248042992Z [2024-05-24T02:17:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:17:00.248845331Z [2024-05-24T02:17:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:17:00.248878533Z [2024-05-24T02:17:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:17:00.248887662Z [2024-05-24T02:17:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:17:00.248897083Z [2024-05-24T02:17:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:17:00.248960790Z [2024-05-24T02:17:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:17:00.523904394Z [2024-05-24T02:17:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status queued for try_number 1 2024-05-24T02:17:00.524284471Z [2024-05-24T02:17:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status queued for try_number 1 2024-05-24T02:17:00.524299127Z [2024-05-24T02:17:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status queued for try_number 1 2024-05-24T02:17:00.531409051Z [2024-05-24T02:17:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 452011d5-8991-4a54-981e-645e0e7fa83c 2024-05-24T02:17:00.531571708Z [2024-05-24T02:17:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e1e5352-6eed-4232-b5a1-8db5996bb8f1 2024-05-24T02:17:00.531710858Z [2024-05-24T02:17:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4133957-7ee3-41b6-ba32-b42ac2b053d9 2024-05-24T02:17:02.792978548Z [2024-05-24T02:17:02.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:17:02.793356582Z [2024-05-24T02:17:02.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:16:00+00:00, run_id=scheduled__2024-05-24T02:16:00+00:00, run_start_date=2024-05-24 02:17:00.178826+00:00, run_end_date=2024-05-24 02:17:02.792890+00:00, run_duration=2.614064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:16:00+00:00, data_interval_end=2024-05-24 02:17:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:17:02.815731078Z [2024-05-24T02:17:02.815+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:17:00+00:00, run_after=2024-05-24T02:18:00+00:00 2024-05-24T02:17:02.877707002Z [2024-05-24T02:17:02.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status success for try_number 1 2024-05-24T02:17:02.882786515Z [2024-05-24T02:17:02.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:16:00+00:00, map_index=-1, run_start_date=2024-05-24 02:17:01.213346+00:00, run_end_date=2024-05-24 02:17:01.591500+00:00, run_duration=0.378154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:17:00.245110+00:00, queued_by_job_id=1, pid=14476 2024-05-24T02:17:03.799559295Z [2024-05-24T02:17:03.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:17:03.799674622Z [2024-05-24T02:17:03.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:16:00+00:00, run_id=scheduled__2024-05-24T02:16:00+00:00, run_start_date=2024-05-24 02:17:00.180230+00:00, run_end_date=2024-05-24 02:17:03.799356+00:00, run_duration=3.619126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:16:00+00:00, data_interval_end=2024-05-24 02:17:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:17:03.810457321Z [2024-05-24T02:17:03.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:17:00+00:00, run_after=2024-05-24T02:18:00+00:00 2024-05-24T02:17:03.827287034Z [2024-05-24T02:17:03.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:17:03.827555507Z [2024-05-24T02:17:03.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:16:00+00:00, run_id=scheduled__2024-05-24T02:16:00+00:00, run_start_date=2024-05-24 02:17:00.181346+00:00, run_end_date=2024-05-24 02:17:03.827146+00:00, run_duration=3.6458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:16:00+00:00, data_interval_end=2024-05-24 02:17:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:17:03.841601868Z [2024-05-24T02:17:03.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:17:00+00:00, run_after=2024-05-24T02:18:00+00:00 2024-05-24T02:17:03.892163092Z [2024-05-24T02:17:03.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status success for try_number 1 2024-05-24T02:17:03.901384099Z [2024-05-24T02:17:03.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:16:00+00:00, map_index=-1, run_start_date=2024-05-24 02:17:02.135830+00:00, run_end_date=2024-05-24 02:17:03.451070+00:00, run_duration=1.31524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:17:00.245110+00:00, queued_by_job_id=1, pid=14494 2024-05-24T02:17:04.182654759Z [2024-05-24T02:17:04.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status success for try_number 1 2024-05-24T02:17:04.188865064Z [2024-05-24T02:17:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:16:00+00:00, map_index=-1, run_start_date=2024-05-24 02:17:02.131808+00:00, run_end_date=2024-05-24 02:17:03.701827+00:00, run_duration=1.570019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:17:00.245110+00:00, queued_by_job_id=1, pid=14495 2024-05-24T02:18:01.045201080Z [2024-05-24T02:18:01.044+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:18:00+00:00, run_after=2024-05-24T02:19:00+00:00 2024-05-24T02:18:01.054206864Z [2024-05-24T02:18:01.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:18:01.081282660Z [2024-05-24T02:18:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:18:00+00:00, run_after=2024-05-24T02:19:00+00:00 2024-05-24T02:18:01.089034214Z [2024-05-24T02:18:01.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:18:01.156888822Z [2024-05-24T02:18:01.156+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:18:01.156930134Z 2024-05-24T02:18:01.156940609Z 2024-05-24T02:18:01.156949832Z 2024-05-24T02:18:01.156958356Z 2024-05-24T02:18:01.156967580Z [2024-05-24T02:18:01.156+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:18:01.156977022Z [2024-05-24T02:18:01.156+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:18:01.157000001Z [2024-05-24T02:18:01.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:18:01.157009344Z [2024-05-24T02:18:01.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:18:01.157639488Z [2024-05-24T02:18:01.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:18:01.157661180Z 2024-05-24T02:18:01.157670717Z 2024-05-24T02:18:01.157679306Z 2024-05-24T02:18:01.157687716Z 2024-05-24T02:18:01.161090419Z [2024-05-24T02:18:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:18:01.161119900Z [2024-05-24T02:18:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:18:01.161259308Z [2024-05-24T02:18:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:18:01.161273155Z [2024-05-24T02:18:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:18:01.161448812Z [2024-05-24T02:18:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:18:01.161460460Z [2024-05-24T02:18:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:18:01.161660901Z [2024-05-24T02:18:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:18:01.161688705Z [2024-05-24T02:18:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:18:01.719516938Z [2024-05-24T02:18:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status queued for try_number 1 2024-05-24T02:18:01.720590744Z [2024-05-24T02:18:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:17:00+00:00 exited with status queued for try_number 1 2024-05-24T02:18:01.724379318Z [2024-05-24T02:18:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:17:00+00:00 exited with status queued for try_number 1 2024-05-24T02:18:01.724593656Z [2024-05-24T02:18:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:17:00+00:00 exited with status queued for try_number 1 2024-05-24T02:18:01.747889303Z [2024-05-24T02:18:01.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to afde2f5f-ec60-496c-b65d-c6751c2c6ff0 2024-05-24T02:18:01.747958331Z [2024-05-24T02:18:01.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f64cbba-dd49-4321-a543-dbc824b0e614 2024-05-24T02:18:01.748080934Z [2024-05-24T02:18:01.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36009f87-3c3c-4a98-90b3-1d32b00fb34e 2024-05-24T02:18:01.748188619Z [2024-05-24T02:18:01.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 649f3d4d-8c85-4876-b240-57651925f0d2 2024-05-24T02:18:01.911105104Z [2024-05-24T02:18:01.910+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:18:01.911138562Z 2024-05-24T02:18:01.914932354Z [2024-05-24T02:18:01.914+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-24T02:18:01.915650520Z [2024-05-24T02:18:01.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:18:01.915669096Z 2024-05-24T02:18:01.923271502Z [2024-05-24T02:18:01.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240524021801_709459', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:18:01.923539731Z [2024-05-24T02:18:01.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240524021801_709459', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-24T02:18:02.050466227Z [2024-05-24T02:18:02.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240524021801_709459 exited with status queued for try_number 1 2024-05-24T02:18:02.063654985Z [2024-05-24T02:18:02.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c2d25a6-5358-4968-aafb-1baadf786158 2024-05-24T02:18:03.294453009Z [2024-05-24T02:18:03.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:18:03.294978649Z [2024-05-24T02:18:03.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:16:00+00:00, run_id=scheduled__2024-05-24T02:16:00+00:00, run_start_date=2024-05-24 02:18:01.098757+00:00, run_end_date=2024-05-24 02:18:03.294652+00:00, run_duration=2.195895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:16:00+00:00, data_interval_end=2024-05-24 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:18:03.305079163Z [2024-05-24T02:18:03.304+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:18:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:18:03.322698378Z [2024-05-24T02:18:03.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:18:03.323114928Z [2024-05-24T02:18:03.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:17:00+00:00, run_id=scheduled__2024-05-24T02:17:00+00:00, run_start_date=2024-05-24 02:18:01.100140+00:00, run_end_date=2024-05-24 02:18:03.322828+00:00, run_duration=2.222688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:17:00+00:00, data_interval_end=2024-05-24 02:18:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:18:03.336954534Z [2024-05-24T02:18:03.336+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:18:00+00:00, run_after=2024-05-24T02:19:00+00:00 2024-05-24T02:18:03.438574013Z [2024-05-24T02:18:03.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:16:00+00:00 exited with status success for try_number 1 2024-05-24T02:18:03.439215144Z [2024-05-24T02:18:03.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:17:00+00:00 exited with status success for try_number 1 2024-05-24T02:18:03.450740780Z [2024-05-24T02:18:03.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:16:00+00:00, map_index=-1, run_start_date=2024-05-24 02:18:02.188240+00:00, run_end_date=2024-05-24 02:18:02.764306+00:00, run_duration=0.576066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:18:01.158314+00:00, queued_by_job_id=1, pid=14529 2024-05-24T02:18:03.451077398Z [2024-05-24T02:18:03.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:17:00+00:00, map_index=-1, run_start_date=2024-05-24 02:18:02.475367+00:00, run_end_date=2024-05-24 02:18:03.046673+00:00, run_duration=0.571306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:18:01.158314+00:00, queued_by_job_id=1, pid=14530 2024-05-24T02:18:04.298561423Z [2024-05-24T02:18:04.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:18:04.298938577Z [2024-05-24T02:18:04.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-24 02:18:01.633055+00:00, run_id=scaleout_vdu_20240524021801_709459, run_start_date=2024-05-24 02:18:01.793541+00:00, run_end_date=2024-05-24 02:18:04.298445+00:00, run_duration=2.504904, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-24 02:18:01.633055+00:00, data_interval_end=2024-05-24 02:18:01.633055+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-24T02:18:04.301763501Z [2024-05-24T02:18:04.301+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-24T02:18:04.377574957Z [2024-05-24T02:18:04.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240524021801_709459 exited with status success for try_number 1 2024-05-24T02:18:04.400749418Z [2024-05-24T02:18:04.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240524021801_709459, map_index=-1, run_start_date=2024-05-24 02:18:02.978709+00:00, run_end_date=2024-05-24 02:18:03.418440+00:00, run_duration=0.439731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:18:01.918278+00:00, queued_by_job_id=1, pid=14542 2024-05-24T02:18:06.093889500Z [2024-05-24T02:18:06.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:18:06.094067587Z [2024-05-24T02:18:06.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:17:00+00:00, run_id=scheduled__2024-05-24T02:17:00+00:00, run_start_date=2024-05-24 02:18:01.101846+00:00, run_end_date=2024-05-24 02:18:06.093769+00:00, run_duration=4.991923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:17:00+00:00, data_interval_end=2024-05-24 02:18:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:18:06.106650565Z [2024-05-24T02:18:06.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:18:00+00:00, run_after=2024-05-24T02:19:00+00:00 2024-05-24T02:18:06.116175818Z [2024-05-24T02:18:06.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:18:06.116480085Z [2024-05-24T02:18:06.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:17:00+00:00, run_id=scheduled__2024-05-24T02:17:00+00:00, run_start_date=2024-05-24 02:18:01.102854+00:00, run_end_date=2024-05-24 02:18:06.116013+00:00, run_duration=5.013159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:17:00+00:00, data_interval_end=2024-05-24 02:18:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:18:06.125311367Z [2024-05-24T02:18:06.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:18:00+00:00, run_after=2024-05-24T02:19:00+00:00 2024-05-24T02:18:06.167714905Z [2024-05-24T02:18:06.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:17:00+00:00 exited with status success for try_number 1 2024-05-24T02:18:06.167759870Z [2024-05-24T02:18:06.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:17:00+00:00 exited with status success for try_number 1 2024-05-24T02:18:06.176333668Z [2024-05-24T02:18:06.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:17:00+00:00, map_index=-1, run_start_date=2024-05-24 02:18:04.035015+00:00, run_end_date=2024-05-24 02:18:05.429553+00:00, run_duration=1.394538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:18:01.158314+00:00, queued_by_job_id=1, pid=14565 2024-05-24T02:18:06.176505565Z [2024-05-24T02:18:06.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:17:00+00:00, map_index=-1, run_start_date=2024-05-24 02:18:03.657405+00:00, run_end_date=2024-05-24 02:18:05.736994+00:00, run_duration=2.079589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:18:01.158314+00:00, queued_by_job_id=1, pid=14554 2024-05-24T02:19:00.052731860Z [2024-05-24T02:19:00.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:19:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:19:00.068365090Z [2024-05-24T02:19:00.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:19:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:19:00.076471734Z [2024-05-24T02:19:00.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:19:00.174312189Z [2024-05-24T02:19:00.173+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:19:00.174385844Z 2024-05-24T02:19:00.174444305Z 2024-05-24T02:19:00.174479812Z 2024-05-24T02:19:00.174498275Z [2024-05-24T02:19:00.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:19:00.174717240Z [2024-05-24T02:19:00.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:19:00.174778633Z [2024-05-24T02:19:00.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:19:00.175267555Z [2024-05-24T02:19:00.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:19:00.175287008Z 2024-05-24T02:19:00.175292791Z 2024-05-24T02:19:00.175298897Z 2024-05-24T02:19:00.179393896Z [2024-05-24T02:19:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:19:00.179727014Z [2024-05-24T02:19:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:19:00.180040161Z [2024-05-24T02:19:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:19:00.180093107Z [2024-05-24T02:19:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:19:00.180589473Z [2024-05-24T02:19:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:19:00.180670181Z [2024-05-24T02:19:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:19:00.438304529Z [2024-05-24T02:19:00.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status queued for try_number 1 2024-05-24T02:19:00.440140129Z [2024-05-24T02:19:00.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status queued for try_number 1 2024-05-24T02:19:00.440309991Z [2024-05-24T02:19:00.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status queued for try_number 1 2024-05-24T02:19:00.457211890Z [2024-05-24T02:19:00.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c064e13-beac-4eb7-9b22-73b9ec1f6182 2024-05-24T02:19:00.457405193Z [2024-05-24T02:19:00.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cf08c8f-0793-42ce-8784-b24710116520 2024-05-24T02:19:00.457492344Z [2024-05-24T02:19:00.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92410505-7098-4eee-b85b-4cd8ef766328 2024-05-24T02:19:02.044246211Z [2024-05-24T02:19:02.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:19:02.044499735Z [2024-05-24T02:19:02.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:18:00+00:00, run_id=scheduled__2024-05-24T02:18:00+00:00, run_start_date=2024-05-24 02:19:00.087865+00:00, run_end_date=2024-05-24 02:19:02.044082+00:00, run_duration=1.956217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:18:00+00:00, data_interval_end=2024-05-24 02:19:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:19:02.054394091Z [2024-05-24T02:19:02.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:19:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:19:02.127093186Z [2024-05-24T02:19:02.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status success for try_number 1 2024-05-24T02:19:02.133924109Z [2024-05-24T02:19:02.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:18:00+00:00, map_index=-1, run_start_date=2024-05-24 02:19:01.234929+00:00, run_end_date=2024-05-24 02:19:01.645749+00:00, run_duration=0.41082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:19:00.176213+00:00, queued_by_job_id=1, pid=14592 2024-05-24T02:19:04.295290753Z [2024-05-24T02:19:04.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:19:04.296955866Z [2024-05-24T02:19:04.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:18:00+00:00, run_id=scheduled__2024-05-24T02:18:00+00:00, run_start_date=2024-05-24 02:19:00.089323+00:00, run_end_date=2024-05-24 02:19:04.295146+00:00, run_duration=4.205823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:18:00+00:00, data_interval_end=2024-05-24 02:19:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:19:04.316973413Z [2024-05-24T02:19:04.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:19:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:19:04.325776474Z [2024-05-24T02:19:04.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:19:04.326311072Z [2024-05-24T02:19:04.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:18:00+00:00, run_id=scheduled__2024-05-24T02:18:00+00:00, run_start_date=2024-05-24 02:19:00.090452+00:00, run_end_date=2024-05-24 02:19:04.325659+00:00, run_duration=4.235207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:18:00+00:00, data_interval_end=2024-05-24 02:19:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:19:04.337974806Z [2024-05-24T02:19:04.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:19:00+00:00, run_after=2024-05-24T02:20:00+00:00 2024-05-24T02:19:04.370230120Z [2024-05-24T02:19:04.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status success for try_number 1 2024-05-24T02:19:04.370454252Z [2024-05-24T02:19:04.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status success for try_number 1 2024-05-24T02:19:04.379787456Z [2024-05-24T02:19:04.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:18:00+00:00, map_index=-1, run_start_date=2024-05-24 02:19:02.361708+00:00, run_end_date=2024-05-24 02:19:03.738758+00:00, run_duration=1.37705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:19:00.176213+00:00, queued_by_job_id=1, pid=14611 2024-05-24T02:19:04.380053862Z [2024-05-24T02:19:04.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:18:00+00:00, map_index=-1, run_start_date=2024-05-24 02:19:02.261909+00:00, run_end_date=2024-05-24 02:19:03.922085+00:00, run_duration=1.660176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:19:00.176213+00:00, queued_by_job_id=1, pid=14610 2024-05-24T02:20:01.077523637Z [2024-05-24T02:20:01.075+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:20:01.090592450Z [2024-05-24T02:20:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:21:00+00:00 2024-05-24T02:20:01.097794884Z [2024-05-24T02:20:01.097+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:20:01.112289173Z [2024-05-24T02:20:01.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:25:00+00:00 2024-05-24T02:20:01.127588441Z [2024-05-24T02:20:01.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:21:00+00:00 2024-05-24T02:20:01.238113908Z [2024-05-24T02:20:01.237+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T02:20:01.238140365Z 2024-05-24T02:20:01.238144005Z 2024-05-24T02:20:01.238148052Z 2024-05-24T02:20:01.238151422Z 2024-05-24T02:20:01.238154625Z 2024-05-24T02:20:01.238320434Z [2024-05-24T02:20:01.238+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:20:01.238423634Z [2024-05-24T02:20:01.238+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:20:01.238577328Z [2024-05-24T02:20:01.238+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:20:01.238670342Z [2024-05-24T02:20:01.238+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:20:01.238732647Z [2024-05-24T02:20:01.238+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:20:01.239284639Z [2024-05-24T02:20:01.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:20:01.239295326Z 2024-05-24T02:20:01.239299124Z 2024-05-24T02:20:01.239302399Z 2024-05-24T02:20:01.239305545Z 2024-05-24T02:20:01.239308925Z 2024-05-24T02:20:01.244009743Z [2024-05-24T02:20:01.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:20:01.244180706Z [2024-05-24T02:20:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:20:01.244323877Z [2024-05-24T02:20:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:20:01.244471087Z [2024-05-24T02:20:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:20:01.244651783Z [2024-05-24T02:20:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:20:01.244727103Z [2024-05-24T02:20:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:20:01.244901134Z [2024-05-24T02:20:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:20:01.244974380Z [2024-05-24T02:20:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:20:01.245103490Z [2024-05-24T02:20:01.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:20:01.245226907Z [2024-05-24T02:20:01.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:20:01.789893823Z [2024-05-24T02:20:01.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:01.792225287Z [2024-05-24T02:20:01.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:01.792472271Z [2024-05-24T02:20:01.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:19:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:01.792648056Z [2024-05-24T02:20:01.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:19:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:01.792814702Z [2024-05-24T02:20:01.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:19:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:01.810543794Z [2024-05-24T02:20:01.810+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bb97a69-5787-4783-9958-ce67cc4adf4d 2024-05-24T02:20:01.811786675Z [2024-05-24T02:20:01.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34e94665-c357-41ed-9e7c-ffced5b94d79 2024-05-24T02:20:01.812146375Z [2024-05-24T02:20:01.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to d909cf53-597a-4a9a-a165-7919309f09c6 2024-05-24T02:20:01.812376786Z [2024-05-24T02:20:01.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8adf727f-439e-4155-bd85-06c90a642e9f 2024-05-24T02:20:01.812597747Z [2024-05-24T02:20:01.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 013e126f-f1fd-4010-b985-14a0efbab15f 2024-05-24T02:20:02.042452125Z [2024-05-24T02:20:02.042+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:20:02.042475633Z 2024-05-24T02:20:02.042738305Z [2024-05-24T02:20:02.042+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-24T02:20:02.043410971Z [2024-05-24T02:20:02.043+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:20:02.043422496Z 2024-05-24T02:20:02.050623451Z [2024-05-24T02:20:02.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240524022001_044252', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:20:02.051160239Z [2024-05-24T02:20:02.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240524022001_044252', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-24T02:20:02.152743832Z [2024-05-24T02:20:02.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240524022001_044252 exited with status queued for try_number 1 2024-05-24T02:20:02.167055775Z [2024-05-24T02:20:02.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7110cc80-d8a7-422a-84aa-9c3c06f2de92 2024-05-24T02:20:04.645966011Z [2024-05-24T02:20:04.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:20:04.646165803Z [2024-05-24T02:20:04.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:19:00+00:00, run_id=scheduled__2024-05-24T02:19:00+00:00, run_start_date=2024-05-24 02:20:01.142873+00:00, run_end_date=2024-05-24 02:20:04.645890+00:00, run_duration=3.503017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:19:00+00:00, data_interval_end=2024-05-24 02:20:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:20:04.656098547Z [2024-05-24T02:20:04.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:21:00+00:00 2024-05-24T02:20:04.666133144Z [2024-05-24T02:20:04.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:20:04.666250593Z [2024-05-24T02:20:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-24 02:20:01.718355+00:00, run_id=scaleout_vdu_20240524022001_044252, run_start_date=2024-05-24 02:20:01.879076+00:00, run_end_date=2024-05-24 02:20:04.666018+00:00, run_duration=2.786942, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-24 02:20:01.718355+00:00, data_interval_end=2024-05-24 02:20:01.718355+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-24T02:20:04.671288594Z [2024-05-24T02:20:04.669+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-24T02:20:04.677528708Z [2024-05-24T02:20:04.677+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:20:04.677771576Z [2024-05-24T02:20:04.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:18:00+00:00, run_id=scheduled__2024-05-24T02:18:00+00:00, run_start_date=2024-05-24 02:20:01.141743+00:00, run_end_date=2024-05-24 02:20:04.677446+00:00, run_duration=3.535703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:18:00+00:00, data_interval_end=2024-05-24 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:20:04.687173740Z [2024-05-24T02:20:04.686+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:22:00+00:00 2024-05-24T02:20:04.751311758Z [2024-05-24T02:20:04.750+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:20:04.751337460Z 2024-05-24T02:20:04.751669575Z [2024-05-24T02:20:04.751+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:20:04.752340558Z [2024-05-24T02:20:04.752+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:20:04.752352286Z 2024-05-24T02:20:04.754588202Z [2024-05-24T02:20:04.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:20:04.754791865Z [2024-05-24T02:20:04.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:20:04.834006757Z [2024-05-24T02:20:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:04.834046485Z [2024-05-24T02:20:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:04.834090442Z [2024-05-24T02:20:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:18:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:04.834137339Z [2024-05-24T02:20:04.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:19:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:04.834208456Z [2024-05-24T02:20:04.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240524022001_044252 exited with status success for try_number 1 2024-05-24T02:20:04.849401469Z [2024-05-24T02:20:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:19:00+00:00, map_index=-1, run_start_date=2024-05-24 02:20:02.787436+00:00, run_end_date=2024-05-24 02:20:04.088740+00:00, run_duration=1.301304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:01.240285+00:00, queued_by_job_id=1, pid=14645 2024-05-24T02:20:04.849501058Z [2024-05-24T02:20:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:15:00+00:00, map_index=-1, run_start_date=2024-05-24 02:20:04.187246+00:00, run_end_date=2024-05-24 02:20:04.588773+00:00, run_duration=0.401527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:01.240285+00:00, queued_by_job_id=1, pid=14665 2024-05-24T02:20:04.849744697Z [2024-05-24T02:20:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240524022001_044252, map_index=-1, run_start_date=2024-05-24 02:20:03.650317+00:00, run_end_date=2024-05-24 02:20:04.338316+00:00, run_duration=0.687999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:02.046925+00:00, queued_by_job_id=1, pid=14648 2024-05-24T02:20:04.849878912Z [2024-05-24T02:20:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:18:00+00:00, map_index=-1, run_start_date=2024-05-24 02:20:03.895268+00:00, run_end_date=2024-05-24 02:20:04.558669+00:00, run_duration=0.663401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:01.240285+00:00, queued_by_job_id=1, pid=14654 2024-05-24T02:20:04.850028905Z [2024-05-24T02:20:04.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 730538fd-0ad4-4967-8aba-e15f770aba71 2024-05-24T02:20:06.387235889Z [2024-05-24T02:20:06.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:20:06.387389932Z [2024-05-24T02:20:06.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:19:00+00:00, run_id=scheduled__2024-05-24T02:19:00+00:00, run_start_date=2024-05-24 02:20:01.145707+00:00, run_end_date=2024-05-24 02:20:06.387185+00:00, run_duration=5.241478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:19:00+00:00, data_interval_end=2024-05-24 02:20:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:20:06.402351941Z [2024-05-24T02:20:06.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:21:00+00:00 2024-05-24T02:20:06.503401133Z [2024-05-24T02:20:06.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:19:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:06.509746385Z [2024-05-24T02:20:06.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:19:00+00:00, map_index=-1, run_start_date=2024-05-24 02:20:04.477580+00:00, run_end_date=2024-05-24 02:20:06.247296+00:00, run_duration=1.769716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:01.240285+00:00, queued_by_job_id=1, pid=14676 2024-05-24T02:20:06.725323888Z [2024-05-24T02:20:06.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:20:06.725739921Z [2024-05-24T02:20:06.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:19:00+00:00, run_id=scheduled__2024-05-24T02:19:00+00:00, run_start_date=2024-05-24 02:20:01.144504+00:00, run_end_date=2024-05-24 02:20:06.725351+00:00, run_duration=5.580847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:19:00+00:00, data_interval_end=2024-05-24 02:20:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:20:06.741362619Z [2024-05-24T02:20:06.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:21:00+00:00 2024-05-24T02:20:06.811596991Z [2024-05-24T02:20:06.811+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:20:06.811622538Z 2024-05-24T02:20:06.811666220Z [2024-05-24T02:20:06.811+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:20:06.812159445Z [2024-05-24T02:20:06.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:20:06.812174173Z 2024-05-24T02:20:06.815120588Z [2024-05-24T02:20:06.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:20:06.815211615Z [2024-05-24T02:20:06.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:20:06.929836445Z [2024-05-24T02:20:06.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:06.930156012Z [2024-05-24T02:20:06.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:19:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:06.930357525Z [2024-05-24T02:20:06.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:06.937792222Z [2024-05-24T02:20:06.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:15:00+00:00, map_index=-1, run_start_date=2024-05-24 02:20:06.348037+00:00, run_end_date=2024-05-24 02:20:06.729073+00:00, run_duration=0.381036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:04.752789+00:00, queued_by_job_id=1, pid=14706 2024-05-24T02:20:06.938021870Z [2024-05-24T02:20:06.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:19:00+00:00, map_index=-1, run_start_date=2024-05-24 02:20:05.271972+00:00, run_end_date=2024-05-24 02:20:06.567749+00:00, run_duration=1.295777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:01.240285+00:00, queued_by_job_id=1, pid=14694 2024-05-24T02:20:06.938278236Z [2024-05-24T02:20:06.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c31633b-59e9-4464-897b-197b1881259c 2024-05-24T02:20:10.534603299Z [2024-05-24T02:20:10.530+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:20:10.534631105Z 2024-05-24T02:20:10.534639512Z [2024-05-24T02:20:10.531+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:20:10.534643919Z [2024-05-24T02:20:10.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:20:10.534647442Z 2024-05-24T02:20:10.538576349Z [2024-05-24T02:20:10.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:20:10.538615910Z [2024-05-24T02:20:10.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:20:10.598590566Z [2024-05-24T02:20:10.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status queued for try_number 1 2024-05-24T02:20:10.598612175Z [2024-05-24T02:20:10.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:10.606610103Z [2024-05-24T02:20:10.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b6fa3bd-1b25-4f68-8fe8-cb7d4c611f3d 2024-05-24T02:20:10.606630427Z [2024-05-24T02:20:10.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:15:00+00:00, map_index=0, run_start_date=2024-05-24 02:20:08.516273+00:00, run_end_date=2024-05-24 02:20:09.773432+00:00, run_duration=1.257159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:06.812444+00:00, queued_by_job_id=1, pid=14714 2024-05-24T02:20:13.453317567Z [2024-05-24T02:20:13.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:20:13.453740586Z [2024-05-24T02:20:13.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:15:00+00:00, run_id=scheduled__2024-05-24T02:15:00+00:00, run_start_date=2024-05-24 02:20:01.140201+00:00, run_end_date=2024-05-24 02:20:13.453144+00:00, run_duration=12.312943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:15:00+00:00, data_interval_end=2024-05-24 02:20:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:20:13.462164354Z [2024-05-24T02:20:13.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:20:00+00:00, run_after=2024-05-24T02:25:00+00:00 2024-05-24T02:20:13.500611535Z [2024-05-24T02:20:13.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:15:00+00:00 exited with status success for try_number 1 2024-05-24T02:20:13.509834832Z [2024-05-24T02:20:13.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:15:00+00:00, map_index=-1, run_start_date=2024-05-24 02:20:12.190207+00:00, run_end_date=2024-05-24 02:20:12.546696+00:00, run_duration=0.356489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:20:10.532229+00:00, queued_by_job_id=1, pid=14727 2024-05-24T02:21:00.277353152Z [2024-05-24T02:21:00.276+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:21:00.289751552Z [2024-05-24T02:21:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:21:00+00:00, run_after=2024-05-24T02:22:00+00:00 2024-05-24T02:21:00.304068098Z [2024-05-24T02:21:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:21:00+00:00, run_after=2024-05-24T02:22:00+00:00 2024-05-24T02:21:00.365682694Z [2024-05-24T02:21:00.364+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:21:00.365711540Z 2024-05-24T02:21:00.365715975Z 2024-05-24T02:21:00.365719757Z 2024-05-24T02:21:00.365723323Z [2024-05-24T02:21:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:21:00.365727007Z [2024-05-24T02:21:00.364+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:21:00.365730496Z [2024-05-24T02:21:00.365+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:21:00.366029373Z [2024-05-24T02:21:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:21:00.366036320Z 2024-05-24T02:21:00.366040178Z 2024-05-24T02:21:00.366043798Z 2024-05-24T02:21:00.368817917Z [2024-05-24T02:21:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:21:00.368859156Z [2024-05-24T02:21:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:21:00.369125349Z [2024-05-24T02:21:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:21:00.369172600Z [2024-05-24T02:21:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:21:00.369457247Z [2024-05-24T02:21:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:21:00.369518680Z [2024-05-24T02:21:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:21:00.744481346Z [2024-05-24T02:21:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:21:00.747118854Z [2024-05-24T02:21:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:21:00.747410212Z [2024-05-24T02:21:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:21:00.759994084Z [2024-05-24T02:21:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97d87b89-3846-458f-add0-a3cc689099f0 2024-05-24T02:21:00.760264019Z [2024-05-24T02:21:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to e61c2a44-6066-4897-838f-9c1c91573c12 2024-05-24T02:21:00.760463449Z [2024-05-24T02:21:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61642d6c-e864-492b-a412-f8720d7ff6a7 2024-05-24T02:21:01.900955696Z [2024-05-24T02:21:01.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:21:01.901291593Z [2024-05-24T02:21:01.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:20:00+00:00, run_id=scheduled__2024-05-24T02:20:00+00:00, run_start_date=2024-05-24 02:21:00.313209+00:00, run_end_date=2024-05-24 02:21:01.900861+00:00, run_duration=1.587652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:20:00+00:00, data_interval_end=2024-05-24 02:21:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:21:01.911712303Z [2024-05-24T02:21:01.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:21:00+00:00, run_after=2024-05-24T02:22:00+00:00 2024-05-24T02:21:01.960842729Z [2024-05-24T02:21:01.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:21:01.968939487Z [2024-05-24T02:21:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=-1, run_start_date=2024-05-24 02:21:01.268715+00:00, run_end_date=2024-05-24 02:21:01.684823+00:00, run_duration=0.416108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:21:00.366646+00:00, queued_by_job_id=1, pid=14750 2024-05-24T02:21:04.344362537Z [2024-05-24T02:21:04.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:21:04.344930204Z [2024-05-24T02:21:04.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:20:00+00:00, run_id=scheduled__2024-05-24T02:20:00+00:00, run_start_date=2024-05-24 02:21:00.314348+00:00, run_end_date=2024-05-24 02:21:04.344578+00:00, run_duration=4.03023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:20:00+00:00, data_interval_end=2024-05-24 02:21:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:21:04.355814721Z [2024-05-24T02:21:04.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:21:00+00:00, run_after=2024-05-24T02:22:00+00:00 2024-05-24T02:21:04.403822044Z [2024-05-24T02:21:04.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:21:04.412082759Z [2024-05-24T02:21:04.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=-1, run_start_date=2024-05-24 02:21:02.076587+00:00, run_end_date=2024-05-24 02:21:03.657850+00:00, run_duration=1.581263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:21:00.366646+00:00, queued_by_job_id=1, pid=14768 2024-05-24T02:21:05.475782966Z [2024-05-24T02:21:05.475+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:21:05.476973305Z [2024-05-24T02:21:05.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:20:00+00:00, run_id=scheduled__2024-05-24T02:20:00+00:00, run_start_date=2024-05-24 02:21:00.315526+00:00, run_end_date=2024-05-24 02:21:05.475594+00:00, run_duration=5.160068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:20:00+00:00, data_interval_end=2024-05-24 02:21:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:21:05.494717638Z [2024-05-24T02:21:05.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:21:00+00:00, run_after=2024-05-24T02:22:00+00:00 2024-05-24T02:21:05.545278059Z [2024-05-24T02:21:05.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:21:05.554722819Z [2024-05-24T02:21:05.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=-1, run_start_date=2024-05-24 02:21:02.168459+00:00, run_end_date=2024-05-24 02:21:04.578035+00:00, run_duration=2.409576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:21:00.366646+00:00, queued_by_job_id=1, pid=14769 2024-05-24T02:21:42.399028239Z [2024-05-24T02:21:42.398+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:22:00.150853697Z [2024-05-24T02:22:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:22:00.169128493Z [2024-05-24T02:22:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:22:00+00:00, run_after=2024-05-24T02:23:00+00:00 2024-05-24T02:22:00.179498104Z [2024-05-24T02:22:00.178+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:22:00.196914222Z [2024-05-24T02:22:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:22:00+00:00, run_after=2024-05-24T02:23:00+00:00 2024-05-24T02:22:00.305513304Z [2024-05-24T02:22:00.305+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:22:00.305551989Z 2024-05-24T02:22:00.305560799Z 2024-05-24T02:22:00.305565394Z 2024-05-24T02:22:00.305569971Z 2024-05-24T02:22:00.305884146Z [2024-05-24T02:22:00.305+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:22:00.306184508Z [2024-05-24T02:22:00.306+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:22:00.306468661Z [2024-05-24T02:22:00.306+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:22:00.306812212Z [2024-05-24T02:22:00.306+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:22:00.307710900Z [2024-05-24T02:22:00.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:22:00.307727559Z 2024-05-24T02:22:00.307733170Z 2024-05-24T02:22:00.307738261Z 2024-05-24T02:22:00.307742938Z 2024-05-24T02:22:00.312654877Z [2024-05-24T02:22:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:22:00.312922140Z [2024-05-24T02:22:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:22:00.313293974Z [2024-05-24T02:22:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:22:00.313505891Z [2024-05-24T02:22:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:22:00.313810838Z [2024-05-24T02:22:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:22:00.314012626Z [2024-05-24T02:22:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:22:00.314314575Z [2024-05-24T02:22:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:22:00.314538601Z [2024-05-24T02:22:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:22:00.690594044Z [2024-05-24T02:22:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:22:00.690713800Z [2024-05-24T02:22:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:21:00+00:00 exited with status queued for try_number 1 2024-05-24T02:22:00.690845271Z [2024-05-24T02:22:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:21:00+00:00 exited with status queued for try_number 1 2024-05-24T02:22:00.690867658Z [2024-05-24T02:22:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:21:00+00:00 exited with status queued for try_number 1 2024-05-24T02:22:00.698882776Z [2024-05-24T02:22:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to a02810b0-ef04-440d-a609-8fb3ce0efdfc 2024-05-24T02:22:00.698948020Z [2024-05-24T02:22:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08bcd2e1-11ed-43aa-936e-e585be0a96a8 2024-05-24T02:22:00.699084140Z [2024-05-24T02:22:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd5429a7-5592-4190-b43a-a825e49f11f8 2024-05-24T02:22:00.699168236Z [2024-05-24T02:22:00.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47a0fe2d-f550-44a7-8e61-6c183d956156 2024-05-24T02:22:01.845470298Z [2024-05-24T02:22:01.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:22:01.846214677Z [2024-05-24T02:22:01.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:20:00+00:00, run_id=scheduled__2024-05-24T02:20:00+00:00, run_start_date=2024-05-24 02:22:00.210492+00:00, run_end_date=2024-05-24 02:22:01.845415+00:00, run_duration=1.634923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:20:00+00:00, data_interval_end=2024-05-24 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:22:01.857866662Z [2024-05-24T02:22:01.857+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:22:00+00:00, run_after=2024-05-24T02:24:00+00:00 2024-05-24T02:22:01.866438259Z [2024-05-24T02:22:01.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:22:01.866464402Z [2024-05-24T02:22:01.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:21:00+00:00, run_id=scheduled__2024-05-24T02:21:00+00:00, run_start_date=2024-05-24 02:22:00.212264+00:00, run_end_date=2024-05-24 02:22:01.865947+00:00, run_duration=1.653683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:21:00+00:00, data_interval_end=2024-05-24 02:22:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:22:01.875775091Z [2024-05-24T02:22:01.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:22:00+00:00, run_after=2024-05-24T02:23:00+00:00 2024-05-24T02:22:01.923748935Z [2024-05-24T02:22:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:22:01.924147589Z [2024-05-24T02:22:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:21:00+00:00 exited with status success for try_number 1 2024-05-24T02:22:01.933874169Z [2024-05-24T02:22:01.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=-1, run_start_date=2024-05-24 02:22:01.255003+00:00, run_end_date=2024-05-24 02:22:01.669535+00:00, run_duration=0.414532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:22:00.308917+00:00, queued_by_job_id=1, pid=14803 2024-05-24T02:22:01.934418850Z [2024-05-24T02:22:01.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:21:00+00:00, map_index=-1, run_start_date=2024-05-24 02:22:01.316357+00:00, run_end_date=2024-05-24 02:22:01.731728+00:00, run_duration=0.415371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:22:00.308917+00:00, queued_by_job_id=1, pid=14804 2024-05-24T02:22:04.106587485Z [2024-05-24T02:22:04.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:22:04.107092477Z [2024-05-24T02:22:04.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:21:00+00:00, run_id=scheduled__2024-05-24T02:21:00+00:00, run_start_date=2024-05-24 02:22:00.213648+00:00, run_end_date=2024-05-24 02:22:04.106487+00:00, run_duration=3.892839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:21:00+00:00, data_interval_end=2024-05-24 02:22:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:22:04.118532593Z [2024-05-24T02:22:04.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:22:00+00:00, run_after=2024-05-24T02:23:00+00:00 2024-05-24T02:22:04.126358341Z [2024-05-24T02:22:04.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:22:04.126857871Z [2024-05-24T02:22:04.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:21:00+00:00, run_id=scheduled__2024-05-24T02:21:00+00:00, run_start_date=2024-05-24 02:22:00.215015+00:00, run_end_date=2024-05-24 02:22:04.126242+00:00, run_duration=3.911227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:21:00+00:00, data_interval_end=2024-05-24 02:22:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:22:04.138356699Z [2024-05-24T02:22:04.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:22:00+00:00, run_after=2024-05-24T02:23:00+00:00 2024-05-24T02:22:04.186371810Z [2024-05-24T02:22:04.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:21:00+00:00 exited with status success for try_number 1 2024-05-24T02:22:04.186843862Z [2024-05-24T02:22:04.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:21:00+00:00 exited with status success for try_number 1 2024-05-24T02:22:04.199134663Z [2024-05-24T02:22:04.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:21:00+00:00, map_index=-1, run_start_date=2024-05-24 02:22:02.263330+00:00, run_end_date=2024-05-24 02:22:03.518941+00:00, run_duration=1.255611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:22:00.308917+00:00, queued_by_job_id=1, pid=14828 2024-05-24T02:22:04.201320734Z [2024-05-24T02:22:04.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:21:00+00:00, map_index=-1, run_start_date=2024-05-24 02:22:02.262580+00:00, run_end_date=2024-05-24 02:22:03.855658+00:00, run_duration=1.593078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:22:00.308917+00:00, queued_by_job_id=1, pid=14827 2024-05-24T02:23:00.066369310Z [2024-05-24T02:23:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:23:00+00:00, run_after=2024-05-24T02:24:00+00:00 2024-05-24T02:23:00.077347466Z [2024-05-24T02:23:00.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:23:00.095251242Z [2024-05-24T02:23:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:23:00+00:00, run_after=2024-05-24T02:24:00+00:00 2024-05-24T02:23:00.194951423Z [2024-05-24T02:23:00.193+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:23:00.194994985Z 2024-05-24T02:23:00.195003128Z 2024-05-24T02:23:00.195010388Z 2024-05-24T02:23:00.195562628Z [2024-05-24T02:23:00.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:23:00.196160530Z [2024-05-24T02:23:00.195+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:23:00.196663960Z [2024-05-24T02:23:00.196+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:23:00.197997338Z [2024-05-24T02:23:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:23:00.198010280Z 2024-05-24T02:23:00.198019430Z 2024-05-24T02:23:00.198028511Z 2024-05-24T02:23:00.217891483Z [2024-05-24T02:23:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:23:00.218044705Z [2024-05-24T02:23:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:23:00.218335574Z [2024-05-24T02:23:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:23:00.218516069Z [2024-05-24T02:23:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:23:00.218863864Z [2024-05-24T02:23:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:23:00.218962152Z [2024-05-24T02:23:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:23:00.588551461Z [2024-05-24T02:23:00.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status queued for try_number 1 2024-05-24T02:23:00.588881558Z [2024-05-24T02:23:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status queued for try_number 1 2024-05-24T02:23:00.589129569Z [2024-05-24T02:23:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status queued for try_number 1 2024-05-24T02:23:00.605590916Z [2024-05-24T02:23:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee98fd67-36c3-4c7a-b4ff-59b257f67fa6 2024-05-24T02:23:00.605762615Z [2024-05-24T02:23:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba88e7c2-03f1-4302-a582-aeb2db4f58f3 2024-05-24T02:23:00.606580435Z [2024-05-24T02:23:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca58e721-57ff-4ace-bd6b-b0f8823d939a 2024-05-24T02:23:01.781781204Z [2024-05-24T02:23:01.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:23:01.782387018Z [2024-05-24T02:23:01.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:22:00+00:00, run_id=scheduled__2024-05-24T02:22:00+00:00, run_start_date=2024-05-24 02:23:00.111553+00:00, run_end_date=2024-05-24 02:23:01.781708+00:00, run_duration=1.670155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:22:00+00:00, data_interval_end=2024-05-24 02:23:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:23:01.798388336Z [2024-05-24T02:23:01.798+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:23:00+00:00, run_after=2024-05-24T02:24:00+00:00 2024-05-24T02:23:01.846449542Z [2024-05-24T02:23:01.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status success for try_number 1 2024-05-24T02:23:01.853580339Z [2024-05-24T02:23:01.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:22:00+00:00, map_index=-1, run_start_date=2024-05-24 02:23:01.069529+00:00, run_end_date=2024-05-24 02:23:01.473922+00:00, run_duration=0.404393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:23:00.199566+00:00, queued_by_job_id=1, pid=14860 2024-05-24T02:23:04.020327372Z [2024-05-24T02:23:04.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:23:04.020871821Z [2024-05-24T02:23:04.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:22:00+00:00, run_id=scheduled__2024-05-24T02:22:00+00:00, run_start_date=2024-05-24 02:23:00.112949+00:00, run_end_date=2024-05-24 02:23:04.020199+00:00, run_duration=3.90725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:22:00+00:00, data_interval_end=2024-05-24 02:23:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:23:04.038629733Z [2024-05-24T02:23:04.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:23:00+00:00, run_after=2024-05-24T02:24:00+00:00 2024-05-24T02:23:04.052041483Z [2024-05-24T02:23:04.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:23:04.052325384Z [2024-05-24T02:23:04.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:22:00+00:00, run_id=scheduled__2024-05-24T02:22:00+00:00, run_start_date=2024-05-24 02:23:00.114098+00:00, run_end_date=2024-05-24 02:23:04.051740+00:00, run_duration=3.937642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:22:00+00:00, data_interval_end=2024-05-24 02:23:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:23:04.075042211Z [2024-05-24T02:23:04.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:23:00+00:00, run_after=2024-05-24T02:24:00+00:00 2024-05-24T02:23:04.128610265Z [2024-05-24T02:23:04.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status success for try_number 1 2024-05-24T02:23:04.129214098Z [2024-05-24T02:23:04.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status success for try_number 1 2024-05-24T02:23:04.149597833Z [2024-05-24T02:23:04.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:22:00+00:00, map_index=-1, run_start_date=2024-05-24 02:23:01.923224+00:00, run_end_date=2024-05-24 02:23:03.278985+00:00, run_duration=1.355761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:23:00.199566+00:00, queued_by_job_id=1, pid=14879 2024-05-24T02:23:04.149664817Z [2024-05-24T02:23:04.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:22:00+00:00, map_index=-1, run_start_date=2024-05-24 02:23:01.927151+00:00, run_end_date=2024-05-24 02:23:03.541812+00:00, run_duration=1.614661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:23:00.199566+00:00, queued_by_job_id=1, pid=14878 2024-05-24T02:24:00.196263731Z [2024-05-24T02:24:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:24:00+00:00, run_after=2024-05-24T02:25:00+00:00 2024-05-24T02:24:00.212509886Z [2024-05-24T02:24:00.212+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:24:00.223605740Z [2024-05-24T02:24:00.223+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:24:00.238933821Z [2024-05-24T02:24:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:24:00+00:00, run_after=2024-05-24T02:25:00+00:00 2024-05-24T02:24:00.304253194Z [2024-05-24T02:24:00.303+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:24:00.304275424Z 2024-05-24T02:24:00.304283120Z 2024-05-24T02:24:00.304286448Z 2024-05-24T02:24:00.304289733Z 2024-05-24T02:24:00.304419424Z [2024-05-24T02:24:00.304+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:24:00.304610837Z [2024-05-24T02:24:00.304+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:24:00.304741240Z [2024-05-24T02:24:00.304+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:24:00.305029916Z [2024-05-24T02:24:00.304+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:24:00.305616542Z [2024-05-24T02:24:00.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:24:00.305641518Z 2024-05-24T02:24:00.305645442Z 2024-05-24T02:24:00.305648584Z 2024-05-24T02:24:00.305651790Z 2024-05-24T02:24:00.310499736Z [2024-05-24T02:24:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:24:00.310723806Z [2024-05-24T02:24:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:24:00.311015840Z [2024-05-24T02:24:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:24:00.311175950Z [2024-05-24T02:24:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:24:00.311438829Z [2024-05-24T02:24:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:24:00.311582228Z [2024-05-24T02:24:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:24:00.311932076Z [2024-05-24T02:24:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:24:00.312085613Z [2024-05-24T02:24:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:24:00.859732231Z [2024-05-24T02:24:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status queued for try_number 1 2024-05-24T02:24:00.859759753Z [2024-05-24T02:24:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:23:00+00:00 exited with status queued for try_number 1 2024-05-24T02:24:00.859905885Z [2024-05-24T02:24:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:23:00+00:00 exited with status queued for try_number 1 2024-05-24T02:24:00.860041252Z [2024-05-24T02:24:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:23:00+00:00 exited with status queued for try_number 1 2024-05-24T02:24:00.880025744Z [2024-05-24T02:24:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 526c6d71-df41-4545-af4e-5f119929299a 2024-05-24T02:24:00.880237650Z [2024-05-24T02:24:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ffd3341-6778-46c6-b383-f634b9f41eee 2024-05-24T02:24:00.880436856Z [2024-05-24T02:24:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 921018cd-5b32-4aa0-8388-ceae428d0232 2024-05-24T02:24:00.880611928Z [2024-05-24T02:24:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9452996c-05e4-47ba-8822-1aec4559ba82 2024-05-24T02:24:02.811841896Z [2024-05-24T02:24:02.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:24:02.814238672Z [2024-05-24T02:24:02.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:22:00+00:00, run_id=scheduled__2024-05-24T02:22:00+00:00, run_start_date=2024-05-24 02:24:00.249636+00:00, run_end_date=2024-05-24 02:24:02.811734+00:00, run_duration=2.562098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:22:00+00:00, data_interval_end=2024-05-24 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:24:02.835396944Z [2024-05-24T02:24:02.835+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:24:00+00:00, run_after=2024-05-24T02:26:00+00:00 2024-05-24T02:24:02.853179558Z [2024-05-24T02:24:02.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:24:02.853556603Z [2024-05-24T02:24:02.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:23:00+00:00, run_id=scheduled__2024-05-24T02:23:00+00:00, run_start_date=2024-05-24 02:24:00.250825+00:00, run_end_date=2024-05-24 02:24:02.853142+00:00, run_duration=2.602317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:23:00+00:00, data_interval_end=2024-05-24 02:24:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:24:02.884778865Z [2024-05-24T02:24:02.884+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:24:00+00:00, run_after=2024-05-24T02:25:00+00:00 2024-05-24T02:24:02.958963014Z [2024-05-24T02:24:02.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:22:00+00:00 exited with status success for try_number 1 2024-05-24T02:24:02.959038367Z [2024-05-24T02:24:02.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:23:00+00:00 exited with status success for try_number 1 2024-05-24T02:24:02.966797389Z [2024-05-24T02:24:02.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:23:00+00:00, map_index=-1, run_start_date=2024-05-24 02:24:01.531585+00:00, run_end_date=2024-05-24 02:24:02.085291+00:00, run_duration=0.553706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:24:00.307738+00:00, queued_by_job_id=1, pid=14911 2024-05-24T02:24:02.966955953Z [2024-05-24T02:24:02.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:22:00+00:00, map_index=-1, run_start_date=2024-05-24 02:24:01.722552+00:00, run_end_date=2024-05-24 02:24:02.263585+00:00, run_duration=0.541033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:24:00.307738+00:00, queued_by_job_id=1, pid=14912 2024-05-24T02:24:05.139188636Z [2024-05-24T02:24:05.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:24:05.140093222Z [2024-05-24T02:24:05.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:23:00+00:00, run_id=scheduled__2024-05-24T02:23:00+00:00, run_start_date=2024-05-24 02:24:00.252763+00:00, run_end_date=2024-05-24 02:24:05.139328+00:00, run_duration=4.886565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:23:00+00:00, data_interval_end=2024-05-24 02:24:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:24:05.157028992Z [2024-05-24T02:24:05.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:24:00+00:00, run_after=2024-05-24T02:25:00+00:00 2024-05-24T02:24:05.195186487Z [2024-05-24T02:24:05.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:23:00+00:00 exited with status success for try_number 1 2024-05-24T02:24:05.195352200Z [2024-05-24T02:24:05.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:23:00+00:00 exited with status success for try_number 1 2024-05-24T02:24:05.203713170Z [2024-05-24T02:24:05.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:23:00+00:00, map_index=-1, run_start_date=2024-05-24 02:24:02.933973+00:00, run_end_date=2024-05-24 02:24:04.790442+00:00, run_duration=1.856469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:24:00.307738+00:00, queued_by_job_id=1, pid=14930 2024-05-24T02:24:05.204208397Z [2024-05-24T02:24:05.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:23:00+00:00, map_index=-1, run_start_date=2024-05-24 02:24:03.238657+00:00, run_end_date=2024-05-24 02:24:05.017371+00:00, run_duration=1.778714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:24:00.307738+00:00, queued_by_job_id=1, pid=14941 2024-05-24T02:24:06.272207913Z [2024-05-24T02:24:06.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:24:06.272499955Z [2024-05-24T02:24:06.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:23:00+00:00, run_id=scheduled__2024-05-24T02:23:00+00:00, run_start_date=2024-05-24 02:24:00.251854+00:00, run_end_date=2024-05-24 02:24:06.272035+00:00, run_duration=6.020181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:23:00+00:00, data_interval_end=2024-05-24 02:24:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:24:06.282836596Z [2024-05-24T02:24:06.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:24:00+00:00, run_after=2024-05-24T02:25:00+00:00 2024-05-24T02:25:00.789572202Z [2024-05-24T02:25:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:25:00+00:00, run_after=2024-05-24T02:26:00+00:00 2024-05-24T02:25:00.806980291Z [2024-05-24T02:25:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:25:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:25:00.827301294Z [2024-05-24T02:25:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:25:00+00:00, run_after=2024-05-24T02:26:00+00:00 2024-05-24T02:25:00.836410186Z [2024-05-24T02:25:00.835+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:25:00.927138643Z [2024-05-24T02:25:00.926+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:25:00.927165884Z 2024-05-24T02:25:00.927175078Z 2024-05-24T02:25:00.927180101Z 2024-05-24T02:25:00.927184556Z 2024-05-24T02:25:00.927430142Z [2024-05-24T02:25:00.927+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:25:00.927460979Z [2024-05-24T02:25:00.927+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:25:00.927754338Z [2024-05-24T02:25:00.927+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:25:00.927813320Z [2024-05-24T02:25:00.927+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:25:00.928490325Z [2024-05-24T02:25:00.928+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:25:00.928503059Z 2024-05-24T02:25:00.928509204Z 2024-05-24T02:25:00.928514587Z 2024-05-24T02:25:00.928519817Z 2024-05-24T02:25:00.932947400Z [2024-05-24T02:25:00.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:25:00.932971450Z [2024-05-24T02:25:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:25:00.933142381Z [2024-05-24T02:25:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:25:00.933272946Z [2024-05-24T02:25:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:25:00.933474751Z [2024-05-24T02:25:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:25:00.933574352Z [2024-05-24T02:25:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:25:00.933824653Z [2024-05-24T02:25:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:25:00.933925644Z [2024-05-24T02:25:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:25:01.448423900Z [2024-05-24T02:25:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:25:01.448465478Z [2024-05-24T02:25:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status queued for try_number 1 2024-05-24T02:25:01.448574513Z [2024-05-24T02:25:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status queued for try_number 1 2024-05-24T02:25:01.448647781Z [2024-05-24T02:25:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status queued for try_number 1 2024-05-24T02:25:01.458221723Z [2024-05-24T02:25:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to e759334e-41c2-4d69-bc57-d64677587a50 2024-05-24T02:25:01.458308619Z [2024-05-24T02:25:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3d68b4d-2e7e-439b-af26-67467dbe97c2 2024-05-24T02:25:01.458409011Z [2024-05-24T02:25:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31ddb706-9ae8-440b-9dac-be8ea7c65edc 2024-05-24T02:25:01.458490559Z [2024-05-24T02:25:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 344ef7cd-ad40-4f3e-b4ae-fd5a9d8cb6e3 2024-05-24T02:25:02.678433003Z [2024-05-24T02:25:02.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:25:02.678876616Z [2024-05-24T02:25:02.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:24:00+00:00, run_id=scheduled__2024-05-24T02:24:00+00:00, run_start_date=2024-05-24 02:25:00.848851+00:00, run_end_date=2024-05-24 02:25:02.678336+00:00, run_duration=1.829485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:24:00+00:00, data_interval_end=2024-05-24 02:25:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:25:02.702293933Z [2024-05-24T02:25:02.701+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:25:00+00:00, run_after=2024-05-24T02:26:00+00:00 2024-05-24T02:25:02.809945965Z [2024-05-24T02:25:02.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status success for try_number 1 2024-05-24T02:25:02.827171426Z [2024-05-24T02:25:02.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:24:00+00:00, map_index=-1, run_start_date=2024-05-24 02:25:01.893516+00:00, run_end_date=2024-05-24 02:25:02.248073+00:00, run_duration=0.354557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:25:00.929396+00:00, queued_by_job_id=1, pid=14969 2024-05-24T02:25:04.004915711Z [2024-05-24T02:25:04.004+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:25:04.004961841Z 2024-05-24T02:25:04.005216733Z [2024-05-24T02:25:04.004+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:25:04.006149428Z [2024-05-24T02:25:04.005+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:25:04.006155793Z 2024-05-24T02:25:04.010207081Z [2024-05-24T02:25:04.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:25:04.010766690Z [2024-05-24T02:25:04.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:25:04.062643644Z [2024-05-24T02:25:04.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:25:04.064067179Z [2024-05-24T02:25:04.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:25:04.073077304Z [2024-05-24T02:25:04.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c402a61-0f54-435a-9706-8ed640985131 2024-05-24T02:25:04.074719515Z [2024-05-24T02:25:04.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=-1, run_start_date=2024-05-24 02:25:03.092484+00:00, run_end_date=2024-05-24 02:25:03.521793+00:00, run_duration=0.429309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:25:00.929396+00:00, queued_by_job_id=1, pid=14995 2024-05-24T02:25:05.239927464Z [2024-05-24T02:25:05.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:25:05.240448775Z [2024-05-24T02:25:05.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:24:00+00:00, run_id=scheduled__2024-05-24T02:24:00+00:00, run_start_date=2024-05-24 02:25:00.850831+00:00, run_end_date=2024-05-24 02:25:05.239832+00:00, run_duration=4.389001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:24:00+00:00, data_interval_end=2024-05-24 02:25:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:25:05.250102134Z [2024-05-24T02:25:05.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:25:00+00:00, run_after=2024-05-24T02:26:00+00:00 2024-05-24T02:25:05.259082835Z [2024-05-24T02:25:05.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:25:05.259379384Z [2024-05-24T02:25:05.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:24:00+00:00, run_id=scheduled__2024-05-24T02:24:00+00:00, run_start_date=2024-05-24 02:25:00.849855+00:00, run_end_date=2024-05-24 02:25:05.258969+00:00, run_duration=4.409114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:24:00+00:00, data_interval_end=2024-05-24 02:25:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:25:05.271629656Z [2024-05-24T02:25:05.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:25:00+00:00, run_after=2024-05-24T02:26:00+00:00 2024-05-24T02:25:05.321651300Z [2024-05-24T02:25:05.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status success for try_number 1 2024-05-24T02:25:05.321684533Z [2024-05-24T02:25:05.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status success for try_number 1 2024-05-24T02:25:05.335559430Z [2024-05-24T02:25:05.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:24:00+00:00, map_index=-1, run_start_date=2024-05-24 02:25:03.080097+00:00, run_end_date=2024-05-24 02:25:04.313998+00:00, run_duration=1.233901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:25:00.929396+00:00, queued_by_job_id=1, pid=14994 2024-05-24T02:25:05.335604399Z [2024-05-24T02:25:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:24:00+00:00, map_index=-1, run_start_date=2024-05-24 02:25:02.856322+00:00, run_end_date=2024-05-24 02:25:04.617096+00:00, run_duration=1.760774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:25:00.929396+00:00, queued_by_job_id=1, pid=14983 2024-05-24T02:25:06.432228499Z [2024-05-24T02:25:06.431+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:25:06.432265822Z 2024-05-24T02:25:06.432717358Z [2024-05-24T02:25:06.432+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:25:06.434057713Z [2024-05-24T02:25:06.433+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:25:06.434066211Z 2024-05-24T02:25:06.438261826Z [2024-05-24T02:25:06.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:25:06.438663030Z [2024-05-24T02:25:06.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:25:06.492766053Z [2024-05-24T02:25:06.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:25:06.493062403Z [2024-05-24T02:25:06.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:25:06.501668138Z [2024-05-24T02:25:06.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 164f7560-f69f-4e88-a440-57a5be133d6e 2024-05-24T02:25:06.501959757Z [2024-05-24T02:25:06.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=-1, run_start_date=2024-05-24 02:25:05.647480+00:00, run_end_date=2024-05-24 02:25:06.061057+00:00, run_duration=0.413577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:25:04.006856+00:00, queued_by_job_id=1, pid=15018 2024-05-24T02:25:09.356448129Z [2024-05-24T02:25:09.356+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:25:09.356473375Z 2024-05-24T02:25:09.356718715Z [2024-05-24T02:25:09.356+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:25:09.357770639Z [2024-05-24T02:25:09.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:25:09.357782488Z 2024-05-24T02:25:09.364459626Z [2024-05-24T02:25:09.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:25:09.364620550Z [2024-05-24T02:25:09.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:25:09.430803357Z [2024-05-24T02:25:09.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status queued for try_number 1 2024-05-24T02:25:09.439722437Z [2024-05-24T02:25:09.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e8492cc-9a2e-473d-a351-c8e5ba6e2375 2024-05-24T02:25:09.518761636Z [2024-05-24T02:25:09.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:25:09.525481369Z [2024-05-24T02:25:09.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=0, run_start_date=2024-05-24 02:25:08.057240+00:00, run_end_date=2024-05-24 02:25:09.251255+00:00, run_duration=1.194015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:25:06.435340+00:00, queued_by_job_id=1, pid=15026 2024-05-24T02:25:12.867036263Z [2024-05-24T02:25:12.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:25:12.867344073Z [2024-05-24T02:25:12.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:20:00+00:00, run_id=scheduled__2024-05-24T02:20:00+00:00, run_start_date=2024-05-24 02:25:00.847603+00:00, run_end_date=2024-05-24 02:25:12.866999+00:00, run_duration=12.019396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:20:00+00:00, data_interval_end=2024-05-24 02:25:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:25:12.875757218Z [2024-05-24T02:25:12.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:25:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:25:12.921212849Z [2024-05-24T02:25:12.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:20:00+00:00 exited with status success for try_number 1 2024-05-24T02:25:12.931698506Z [2024-05-24T02:25:12.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:20:00+00:00, map_index=-1, run_start_date=2024-05-24 02:25:11.452512+00:00, run_end_date=2024-05-24 02:25:11.844075+00:00, run_duration=0.391563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:25:09.358288+00:00, queued_by_job_id=1, pid=15039 2024-05-24T02:26:00.846734981Z [2024-05-24T02:26:00.846+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:26:00.859048181Z [2024-05-24T02:26:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:26:00+00:00, run_after=2024-05-24T02:27:00+00:00 2024-05-24T02:26:00.872263165Z [2024-05-24T02:26:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:26:00+00:00, run_after=2024-05-24T02:27:00+00:00 2024-05-24T02:26:00.881164789Z [2024-05-24T02:26:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:26:00.996315978Z [2024-05-24T02:26:00.995+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:26:00.996344426Z 2024-05-24T02:26:00.996365929Z 2024-05-24T02:26:00.996371555Z 2024-05-24T02:26:00.996376952Z 2024-05-24T02:26:00.996513729Z [2024-05-24T02:26:00.996+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:26:00.996767225Z [2024-05-24T02:26:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:26:00.997121099Z [2024-05-24T02:26:00.996+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:26:00.997355549Z [2024-05-24T02:26:00.997+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:26:00.998085320Z [2024-05-24T02:26:00.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:26:00.998103658Z 2024-05-24T02:26:00.998111081Z 2024-05-24T02:26:00.998117225Z 2024-05-24T02:26:00.998123625Z 2024-05-24T02:26:01.005565248Z [2024-05-24T02:26:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:26:01.005833266Z [2024-05-24T02:26:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:26:01.006127332Z [2024-05-24T02:26:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:26:01.006294651Z [2024-05-24T02:26:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:26:01.006613686Z [2024-05-24T02:26:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:26:01.006811481Z [2024-05-24T02:26:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:26:01.007121159Z [2024-05-24T02:26:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:26:01.007283709Z [2024-05-24T02:26:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:26:01.456981998Z [2024-05-24T02:26:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status queued for try_number 1 2024-05-24T02:26:01.457143456Z [2024-05-24T02:26:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status queued for try_number 1 2024-05-24T02:26:01.457314795Z [2024-05-24T02:26:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status queued for try_number 1 2024-05-24T02:26:01.457455452Z [2024-05-24T02:26:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status queued for try_number 1 2024-05-24T02:26:01.474902449Z [2024-05-24T02:26:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b7285be-97aa-4e14-a76c-a5fa97438551 2024-05-24T02:26:01.475154518Z [2024-05-24T02:26:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6896a8f0-5231-427a-b87a-8edac3620ac5 2024-05-24T02:26:01.475262059Z [2024-05-24T02:26:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41b61a29-7a7d-4597-837d-12c198f9b3e8 2024-05-24T02:26:01.475360601Z [2024-05-24T02:26:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 573ab6c5-4f1f-4ac7-986e-8394718de057 2024-05-24T02:26:02.714694571Z [2024-05-24T02:26:02.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:26:02.714726209Z [2024-05-24T02:26:02.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:24:00+00:00, run_id=scheduled__2024-05-24T02:24:00+00:00, run_start_date=2024-05-24 02:26:00.894613+00:00, run_end_date=2024-05-24 02:26:02.710267+00:00, run_duration=1.815654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:24:00+00:00, data_interval_end=2024-05-24 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:26:02.726013073Z [2024-05-24T02:26:02.722+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:26:00+00:00, run_after=2024-05-24T02:28:00+00:00 2024-05-24T02:26:02.732738890Z [2024-05-24T02:26:02.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:26:02.735034044Z [2024-05-24T02:26:02.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:25:00+00:00, run_id=scheduled__2024-05-24T02:25:00+00:00, run_start_date=2024-05-24 02:26:00.896074+00:00, run_end_date=2024-05-24 02:26:02.732508+00:00, run_duration=1.836434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:25:00+00:00, data_interval_end=2024-05-24 02:26:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:26:02.748214008Z [2024-05-24T02:26:02.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:26:00+00:00, run_after=2024-05-24T02:27:00+00:00 2024-05-24T02:26:02.832139476Z [2024-05-24T02:26:02.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:24:00+00:00 exited with status success for try_number 1 2024-05-24T02:26:02.832353053Z [2024-05-24T02:26:02.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status success for try_number 1 2024-05-24T02:26:02.841985800Z [2024-05-24T02:26:02.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:24:00+00:00, map_index=-1, run_start_date=2024-05-24 02:26:01.773940+00:00, run_end_date=2024-05-24 02:26:02.230469+00:00, run_duration=0.456529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:26:00.999421+00:00, queued_by_job_id=1, pid=15062 2024-05-24T02:26:02.842313897Z [2024-05-24T02:26:02.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:25:00+00:00, map_index=-1, run_start_date=2024-05-24 02:26:01.822705+00:00, run_end_date=2024-05-24 02:26:02.267410+00:00, run_duration=0.444705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:26:00.999421+00:00, queued_by_job_id=1, pid=15063 2024-05-24T02:26:04.933257029Z [2024-05-24T02:26:04.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:26:04.933849978Z [2024-05-24T02:26:04.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:25:00+00:00, run_id=scheduled__2024-05-24T02:25:00+00:00, run_start_date=2024-05-24 02:26:00.897572+00:00, run_end_date=2024-05-24 02:26:04.933035+00:00, run_duration=4.035463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:25:00+00:00, data_interval_end=2024-05-24 02:26:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:26:04.953326410Z [2024-05-24T02:26:04.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:26:00+00:00, run_after=2024-05-24T02:27:00+00:00 2024-05-24T02:26:05.016359035Z [2024-05-24T02:26:05.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status success for try_number 1 2024-05-24T02:26:05.024371257Z [2024-05-24T02:26:05.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:25:00+00:00, map_index=-1, run_start_date=2024-05-24 02:26:02.944311+00:00, run_end_date=2024-05-24 02:26:04.358976+00:00, run_duration=1.414665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:26:00.999421+00:00, queued_by_job_id=1, pid=15081 2024-05-24T02:26:06.081864070Z [2024-05-24T02:26:06.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:26:06.082169448Z [2024-05-24T02:26:06.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:25:00+00:00, run_id=scheduled__2024-05-24T02:25:00+00:00, run_start_date=2024-05-24 02:26:00.899031+00:00, run_end_date=2024-05-24 02:26:06.081773+00:00, run_duration=5.182742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:25:00+00:00, data_interval_end=2024-05-24 02:26:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:26:06.098830031Z [2024-05-24T02:26:06.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:26:00+00:00, run_after=2024-05-24T02:27:00+00:00 2024-05-24T02:26:06.157707025Z [2024-05-24T02:26:06.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status success for try_number 1 2024-05-24T02:26:06.168533293Z [2024-05-24T02:26:06.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:25:00+00:00, map_index=-1, run_start_date=2024-05-24 02:26:03.152171+00:00, run_end_date=2024-05-24 02:26:05.171349+00:00, run_duration=2.019178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:26:00.999421+00:00, queued_by_job_id=1, pid=15087 2024-05-24T02:26:25.248186169Z [2024-05-24T02:26:25.246+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:26:25.248346468Z 2024-05-24T02:26:25.249184451Z [2024-05-24T02:26:25.248+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-24T02:26:25.251396224Z [2024-05-24T02:26:25.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:26:25.251429096Z 2024-05-24T02:26:25.256699619Z [2024-05-24T02:26:25.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240524022624_540607', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:26:25.257394069Z [2024-05-24T02:26:25.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240524022624_540607', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-24T02:26:25.334223847Z [2024-05-24T02:26:25.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240524022624_540607 exited with status queued for try_number 1 2024-05-24T02:26:25.342468568Z [2024-05-24T02:26:25.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 606871ad-ffc7-44d4-9b77-5c52fe16bbda 2024-05-24T02:26:26.490870860Z [2024-05-24T02:26:26.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:26:26.491066130Z [2024-05-24T02:26:26.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-24 02:26:24.348472+00:00, run_id=vdu_alarm_20240524022624_540607, run_start_date=2024-05-24 02:26:25.198621+00:00, run_end_date=2024-05-24 02:26:26.490669+00:00, run_duration=1.292048, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-24 02:26:24.348472+00:00, data_interval_end=2024-05-24 02:26:24.348472+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-24T02:26:26.494999074Z [2024-05-24T02:26:26.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-24T02:26:26.540642345Z [2024-05-24T02:26:26.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240524022624_540607 exited with status success for try_number 1 2024-05-24T02:26:26.546366537Z [2024-05-24T02:26:26.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240524022624_540607, map_index=-1, run_start_date=2024-05-24 02:26:25.845543+00:00, run_end_date=2024-05-24 02:26:26.219411+00:00, run_duration=0.373868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:26:25.252402+00:00, queued_by_job_id=1, pid=15112 2024-05-24T02:26:42.477831985Z [2024-05-24T02:26:42.477+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:27:00.791335580Z [2024-05-24T02:27:00.790+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:27:00.816698843Z [2024-05-24T02:27:00.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:27:00+00:00, run_after=2024-05-24T02:28:00+00:00 2024-05-24T02:27:00.836360490Z [2024-05-24T02:27:00.835+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:27:00+00:00, run_after=2024-05-24T02:28:00+00:00 2024-05-24T02:27:00.952324819Z [2024-05-24T02:27:00.951+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:27:00.952384762Z 2024-05-24T02:27:00.952389809Z 2024-05-24T02:27:00.952393605Z 2024-05-24T02:27:00.954887030Z [2024-05-24T02:27:00.952+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:27:00.955037501Z [2024-05-24T02:27:00.954+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:27:00.955153031Z [2024-05-24T02:27:00.955+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:27:00.955837498Z [2024-05-24T02:27:00.955+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:27:00.955851403Z 2024-05-24T02:27:00.955857009Z 2024-05-24T02:27:00.955862055Z 2024-05-24T02:27:00.960168957Z [2024-05-24T02:27:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:27:00.960193298Z [2024-05-24T02:27:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:27:00.960398294Z [2024-05-24T02:27:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:27:00.960526573Z [2024-05-24T02:27:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:27:00.960726132Z [2024-05-24T02:27:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:27:00.960841710Z [2024-05-24T02:27:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:27:01.227386905Z [2024-05-24T02:27:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status queued for try_number 1 2024-05-24T02:27:01.228354302Z [2024-05-24T02:27:01.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status queued for try_number 1 2024-05-24T02:27:01.228697293Z [2024-05-24T02:27:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status queued for try_number 1 2024-05-24T02:27:01.239412887Z [2024-05-24T02:27:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dd7ebab-17ec-4737-905f-4302c299a8fe 2024-05-24T02:27:01.239704238Z [2024-05-24T02:27:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to aaed8f8e-74d6-4e5f-84ca-d2d0a425b9bf 2024-05-24T02:27:01.239871507Z [2024-05-24T02:27:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc80ee87-c55b-403a-b26f-6eca66be0781 2024-05-24T02:27:02.400000807Z [2024-05-24T02:27:02.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:27:02.400458527Z [2024-05-24T02:27:02.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:26:00+00:00, run_id=scheduled__2024-05-24T02:26:00+00:00, run_start_date=2024-05-24 02:27:00.850709+00:00, run_end_date=2024-05-24 02:27:02.399943+00:00, run_duration=1.549234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:26:00+00:00, data_interval_end=2024-05-24 02:27:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:27:02.410016468Z [2024-05-24T02:27:02.409+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:27:00+00:00, run_after=2024-05-24T02:28:00+00:00 2024-05-24T02:27:02.473760060Z [2024-05-24T02:27:02.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status success for try_number 1 2024-05-24T02:27:02.489566858Z [2024-05-24T02:27:02.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:26:00+00:00, map_index=-1, run_start_date=2024-05-24 02:27:01.700744+00:00, run_end_date=2024-05-24 02:27:02.124389+00:00, run_duration=0.423645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:27:00.957112+00:00, queued_by_job_id=1, pid=15126 2024-05-24T02:27:04.837468323Z [2024-05-24T02:27:04.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:27:04.837834456Z [2024-05-24T02:27:04.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:26:00+00:00, run_id=scheduled__2024-05-24T02:26:00+00:00, run_start_date=2024-05-24 02:27:00.852258+00:00, run_end_date=2024-05-24 02:27:04.837307+00:00, run_duration=3.985049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:26:00+00:00, data_interval_end=2024-05-24 02:27:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:27:04.856825292Z [2024-05-24T02:27:04.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:27:00+00:00, run_after=2024-05-24T02:28:00+00:00 2024-05-24T02:27:04.909355603Z [2024-05-24T02:27:04.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status success for try_number 1 2024-05-24T02:27:04.917986705Z [2024-05-24T02:27:04.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:26:00+00:00, map_index=-1, run_start_date=2024-05-24 02:27:02.864727+00:00, run_end_date=2024-05-24 02:27:04.595434+00:00, run_duration=1.730707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:27:00.957112+00:00, queued_by_job_id=1, pid=15145 2024-05-24T02:27:06.007733553Z [2024-05-24T02:27:06.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:27:06.008168907Z [2024-05-24T02:27:06.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:26:00+00:00, run_id=scheduled__2024-05-24T02:26:00+00:00, run_start_date=2024-05-24 02:27:00.853719+00:00, run_end_date=2024-05-24 02:27:06.007611+00:00, run_duration=5.153892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:26:00+00:00, data_interval_end=2024-05-24 02:27:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:27:06.020436504Z [2024-05-24T02:27:06.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:27:00+00:00, run_after=2024-05-24T02:28:00+00:00 2024-05-24T02:27:06.058631742Z [2024-05-24T02:27:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status success for try_number 1 2024-05-24T02:27:06.064806397Z [2024-05-24T02:27:06.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:26:00+00:00, map_index=-1, run_start_date=2024-05-24 02:27:02.714855+00:00, run_end_date=2024-05-24 02:27:05.035345+00:00, run_duration=2.32049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:27:00.957112+00:00, queued_by_job_id=1, pid=15144 2024-05-24T02:28:00.705658052Z [2024-05-24T02:28:00.705+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:28:00.723890333Z [2024-05-24T02:28:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:28:00+00:00, run_after=2024-05-24T02:29:00+00:00 2024-05-24T02:28:00.735050919Z [2024-05-24T02:28:00.734+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:28:00.757945796Z [2024-05-24T02:28:00.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:28:00+00:00, run_after=2024-05-24T02:29:00+00:00 2024-05-24T02:28:00.853844846Z [2024-05-24T02:28:00.853+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:28:00.853870861Z 2024-05-24T02:28:00.853874969Z 2024-05-24T02:28:00.853878082Z 2024-05-24T02:28:00.853881093Z 2024-05-24T02:28:00.854105260Z [2024-05-24T02:28:00.853+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:28:00.854317695Z [2024-05-24T02:28:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:28:00.854555631Z [2024-05-24T02:28:00.854+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:28:00.854756070Z [2024-05-24T02:28:00.854+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:28:00.855486124Z [2024-05-24T02:28:00.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:28:00.855499443Z 2024-05-24T02:28:00.855503514Z 2024-05-24T02:28:00.855507064Z 2024-05-24T02:28:00.855510577Z 2024-05-24T02:28:00.859790699Z [2024-05-24T02:28:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:28:00.860223606Z [2024-05-24T02:28:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:28:00.860875430Z [2024-05-24T02:28:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:28:00.861189354Z [2024-05-24T02:28:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:28:00.861599655Z [2024-05-24T02:28:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:28:00.861958508Z [2024-05-24T02:28:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:28:00.862689851Z [2024-05-24T02:28:00.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:28:00.863070165Z [2024-05-24T02:28:00.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:28:01.367334975Z [2024-05-24T02:28:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status queued for try_number 1 2024-05-24T02:28:01.367656700Z [2024-05-24T02:28:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:27:00+00:00 exited with status queued for try_number 1 2024-05-24T02:28:01.367845262Z [2024-05-24T02:28:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:27:00+00:00 exited with status queued for try_number 1 2024-05-24T02:28:01.368018126Z [2024-05-24T02:28:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:27:00+00:00 exited with status queued for try_number 1 2024-05-24T02:28:01.386859894Z [2024-05-24T02:28:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a84ef15-6770-40aa-9d91-775c818d205e 2024-05-24T02:28:01.390974407Z [2024-05-24T02:28:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24fef8f3-a58a-4469-b5ee-ce6a65bde179 2024-05-24T02:28:01.391273446Z [2024-05-24T02:28:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7893137b-818f-47a7-bbff-3d47db3fda83 2024-05-24T02:28:01.391500780Z [2024-05-24T02:28:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to a47a9031-0dfd-43c9-8a48-a627767c4edd 2024-05-24T02:28:02.589680147Z [2024-05-24T02:28:02.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:28:02.589911095Z [2024-05-24T02:28:02.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:26:00+00:00, run_id=scheduled__2024-05-24T02:26:00+00:00, run_start_date=2024-05-24 02:28:00.772135+00:00, run_end_date=2024-05-24 02:28:02.589524+00:00, run_duration=1.817389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:26:00+00:00, data_interval_end=2024-05-24 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:28:02.599496254Z [2024-05-24T02:28:02.599+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:28:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:28:02.606871640Z [2024-05-24T02:28:02.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:28:02.607012605Z [2024-05-24T02:28:02.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:27:00+00:00, run_id=scheduled__2024-05-24T02:27:00+00:00, run_start_date=2024-05-24 02:28:00.773972+00:00, run_end_date=2024-05-24 02:28:02.606755+00:00, run_duration=1.832783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:27:00+00:00, data_interval_end=2024-05-24 02:28:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:28:02.619595909Z [2024-05-24T02:28:02.619+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:28:00+00:00, run_after=2024-05-24T02:29:00+00:00 2024-05-24T02:28:02.681247737Z [2024-05-24T02:28:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:26:00+00:00 exited with status success for try_number 1 2024-05-24T02:28:02.681288586Z [2024-05-24T02:28:02.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:27:00+00:00 exited with status success for try_number 1 2024-05-24T02:28:02.698716764Z [2024-05-24T02:28:02.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:26:00+00:00, map_index=-1, run_start_date=2024-05-24 02:28:01.737071+00:00, run_end_date=2024-05-24 02:28:02.071900+00:00, run_duration=0.334829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:28:00.856432+00:00, queued_by_job_id=1, pid=15179 2024-05-24T02:28:02.698815671Z [2024-05-24T02:28:02.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:27:00+00:00, map_index=-1, run_start_date=2024-05-24 02:28:01.770103+00:00, run_end_date=2024-05-24 02:28:02.207639+00:00, run_duration=0.437536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:28:00.856432+00:00, queued_by_job_id=1, pid=15180 2024-05-24T02:28:04.887303534Z [2024-05-24T02:28:04.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:28:04.887940768Z [2024-05-24T02:28:04.887+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:27:00+00:00, run_id=scheduled__2024-05-24T02:27:00+00:00, run_start_date=2024-05-24 02:28:00.775579+00:00, run_end_date=2024-05-24 02:28:04.887220+00:00, run_duration=4.111641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:27:00+00:00, data_interval_end=2024-05-24 02:28:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:28:04.903621666Z [2024-05-24T02:28:04.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:28:00+00:00, run_after=2024-05-24T02:29:00+00:00 2024-05-24T02:28:04.912121383Z [2024-05-24T02:28:04.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:28:04.912231759Z [2024-05-24T02:28:04.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:27:00+00:00, run_id=scheduled__2024-05-24T02:27:00+00:00, run_start_date=2024-05-24 02:28:00.776849+00:00, run_end_date=2024-05-24 02:28:04.911935+00:00, run_duration=4.135086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:27:00+00:00, data_interval_end=2024-05-24 02:28:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:28:04.922114726Z [2024-05-24T02:28:04.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:28:00+00:00, run_after=2024-05-24T02:29:00+00:00 2024-05-24T02:28:04.972727668Z [2024-05-24T02:28:04.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:27:00+00:00 exited with status success for try_number 1 2024-05-24T02:28:04.980371845Z [2024-05-24T02:28:04.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:27:00+00:00, map_index=-1, run_start_date=2024-05-24 02:28:02.888669+00:00, run_end_date=2024-05-24 02:28:04.385005+00:00, run_duration=1.496336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:28:00.856432+00:00, queued_by_job_id=1, pid=15198 2024-05-24T02:28:06.075911996Z [2024-05-24T02:28:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:27:00+00:00 exited with status success for try_number 1 2024-05-24T02:28:06.087230753Z [2024-05-24T02:28:06.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:27:00+00:00, map_index=-1, run_start_date=2024-05-24 02:28:03.131294+00:00, run_end_date=2024-05-24 02:28:04.827372+00:00, run_duration=1.696078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:28:00.856432+00:00, queued_by_job_id=1, pid=15204 2024-05-24T02:29:00.328856616Z [2024-05-24T02:29:00.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:29:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:29:00.353083367Z [2024-05-24T02:29:00.352+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:29:00.378842299Z [2024-05-24T02:29:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:29:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:29:00.445900024Z [2024-05-24T02:29:00.445+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:29:00.445927133Z 2024-05-24T02:29:00.445930641Z 2024-05-24T02:29:00.445933717Z 2024-05-24T02:29:00.445943693Z [2024-05-24T02:29:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:29:00.446014476Z [2024-05-24T02:29:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:29:00.446076174Z [2024-05-24T02:29:00.446+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:29:00.446632507Z [2024-05-24T02:29:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:29:00.446641345Z 2024-05-24T02:29:00.446644488Z 2024-05-24T02:29:00.446647272Z 2024-05-24T02:29:00.449825227Z [2024-05-24T02:29:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:29:00.449920689Z [2024-05-24T02:29:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:29:00.450110389Z [2024-05-24T02:29:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:29:00.450179757Z [2024-05-24T02:29:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:29:00.450339675Z [2024-05-24T02:29:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:29:00.450404950Z [2024-05-24T02:29:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:29:00.823540378Z [2024-05-24T02:29:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status queued for try_number 1 2024-05-24T02:29:00.823658148Z [2024-05-24T02:29:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status queued for try_number 1 2024-05-24T02:29:00.823675250Z [2024-05-24T02:29:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status queued for try_number 1 2024-05-24T02:29:00.836471620Z [2024-05-24T02:29:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba6ca7e2-ffa1-47db-9904-6ae7849134c5 2024-05-24T02:29:00.836488549Z [2024-05-24T02:29:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0358eed3-2531-4807-9020-17474605ff5a 2024-05-24T02:29:00.836508266Z [2024-05-24T02:29:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08cfd2ba-da09-4ad5-b54f-c2b120014cf9 2024-05-24T02:29:03.355952425Z [2024-05-24T02:29:03.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:29:03.359029109Z [2024-05-24T02:29:03.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:28:00+00:00, run_id=scheduled__2024-05-24T02:28:00+00:00, run_start_date=2024-05-24 02:29:00.397590+00:00, run_end_date=2024-05-24 02:29:03.358573+00:00, run_duration=2.960983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:28:00+00:00, data_interval_end=2024-05-24 02:29:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:29:03.381362112Z [2024-05-24T02:29:03.381+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:29:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:29:03.435459521Z [2024-05-24T02:29:03.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status success for try_number 1 2024-05-24T02:29:03.440608924Z [2024-05-24T02:29:03.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:28:00+00:00, map_index=-1, run_start_date=2024-05-24 02:29:01.476525+00:00, run_end_date=2024-05-24 02:29:02.387952+00:00, run_duration=0.911427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:29:00.447450+00:00, queued_by_job_id=1, pid=15236 2024-05-24T02:29:05.615792120Z [2024-05-24T02:29:05.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:29:05.616186773Z [2024-05-24T02:29:05.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:28:00+00:00, run_id=scheduled__2024-05-24T02:28:00+00:00, run_start_date=2024-05-24 02:29:00.399006+00:00, run_end_date=2024-05-24 02:29:05.615732+00:00, run_duration=5.216726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:28:00+00:00, data_interval_end=2024-05-24 02:29:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:29:05.625389093Z [2024-05-24T02:29:05.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:29:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:29:05.666178455Z [2024-05-24T02:29:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status success for try_number 1 2024-05-24T02:29:05.674032419Z [2024-05-24T02:29:05.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:28:00+00:00, map_index=-1, run_start_date=2024-05-24 02:29:03.129136+00:00, run_end_date=2024-05-24 02:29:05.128778+00:00, run_duration=1.999642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:29:00.447450+00:00, queued_by_job_id=1, pid=15255 2024-05-24T02:29:06.731218667Z [2024-05-24T02:29:06.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:29:06.731463644Z [2024-05-24T02:29:06.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:28:00+00:00, run_id=scheduled__2024-05-24T02:28:00+00:00, run_start_date=2024-05-24 02:29:00.400121+00:00, run_end_date=2024-05-24 02:29:06.731093+00:00, run_duration=6.330972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:28:00+00:00, data_interval_end=2024-05-24 02:29:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:29:06.740809870Z [2024-05-24T02:29:06.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:29:00+00:00, run_after=2024-05-24T02:30:00+00:00 2024-05-24T02:29:06.780964184Z [2024-05-24T02:29:06.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status success for try_number 1 2024-05-24T02:29:06.787513433Z [2024-05-24T02:29:06.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:28:00+00:00, map_index=-1, run_start_date=2024-05-24 02:29:03.158459+00:00, run_end_date=2024-05-24 02:29:05.716310+00:00, run_duration=2.557851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:29:00.447450+00:00, queued_by_job_id=1, pid=15254 2024-05-24T02:30:00.715486087Z [2024-05-24T02:30:00.714+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:30:00.736219869Z [2024-05-24T02:30:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:31:00+00:00 2024-05-24T02:30:00.749805206Z [2024-05-24T02:30:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:31:00+00:00 2024-05-24T02:30:00.758715110Z [2024-05-24T02:30:00.758+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:30:00.781902214Z [2024-05-24T02:30:00.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:35:00+00:00 2024-05-24T02:30:00.911881014Z [2024-05-24T02:30:00.911+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T02:30:00.911901891Z 2024-05-24T02:30:00.911905689Z 2024-05-24T02:30:00.911910379Z 2024-05-24T02:30:00.911913721Z 2024-05-24T02:30:00.911916937Z 2024-05-24T02:30:00.912076498Z [2024-05-24T02:30:00.911+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:30:00.912269678Z [2024-05-24T02:30:00.912+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:30:00.912404627Z [2024-05-24T02:30:00.912+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:30:00.912531693Z [2024-05-24T02:30:00.912+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:30:00.912653531Z [2024-05-24T02:30:00.912+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:30:00.913271087Z [2024-05-24T02:30:00.913+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:30:00.913284914Z 2024-05-24T02:30:00.913290681Z 2024-05-24T02:30:00.913294934Z 2024-05-24T02:30:00.913299163Z 2024-05-24T02:30:00.913320492Z 2024-05-24T02:30:00.917433351Z [2024-05-24T02:30:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:30:00.917677953Z [2024-05-24T02:30:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:30:00.917957514Z [2024-05-24T02:30:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:30:00.918084653Z [2024-05-24T02:30:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:30:00.918298350Z [2024-05-24T02:30:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:30:00.918430875Z [2024-05-24T02:30:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:30:00.918737529Z [2024-05-24T02:30:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:30:00.918836389Z [2024-05-24T02:30:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:30:00.919004598Z [2024-05-24T02:30:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:30:00.919169983Z [2024-05-24T02:30:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:30:01.450181454Z [2024-05-24T02:30:01.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:01.452476576Z [2024-05-24T02:30:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:01.452555419Z [2024-05-24T02:30:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:29:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:01.452678434Z [2024-05-24T02:30:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:29:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:01.452778937Z [2024-05-24T02:30:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:29:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:01.462967074Z [2024-05-24T02:30:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9873f31b-3801-48d1-a5de-0c7d6c82cea5 2024-05-24T02:30:01.463244090Z [2024-05-24T02:30:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to de4e32f0-897a-4441-91f2-19c1fe53d69b 2024-05-24T02:30:01.463397507Z [2024-05-24T02:30:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25d69122-3f14-41bb-a082-7a757b4b391d 2024-05-24T02:30:01.463616918Z [2024-05-24T02:30:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2bb73c1-fa5f-4b9c-805f-1c35fd00e3ea 2024-05-24T02:30:01.463805604Z [2024-05-24T02:30:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cc1a70d-03f1-412f-9746-9c5961d92606 2024-05-24T02:30:02.782560128Z [2024-05-24T02:30:02.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:28:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:02.790552211Z [2024-05-24T02:30:02.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:28:00+00:00, map_index=-1, run_start_date=2024-05-24 02:30:01.938190+00:00, run_end_date=2024-05-24 02:30:02.495604+00:00, run_duration=0.557414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:00.914281+00:00, queued_by_job_id=1, pid=15284 2024-05-24T02:30:03.172030090Z [2024-05-24T02:30:03.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:30:03.173120243Z [2024-05-24T02:30:03.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:28:00+00:00, run_id=scheduled__2024-05-24T02:28:00+00:00, run_start_date=2024-05-24 02:30:00.811429+00:00, run_end_date=2024-05-24 02:30:03.172714+00:00, run_duration=2.361285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:28:00+00:00, data_interval_end=2024-05-24 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:30:03.182629530Z [2024-05-24T02:30:03.182+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:32:00+00:00 2024-05-24T02:30:04.375196804Z [2024-05-24T02:30:04.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:30:04.375614022Z [2024-05-24T02:30:04.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:29:00+00:00, run_id=scheduled__2024-05-24T02:29:00+00:00, run_start_date=2024-05-24 02:30:00.814994+00:00, run_end_date=2024-05-24 02:30:04.375112+00:00, run_duration=3.560118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:29:00+00:00, data_interval_end=2024-05-24 02:30:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:30:04.384429158Z [2024-05-24T02:30:04.384+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:31:00+00:00 2024-05-24T02:30:04.438963888Z [2024-05-24T02:30:04.438+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:30:04.438990483Z 2024-05-24T02:30:04.439836949Z [2024-05-24T02:30:04.439+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:30:04.440626825Z [2024-05-24T02:30:04.440+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:30:04.440640520Z 2024-05-24T02:30:04.444075483Z [2024-05-24T02:30:04.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:30:04.445718747Z [2024-05-24T02:30:04.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:30:04.499937514Z [2024-05-24T02:30:04.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:04.500457806Z [2024-05-24T02:30:04.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:04.500796378Z [2024-05-24T02:30:04.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:29:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:04.517262299Z [2024-05-24T02:30:04.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:25:00+00:00, map_index=-1, run_start_date=2024-05-24 02:30:03.580650+00:00, run_end_date=2024-05-24 02:30:04.017297+00:00, run_duration=0.436647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:00.914281+00:00, queued_by_job_id=1, pid=15315 2024-05-24T02:30:04.517804598Z [2024-05-24T02:30:04.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:29:00+00:00, map_index=-1, run_start_date=2024-05-24 02:30:02.698922+00:00, run_end_date=2024-05-24 02:30:03.219946+00:00, run_duration=0.521024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:00.914281+00:00, queued_by_job_id=1, pid=15297 2024-05-24T02:30:04.518268620Z [2024-05-24T02:30:04.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to d09664a7-b9bb-4ecd-8a4d-852945ba6998 2024-05-24T02:30:05.698696510Z [2024-05-24T02:30:05.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:30:05.699268554Z [2024-05-24T02:30:05.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:29:00+00:00, run_id=scheduled__2024-05-24T02:29:00+00:00, run_start_date=2024-05-24 02:30:00.817895+00:00, run_end_date=2024-05-24 02:30:05.698830+00:00, run_duration=4.880935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:29:00+00:00, data_interval_end=2024-05-24 02:30:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:30:05.709199353Z [2024-05-24T02:30:05.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:31:00+00:00 2024-05-24T02:30:05.770675608Z [2024-05-24T02:30:05.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:29:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:05.777979807Z [2024-05-24T02:30:05.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:29:00+00:00, map_index=-1, run_start_date=2024-05-24 02:30:03.502249+00:00, run_end_date=2024-05-24 02:30:04.822163+00:00, run_duration=1.319914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:00.914281+00:00, queued_by_job_id=1, pid=15314 2024-05-24T02:30:06.816684204Z [2024-05-24T02:30:06.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:30:06.816704167Z [2024-05-24T02:30:06.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:29:00+00:00, run_id=scheduled__2024-05-24T02:29:00+00:00, run_start_date=2024-05-24 02:30:00.820375+00:00, run_end_date=2024-05-24 02:30:06.815846+00:00, run_duration=5.995471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:29:00+00:00, data_interval_end=2024-05-24 02:30:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:30:06.824836991Z [2024-05-24T02:30:06.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:31:00+00:00 2024-05-24T02:30:06.849683788Z [2024-05-24T02:30:06.849+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:30:06.849718324Z 2024-05-24T02:30:06.849867762Z [2024-05-24T02:30:06.849+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:30:06.850406572Z [2024-05-24T02:30:06.850+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:30:06.850415054Z 2024-05-24T02:30:06.852414133Z [2024-05-24T02:30:06.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:30:06.852593472Z [2024-05-24T02:30:06.852+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:30:06.936005744Z [2024-05-24T02:30:06.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:06.938379244Z [2024-05-24T02:30:06.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:29:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:06.938534262Z [2024-05-24T02:30:06.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:06.947007048Z [2024-05-24T02:30:06.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:25:00+00:00, map_index=-1, run_start_date=2024-05-24 02:30:06.088312+00:00, run_end_date=2024-05-24 02:30:06.482090+00:00, run_duration=0.393778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:04.441307+00:00, queued_by_job_id=1, pid=15344 2024-05-24T02:30:06.947303809Z [2024-05-24T02:30:06.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:29:00+00:00, map_index=-1, run_start_date=2024-05-24 02:30:04.094487+00:00, run_end_date=2024-05-24 02:30:05.742095+00:00, run_duration=1.647608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:00.914281+00:00, queued_by_job_id=1, pid=15331 2024-05-24T02:30:06.947512101Z [2024-05-24T02:30:06.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c035859-4c21-41eb-8406-1a6856867afc 2024-05-24T02:30:09.503513473Z [2024-05-24T02:30:09.503+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:30:09.503547971Z 2024-05-24T02:30:09.503765661Z [2024-05-24T02:30:09.503+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:30:09.504410749Z [2024-05-24T02:30:09.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:30:09.504424480Z 2024-05-24T02:30:09.506761531Z [2024-05-24T02:30:09.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:30:09.506926284Z [2024-05-24T02:30:09.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:30:09.567884117Z [2024-05-24T02:30:09.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status queued for try_number 1 2024-05-24T02:30:09.567907973Z [2024-05-24T02:30:09.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:09.575524992Z [2024-05-24T02:30:09.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e6c5b00-c609-4922-9ecf-b31430937996 2024-05-24T02:30:09.575669569Z [2024-05-24T02:30:09.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:25:00+00:00, map_index=0, run_start_date=2024-05-24 02:30:08.470630+00:00, run_end_date=2024-05-24 02:30:08.816861+00:00, run_duration=0.346231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:06.850753+00:00, queued_by_job_id=1, pid=15352 2024-05-24T02:30:11.852153273Z [2024-05-24T02:30:11.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:30:11.852361379Z [2024-05-24T02:30:11.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:25:00+00:00, run_id=scheduled__2024-05-24T02:25:00+00:00, run_start_date=2024-05-24 02:30:00.807338+00:00, run_end_date=2024-05-24 02:30:11.851855+00:00, run_duration=11.044517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:25:00+00:00, data_interval_end=2024-05-24 02:30:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:30:11.866122422Z [2024-05-24T02:30:11.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:30:00+00:00, run_after=2024-05-24T02:35:00+00:00 2024-05-24T02:30:11.914279694Z [2024-05-24T02:30:11.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:25:00+00:00 exited with status success for try_number 1 2024-05-24T02:30:11.920605095Z [2024-05-24T02:30:11.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:25:00+00:00, map_index=-1, run_start_date=2024-05-24 02:30:11.199437+00:00, run_end_date=2024-05-24 02:30:11.584528+00:00, run_duration=0.385091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:09.504811+00:00, queued_by_job_id=1, pid=15360 2024-05-24T02:30:24.654636881Z [2024-05-24T02:30:24.653+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:30:24.654714557Z 2024-05-24T02:30:24.654725172Z [2024-05-24T02:30:24.654+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-24T02:30:24.655429348Z [2024-05-24T02:30:24.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:30:24.655445819Z 2024-05-24T02:30:24.658282001Z [2024-05-24T02:30:24.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240524023024_700510', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:30:24.658307358Z [2024-05-24T02:30:24.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240524023024_700510', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-24T02:30:24.724488069Z [2024-05-24T02:30:24.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240524023024_700510 exited with status queued for try_number 1 2024-05-24T02:30:24.731147076Z [2024-05-24T02:30:24.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dc34fab-6a3c-4119-8edf-12ce153d489a 2024-05-24T02:30:25.856682384Z [2024-05-24T02:30:25.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:30:25.856799128Z [2024-05-24T02:30:25.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-24 02:30:24.313300+00:00, run_id=vdu_alarm_20240524023024_700510, run_start_date=2024-05-24 02:30:24.617907+00:00, run_end_date=2024-05-24 02:30:25.856476+00:00, run_duration=1.238569, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-24 02:30:24.313300+00:00, data_interval_end=2024-05-24 02:30:24.313300+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-24T02:30:25.862243757Z [2024-05-24T02:30:25.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-24T02:30:25.902395192Z [2024-05-24T02:30:25.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240524023024_700510 exited with status success for try_number 1 2024-05-24T02:30:25.908475554Z [2024-05-24T02:30:25.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240524023024_700510, map_index=-1, run_start_date=2024-05-24 02:30:25.318689+00:00, run_end_date=2024-05-24 02:30:25.680650+00:00, run_duration=0.361961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:30:24.655613+00:00, queued_by_job_id=1, pid=15375 2024-05-24T02:31:01.052879752Z [2024-05-24T02:31:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:31:00+00:00, run_after=2024-05-24T02:32:00+00:00 2024-05-24T02:31:01.067881180Z [2024-05-24T02:31:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:31:00+00:00, run_after=2024-05-24T02:32:00+00:00 2024-05-24T02:31:01.076645154Z [2024-05-24T02:31:01.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:31:01.161739975Z [2024-05-24T02:31:01.161+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:31:01.161786369Z 2024-05-24T02:31:01.161796136Z 2024-05-24T02:31:01.161804938Z 2024-05-24T02:31:01.162215384Z [2024-05-24T02:31:01.161+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:31:01.162817499Z [2024-05-24T02:31:01.162+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:31:01.163432877Z [2024-05-24T02:31:01.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:31:01.165244148Z [2024-05-24T02:31:01.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:31:01.165268990Z 2024-05-24T02:31:01.165277824Z 2024-05-24T02:31:01.165286434Z 2024-05-24T02:31:01.171962804Z [2024-05-24T02:31:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:31:01.172400084Z [2024-05-24T02:31:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:31:01.173071422Z [2024-05-24T02:31:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:31:01.173515149Z [2024-05-24T02:31:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:31:01.174259000Z [2024-05-24T02:31:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:31:01.174743931Z [2024-05-24T02:31:01.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:31:01.399332732Z [2024-05-24T02:31:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:31:01.399490124Z [2024-05-24T02:31:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:31:01.399643252Z [2024-05-24T02:31:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:31:01.409017780Z [2024-05-24T02:31:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f94d04a-c66a-4928-bf38-7f02879b09da 2024-05-24T02:31:01.409284881Z [2024-05-24T02:31:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88fed40e-7ac8-4c8b-90f5-dbe79055b486 2024-05-24T02:31:01.409491408Z [2024-05-24T02:31:01.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to adbaf7ab-c473-4a7f-b507-12907f9cce13 2024-05-24T02:31:02.574897872Z [2024-05-24T02:31:02.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:31:02.575270785Z [2024-05-24T02:31:02.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:30:00+00:00, run_id=scheduled__2024-05-24T02:30:00+00:00, run_start_date=2024-05-24 02:31:01.088235+00:00, run_end_date=2024-05-24 02:31:02.574895+00:00, run_duration=1.48666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:30:00+00:00, data_interval_end=2024-05-24 02:31:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:31:02.584701434Z [2024-05-24T02:31:02.584+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:31:00+00:00, run_after=2024-05-24T02:32:00+00:00 2024-05-24T02:31:02.628716638Z [2024-05-24T02:31:02.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:31:02.634028571Z [2024-05-24T02:31:02.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=-1, run_start_date=2024-05-24 02:31:01.953175+00:00, run_end_date=2024-05-24 02:31:02.392348+00:00, run_duration=0.439173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:31:01.167082+00:00, queued_by_job_id=1, pid=15389 2024-05-24T02:31:05.410426068Z [2024-05-24T02:31:05.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:31:05.411075477Z [2024-05-24T02:31:05.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:30:00+00:00, run_id=scheduled__2024-05-24T02:30:00+00:00, run_start_date=2024-05-24 02:31:01.089812+00:00, run_end_date=2024-05-24 02:31:05.410638+00:00, run_duration=4.320826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:30:00+00:00, data_interval_end=2024-05-24 02:31:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:31:05.424441691Z [2024-05-24T02:31:05.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:31:00+00:00, run_after=2024-05-24T02:32:00+00:00 2024-05-24T02:31:05.435225558Z [2024-05-24T02:31:05.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:31:05.435709041Z [2024-05-24T02:31:05.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:30:00+00:00, run_id=scheduled__2024-05-24T02:30:00+00:00, run_start_date=2024-05-24 02:31:01.092213+00:00, run_end_date=2024-05-24 02:31:05.435411+00:00, run_duration=4.343198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:30:00+00:00, data_interval_end=2024-05-24 02:31:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:31:05.448836646Z [2024-05-24T02:31:05.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:31:00+00:00, run_after=2024-05-24T02:32:00+00:00 2024-05-24T02:31:05.496138824Z [2024-05-24T02:31:05.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:31:05.496541321Z [2024-05-24T02:31:05.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:31:05.508896857Z [2024-05-24T02:31:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=-1, run_start_date=2024-05-24 02:31:03.201330+00:00, run_end_date=2024-05-24 02:31:05.016978+00:00, run_duration=1.815648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:31:01.167082+00:00, queued_by_job_id=1, pid=15408 2024-05-24T02:31:05.509593686Z [2024-05-24T02:31:05.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=-1, run_start_date=2024-05-24 02:31:03.040684+00:00, run_end_date=2024-05-24 02:31:04.410992+00:00, run_duration=1.370308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:31:01.167082+00:00, queued_by_job_id=1, pid=15407 2024-05-24T02:31:42.570101359Z [2024-05-24T02:31:42.569+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:32:00.132926157Z [2024-05-24T02:32:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:32:00+00:00, run_after=2024-05-24T02:33:00+00:00 2024-05-24T02:32:00.142797184Z [2024-05-24T02:32:00.142+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:32:00.156790329Z [2024-05-24T02:32:00.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:32:00+00:00, run_after=2024-05-24T02:33:00+00:00 2024-05-24T02:32:00.165437895Z [2024-05-24T02:32:00.165+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:32:00.257411805Z [2024-05-24T02:32:00.257+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:32:00.257451836Z 2024-05-24T02:32:00.257456793Z 2024-05-24T02:32:00.257460188Z 2024-05-24T02:32:00.257463346Z 2024-05-24T02:32:00.257729246Z [2024-05-24T02:32:00.257+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:32:00.257881008Z [2024-05-24T02:32:00.257+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:32:00.258024782Z [2024-05-24T02:32:00.257+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:32:00.258201463Z [2024-05-24T02:32:00.258+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:32:00.258913015Z [2024-05-24T02:32:00.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:32:00.258928950Z 2024-05-24T02:32:00.258932866Z 2024-05-24T02:32:00.258936086Z 2024-05-24T02:32:00.258964974Z 2024-05-24T02:32:00.263502703Z [2024-05-24T02:32:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:32:00.263750153Z [2024-05-24T02:32:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:32:00.264060453Z [2024-05-24T02:32:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:32:00.264293084Z [2024-05-24T02:32:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:32:00.264664308Z [2024-05-24T02:32:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:32:00.264867539Z [2024-05-24T02:32:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:32:00.265225531Z [2024-05-24T02:32:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:32:00.265422172Z [2024-05-24T02:32:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:32:00.841548689Z [2024-05-24T02:32:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:32:00.841654747Z [2024-05-24T02:32:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:31:00+00:00 exited with status queued for try_number 1 2024-05-24T02:32:00.841686081Z [2024-05-24T02:32:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:31:00+00:00 exited with status queued for try_number 1 2024-05-24T02:32:00.841744582Z [2024-05-24T02:32:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:31:00+00:00 exited with status queued for try_number 1 2024-05-24T02:32:00.855648487Z [2024-05-24T02:32:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59f1aa7d-77e1-4192-9cb8-980261dc1825 2024-05-24T02:32:00.855778674Z [2024-05-24T02:32:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72025783-bcdb-41b1-b8b2-7faf6f7a91cb 2024-05-24T02:32:00.855921436Z [2024-05-24T02:32:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26f92a66-a129-4f4d-9ae4-da125373af09 2024-05-24T02:32:00.856007448Z [2024-05-24T02:32:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 914d1753-7358-4535-b572-987d16d7a349 2024-05-24T02:32:02.150834155Z [2024-05-24T02:32:02.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:32:02.151195801Z [2024-05-24T02:32:02.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:30:00+00:00, run_id=scheduled__2024-05-24T02:30:00+00:00, run_start_date=2024-05-24 02:32:00.185457+00:00, run_end_date=2024-05-24 02:32:02.150799+00:00, run_duration=1.965342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:30:00+00:00, data_interval_end=2024-05-24 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:32:02.159956456Z [2024-05-24T02:32:02.159+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:32:00+00:00, run_after=2024-05-24T02:34:00+00:00 2024-05-24T02:32:02.167103892Z [2024-05-24T02:32:02.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:32:02.167468881Z [2024-05-24T02:32:02.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:31:00+00:00, run_id=scheduled__2024-05-24T02:31:00+00:00, run_start_date=2024-05-24 02:32:00.187636+00:00, run_end_date=2024-05-24 02:32:02.167086+00:00, run_duration=1.97945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:31:00+00:00, data_interval_end=2024-05-24 02:32:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:32:02.180575397Z [2024-05-24T02:32:02.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:32:00+00:00, run_after=2024-05-24T02:33:00+00:00 2024-05-24T02:32:02.232078438Z [2024-05-24T02:32:02.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:32:02.232229485Z [2024-05-24T02:32:02.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:31:00+00:00 exited with status success for try_number 1 2024-05-24T02:32:02.239436528Z [2024-05-24T02:32:02.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:31:00+00:00, map_index=-1, run_start_date=2024-05-24 02:32:01.336154+00:00, run_end_date=2024-05-24 02:32:01.907800+00:00, run_duration=0.571646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:32:00.259740+00:00, queued_by_job_id=1, pid=15441 2024-05-24T02:32:02.239688138Z [2024-05-24T02:32:02.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=-1, run_start_date=2024-05-24 02:32:01.275033+00:00, run_end_date=2024-05-24 02:32:01.747301+00:00, run_duration=0.472268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:32:00.259740+00:00, queued_by_job_id=1, pid=15440 2024-05-24T02:32:04.406087751Z [2024-05-24T02:32:04.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:32:04.407072797Z [2024-05-24T02:32:04.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:31:00+00:00, run_id=scheduled__2024-05-24T02:31:00+00:00, run_start_date=2024-05-24 02:32:00.190043+00:00, run_end_date=2024-05-24 02:32:04.406199+00:00, run_duration=4.216156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:31:00+00:00, data_interval_end=2024-05-24 02:32:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:32:04.425193234Z [2024-05-24T02:32:04.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:32:00+00:00, run_after=2024-05-24T02:33:00+00:00 2024-05-24T02:32:04.469252860Z [2024-05-24T02:32:04.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:31:00+00:00 exited with status success for try_number 1 2024-05-24T02:32:04.476331919Z [2024-05-24T02:32:04.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:31:00+00:00, map_index=-1, run_start_date=2024-05-24 02:32:02.516151+00:00, run_end_date=2024-05-24 02:32:03.879677+00:00, run_duration=1.363526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:32:00.259740+00:00, queued_by_job_id=1, pid=15464 2024-05-24T02:32:05.531661530Z [2024-05-24T02:32:05.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:32:05.531876637Z [2024-05-24T02:32:05.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:31:00+00:00, run_id=scheduled__2024-05-24T02:31:00+00:00, run_start_date=2024-05-24 02:32:00.192116+00:00, run_end_date=2024-05-24 02:32:05.531326+00:00, run_duration=5.33921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:31:00+00:00, data_interval_end=2024-05-24 02:32:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:32:05.549533854Z [2024-05-24T02:32:05.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:32:00+00:00, run_after=2024-05-24T02:33:00+00:00 2024-05-24T02:32:05.600262748Z [2024-05-24T02:32:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:31:00+00:00 exited with status success for try_number 1 2024-05-24T02:32:05.608461007Z [2024-05-24T02:32:05.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:31:00+00:00, map_index=-1, run_start_date=2024-05-24 02:32:02.564243+00:00, run_end_date=2024-05-24 02:32:04.388947+00:00, run_duration=1.824704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:32:00.259740+00:00, queued_by_job_id=1, pid=15465 2024-05-24T02:33:00.889275014Z [2024-05-24T02:33:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:33:00+00:00, run_after=2024-05-24T02:34:00+00:00 2024-05-24T02:33:00.924085170Z [2024-05-24T02:33:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:33:00+00:00, run_after=2024-05-24T02:34:00+00:00 2024-05-24T02:33:00.936111069Z [2024-05-24T02:33:00.934+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:33:01.002677545Z [2024-05-24T02:33:00.997+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:33:01.002701462Z 2024-05-24T02:33:01.002704974Z 2024-05-24T02:33:01.002708201Z 2024-05-24T02:33:01.002711611Z [2024-05-24T02:33:00.997+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:33:01.002714668Z [2024-05-24T02:33:00.997+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:33:01.002717686Z [2024-05-24T02:33:00.997+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:33:01.002723612Z [2024-05-24T02:33:00.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:33:01.002726983Z 2024-05-24T02:33:01.002729993Z 2024-05-24T02:33:01.002733037Z 2024-05-24T02:33:01.007108206Z [2024-05-24T02:33:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:33:01.007374504Z [2024-05-24T02:33:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:33:01.007631587Z [2024-05-24T02:33:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:33:01.007756998Z [2024-05-24T02:33:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:33:01.007987173Z [2024-05-24T02:33:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:33:01.008108889Z [2024-05-24T02:33:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:33:01.351183446Z [2024-05-24T02:33:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status queued for try_number 1 2024-05-24T02:33:01.351271743Z [2024-05-24T02:33:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status queued for try_number 1 2024-05-24T02:33:01.351448543Z [2024-05-24T02:33:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status queued for try_number 1 2024-05-24T02:33:01.360538070Z [2024-05-24T02:33:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to c22eab40-960b-4a00-9924-9451f4117ac6 2024-05-24T02:33:01.360617500Z [2024-05-24T02:33:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03a5e47e-e487-41a5-876f-0c9d6fa534f2 2024-05-24T02:33:01.360793945Z [2024-05-24T02:33:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15a260a9-8e01-46a4-9cfd-4be3619b4941 2024-05-24T02:33:02.945809475Z [2024-05-24T02:33:02.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:33:02.946339277Z [2024-05-24T02:33:02.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:32:00+00:00, run_id=scheduled__2024-05-24T02:32:00+00:00, run_start_date=2024-05-24 02:33:00.948000+00:00, run_end_date=2024-05-24 02:33:02.945828+00:00, run_duration=1.997828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:32:00+00:00, data_interval_end=2024-05-24 02:33:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:33:02.959430718Z [2024-05-24T02:33:02.959+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:33:00+00:00, run_after=2024-05-24T02:34:00+00:00 2024-05-24T02:33:03.024624416Z [2024-05-24T02:33:03.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status success for try_number 1 2024-05-24T02:33:03.031056718Z [2024-05-24T02:33:03.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:32:00+00:00, map_index=-1, run_start_date=2024-05-24 02:33:01.875963+00:00, run_end_date=2024-05-24 02:33:02.316932+00:00, run_duration=0.440969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:33:00.998814+00:00, queued_by_job_id=1, pid=15497 2024-05-24T02:33:05.206750320Z [2024-05-24T02:33:05.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:33:05.206979736Z [2024-05-24T02:33:05.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:32:00+00:00, run_id=scheduled__2024-05-24T02:32:00+00:00, run_start_date=2024-05-24 02:33:00.949250+00:00, run_end_date=2024-05-24 02:33:05.206448+00:00, run_duration=4.257198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:32:00+00:00, data_interval_end=2024-05-24 02:33:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:33:05.216023245Z [2024-05-24T02:33:05.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:33:00+00:00, run_after=2024-05-24T02:34:00+00:00 2024-05-24T02:33:06.334740795Z [2024-05-24T02:33:06.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:33:06.335163829Z [2024-05-24T02:33:06.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:32:00+00:00, run_id=scheduled__2024-05-24T02:32:00+00:00, run_start_date=2024-05-24 02:33:00.950215+00:00, run_end_date=2024-05-24 02:33:06.334591+00:00, run_duration=5.384376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:32:00+00:00, data_interval_end=2024-05-24 02:33:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:33:06.345373951Z [2024-05-24T02:33:06.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:33:00+00:00, run_after=2024-05-24T02:34:00+00:00 2024-05-24T02:33:06.379635138Z [2024-05-24T02:33:06.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status success for try_number 1 2024-05-24T02:33:06.380021719Z [2024-05-24T02:33:06.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status success for try_number 1 2024-05-24T02:33:06.388757281Z [2024-05-24T02:33:06.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:32:00+00:00, map_index=-1, run_start_date=2024-05-24 02:33:03.137976+00:00, run_end_date=2024-05-24 02:33:05.139341+00:00, run_duration=2.001365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:33:00.998814+00:00, queued_by_job_id=1, pid=15515 2024-05-24T02:33:06.389362839Z [2024-05-24T02:33:06.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:32:00+00:00, map_index=-1, run_start_date=2024-05-24 02:33:03.246732+00:00, run_end_date=2024-05-24 02:33:05.594988+00:00, run_duration=2.348256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:33:00.998814+00:00, queued_by_job_id=1, pid=15516 2024-05-24T02:34:00.978952520Z [2024-05-24T02:34:00.978+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:34:00.991369967Z [2024-05-24T02:34:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:34:00+00:00, run_after=2024-05-24T02:35:00+00:00 2024-05-24T02:34:01.019069047Z [2024-05-24T02:34:01.018+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:34:01.040304790Z [2024-05-24T02:34:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:34:00+00:00, run_after=2024-05-24T02:35:00+00:00 2024-05-24T02:34:01.150461794Z [2024-05-24T02:34:01.149+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:34:01.150572939Z 2024-05-24T02:34:01.150587955Z 2024-05-24T02:34:01.150596901Z 2024-05-24T02:34:01.150605522Z 2024-05-24T02:34:01.150773379Z [2024-05-24T02:34:01.150+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:34:01.150890203Z [2024-05-24T02:34:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:34:01.151358972Z [2024-05-24T02:34:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:34:01.151568316Z [2024-05-24T02:34:01.151+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:34:01.152321110Z [2024-05-24T02:34:01.152+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:34:01.152370232Z 2024-05-24T02:34:01.152380260Z 2024-05-24T02:34:01.152388836Z 2024-05-24T02:34:01.152397808Z 2024-05-24T02:34:01.159353504Z [2024-05-24T02:34:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:34:01.159389667Z [2024-05-24T02:34:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:34:01.159581688Z [2024-05-24T02:34:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:34:01.159596485Z [2024-05-24T02:34:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:34:01.159774385Z [2024-05-24T02:34:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:34:01.159897087Z [2024-05-24T02:34:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:34:01.160018219Z [2024-05-24T02:34:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:34:01.160143687Z [2024-05-24T02:34:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:34:01.455964457Z [2024-05-24T02:34:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status queued for try_number 1 2024-05-24T02:34:01.456150917Z [2024-05-24T02:34:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:33:00+00:00 exited with status queued for try_number 1 2024-05-24T02:34:01.456355872Z [2024-05-24T02:34:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:33:00+00:00 exited with status queued for try_number 1 2024-05-24T02:34:01.456537437Z [2024-05-24T02:34:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:33:00+00:00 exited with status queued for try_number 1 2024-05-24T02:34:01.479889611Z [2024-05-24T02:34:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34063a58-4a3a-46c8-aed2-916ec162d04e 2024-05-24T02:34:01.482975293Z [2024-05-24T02:34:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e066280-75f4-420c-83dd-912910aadd90 2024-05-24T02:34:01.483257649Z [2024-05-24T02:34:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 075511a5-cb87-4821-979a-0dd4af69e977 2024-05-24T02:34:01.483509180Z [2024-05-24T02:34:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a8dfd0e-67b9-4821-a5c7-f9744ae2a032 2024-05-24T02:34:02.868609955Z [2024-05-24T02:34:02.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:34:02.869032653Z [2024-05-24T02:34:02.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:32:00+00:00, run_id=scheduled__2024-05-24T02:32:00+00:00, run_start_date=2024-05-24 02:34:01.052252+00:00, run_end_date=2024-05-24 02:34:02.868620+00:00, run_duration=1.816368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:32:00+00:00, data_interval_end=2024-05-24 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:34:02.876186133Z [2024-05-24T02:34:02.875+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:34:00+00:00, run_after=2024-05-24T02:36:00+00:00 2024-05-24T02:34:02.882756410Z [2024-05-24T02:34:02.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:34:02.882986824Z [2024-05-24T02:34:02.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:33:00+00:00, run_id=scheduled__2024-05-24T02:33:00+00:00, run_start_date=2024-05-24 02:34:01.053777+00:00, run_end_date=2024-05-24 02:34:02.882736+00:00, run_duration=1.828959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:33:00+00:00, data_interval_end=2024-05-24 02:34:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:34:02.892396604Z [2024-05-24T02:34:02.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:34:00+00:00, run_after=2024-05-24T02:35:00+00:00 2024-05-24T02:34:02.937713611Z [2024-05-24T02:34:02.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:32:00+00:00 exited with status success for try_number 1 2024-05-24T02:34:02.938086292Z [2024-05-24T02:34:02.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:33:00+00:00 exited with status success for try_number 1 2024-05-24T02:34:02.949925046Z [2024-05-24T02:34:02.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:33:00+00:00, map_index=-1, run_start_date=2024-05-24 02:34:02.132595+00:00, run_end_date=2024-05-24 02:34:02.562842+00:00, run_duration=0.430247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:34:01.153809+00:00, queued_by_job_id=1, pid=15549 2024-05-24T02:34:02.950326449Z [2024-05-24T02:34:02.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:32:00+00:00, map_index=-1, run_start_date=2024-05-24 02:34:02.142948+00:00, run_end_date=2024-05-24 02:34:02.535356+00:00, run_duration=0.392408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:34:01.153809+00:00, queued_by_job_id=1, pid=15550 2024-05-24T02:34:05.134619371Z [2024-05-24T02:34:05.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:34:05.135401577Z [2024-05-24T02:34:05.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:33:00+00:00, run_id=scheduled__2024-05-24T02:33:00+00:00, run_start_date=2024-05-24 02:34:01.055029+00:00, run_end_date=2024-05-24 02:34:05.135082+00:00, run_duration=4.080053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:33:00+00:00, data_interval_end=2024-05-24 02:34:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:34:05.144248785Z [2024-05-24T02:34:05.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:34:00+00:00, run_after=2024-05-24T02:35:00+00:00 2024-05-24T02:34:05.178197849Z [2024-05-24T02:34:05.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:33:00+00:00 exited with status success for try_number 1 2024-05-24T02:34:05.192410230Z [2024-05-24T02:34:05.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:33:00+00:00, map_index=-1, run_start_date=2024-05-24 02:34:03.365515+00:00, run_end_date=2024-05-24 02:34:04.747280+00:00, run_duration=1.381765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:34:01.153809+00:00, queued_by_job_id=1, pid=15573 2024-05-24T02:34:06.236721830Z [2024-05-24T02:34:06.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:34:06.237173699Z [2024-05-24T02:34:06.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:33:00+00:00, run_id=scheduled__2024-05-24T02:33:00+00:00, run_start_date=2024-05-24 02:34:01.056115+00:00, run_end_date=2024-05-24 02:34:06.236617+00:00, run_duration=5.180502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:33:00+00:00, data_interval_end=2024-05-24 02:34:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:34:06.245882420Z [2024-05-24T02:34:06.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:34:00+00:00, run_after=2024-05-24T02:35:00+00:00 2024-05-24T02:34:06.289688225Z [2024-05-24T02:34:06.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:33:00+00:00 exited with status success for try_number 1 2024-05-24T02:34:06.300690356Z [2024-05-24T02:34:06.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:33:00+00:00, map_index=-1, run_start_date=2024-05-24 02:34:03.432156+00:00, run_end_date=2024-05-24 02:34:05.095519+00:00, run_duration=1.663363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:34:01.153809+00:00, queued_by_job_id=1, pid=15574 2024-05-24T02:35:00.993090161Z [2024-05-24T02:35:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:35:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:35:01.007235672Z [2024-05-24T02:35:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:35:00+00:00, run_after=2024-05-24T02:36:00+00:00 2024-05-24T02:35:01.022074201Z [2024-05-24T02:35:01.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:35:00+00:00, run_after=2024-05-24T02:36:00+00:00 2024-05-24T02:35:01.029444964Z [2024-05-24T02:35:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:35:01.145910500Z [2024-05-24T02:35:01.145+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:35:01.145968729Z 2024-05-24T02:35:01.145982985Z 2024-05-24T02:35:01.145990734Z 2024-05-24T02:35:01.145998394Z 2024-05-24T02:35:01.146272214Z [2024-05-24T02:35:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:35:01.146782141Z [2024-05-24T02:35:01.146+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:35:01.147245048Z [2024-05-24T02:35:01.146+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:35:01.147658596Z [2024-05-24T02:35:01.147+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:35:01.148872729Z [2024-05-24T02:35:01.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:35:01.148894644Z 2024-05-24T02:35:01.148903395Z 2024-05-24T02:35:01.148910184Z 2024-05-24T02:35:01.148916825Z 2024-05-24T02:35:01.155582941Z [2024-05-24T02:35:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:35:01.156010435Z [2024-05-24T02:35:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:35:01.156679320Z [2024-05-24T02:35:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:35:01.157030714Z [2024-05-24T02:35:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:35:01.157512769Z [2024-05-24T02:35:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:35:01.157831622Z [2024-05-24T02:35:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:35:01.158264182Z [2024-05-24T02:35:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:35:01.158393734Z [2024-05-24T02:35:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:35:01.565461139Z [2024-05-24T02:35:01.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:35:01.565740467Z [2024-05-24T02:35:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status queued for try_number 1 2024-05-24T02:35:01.565886436Z [2024-05-24T02:35:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status queued for try_number 1 2024-05-24T02:35:01.566025982Z [2024-05-24T02:35:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status queued for try_number 1 2024-05-24T02:35:01.589028754Z [2024-05-24T02:35:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86cde836-87e5-418a-973b-f9a91d561f84 2024-05-24T02:35:01.589292013Z [2024-05-24T02:35:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcd14480-002d-4524-a391-9dd60314d634 2024-05-24T02:35:01.589516961Z [2024-05-24T02:35:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e2a3a13-15ee-4830-ac8c-d20513300afd 2024-05-24T02:35:01.589716441Z [2024-05-24T02:35:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dbd18ac-403d-4b9a-bdb9-3ce0f0cebd91 2024-05-24T02:35:03.532068151Z [2024-05-24T02:35:03.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:35:03.532562566Z [2024-05-24T02:35:03.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:34:00+00:00, run_id=scheduled__2024-05-24T02:34:00+00:00, run_start_date=2024-05-24 02:35:01.045275+00:00, run_end_date=2024-05-24 02:35:03.532182+00:00, run_duration=2.486907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:34:00+00:00, data_interval_end=2024-05-24 02:35:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:35:03.545310336Z [2024-05-24T02:35:03.544+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:35:00+00:00, run_after=2024-05-24T02:36:00+00:00 2024-05-24T02:35:03.615619192Z [2024-05-24T02:35:03.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status success for try_number 1 2024-05-24T02:35:03.625551845Z [2024-05-24T02:35:03.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:34:00+00:00, map_index=-1, run_start_date=2024-05-24 02:35:02.148464+00:00, run_end_date=2024-05-24 02:35:02.496712+00:00, run_duration=0.348248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:35:01.150649+00:00, queued_by_job_id=1, pid=15606 2024-05-24T02:35:03.995173405Z [2024-05-24T02:35:03.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:35:03.995207921Z 2024-05-24T02:35:03.995419014Z [2024-05-24T02:35:03.995+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:35:03.996059916Z [2024-05-24T02:35:03.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:35:03.996071786Z 2024-05-24T02:35:03.998564327Z [2024-05-24T02:35:03.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:35:03.998823120Z [2024-05-24T02:35:03.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:35:04.064884092Z [2024-05-24T02:35:04.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:35:04.064907495Z [2024-05-24T02:35:04.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:35:04.070406084Z [2024-05-24T02:35:04.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bf98c67-097f-45d7-9cc3-8dd0aee6ae85 2024-05-24T02:35:04.070479710Z [2024-05-24T02:35:04.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=-1, run_start_date=2024-05-24 02:35:03.255741+00:00, run_end_date=2024-05-24 02:35:03.627512+00:00, run_duration=0.371771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:35:01.150649+00:00, queued_by_job_id=1, pid=15631 2024-05-24T02:35:05.248931787Z [2024-05-24T02:35:05.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:35:05.249371378Z [2024-05-24T02:35:05.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:34:00+00:00, run_id=scheduled__2024-05-24T02:34:00+00:00, run_start_date=2024-05-24 02:35:01.047162+00:00, run_end_date=2024-05-24 02:35:05.249025+00:00, run_duration=4.201863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:34:00+00:00, data_interval_end=2024-05-24 02:35:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:35:05.260235443Z [2024-05-24T02:35:05.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:35:00+00:00, run_after=2024-05-24T02:36:00+00:00 2024-05-24T02:35:05.281986347Z [2024-05-24T02:35:05.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:35:05.282304659Z [2024-05-24T02:35:05.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:34:00+00:00, run_id=scheduled__2024-05-24T02:34:00+00:00, run_start_date=2024-05-24 02:35:01.048883+00:00, run_end_date=2024-05-24 02:35:05.281979+00:00, run_duration=4.233096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:34:00+00:00, data_interval_end=2024-05-24 02:35:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:35:05.293079913Z [2024-05-24T02:35:05.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:35:00+00:00, run_after=2024-05-24T02:36:00+00:00 2024-05-24T02:35:05.384172908Z [2024-05-24T02:35:05.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status success for try_number 1 2024-05-24T02:35:05.384724050Z [2024-05-24T02:35:05.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status success for try_number 1 2024-05-24T02:35:05.394260779Z [2024-05-24T02:35:05.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:34:00+00:00, map_index=-1, run_start_date=2024-05-24 02:35:03.384159+00:00, run_end_date=2024-05-24 02:35:04.664111+00:00, run_duration=1.279952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:35:01.150649+00:00, queued_by_job_id=1, pid=15632 2024-05-24T02:35:05.394574615Z [2024-05-24T02:35:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:34:00+00:00, map_index=-1, run_start_date=2024-05-24 02:35:03.186458+00:00, run_end_date=2024-05-24 02:35:04.701361+00:00, run_duration=1.514903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:35:01.150649+00:00, queued_by_job_id=1, pid=15630 2024-05-24T02:35:06.484089345Z [2024-05-24T02:35:06.483+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:35:06.484137476Z 2024-05-24T02:35:06.484207928Z [2024-05-24T02:35:06.483+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:35:06.485041779Z [2024-05-24T02:35:06.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:35:06.485061234Z 2024-05-24T02:35:06.487980724Z [2024-05-24T02:35:06.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:35:06.488093248Z [2024-05-24T02:35:06.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:35:06.545095948Z [2024-05-24T02:35:06.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:35:06.545468208Z [2024-05-24T02:35:06.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:35:06.551989133Z [2024-05-24T02:35:06.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28d1d5c6-daf5-4d1f-b5bd-bc649a2b50a8 2024-05-24T02:35:06.552728237Z [2024-05-24T02:35:06.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=-1, run_start_date=2024-05-24 02:35:05.798502+00:00, run_end_date=2024-05-24 02:35:06.223317+00:00, run_duration=0.424815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:35:03.996432+00:00, queued_by_job_id=1, pid=15655 2024-05-24T02:35:08.817858913Z [2024-05-24T02:35:08.817+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:35:08.818377024Z 2024-05-24T02:35:08.818397056Z [2024-05-24T02:35:08.817+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:35:08.824873960Z [2024-05-24T02:35:08.824+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:35:08.825001629Z 2024-05-24T02:35:08.827695425Z [2024-05-24T02:35:08.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:35:08.827856438Z [2024-05-24T02:35:08.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:35:08.931703931Z [2024-05-24T02:35:08.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status queued for try_number 1 2024-05-24T02:35:08.931797673Z [2024-05-24T02:35:08.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:35:08.967198373Z [2024-05-24T02:35:08.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to f783153b-88cf-42b7-83d5-0d4f156afb53 2024-05-24T02:35:08.967224958Z [2024-05-24T02:35:08.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=0, run_start_date=2024-05-24 02:35:08.175067+00:00, run_end_date=2024-05-24 02:35:08.518990+00:00, run_duration=0.343923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:35:06.485694+00:00, queued_by_job_id=1, pid=15663 2024-05-24T02:35:12.045498055Z [2024-05-24T02:35:12.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:35:12.045749976Z [2024-05-24T02:35:12.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:30:00+00:00, run_id=scheduled__2024-05-24T02:30:00+00:00, run_start_date=2024-05-24 02:35:01.042879+00:00, run_end_date=2024-05-24 02:35:12.045307+00:00, run_duration=11.002428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:30:00+00:00, data_interval_end=2024-05-24 02:35:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:35:12.053310463Z [2024-05-24T02:35:12.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:35:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:35:12.099878438Z [2024-05-24T02:35:12.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:30:00+00:00 exited with status success for try_number 1 2024-05-24T02:35:12.111294546Z [2024-05-24T02:35:12.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:30:00+00:00, map_index=-1, run_start_date=2024-05-24 02:35:10.878242+00:00, run_end_date=2024-05-24 02:35:11.265724+00:00, run_duration=0.387482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:35:08.825584+00:00, queued_by_job_id=1, pid=15671 2024-05-24T02:36:01.035493608Z [2024-05-24T02:36:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:36:00+00:00, run_after=2024-05-24T02:37:00+00:00 2024-05-24T02:36:01.049088843Z [2024-05-24T02:36:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:36:00+00:00, run_after=2024-05-24T02:37:00+00:00 2024-05-24T02:36:01.056239631Z [2024-05-24T02:36:01.055+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:36:01.062250644Z [2024-05-24T02:36:01.061+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:36:01.139816185Z [2024-05-24T02:36:01.138+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:36:01.139859551Z 2024-05-24T02:36:01.139939125Z 2024-05-24T02:36:01.139949463Z 2024-05-24T02:36:01.139958086Z 2024-05-24T02:36:01.140573870Z [2024-05-24T02:36:01.140+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:36:01.141202243Z [2024-05-24T02:36:01.140+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:36:01.141674952Z [2024-05-24T02:36:01.141+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:36:01.142229456Z [2024-05-24T02:36:01.141+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:36:01.144218695Z [2024-05-24T02:36:01.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:36:01.144257137Z 2024-05-24T02:36:01.144270031Z 2024-05-24T02:36:01.144280981Z 2024-05-24T02:36:01.144290819Z 2024-05-24T02:36:01.152992659Z [2024-05-24T02:36:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:36:01.153357136Z [2024-05-24T02:36:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:36:01.153890786Z [2024-05-24T02:36:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:36:01.154213427Z [2024-05-24T02:36:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:36:01.154840873Z [2024-05-24T02:36:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:36:01.155127991Z [2024-05-24T02:36:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:36:01.155682246Z [2024-05-24T02:36:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:36:01.156053026Z [2024-05-24T02:36:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:36:01.625404830Z [2024-05-24T02:36:01.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status queued for try_number 1 2024-05-24T02:36:01.625544046Z [2024-05-24T02:36:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status queued for try_number 1 2024-05-24T02:36:01.625696420Z [2024-05-24T02:36:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status queued for try_number 1 2024-05-24T02:36:01.625826229Z [2024-05-24T02:36:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status queued for try_number 1 2024-05-24T02:36:01.641351481Z [2024-05-24T02:36:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to d24ad7ee-86d0-4387-9fca-9719730b448b 2024-05-24T02:36:01.641639326Z [2024-05-24T02:36:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0de62d65-eec1-45d7-b6ef-1faf1db75efd 2024-05-24T02:36:01.641890062Z [2024-05-24T02:36:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccbe657e-1163-4929-9943-fedf5eafaec4 2024-05-24T02:36:01.642123662Z [2024-05-24T02:36:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to e369cbbc-ef68-49c0-a939-b8c424ced6b1 2024-05-24T02:36:02.918742609Z [2024-05-24T02:36:02.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:36:02.918774010Z [2024-05-24T02:36:02.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:34:00+00:00, run_id=scheduled__2024-05-24T02:34:00+00:00, run_start_date=2024-05-24 02:36:01.071606+00:00, run_end_date=2024-05-24 02:36:02.911802+00:00, run_duration=1.840196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:34:00+00:00, data_interval_end=2024-05-24 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:36:02.927419194Z [2024-05-24T02:36:02.923+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:36:00+00:00, run_after=2024-05-24T02:38:00+00:00 2024-05-24T02:36:02.934660316Z [2024-05-24T02:36:02.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:36:02.934698821Z [2024-05-24T02:36:02.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:35:00+00:00, run_id=scheduled__2024-05-24T02:35:00+00:00, run_start_date=2024-05-24 02:36:01.072768+00:00, run_end_date=2024-05-24 02:36:02.934000+00:00, run_duration=1.861232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:35:00+00:00, data_interval_end=2024-05-24 02:36:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:36:02.946640785Z [2024-05-24T02:36:02.943+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:36:00+00:00, run_after=2024-05-24T02:37:00+00:00 2024-05-24T02:36:03.015052659Z [2024-05-24T02:36:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:34:00+00:00 exited with status success for try_number 1 2024-05-24T02:36:03.015348348Z [2024-05-24T02:36:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status success for try_number 1 2024-05-24T02:36:03.023541763Z [2024-05-24T02:36:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:34:00+00:00, map_index=-1, run_start_date=2024-05-24 02:36:01.928711+00:00, run_end_date=2024-05-24 02:36:02.353584+00:00, run_duration=0.424873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:36:01.147358+00:00, queued_by_job_id=1, pid=15694 2024-05-24T02:36:03.023895041Z [2024-05-24T02:36:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:35:00+00:00, map_index=-1, run_start_date=2024-05-24 02:36:02.046289+00:00, run_end_date=2024-05-24 02:36:02.497938+00:00, run_duration=0.451649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:36:01.147358+00:00, queued_by_job_id=1, pid=15695 2024-05-24T02:36:05.044939507Z [2024-05-24T02:36:05.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:36:05.045544935Z [2024-05-24T02:36:05.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:35:00+00:00, run_id=scheduled__2024-05-24T02:35:00+00:00, run_start_date=2024-05-24 02:36:01.073748+00:00, run_end_date=2024-05-24 02:36:05.044759+00:00, run_duration=3.971011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:35:00+00:00, data_interval_end=2024-05-24 02:36:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:36:05.060900174Z [2024-05-24T02:36:05.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:36:00+00:00, run_after=2024-05-24T02:37:00+00:00 2024-05-24T02:36:05.131549072Z [2024-05-24T02:36:05.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status success for try_number 1 2024-05-24T02:36:05.146868998Z [2024-05-24T02:36:05.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:35:00+00:00, map_index=-1, run_start_date=2024-05-24 02:36:03.091563+00:00, run_end_date=2024-05-24 02:36:04.661837+00:00, run_duration=1.570274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:36:01.147358+00:00, queued_by_job_id=1, pid=15718 2024-05-24T02:36:06.214943388Z [2024-05-24T02:36:06.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:36:06.215747748Z [2024-05-24T02:36:06.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:35:00+00:00, run_id=scheduled__2024-05-24T02:35:00+00:00, run_start_date=2024-05-24 02:36:01.074811+00:00, run_end_date=2024-05-24 02:36:06.215081+00:00, run_duration=5.14027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:35:00+00:00, data_interval_end=2024-05-24 02:36:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:36:06.230554716Z [2024-05-24T02:36:06.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:36:00+00:00, run_after=2024-05-24T02:37:00+00:00 2024-05-24T02:36:06.263680160Z [2024-05-24T02:36:06.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status success for try_number 1 2024-05-24T02:36:06.271209766Z [2024-05-24T02:36:06.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:35:00+00:00, map_index=-1, run_start_date=2024-05-24 02:36:03.183045+00:00, run_end_date=2024-05-24 02:36:05.159292+00:00, run_duration=1.976247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:36:01.147358+00:00, queued_by_job_id=1, pid=15719 2024-05-24T02:36:42.641302081Z [2024-05-24T02:36:42.640+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:37:00.722911025Z [2024-05-24T02:37:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:37:00+00:00, run_after=2024-05-24T02:38:00+00:00 2024-05-24T02:37:00.738729370Z [2024-05-24T02:37:00.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:37:00+00:00, run_after=2024-05-24T02:38:00+00:00 2024-05-24T02:37:00.746726031Z [2024-05-24T02:37:00.746+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:37:00.826604858Z [2024-05-24T02:37:00.826+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:37:00.826654181Z 2024-05-24T02:37:00.826689766Z 2024-05-24T02:37:00.826698732Z 2024-05-24T02:37:00.826934412Z [2024-05-24T02:37:00.826+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:37:00.827394995Z [2024-05-24T02:37:00.827+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:37:00.827693209Z [2024-05-24T02:37:00.827+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:37:00.829156613Z [2024-05-24T02:37:00.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:37:00.829167570Z 2024-05-24T02:37:00.829171159Z 2024-05-24T02:37:00.829174604Z 2024-05-24T02:37:00.835178303Z [2024-05-24T02:37:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:37:00.835474543Z [2024-05-24T02:37:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:37:00.835854095Z [2024-05-24T02:37:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:37:00.836174726Z [2024-05-24T02:37:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:37:00.836466599Z [2024-05-24T02:37:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:37:00.836567374Z [2024-05-24T02:37:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:37:01.297423844Z [2024-05-24T02:37:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status queued for try_number 1 2024-05-24T02:37:01.297619437Z [2024-05-24T02:37:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status queued for try_number 1 2024-05-24T02:37:01.297889714Z [2024-05-24T02:37:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status queued for try_number 1 2024-05-24T02:37:01.311595818Z [2024-05-24T02:37:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76185885-8689-4087-9b99-7e946389b5cd 2024-05-24T02:37:01.311931161Z [2024-05-24T02:37:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to a52a7243-cf2d-45b4-90d4-5aa2bf5bee42 2024-05-24T02:37:01.312308144Z [2024-05-24T02:37:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27f9a729-15e1-4136-8b1d-e83d5aeb4ac1 2024-05-24T02:37:02.557424604Z [2024-05-24T02:37:02.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:37:02.558139442Z [2024-05-24T02:37:02.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:36:00+00:00, run_id=scheduled__2024-05-24T02:36:00+00:00, run_start_date=2024-05-24 02:37:00.765022+00:00, run_end_date=2024-05-24 02:37:02.557383+00:00, run_duration=1.792361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:36:00+00:00, data_interval_end=2024-05-24 02:37:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:37:02.572200995Z [2024-05-24T02:37:02.571+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:37:00+00:00, run_after=2024-05-24T02:38:00+00:00 2024-05-24T02:37:02.627151080Z [2024-05-24T02:37:02.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status success for try_number 1 2024-05-24T02:37:02.634572853Z [2024-05-24T02:37:02.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:36:00+00:00, map_index=-1, run_start_date=2024-05-24 02:37:01.790451+00:00, run_end_date=2024-05-24 02:37:02.217929+00:00, run_duration=0.427478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:37:00.831429+00:00, queued_by_job_id=1, pid=15752 2024-05-24T02:37:05.591949051Z [2024-05-24T02:37:05.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:37:05.592385756Z [2024-05-24T02:37:05.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:36:00+00:00, run_id=scheduled__2024-05-24T02:36:00+00:00, run_start_date=2024-05-24 02:37:00.767068+00:00, run_end_date=2024-05-24 02:37:05.591823+00:00, run_duration=4.824755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:36:00+00:00, data_interval_end=2024-05-24 02:37:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:37:05.601017825Z [2024-05-24T02:37:05.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:37:00+00:00, run_after=2024-05-24T02:38:00+00:00 2024-05-24T02:37:05.616361266Z [2024-05-24T02:37:05.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:37:05.616903266Z [2024-05-24T02:37:05.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:36:00+00:00, run_id=scheduled__2024-05-24T02:36:00+00:00, run_start_date=2024-05-24 02:37:00.768774+00:00, run_end_date=2024-05-24 02:37:05.616181+00:00, run_duration=4.847407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:36:00+00:00, data_interval_end=2024-05-24 02:37:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:37:05.639712896Z [2024-05-24T02:37:05.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:37:00+00:00, run_after=2024-05-24T02:38:00+00:00 2024-05-24T02:37:05.695474505Z [2024-05-24T02:37:05.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status success for try_number 1 2024-05-24T02:37:05.695789929Z [2024-05-24T02:37:05.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status success for try_number 1 2024-05-24T02:37:05.708746325Z [2024-05-24T02:37:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:36:00+00:00, map_index=-1, run_start_date=2024-05-24 02:37:02.997575+00:00, run_end_date=2024-05-24 02:37:05.224778+00:00, run_duration=2.227203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:37:00.831429+00:00, queued_by_job_id=1, pid=15771 2024-05-24T02:37:05.709131336Z [2024-05-24T02:37:05.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:36:00+00:00, map_index=-1, run_start_date=2024-05-24 02:37:02.948600+00:00, run_end_date=2024-05-24 02:37:04.409803+00:00, run_duration=1.461203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:37:00.831429+00:00, queued_by_job_id=1, pid=15770 2024-05-24T02:38:00.390984131Z [2024-05-24T02:38:00.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:38:00+00:00, run_after=2024-05-24T02:39:00+00:00 2024-05-24T02:38:00.397114226Z [2024-05-24T02:38:00.396+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:38:00.402708781Z [2024-05-24T02:38:00.402+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:38:00.412971268Z [2024-05-24T02:38:00.412+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:38:00+00:00, run_after=2024-05-24T02:39:00+00:00 2024-05-24T02:38:00.521292253Z [2024-05-24T02:38:00.520+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:38:00.521314453Z 2024-05-24T02:38:00.521318560Z 2024-05-24T02:38:00.521322214Z 2024-05-24T02:38:00.521325513Z 2024-05-24T02:38:00.521672333Z [2024-05-24T02:38:00.521+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:38:00.522935746Z [2024-05-24T02:38:00.522+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:38:00.523107442Z [2024-05-24T02:38:00.522+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:38:00.523296214Z [2024-05-24T02:38:00.523+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:38:00.524460231Z [2024-05-24T02:38:00.523+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:38:00.524479919Z 2024-05-24T02:38:00.524489262Z 2024-05-24T02:38:00.524498369Z 2024-05-24T02:38:00.524507276Z 2024-05-24T02:38:00.531194047Z [2024-05-24T02:38:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:38:00.531328218Z [2024-05-24T02:38:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:38:00.531676147Z [2024-05-24T02:38:00.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:38:00.531884937Z [2024-05-24T02:38:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:38:00.532098952Z [2024-05-24T02:38:00.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:38:00.532223712Z [2024-05-24T02:38:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:38:00.532508358Z [2024-05-24T02:38:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:38:00.532698502Z [2024-05-24T02:38:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:38:01.023948607Z [2024-05-24T02:38:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status queued for try_number 1 2024-05-24T02:38:01.023976189Z [2024-05-24T02:38:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:37:00+00:00 exited with status queued for try_number 1 2024-05-24T02:38:01.023981635Z [2024-05-24T02:38:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:37:00+00:00 exited with status queued for try_number 1 2024-05-24T02:38:01.023986056Z [2024-05-24T02:38:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:37:00+00:00 exited with status queued for try_number 1 2024-05-24T02:38:01.054736527Z [2024-05-24T02:38:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff3d23ac-da0e-491d-90ac-54300c77b137 2024-05-24T02:38:01.054773784Z [2024-05-24T02:38:01.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1346f9a-d1e6-4bd9-be6f-dcda0e61a458 2024-05-24T02:38:01.054779820Z [2024-05-24T02:38:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82203527-0816-4a5f-a42f-16238b67df94 2024-05-24T02:38:01.054784909Z [2024-05-24T02:38:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdaa213f-ea85-408d-8b13-8822bc08181c 2024-05-24T02:38:02.260789548Z [2024-05-24T02:38:02.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:38:02.261000752Z [2024-05-24T02:38:02.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:36:00+00:00, run_id=scheduled__2024-05-24T02:36:00+00:00, run_start_date=2024-05-24 02:38:00.421842+00:00, run_end_date=2024-05-24 02:38:02.260640+00:00, run_duration=1.838798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:36:00+00:00, data_interval_end=2024-05-24 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:38:02.268929368Z [2024-05-24T02:38:02.268+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:38:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:38:02.288795654Z [2024-05-24T02:38:02.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:38:02.288952301Z [2024-05-24T02:38:02.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:37:00+00:00, run_id=scheduled__2024-05-24T02:37:00+00:00, run_start_date=2024-05-24 02:38:00.422968+00:00, run_end_date=2024-05-24 02:38:02.288713+00:00, run_duration=1.865745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:37:00+00:00, data_interval_end=2024-05-24 02:38:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:38:02.301005252Z [2024-05-24T02:38:02.300+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:38:00+00:00, run_after=2024-05-24T02:39:00+00:00 2024-05-24T02:38:02.358447394Z [2024-05-24T02:38:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:36:00+00:00 exited with status success for try_number 1 2024-05-24T02:38:02.358546160Z [2024-05-24T02:38:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:37:00+00:00 exited with status success for try_number 1 2024-05-24T02:38:02.365813991Z [2024-05-24T02:38:02.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:36:00+00:00, map_index=-1, run_start_date=2024-05-24 02:38:01.720150+00:00, run_end_date=2024-05-24 02:38:02.114712+00:00, run_duration=0.394562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:38:00.526159+00:00, queued_by_job_id=1, pid=15805 2024-05-24T02:38:02.366162518Z [2024-05-24T02:38:02.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:37:00+00:00, map_index=-1, run_start_date=2024-05-24 02:38:01.618834+00:00, run_end_date=2024-05-24 02:38:02.131351+00:00, run_duration=0.512517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:38:00.526159+00:00, queued_by_job_id=1, pid=15804 2024-05-24T02:38:04.983788942Z [2024-05-24T02:38:04.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:38:04.985142520Z [2024-05-24T02:38:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:37:00+00:00, run_id=scheduled__2024-05-24T02:37:00+00:00, run_start_date=2024-05-24 02:38:00.423908+00:00, run_end_date=2024-05-24 02:38:04.983710+00:00, run_duration=4.559802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:37:00+00:00, data_interval_end=2024-05-24 02:38:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:38:05.007082037Z [2024-05-24T02:38:05.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:38:00+00:00, run_after=2024-05-24T02:39:00+00:00 2024-05-24T02:38:05.054634615Z [2024-05-24T02:38:05.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:37:00+00:00 exited with status success for try_number 1 2024-05-24T02:38:05.056848378Z [2024-05-24T02:38:05.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:37:00+00:00, map_index=-1, run_start_date=2024-05-24 02:38:03.150814+00:00, run_end_date=2024-05-24 02:38:04.791398+00:00, run_duration=1.640584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:38:00.526159+00:00, queued_by_job_id=1, pid=15829 2024-05-24T02:38:06.119758988Z [2024-05-24T02:38:06.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:38:06.120124967Z [2024-05-24T02:38:06.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:37:00+00:00, run_id=scheduled__2024-05-24T02:37:00+00:00, run_start_date=2024-05-24 02:38:00.424820+00:00, run_end_date=2024-05-24 02:38:06.119610+00:00, run_duration=5.69479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:37:00+00:00, data_interval_end=2024-05-24 02:38:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:38:06.131066744Z [2024-05-24T02:38:06.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:38:00+00:00, run_after=2024-05-24T02:39:00+00:00 2024-05-24T02:38:06.172663605Z [2024-05-24T02:38:06.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:37:00+00:00 exited with status success for try_number 1 2024-05-24T02:38:06.181974252Z [2024-05-24T02:38:06.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:37:00+00:00, map_index=-1, run_start_date=2024-05-24 02:38:03.062186+00:00, run_end_date=2024-05-24 02:38:05.241057+00:00, run_duration=2.178871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:38:00.526159+00:00, queued_by_job_id=1, pid=15828 2024-05-24T02:39:00.406681013Z [2024-05-24T02:39:00.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:39:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:39:00.426560876Z [2024-05-24T02:39:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:39:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:39:00.442489285Z [2024-05-24T02:39:00.441+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:39:00.526915471Z [2024-05-24T02:39:00.526+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:39:00.526975377Z 2024-05-24T02:39:00.526985336Z 2024-05-24T02:39:00.526993374Z 2024-05-24T02:39:00.527189598Z [2024-05-24T02:39:00.526+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:39:00.527477865Z [2024-05-24T02:39:00.527+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:39:00.527763002Z [2024-05-24T02:39:00.527+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:39:00.528801917Z [2024-05-24T02:39:00.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:39:00.528819278Z 2024-05-24T02:39:00.528827775Z 2024-05-24T02:39:00.528835451Z 2024-05-24T02:39:00.533800966Z [2024-05-24T02:39:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:39:00.534933779Z [2024-05-24T02:39:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:39:00.534956614Z [2024-05-24T02:39:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:39:00.534965132Z [2024-05-24T02:39:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:39:00.534973416Z [2024-05-24T02:39:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:39:00.535005178Z [2024-05-24T02:39:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:39:00.783461487Z [2024-05-24T02:39:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status queued for try_number 1 2024-05-24T02:39:00.783485866Z [2024-05-24T02:39:00.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status queued for try_number 1 2024-05-24T02:39:00.783654082Z [2024-05-24T02:39:00.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status queued for try_number 1 2024-05-24T02:39:00.791228579Z [2024-05-24T02:39:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa36288a-7641-44c4-a943-71776bc9b811 2024-05-24T02:39:00.791709755Z [2024-05-24T02:39:00.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75ec95b3-0cc0-4459-af2f-830d6109073b 2024-05-24T02:39:00.791955146Z [2024-05-24T02:39:00.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f6bcdcd-737f-46b2-bafb-8fc617ef3e98 2024-05-24T02:39:01.935285537Z [2024-05-24T02:39:01.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:39:01.936313447Z [2024-05-24T02:39:01.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:38:00+00:00, run_id=scheduled__2024-05-24T02:38:00+00:00, run_start_date=2024-05-24 02:39:00.454476+00:00, run_end_date=2024-05-24 02:39:01.935864+00:00, run_duration=1.481388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:38:00+00:00, data_interval_end=2024-05-24 02:39:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:39:01.949649955Z [2024-05-24T02:39:01.949+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:39:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:39:02.010128980Z [2024-05-24T02:39:02.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status success for try_number 1 2024-05-24T02:39:02.018925283Z [2024-05-24T02:39:02.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:38:00+00:00, map_index=-1, run_start_date=2024-05-24 02:39:01.387695+00:00, run_end_date=2024-05-24 02:39:01.775821+00:00, run_duration=0.388126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:39:00.529814+00:00, queued_by_job_id=1, pid=15862 2024-05-24T02:39:04.327332223Z [2024-05-24T02:39:04.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:39:04.327706377Z [2024-05-24T02:39:04.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:38:00+00:00, run_id=scheduled__2024-05-24T02:38:00+00:00, run_start_date=2024-05-24 02:39:00.456518+00:00, run_end_date=2024-05-24 02:39:04.327238+00:00, run_duration=3.87072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:38:00+00:00, data_interval_end=2024-05-24 02:39:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:39:04.344682727Z [2024-05-24T02:39:04.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:39:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:39:04.352594388Z [2024-05-24T02:39:04.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:39:04.355124271Z [2024-05-24T02:39:04.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:38:00+00:00, run_id=scheduled__2024-05-24T02:38:00+00:00, run_start_date=2024-05-24 02:39:00.458037+00:00, run_end_date=2024-05-24 02:39:04.352341+00:00, run_duration=3.894304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:38:00+00:00, data_interval_end=2024-05-24 02:39:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:39:04.369294594Z [2024-05-24T02:39:04.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:39:00+00:00, run_after=2024-05-24T02:40:00+00:00 2024-05-24T02:39:04.395453321Z [2024-05-24T02:39:04.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status success for try_number 1 2024-05-24T02:39:04.395510928Z [2024-05-24T02:39:04.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status success for try_number 1 2024-05-24T02:39:04.401151115Z [2024-05-24T02:39:04.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:38:00+00:00, map_index=-1, run_start_date=2024-05-24 02:39:02.324079+00:00, run_end_date=2024-05-24 02:39:03.788184+00:00, run_duration=1.464105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:39:00.529814+00:00, queued_by_job_id=1, pid=15881 2024-05-24T02:39:04.401272175Z [2024-05-24T02:39:04.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:38:00+00:00, map_index=-1, run_start_date=2024-05-24 02:39:02.278898+00:00, run_end_date=2024-05-24 02:39:03.904630+00:00, run_duration=1.625732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:39:00.529814+00:00, queued_by_job_id=1, pid=15880 2024-05-24T02:40:00.386295898Z [2024-05-24T02:40:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:45:00+00:00 2024-05-24T02:40:00.404173214Z [2024-05-24T02:40:00.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:41:00+00:00 2024-05-24T02:40:00.411733128Z [2024-05-24T02:40:00.411+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:40:00.435394667Z [2024-05-24T02:40:00.434+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:41:00+00:00 2024-05-24T02:40:00.452606322Z [2024-05-24T02:40:00.452+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:40:00.583046788Z [2024-05-24T02:40:00.582+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-24T02:40:00.583085213Z 2024-05-24T02:40:00.583090299Z 2024-05-24T02:40:00.583098333Z 2024-05-24T02:40:00.583102720Z 2024-05-24T02:40:00.583107003Z 2024-05-24T02:40:00.583695854Z [2024-05-24T02:40:00.583+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:40:00.584065632Z [2024-05-24T02:40:00.583+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:40:00.584377597Z [2024-05-24T02:40:00.584+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:40:00.584746413Z [2024-05-24T02:40:00.584+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:40:00.585010909Z [2024-05-24T02:40:00.584+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:40:00.586103801Z [2024-05-24T02:40:00.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:40:00.586117084Z 2024-05-24T02:40:00.586121840Z 2024-05-24T02:40:00.586125944Z 2024-05-24T02:40:00.586156908Z 2024-05-24T02:40:00.586160874Z 2024-05-24T02:40:00.592416601Z [2024-05-24T02:40:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:40:00.592840412Z [2024-05-24T02:40:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:40:00.593254748Z [2024-05-24T02:40:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:40:00.593621669Z [2024-05-24T02:40:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:40:00.594012976Z [2024-05-24T02:40:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:40:00.594211107Z [2024-05-24T02:40:00.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:40:00.594595167Z [2024-05-24T02:40:00.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:40:00.594936666Z [2024-05-24T02:40:00.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:40:00.595270153Z [2024-05-24T02:40:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:40:00.595543768Z [2024-05-24T02:40:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:40:01.125926529Z [2024-05-24T02:40:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:01.125974445Z [2024-05-24T02:40:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:01.125982813Z [2024-05-24T02:40:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:39:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:01.126066255Z [2024-05-24T02:40:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:39:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:01.126126680Z [2024-05-24T02:40:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:39:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:01.147869132Z [2024-05-24T02:40:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3058724c-08c2-4103-8566-985467faa450 2024-05-24T02:40:01.147898842Z [2024-05-24T02:40:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1e2301c-e72f-40a8-9d03-ce7bf2061eca 2024-05-24T02:40:01.148016575Z [2024-05-24T02:40:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a9d48ef-7c4c-459c-a0d9-210a81770425 2024-05-24T02:40:01.148112297Z [2024-05-24T02:40:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6a024a5-1a9e-4ff5-b8e6-f823a183ef64 2024-05-24T02:40:01.148193435Z [2024-05-24T02:40:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4d2da5b-5847-4b0a-bdd9-1f2f0815b7e2 2024-05-24T02:40:02.489349243Z [2024-05-24T02:40:02.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:40:02.489527220Z [2024-05-24T02:40:02.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:38:00+00:00, run_id=scheduled__2024-05-24T02:38:00+00:00, run_start_date=2024-05-24 02:40:00.496117+00:00, run_end_date=2024-05-24 02:40:02.489246+00:00, run_duration=1.993129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:38:00+00:00, data_interval_end=2024-05-24 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:40:02.498061153Z [2024-05-24T02:40:02.497+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:42:00+00:00 2024-05-24T02:40:02.505004038Z [2024-05-24T02:40:02.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:40:02.505211204Z [2024-05-24T02:40:02.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:39:00+00:00, run_id=scheduled__2024-05-24T02:39:00+00:00, run_start_date=2024-05-24 02:40:00.497524+00:00, run_end_date=2024-05-24 02:40:02.504945+00:00, run_duration=2.007421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:39:00+00:00, data_interval_end=2024-05-24 02:40:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:40:02.515962679Z [2024-05-24T02:40:02.515+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:41:00+00:00 2024-05-24T02:40:02.574325778Z [2024-05-24T02:40:02.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:38:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:02.574370849Z [2024-05-24T02:40:02.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:39:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:02.583062910Z [2024-05-24T02:40:02.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:39:00+00:00, map_index=-1, run_start_date=2024-05-24 02:40:01.602830+00:00, run_end_date=2024-05-24 02:40:02.062018+00:00, run_duration=0.459188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:00.587811+00:00, queued_by_job_id=1, pid=15914 2024-05-24T02:40:02.583150457Z [2024-05-24T02:40:02.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:38:00+00:00, map_index=-1, run_start_date=2024-05-24 02:40:01.732999+00:00, run_end_date=2024-05-24 02:40:02.109634+00:00, run_duration=0.376635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:00.587811+00:00, queued_by_job_id=1, pid=15915 2024-05-24T02:40:03.689830688Z [2024-05-24T02:40:03.689+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:40:03.689851785Z 2024-05-24T02:40:03.689856596Z [2024-05-24T02:40:03.689+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:40:03.690195421Z [2024-05-24T02:40:03.689+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:40:03.690211063Z 2024-05-24T02:40:03.694739539Z [2024-05-24T02:40:03.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:40:03.694776646Z [2024-05-24T02:40:03.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:40:03.794573120Z [2024-05-24T02:40:03.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:03.794836172Z [2024-05-24T02:40:03.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:03.800536578Z [2024-05-24T02:40:03.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 604b1ac3-cec8-490e-9f5c-f7242acb4ba3 2024-05-24T02:40:03.800863844Z [2024-05-24T02:40:03.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:35:00+00:00, map_index=-1, run_start_date=2024-05-24 02:40:03.150222+00:00, run_end_date=2024-05-24 02:40:03.607959+00:00, run_duration=0.457737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:00.587811+00:00, queued_by_job_id=1, pid=15946 2024-05-24T02:40:04.389388277Z [2024-05-24T02:40:04.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:40:04.389533416Z [2024-05-24T02:40:04.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:39:00+00:00, run_id=scheduled__2024-05-24T02:39:00+00:00, run_start_date=2024-05-24 02:40:00.498698+00:00, run_end_date=2024-05-24 02:40:04.389299+00:00, run_duration=3.890601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:39:00+00:00, data_interval_end=2024-05-24 02:40:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:40:04.400144153Z [2024-05-24T02:40:04.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:41:00+00:00 2024-05-24T02:40:04.462020831Z [2024-05-24T02:40:04.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:39:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:04.472712076Z [2024-05-24T02:40:04.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:39:00+00:00, map_index=-1, run_start_date=2024-05-24 02:40:02.797330+00:00, run_end_date=2024-05-24 02:40:04.135760+00:00, run_duration=1.33843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:00.587811+00:00, queued_by_job_id=1, pid=15939 2024-05-24T02:40:05.943676288Z [2024-05-24T02:40:05.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:40:05.944117215Z [2024-05-24T02:40:05.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:39:00+00:00, run_id=scheduled__2024-05-24T02:39:00+00:00, run_start_date=2024-05-24 02:40:00.499770+00:00, run_end_date=2024-05-24 02:40:05.943584+00:00, run_duration=5.443814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:39:00+00:00, data_interval_end=2024-05-24 02:40:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:40:05.956958742Z [2024-05-24T02:40:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:41:00+00:00 2024-05-24T02:40:06.010478837Z [2024-05-24T02:40:06.009+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:40:06.010498108Z 2024-05-24T02:40:06.010635667Z [2024-05-24T02:40:06.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:40:06.011269210Z [2024-05-24T02:40:06.011+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:40:06.011281745Z 2024-05-24T02:40:06.013577286Z [2024-05-24T02:40:06.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:40:06.013727942Z [2024-05-24T02:40:06.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:40:06.058264063Z [2024-05-24T02:40:06.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:06.060576069Z [2024-05-24T02:40:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:39:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:06.066945406Z [2024-05-24T02:40:06.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9b80f50-4c36-4723-85cc-d2d6a3758947 2024-05-24T02:40:06.067390800Z [2024-05-24T02:40:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:39:00+00:00, map_index=-1, run_start_date=2024-05-24 02:40:02.909002+00:00, run_end_date=2024-05-24 02:40:04.743295+00:00, run_duration=1.834293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:00.587811+00:00, queued_by_job_id=1, pid=15940 2024-05-24T02:40:06.182810406Z [2024-05-24T02:40:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:06.189296381Z [2024-05-24T02:40:06.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:35:00+00:00, map_index=-1, run_start_date=2024-05-24 02:40:05.499451+00:00, run_end_date=2024-05-24 02:40:05.855539+00:00, run_duration=0.356088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:03.690477+00:00, queued_by_job_id=1, pid=15969 2024-05-24T02:40:08.388199862Z [2024-05-24T02:40:08.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:40:08.388235699Z 2024-05-24T02:40:08.388409702Z [2024-05-24T02:40:08.388+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:40:08.389152225Z [2024-05-24T02:40:08.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:40:08.389164485Z 2024-05-24T02:40:08.391856575Z [2024-05-24T02:40:08.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:40:08.392093706Z [2024-05-24T02:40:08.391+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:40:08.440731017Z [2024-05-24T02:40:08.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status queued for try_number 1 2024-05-24T02:40:08.440842933Z [2024-05-24T02:40:08.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:08.446115260Z [2024-05-24T02:40:08.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6f08c80-762b-42c4-9eb1-e6cdef8c5d7f 2024-05-24T02:40:08.446339734Z [2024-05-24T02:40:08.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:35:00+00:00, map_index=0, run_start_date=2024-05-24 02:40:07.571927+00:00, run_end_date=2024-05-24 02:40:07.989570+00:00, run_duration=0.417643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:06.011745+00:00, queued_by_job_id=1, pid=15977 2024-05-24T02:40:10.608879475Z [2024-05-24T02:40:10.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:40:10.609514645Z [2024-05-24T02:40:10.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:35:00+00:00, run_id=scheduled__2024-05-24T02:35:00+00:00, run_start_date=2024-05-24 02:40:00.493191+00:00, run_end_date=2024-05-24 02:40:10.609130+00:00, run_duration=10.115939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:35:00+00:00, data_interval_end=2024-05-24 02:40:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:40:10.615689628Z [2024-05-24T02:40:10.615+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:40:00+00:00, run_after=2024-05-24T02:45:00+00:00 2024-05-24T02:40:11.734979927Z [2024-05-24T02:40:11.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:35:00+00:00 exited with status success for try_number 1 2024-05-24T02:40:11.742196922Z [2024-05-24T02:40:11.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:35:00+00:00, map_index=-1, run_start_date=2024-05-24 02:40:10.115053+00:00, run_end_date=2024-05-24 02:40:10.494483+00:00, run_duration=0.37943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:40:08.389580+00:00, queued_by_job_id=1, pid=15985 2024-05-24T02:41:00.406587451Z [2024-05-24T02:41:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:41:00+00:00, run_after=2024-05-24T02:42:00+00:00 2024-05-24T02:41:00.406739297Z [2024-05-24T02:41:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:41:00.418468911Z [2024-05-24T02:41:00.417+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:41:00+00:00, run_after=2024-05-24T02:42:00+00:00 2024-05-24T02:41:00.482099627Z [2024-05-24T02:41:00.481+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:41:00.482146587Z 2024-05-24T02:41:00.482156772Z 2024-05-24T02:41:00.482165604Z 2024-05-24T02:41:00.482189013Z [2024-05-24T02:41:00.481+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:41:00.482207146Z [2024-05-24T02:41:00.482+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:41:00.482405230Z [2024-05-24T02:41:00.482+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:41:00.483110707Z [2024-05-24T02:41:00.482+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:41:00.483128927Z 2024-05-24T02:41:00.483155058Z 2024-05-24T02:41:00.483164875Z 2024-05-24T02:41:00.487124683Z [2024-05-24T02:41:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:41:00.487249487Z [2024-05-24T02:41:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:41:00.487602879Z [2024-05-24T02:41:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:41:00.487766299Z [2024-05-24T02:41:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:41:00.488057814Z [2024-05-24T02:41:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:41:00.488224121Z [2024-05-24T02:41:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:41:00.724390668Z [2024-05-24T02:41:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:41:00.724449839Z [2024-05-24T02:41:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:41:00.724619123Z [2024-05-24T02:41:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:41:00.733409183Z [2024-05-24T02:41:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8101e55d-3287-4fbe-a3f7-e92961936586 2024-05-24T02:41:00.733444365Z [2024-05-24T02:41:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to b872900b-db54-459f-a9a5-b2b4aa3d2ee5 2024-05-24T02:41:00.733586120Z [2024-05-24T02:41:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72b1462c-7846-4c5c-9e6f-06dfa65b9e02 2024-05-24T02:41:01.883701450Z [2024-05-24T02:41:01.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:41:01.884168338Z [2024-05-24T02:41:01.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:40:00+00:00, run_id=scheduled__2024-05-24T02:40:00+00:00, run_start_date=2024-05-24 02:41:00.430136+00:00, run_end_date=2024-05-24 02:41:01.883766+00:00, run_duration=1.45363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:40:00+00:00, data_interval_end=2024-05-24 02:41:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:41:01.894330521Z [2024-05-24T02:41:01.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:41:00+00:00, run_after=2024-05-24T02:42:00+00:00 2024-05-24T02:41:01.988585229Z [2024-05-24T02:41:01.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:41:01.995158608Z [2024-05-24T02:41:01.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=-1, run_start_date=2024-05-24 02:41:01.192004+00:00, run_end_date=2024-05-24 02:41:01.606330+00:00, run_duration=0.414326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:41:00.483914+00:00, queued_by_job_id=1, pid=16007 2024-05-24T02:41:04.179418252Z [2024-05-24T02:41:04.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:41:04.179800097Z [2024-05-24T02:41:04.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:40:00+00:00, run_id=scheduled__2024-05-24T02:40:00+00:00, run_start_date=2024-05-24 02:41:00.431332+00:00, run_end_date=2024-05-24 02:41:04.179245+00:00, run_duration=3.747913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:40:00+00:00, data_interval_end=2024-05-24 02:41:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:41:04.190337027Z [2024-05-24T02:41:04.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:41:00+00:00, run_after=2024-05-24T02:42:00+00:00 2024-05-24T02:41:04.254899742Z [2024-05-24T02:41:04.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:41:04.261925423Z [2024-05-24T02:41:04.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=-1, run_start_date=2024-05-24 02:41:02.293034+00:00, run_end_date=2024-05-24 02:41:03.596877+00:00, run_duration=1.303843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:41:00.483914+00:00, queued_by_job_id=1, pid=16020 2024-05-24T02:41:05.296753231Z [2024-05-24T02:41:05.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:41:05.297431443Z [2024-05-24T02:41:05.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:40:00+00:00, run_id=scheduled__2024-05-24T02:40:00+00:00, run_start_date=2024-05-24 02:41:00.432320+00:00, run_end_date=2024-05-24 02:41:05.296648+00:00, run_duration=4.864328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:40:00+00:00, data_interval_end=2024-05-24 02:41:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:41:05.317771571Z [2024-05-24T02:41:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:41:00+00:00, run_after=2024-05-24T02:42:00+00:00 2024-05-24T02:41:05.365595816Z [2024-05-24T02:41:05.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:41:05.374625251Z [2024-05-24T02:41:05.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=-1, run_start_date=2024-05-24 02:41:02.562063+00:00, run_end_date=2024-05-24 02:41:04.584913+00:00, run_duration=2.02285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:41:00.483914+00:00, queued_by_job_id=1, pid=16031 2024-05-24T02:41:42.756600955Z [2024-05-24T02:41:42.756+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:42:00.993699550Z [2024-05-24T02:42:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:42:00+00:00, run_after=2024-05-24T02:43:00+00:00 2024-05-24T02:42:00.998015029Z [2024-05-24T02:42:00.997+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:42:01.004091318Z [2024-05-24T02:42:01.003+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:42:01.015745633Z [2024-05-24T02:42:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:42:00+00:00, run_after=2024-05-24T02:43:00+00:00 2024-05-24T02:42:01.118077089Z [2024-05-24T02:42:01.117+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:42:01.118100611Z 2024-05-24T02:42:01.118104600Z 2024-05-24T02:42:01.118107936Z 2024-05-24T02:42:01.118111218Z 2024-05-24T02:42:01.118409409Z [2024-05-24T02:42:01.118+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:42:01.118838859Z [2024-05-24T02:42:01.118+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:42:01.119153039Z [2024-05-24T02:42:01.118+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:42:01.119470369Z [2024-05-24T02:42:01.119+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:42:01.120711227Z [2024-05-24T02:42:01.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:42:01.120729292Z 2024-05-24T02:42:01.120735137Z 2024-05-24T02:42:01.120740004Z 2024-05-24T02:42:01.120744774Z 2024-05-24T02:42:01.126166892Z [2024-05-24T02:42:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:42:01.126472559Z [2024-05-24T02:42:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:42:01.126928383Z [2024-05-24T02:42:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:42:01.127385456Z [2024-05-24T02:42:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:42:01.127784265Z [2024-05-24T02:42:01.127+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:42:01.128085243Z [2024-05-24T02:42:01.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:42:01.128448755Z [2024-05-24T02:42:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:42:01.128659358Z [2024-05-24T02:42:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:42:01.551795735Z [2024-05-24T02:42:01.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:42:01.554068896Z [2024-05-24T02:42:01.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:41:00+00:00 exited with status queued for try_number 1 2024-05-24T02:42:01.554232041Z [2024-05-24T02:42:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:41:00+00:00 exited with status queued for try_number 1 2024-05-24T02:42:01.554383322Z [2024-05-24T02:42:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:41:00+00:00 exited with status queued for try_number 1 2024-05-24T02:42:01.563828059Z [2024-05-24T02:42:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc1c7bbe-3eba-43b5-8aa8-f47ed66e18dc 2024-05-24T02:42:01.564114098Z [2024-05-24T02:42:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7ade885-9249-4852-a3dc-5089e60108c2 2024-05-24T02:42:01.564306203Z [2024-05-24T02:42:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0f4cf4d-bc74-4141-82bf-5efed0640d7e 2024-05-24T02:42:01.564512983Z [2024-05-24T02:42:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8b5c5e5-a853-4ae0-9aa6-d9fdd8202891 2024-05-24T02:42:02.859007250Z [2024-05-24T02:42:02.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:42:02.860234963Z [2024-05-24T02:42:02.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:40:00+00:00, run_id=scheduled__2024-05-24T02:40:00+00:00, run_start_date=2024-05-24 02:42:01.025895+00:00, run_end_date=2024-05-24 02:42:02.859044+00:00, run_duration=1.833149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:40:00+00:00, data_interval_end=2024-05-24 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:42:02.871134229Z [2024-05-24T02:42:02.870+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:42:00+00:00, run_after=2024-05-24T02:44:00+00:00 2024-05-24T02:42:02.877444724Z [2024-05-24T02:42:02.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:42:02.877807856Z [2024-05-24T02:42:02.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:41:00+00:00, run_id=scheduled__2024-05-24T02:41:00+00:00, run_start_date=2024-05-24 02:42:01.029578+00:00, run_end_date=2024-05-24 02:42:02.877473+00:00, run_duration=1.847895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:41:00+00:00, data_interval_end=2024-05-24 02:42:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:42:02.888179292Z [2024-05-24T02:42:02.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:42:00+00:00, run_after=2024-05-24T02:43:00+00:00 2024-05-24T02:42:02.933454260Z [2024-05-24T02:42:02.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:42:02.933510094Z [2024-05-24T02:42:02.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:41:00+00:00 exited with status success for try_number 1 2024-05-24T02:42:02.941457488Z [2024-05-24T02:42:02.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=-1, run_start_date=2024-05-24 02:42:02.034667+00:00, run_end_date=2024-05-24 02:42:02.319460+00:00, run_duration=0.284793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:42:01.122285+00:00, queued_by_job_id=1, pid=16058 2024-05-24T02:42:02.941643148Z [2024-05-24T02:42:02.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:41:00+00:00, map_index=-1, run_start_date=2024-05-24 02:42:02.250009+00:00, run_end_date=2024-05-24 02:42:02.648551+00:00, run_duration=0.398542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:42:01.122285+00:00, queued_by_job_id=1, pid=16061 2024-05-24T02:42:05.112533159Z [2024-05-24T02:42:05.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:42:05.116887317Z [2024-05-24T02:42:05.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:41:00+00:00, run_id=scheduled__2024-05-24T02:41:00+00:00, run_start_date=2024-05-24 02:42:01.031630+00:00, run_end_date=2024-05-24 02:42:05.116440+00:00, run_duration=4.08481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:41:00+00:00, data_interval_end=2024-05-24 02:42:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:42:05.139924531Z [2024-05-24T02:42:05.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:42:00+00:00, run_after=2024-05-24T02:43:00+00:00 2024-05-24T02:42:05.150686426Z [2024-05-24T02:42:05.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:42:05.151169947Z [2024-05-24T02:42:05.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:41:00+00:00, run_id=scheduled__2024-05-24T02:41:00+00:00, run_start_date=2024-05-24 02:42:01.033563+00:00, run_end_date=2024-05-24 02:42:05.150799+00:00, run_duration=4.117236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:41:00+00:00, data_interval_end=2024-05-24 02:42:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:42:05.160327087Z [2024-05-24T02:42:05.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:42:00+00:00, run_after=2024-05-24T02:43:00+00:00 2024-05-24T02:42:05.187620324Z [2024-05-24T02:42:05.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:41:00+00:00 exited with status success for try_number 1 2024-05-24T02:42:05.187854083Z [2024-05-24T02:42:05.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:41:00+00:00 exited with status success for try_number 1 2024-05-24T02:42:05.196177280Z [2024-05-24T02:42:05.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:41:00+00:00, map_index=-1, run_start_date=2024-05-24 02:42:03.602043+00:00, run_end_date=2024-05-24 02:42:04.922828+00:00, run_duration=1.320785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:42:01.122285+00:00, queued_by_job_id=1, pid=16083 2024-05-24T02:42:05.196577152Z [2024-05-24T02:42:05.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:41:00+00:00, map_index=-1, run_start_date=2024-05-24 02:42:03.461677+00:00, run_end_date=2024-05-24 02:42:04.960135+00:00, run_duration=1.498458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:42:01.122285+00:00, queued_by_job_id=1, pid=16082 2024-05-24T02:43:00.238544551Z [2024-05-24T02:43:00.237+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:43:00+00:00, run_after=2024-05-24T02:44:00+00:00 2024-05-24T02:43:00.246925111Z [2024-05-24T02:43:00.245+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:43:00.265051799Z [2024-05-24T02:43:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:43:00+00:00, run_after=2024-05-24T02:44:00+00:00 2024-05-24T02:43:00.363641437Z [2024-05-24T02:43:00.363+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:43:00.363672155Z 2024-05-24T02:43:00.363677576Z 2024-05-24T02:43:00.363682580Z 2024-05-24T02:43:00.363696298Z [2024-05-24T02:43:00.363+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:43:00.363712205Z [2024-05-24T02:43:00.363+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:43:00.363911875Z [2024-05-24T02:43:00.363+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:43:00.364339868Z [2024-05-24T02:43:00.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:43:00.364353512Z 2024-05-24T02:43:00.364359070Z 2024-05-24T02:43:00.364364057Z 2024-05-24T02:43:00.368221272Z [2024-05-24T02:43:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:43:00.368297412Z [2024-05-24T02:43:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:43:00.368460549Z [2024-05-24T02:43:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:43:00.368570946Z [2024-05-24T02:43:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:43:00.368835548Z [2024-05-24T02:43:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:43:00.368907760Z [2024-05-24T02:43:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:43:00.806479300Z [2024-05-24T02:43:00.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status queued for try_number 1 2024-05-24T02:43:00.806661803Z [2024-05-24T02:43:00.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status queued for try_number 1 2024-05-24T02:43:00.806806460Z [2024-05-24T02:43:00.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status queued for try_number 1 2024-05-24T02:43:00.816422679Z [2024-05-24T02:43:00.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to e44abbcc-c069-40ac-9127-37f96c42b7a0 2024-05-24T02:43:00.816768135Z [2024-05-24T02:43:00.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6bb7277-8be4-4289-ac49-e52f109330e7 2024-05-24T02:43:00.817059010Z [2024-05-24T02:43:00.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab28305f-7f12-4ea3-85be-dfb9c25d253f 2024-05-24T02:43:02.010947735Z [2024-05-24T02:43:02.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:43:02.012323162Z [2024-05-24T02:43:02.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:42:00+00:00, run_id=scheduled__2024-05-24T02:42:00+00:00, run_start_date=2024-05-24 02:43:00.278402+00:00, run_end_date=2024-05-24 02:43:02.010841+00:00, run_duration=1.732439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:42:00+00:00, data_interval_end=2024-05-24 02:43:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:43:02.023761697Z [2024-05-24T02:43:02.023+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:43:00+00:00, run_after=2024-05-24T02:44:00+00:00 2024-05-24T02:43:02.085080875Z [2024-05-24T02:43:02.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status success for try_number 1 2024-05-24T02:43:02.091325526Z [2024-05-24T02:43:02.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:42:00+00:00, map_index=-1, run_start_date=2024-05-24 02:43:01.242421+00:00, run_end_date=2024-05-24 02:43:01.613319+00:00, run_duration=0.370898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:43:00.365002+00:00, queued_by_job_id=1, pid=16116 2024-05-24T02:43:04.898858538Z [2024-05-24T02:43:04.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:43:04.899139774Z [2024-05-24T02:43:04.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:42:00+00:00, run_id=scheduled__2024-05-24T02:42:00+00:00, run_start_date=2024-05-24 02:43:00.280247+00:00, run_end_date=2024-05-24 02:43:04.898702+00:00, run_duration=4.618455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:42:00+00:00, data_interval_end=2024-05-24 02:43:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:43:04.907902510Z [2024-05-24T02:43:04.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:43:00+00:00, run_after=2024-05-24T02:44:00+00:00 2024-05-24T02:43:04.914854083Z [2024-05-24T02:43:04.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:43:04.915030500Z [2024-05-24T02:43:04.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:42:00+00:00, run_id=scheduled__2024-05-24T02:42:00+00:00, run_start_date=2024-05-24 02:43:00.281470+00:00, run_end_date=2024-05-24 02:43:04.914626+00:00, run_duration=4.633156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:42:00+00:00, data_interval_end=2024-05-24 02:43:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:43:04.924204494Z [2024-05-24T02:43:04.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:43:00+00:00, run_after=2024-05-24T02:44:00+00:00 2024-05-24T02:43:04.954038872Z [2024-05-24T02:43:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status success for try_number 1 2024-05-24T02:43:04.954071090Z [2024-05-24T02:43:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status success for try_number 1 2024-05-24T02:43:04.960410430Z [2024-05-24T02:43:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:42:00+00:00, map_index=-1, run_start_date=2024-05-24 02:43:02.156955+00:00, run_end_date=2024-05-24 02:43:03.863090+00:00, run_duration=1.706135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:43:00.365002+00:00, queued_by_job_id=1, pid=16134 2024-05-24T02:43:04.960576753Z [2024-05-24T02:43:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:42:00+00:00, map_index=-1, run_start_date=2024-05-24 02:43:02.291207+00:00, run_end_date=2024-05-24 02:43:03.865663+00:00, run_duration=1.574456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:43:00.365002+00:00, queued_by_job_id=1, pid=16135 2024-05-24T02:44:00.833503736Z [2024-05-24T02:44:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:44:00+00:00, run_after=2024-05-24T02:45:00+00:00 2024-05-24T02:44:00.849203306Z [2024-05-24T02:44:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:44:00+00:00, run_after=2024-05-24T02:45:00+00:00 2024-05-24T02:44:00.856742492Z [2024-05-24T02:44:00.856+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:44:00.866021549Z [2024-05-24T02:44:00.865+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:44:00.958748592Z [2024-05-24T02:44:00.957+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:44:00.958771736Z 2024-05-24T02:44:00.958784799Z 2024-05-24T02:44:00.958798435Z 2024-05-24T02:44:00.958801774Z 2024-05-24T02:44:00.958806359Z [2024-05-24T02:44:00.957+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:44:00.958809393Z [2024-05-24T02:44:00.957+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:44:00.958812522Z [2024-05-24T02:44:00.957+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:44:00.958815672Z [2024-05-24T02:44:00.958+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:44:00.958818865Z [2024-05-24T02:44:00.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:44:00.958821989Z 2024-05-24T02:44:00.958825056Z 2024-05-24T02:44:00.958828239Z 2024-05-24T02:44:00.958831306Z 2024-05-24T02:44:00.962766144Z [2024-05-24T02:44:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:44:00.962803309Z [2024-05-24T02:44:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:44:00.962810449Z [2024-05-24T02:44:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:44:00.966324266Z [2024-05-24T02:44:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:44:00.966363924Z [2024-05-24T02:44:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:44:00.966369350Z [2024-05-24T02:44:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:44:00.966372680Z [2024-05-24T02:44:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:44:00.966385993Z [2024-05-24T02:44:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:44:01.327932901Z [2024-05-24T02:44:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status queued for try_number 1 2024-05-24T02:44:01.327966846Z [2024-05-24T02:44:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:43:00+00:00 exited with status queued for try_number 1 2024-05-24T02:44:01.328008147Z [2024-05-24T02:44:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:43:00+00:00 exited with status queued for try_number 1 2024-05-24T02:44:01.328085660Z [2024-05-24T02:44:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:43:00+00:00 exited with status queued for try_number 1 2024-05-24T02:44:01.342631081Z [2024-05-24T02:44:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0be0b81f-c7c9-4a0c-a326-915334f72830 2024-05-24T02:44:01.342704305Z [2024-05-24T02:44:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d2ffc17-35d9-4657-87cd-6d553b56a290 2024-05-24T02:44:01.342806094Z [2024-05-24T02:44:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c809448-d802-46ac-ad54-54298eb9b5b5 2024-05-24T02:44:01.342900104Z [2024-05-24T02:44:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 955ad20a-d824-4dba-931b-2f6507ebf1f4 2024-05-24T02:44:02.500189564Z [2024-05-24T02:44:02.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:44:02.500554784Z [2024-05-24T02:44:02.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:42:00+00:00, run_id=scheduled__2024-05-24T02:42:00+00:00, run_start_date=2024-05-24 02:44:00.879283+00:00, run_end_date=2024-05-24 02:44:02.500071+00:00, run_duration=1.620788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:42:00+00:00, data_interval_end=2024-05-24 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:44:02.508991718Z [2024-05-24T02:44:02.508+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:44:00+00:00, run_after=2024-05-24T02:46:00+00:00 2024-05-24T02:44:02.516067770Z [2024-05-24T02:44:02.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:44:02.516269627Z [2024-05-24T02:44:02.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:43:00+00:00, run_id=scheduled__2024-05-24T02:43:00+00:00, run_start_date=2024-05-24 02:44:00.880886+00:00, run_end_date=2024-05-24 02:44:02.515938+00:00, run_duration=1.635052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:43:00+00:00, data_interval_end=2024-05-24 02:44:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:44:02.525830280Z [2024-05-24T02:44:02.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:44:00+00:00, run_after=2024-05-24T02:45:00+00:00 2024-05-24T02:44:02.590876246Z [2024-05-24T02:44:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:42:00+00:00 exited with status success for try_number 1 2024-05-24T02:44:02.591327294Z [2024-05-24T02:44:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:43:00+00:00 exited with status success for try_number 1 2024-05-24T02:44:02.601253911Z [2024-05-24T02:44:02.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:42:00+00:00, map_index=-1, run_start_date=2024-05-24 02:44:01.864197+00:00, run_end_date=2024-05-24 02:44:02.189626+00:00, run_duration=0.325429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:44:00.959439+00:00, queued_by_job_id=1, pid=16168 2024-05-24T02:44:02.601802554Z [2024-05-24T02:44:02.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:43:00+00:00, map_index=-1, run_start_date=2024-05-24 02:44:01.920019+00:00, run_end_date=2024-05-24 02:44:02.344827+00:00, run_duration=0.424808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:44:00.959439+00:00, queued_by_job_id=1, pid=16169 2024-05-24T02:44:04.819759810Z [2024-05-24T02:44:04.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:44:04.820187330Z [2024-05-24T02:44:04.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:43:00+00:00, run_id=scheduled__2024-05-24T02:43:00+00:00, run_start_date=2024-05-24 02:44:00.882341+00:00, run_end_date=2024-05-24 02:44:04.819604+00:00, run_duration=3.937263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:43:00+00:00, data_interval_end=2024-05-24 02:44:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:44:04.831739105Z [2024-05-24T02:44:04.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:44:00+00:00, run_after=2024-05-24T02:45:00+00:00 2024-05-24T02:44:04.894703470Z [2024-05-24T02:44:04.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:43:00+00:00 exited with status success for try_number 1 2024-05-24T02:44:04.900882615Z [2024-05-24T02:44:04.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:43:00+00:00, map_index=-1, run_start_date=2024-05-24 02:44:03.059158+00:00, run_end_date=2024-05-24 02:44:04.672261+00:00, run_duration=1.613103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:44:00.959439+00:00, queued_by_job_id=1, pid=16192 2024-05-24T02:44:05.967077724Z [2024-05-24T02:44:05.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:44:05.967257518Z [2024-05-24T02:44:05.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:43:00+00:00, run_id=scheduled__2024-05-24T02:43:00+00:00, run_start_date=2024-05-24 02:44:00.883752+00:00, run_end_date=2024-05-24 02:44:05.966765+00:00, run_duration=5.083013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:43:00+00:00, data_interval_end=2024-05-24 02:44:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:44:05.977370113Z [2024-05-24T02:44:05.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:44:00+00:00, run_after=2024-05-24T02:45:00+00:00 2024-05-24T02:44:06.023185094Z [2024-05-24T02:44:06.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:43:00+00:00 exited with status success for try_number 1 2024-05-24T02:44:06.029423377Z [2024-05-24T02:44:06.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:43:00+00:00, map_index=-1, run_start_date=2024-05-24 02:44:03.081302+00:00, run_end_date=2024-05-24 02:44:05.343215+00:00, run_duration=2.261913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:44:00.959439+00:00, queued_by_job_id=1, pid=16193 2024-05-24T02:45:00.720875658Z [2024-05-24T02:45:00.719+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:45:00.743400415Z [2024-05-24T02:45:00.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:45:00+00:00, run_after=2024-05-24T02:46:00+00:00 2024-05-24T02:45:00.767676504Z [2024-05-24T02:45:00.766+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:45:00+00:00, run_after=2024-05-24T02:46:00+00:00 2024-05-24T02:45:00.791419628Z [2024-05-24T02:45:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:45:00+00:00, run_after=2024-05-24T02:50:00+00:00 2024-05-24T02:45:00.924315741Z [2024-05-24T02:45:00.923+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:45:00.924489792Z 2024-05-24T02:45:00.924497187Z 2024-05-24T02:45:00.924544071Z 2024-05-24T02:45:00.924550011Z 2024-05-24T02:45:00.924711012Z [2024-05-24T02:45:00.924+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:45:00.924979527Z [2024-05-24T02:45:00.924+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:45:00.925165641Z [2024-05-24T02:45:00.925+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:45:00.925373770Z [2024-05-24T02:45:00.925+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:45:00.927353682Z [2024-05-24T02:45:00.926+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:45:00.927376545Z 2024-05-24T02:45:00.927384373Z 2024-05-24T02:45:00.927390997Z 2024-05-24T02:45:00.927397462Z 2024-05-24T02:45:00.935630375Z [2024-05-24T02:45:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-24T02:45:00.935925990Z [2024-05-24T02:45:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:45:00.936067098Z [2024-05-24T02:45:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:45:00.936194747Z [2024-05-24T02:45:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:45:00.936446950Z [2024-05-24T02:45:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:45:00.936603888Z [2024-05-24T02:45:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:45:00.936868990Z [2024-05-24T02:45:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:45:00.936994551Z [2024-05-24T02:45:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:45:01.223720592Z [2024-05-24T02:45:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:45:01.224024091Z [2024-05-24T02:45:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status queued for try_number 1 2024-05-24T02:45:01.224237429Z [2024-05-24T02:45:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status queued for try_number 1 2024-05-24T02:45:01.224426210Z [2024-05-24T02:45:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status queued for try_number 1 2024-05-24T02:45:01.233449094Z [2024-05-24T02:45:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3288d80e-d45b-4637-886a-71a2947f8d5e 2024-05-24T02:45:01.233800427Z [2024-05-24T02:45:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f3cf685-5724-412b-8851-296a5de096bd 2024-05-24T02:45:01.234055574Z [2024-05-24T02:45:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9896d391-7f24-4a9b-9e4b-05fa781ebe22 2024-05-24T02:45:01.234290369Z [2024-05-24T02:45:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 041760fd-acda-4853-938e-1d985d227ca4 2024-05-24T02:45:02.411717946Z [2024-05-24T02:45:02.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:45:02.412698464Z [2024-05-24T02:45:02.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:44:00+00:00, run_id=scheduled__2024-05-24T02:44:00+00:00, run_start_date=2024-05-24 02:45:00.809777+00:00, run_end_date=2024-05-24 02:45:02.411980+00:00, run_duration=1.602203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:44:00+00:00, data_interval_end=2024-05-24 02:45:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:45:02.427858901Z [2024-05-24T02:45:02.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:45:00+00:00, run_after=2024-05-24T02:46:00+00:00 2024-05-24T02:45:02.503128143Z [2024-05-24T02:45:02.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status success for try_number 1 2024-05-24T02:45:02.508781289Z [2024-05-24T02:45:02.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:44:00+00:00, map_index=-1, run_start_date=2024-05-24 02:45:01.762587+00:00, run_end_date=2024-05-24 02:45:02.155763+00:00, run_duration=0.393176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:45:00.930190+00:00, queued_by_job_id=1, pid=16227 2024-05-24T02:45:03.643481075Z [2024-05-24T02:45:03.641+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:45:03.643538765Z 2024-05-24T02:45:03.643717199Z [2024-05-24T02:45:03.643+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:45:03.645051457Z [2024-05-24T02:45:03.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:45:03.645068597Z 2024-05-24T02:45:03.649849567Z [2024-05-24T02:45:03.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='split_metrics', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-24T02:45:03.649883809Z [2024-05-24T02:45:03.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'split_metrics', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:45:03.740842729Z [2024-05-24T02:45:03.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:45:03.740949439Z [2024-05-24T02:45:03.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.extract_metrics_from_vnfrs run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:45:03.745945471Z [2024-05-24T02:45:03.745+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f23cdfe-6aef-49a4-b9ee-c6ac8cfb47b9 2024-05-24T02:45:03.746054963Z [2024-05-24T02:45:03.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=-1, run_start_date=2024-05-24 02:45:02.990163+00:00, run_end_date=2024-05-24 02:45:03.309301+00:00, run_duration=0.319138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:45:00.930190+00:00, queued_by_job_id=1, pid=16252 2024-05-24T02:45:04.711484398Z [2024-05-24T02:45:04.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:45:04.711810715Z [2024-05-24T02:45:04.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:44:00+00:00, run_id=scheduled__2024-05-24T02:44:00+00:00, run_start_date=2024-05-24 02:45:00.811210+00:00, run_end_date=2024-05-24 02:45:04.711358+00:00, run_duration=3.900148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:44:00+00:00, data_interval_end=2024-05-24 02:45:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:45:04.721049731Z [2024-05-24T02:45:04.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:45:00+00:00, run_after=2024-05-24T02:46:00+00:00 2024-05-24T02:45:04.727752678Z [2024-05-24T02:45:04.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:45:04.728069394Z [2024-05-24T02:45:04.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:44:00+00:00, run_id=scheduled__2024-05-24T02:44:00+00:00, run_start_date=2024-05-24 02:45:00.812888+00:00, run_end_date=2024-05-24 02:45:04.727637+00:00, run_duration=3.914749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:44:00+00:00, data_interval_end=2024-05-24 02:45:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:45:04.739981348Z [2024-05-24T02:45:04.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:45:00+00:00, run_after=2024-05-24T02:46:00+00:00 2024-05-24T02:45:04.811614299Z [2024-05-24T02:45:04.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status success for try_number 1 2024-05-24T02:45:04.820182787Z [2024-05-24T02:45:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:44:00+00:00, map_index=-1, run_start_date=2024-05-24 02:45:02.958513+00:00, run_end_date=2024-05-24 02:45:04.231567+00:00, run_duration=1.273054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:45:00.930190+00:00, queued_by_job_id=1, pid=16251 2024-05-24T02:45:05.910035443Z [2024-05-24T02:45:05.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status success for try_number 1 2024-05-24T02:45:05.919523226Z [2024-05-24T02:45:05.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:44:00+00:00, map_index=-1, run_start_date=2024-05-24 02:45:03.071951+00:00, run_end_date=2024-05-24 02:45:04.656015+00:00, run_duration=1.584064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:45:00.930190+00:00, queued_by_job_id=1, pid=16253 2024-05-24T02:45:06.932542256Z [2024-05-24T02:45:06.931+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:45:06.932573915Z 2024-05-24T02:45:06.932799388Z [2024-05-24T02:45:06.932+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:45:06.934434078Z [2024-05-24T02:45:06.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:45:06.934448175Z 2024-05-24T02:45:06.939344708Z [2024-05-24T02:45:06.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='collect_metrics', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-24T02:45:06.939511528Z [2024-05-24T02:45:06.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'collect_metrics', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T02:45:07.014691227Z [2024-05-24T02:45:07.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:45:07.014721217Z [2024-05-24T02:45:07.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.split_metrics run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:45:07.021124345Z [2024-05-24T02:45:07.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 919be378-b51d-4130-919f-53ca076c7f01 2024-05-24T02:45:07.021520018Z [2024-05-24T02:45:07.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=split_metrics, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=-1, run_start_date=2024-05-24 02:45:05.337738+00:00, run_end_date=2024-05-24 02:45:05.755198+00:00, run_duration=0.41746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:45:03.645731+00:00, queued_by_job_id=1, pid=16276 2024-05-24T02:45:09.276092591Z [2024-05-24T02:45:09.275+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-24T02:45:09.276126136Z 2024-05-24T02:45:09.276561911Z [2024-05-24T02:45:09.276+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:45:09.277413151Z [2024-05-24T02:45:09.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:45:09.277427837Z 2024-05-24T02:45:09.280518495Z [2024-05-24T02:45:09.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='send_prometheus', run_id='scheduled__2024-05-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:45:09.280811969Z [2024-05-24T02:45:09.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'send_prometheus', 'scheduled__2024-05-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T02:45:09.370881650Z [2024-05-24T02:45:09.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status queued for try_number 1 2024-05-24T02:45:09.370910220Z [2024-05-24T02:45:09.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.collect_metrics run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:45:09.379945738Z [2024-05-24T02:45:09.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba6ad92f-6e2e-4202-9efd-432a5635f068 2024-05-24T02:45:09.380070096Z [2024-05-24T02:45:09.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=collect_metrics, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=0, run_start_date=2024-05-24 02:45:08.623731+00:00, run_end_date=2024-05-24 02:45:09.025314+00:00, run_duration=0.401583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:45:06.935565+00:00, queued_by_job_id=1, pid=16284 2024-05-24T02:45:12.053168175Z [2024-05-24T02:45:12.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:45:12.053749102Z [2024-05-24T02:45:12.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:40:00+00:00, run_id=scheduled__2024-05-24T02:40:00+00:00, run_start_date=2024-05-24 02:45:00.808044+00:00, run_end_date=2024-05-24 02:45:12.053435+00:00, run_duration=11.245391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:40:00+00:00, data_interval_end=2024-05-24 02:45:00+00:00, dag_hash=c20b875a7706b2393c1bab880ab94477 2024-05-24T02:45:12.060065530Z [2024-05-24T02:45:12.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:45:00+00:00, run_after=2024-05-24T02:50:00+00:00 2024-05-24T02:45:12.092151607Z [2024-05-24T02:45:12.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.send_prometheus run_id=scheduled__2024-05-24T02:40:00+00:00 exited with status success for try_number 1 2024-05-24T02:45:12.103559657Z [2024-05-24T02:45:12.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=send_prometheus, run_id=scheduled__2024-05-24T02:40:00+00:00, map_index=-1, run_start_date=2024-05-24 02:45:10.874419+00:00, run_end_date=2024-05-24 02:45:11.267709+00:00, run_duration=0.39329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:45:09.278105+00:00, queued_by_job_id=1, pid=16292 2024-05-24T02:46:00.591069199Z [2024-05-24T02:46:00.590+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:46:00+00:00, run_after=2024-05-24T02:47:00+00:00 2024-05-24T02:46:00.600090983Z [2024-05-24T02:46:00.599+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:46:00.612636888Z [2024-05-24T02:46:00.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:46:00+00:00, run_after=2024-05-24T02:47:00+00:00 2024-05-24T02:46:00.620139896Z [2024-05-24T02:46:00.619+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:46:00.723638502Z [2024-05-24T02:46:00.723+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:46:00.723669712Z 2024-05-24T02:46:00.723676130Z 2024-05-24T02:46:00.723682419Z 2024-05-24T02:46:00.723687784Z 2024-05-24T02:46:00.723769800Z [2024-05-24T02:46:00.723+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:46:00.724084031Z [2024-05-24T02:46:00.723+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:46:00.724419688Z [2024-05-24T02:46:00.724+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:46:00.724467828Z [2024-05-24T02:46:00.724+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:46:00.725229433Z [2024-05-24T02:46:00.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:46:00.725243714Z 2024-05-24T02:46:00.725248359Z 2024-05-24T02:46:00.725269849Z 2024-05-24T02:46:00.725274953Z 2024-05-24T02:46:00.732245081Z [2024-05-24T02:46:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:46:00.732379992Z [2024-05-24T02:46:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:46:00.732859044Z [2024-05-24T02:46:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:46:00.733155202Z [2024-05-24T02:46:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:46:00.733590095Z [2024-05-24T02:46:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:46:00.733906866Z [2024-05-24T02:46:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:46:00.734172708Z [2024-05-24T02:46:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:46:00.734373416Z [2024-05-24T02:46:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:46:01.064319904Z [2024-05-24T02:46:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status queued for try_number 1 2024-05-24T02:46:01.066555938Z [2024-05-24T02:46:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:45:00+00:00 exited with status queued for try_number 1 2024-05-24T02:46:01.066758358Z [2024-05-24T02:46:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:45:00+00:00 exited with status queued for try_number 1 2024-05-24T02:46:01.066935540Z [2024-05-24T02:46:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:45:00+00:00 exited with status queued for try_number 1 2024-05-24T02:46:01.074889029Z [2024-05-24T02:46:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96e3b30d-0d69-4179-934b-c2a676e46217 2024-05-24T02:46:01.075195429Z [2024-05-24T02:46:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00b7b413-daff-49cb-a2bb-5bfd66c38861 2024-05-24T02:46:01.075460668Z [2024-05-24T02:46:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b0ad3f8-bacf-41df-b86a-700c03491747 2024-05-24T02:46:01.075666709Z [2024-05-24T02:46:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0db3a68-0b15-4071-be5c-74cbcd048d2f 2024-05-24T02:46:02.347698598Z [2024-05-24T02:46:02.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:46:02.348060252Z [2024-05-24T02:46:02.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:44:00+00:00, run_id=scheduled__2024-05-24T02:44:00+00:00, run_start_date=2024-05-24 02:46:00.637050+00:00, run_end_date=2024-05-24 02:46:02.347463+00:00, run_duration=1.710413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:44:00+00:00, data_interval_end=2024-05-24 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:46:02.361095549Z [2024-05-24T02:46:02.360+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:46:00+00:00, run_after=2024-05-24T02:48:00+00:00 2024-05-24T02:46:02.370381985Z [2024-05-24T02:46:02.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:46:02.370718866Z [2024-05-24T02:46:02.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:45:00+00:00, run_id=scheduled__2024-05-24T02:45:00+00:00, run_start_date=2024-05-24 02:46:00.640374+00:00, run_end_date=2024-05-24 02:46:02.370252+00:00, run_duration=1.729878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:45:00+00:00, data_interval_end=2024-05-24 02:46:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:46:02.380385428Z [2024-05-24T02:46:02.379+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:46:00+00:00, run_after=2024-05-24T02:47:00+00:00 2024-05-24T02:46:02.455116353Z [2024-05-24T02:46:02.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:44:00+00:00 exited with status success for try_number 1 2024-05-24T02:46:02.479381903Z [2024-05-24T02:46:02.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:44:00+00:00, map_index=-1, run_start_date=2024-05-24 02:46:01.434966+00:00, run_end_date=2024-05-24 02:46:01.783183+00:00, run_duration=0.348217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:46:00.727392+00:00, queued_by_job_id=1, pid=16310 2024-05-24T02:46:03.600030353Z [2024-05-24T02:46:03.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:45:00+00:00 exited with status success for try_number 1 2024-05-24T02:46:03.607859834Z [2024-05-24T02:46:03.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:45:00+00:00, map_index=-1, run_start_date=2024-05-24 02:46:01.819534+00:00, run_end_date=2024-05-24 02:46:02.255264+00:00, run_duration=0.43573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:46:00.727392+00:00, queued_by_job_id=1, pid=16322 2024-05-24T02:46:04.657111682Z [2024-05-24T02:46:04.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:46:04.657397140Z [2024-05-24T02:46:04.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:45:00+00:00, run_id=scheduled__2024-05-24T02:45:00+00:00, run_start_date=2024-05-24 02:46:00.642607+00:00, run_end_date=2024-05-24 02:46:04.656955+00:00, run_duration=4.014348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:45:00+00:00, data_interval_end=2024-05-24 02:46:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:46:04.671284310Z [2024-05-24T02:46:04.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:46:00+00:00, run_after=2024-05-24T02:47:00+00:00 2024-05-24T02:46:04.730404640Z [2024-05-24T02:46:04.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:45:00+00:00 exited with status success for try_number 1 2024-05-24T02:46:04.741408114Z [2024-05-24T02:46:04.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:45:00+00:00, map_index=-1, run_start_date=2024-05-24 02:46:02.617031+00:00, run_end_date=2024-05-24 02:46:04.209654+00:00, run_duration=1.592623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:46:00.727392+00:00, queued_by_job_id=1, pid=16339 2024-05-24T02:46:06.161810679Z [2024-05-24T02:46:06.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:46:06.162040474Z [2024-05-24T02:46:06.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:45:00+00:00, run_id=scheduled__2024-05-24T02:45:00+00:00, run_start_date=2024-05-24 02:46:00.644392+00:00, run_end_date=2024-05-24 02:46:06.161734+00:00, run_duration=5.517342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:45:00+00:00, data_interval_end=2024-05-24 02:46:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:46:06.180759740Z [2024-05-24T02:46:06.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:46:00+00:00, run_after=2024-05-24T02:47:00+00:00 2024-05-24T02:46:06.225289556Z [2024-05-24T02:46:06.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:45:00+00:00 exited with status success for try_number 1 2024-05-24T02:46:06.230732529Z [2024-05-24T02:46:06.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:45:00+00:00, map_index=-1, run_start_date=2024-05-24 02:46:02.682164+00:00, run_end_date=2024-05-24 02:46:06.038355+00:00, run_duration=3.356191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:46:00.727392+00:00, queued_by_job_id=1, pid=16340 2024-05-24T02:46:42.822168013Z [2024-05-24T02:46:42.821+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-24T02:47:00.249306544Z [2024-05-24T02:47:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:47:00+00:00, run_after=2024-05-24T02:48:00+00:00 2024-05-24T02:47:00.262255354Z [2024-05-24T02:47:00.261+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:47:00.291755392Z [2024-05-24T02:47:00.291+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:47:00+00:00, run_after=2024-05-24T02:48:00+00:00 2024-05-24T02:47:00.366636114Z [2024-05-24T02:47:00.366+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-24T02:47:00.366691319Z 2024-05-24T02:47:00.366696968Z 2024-05-24T02:47:00.366703151Z 2024-05-24T02:47:00.366983400Z [2024-05-24T02:47:00.366+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:47:00.367217447Z [2024-05-24T02:47:00.367+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:47:00.367484547Z [2024-05-24T02:47:00.367+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:47:00.368367407Z [2024-05-24T02:47:00.368+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:47:00.368382558Z 2024-05-24T02:47:00.368388114Z 2024-05-24T02:47:00.368393338Z 2024-05-24T02:47:00.371678181Z [2024-05-24T02:47:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:47:00.371911083Z [2024-05-24T02:47:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:47:00.372232951Z [2024-05-24T02:47:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:47:00.372430147Z [2024-05-24T02:47:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:47:00.372775686Z [2024-05-24T02:47:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:47:00.372969108Z [2024-05-24T02:47:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:47:00.750815801Z [2024-05-24T02:47:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status queued for try_number 1 2024-05-24T02:47:00.753292303Z [2024-05-24T02:47:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status queued for try_number 1 2024-05-24T02:47:00.753545206Z [2024-05-24T02:47:00.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status queued for try_number 1 2024-05-24T02:47:00.763063966Z [2024-05-24T02:47:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to dadf36ab-66b1-460e-96a1-176dc7f8f16e 2024-05-24T02:47:00.763385444Z [2024-05-24T02:47:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28752f9a-391f-4eb0-90aa-7c4cd93735d9 2024-05-24T02:47:00.763596437Z [2024-05-24T02:47:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 238dc0eb-2bf3-432b-b418-4a2c6ce0df3b 2024-05-24T02:47:01.901536551Z [2024-05-24T02:47:01.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:47:01.901758583Z [2024-05-24T02:47:01.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:46:00+00:00, run_id=scheduled__2024-05-24T02:46:00+00:00, run_start_date=2024-05-24 02:47:00.306063+00:00, run_end_date=2024-05-24 02:47:01.901446+00:00, run_duration=1.595383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:46:00+00:00, data_interval_end=2024-05-24 02:47:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:47:01.914623000Z [2024-05-24T02:47:01.913+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:47:00+00:00, run_after=2024-05-24T02:48:00+00:00 2024-05-24T02:47:01.971242842Z [2024-05-24T02:47:01.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status success for try_number 1 2024-05-24T02:47:01.982952017Z [2024-05-24T02:47:01.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:46:00+00:00, map_index=-1, run_start_date=2024-05-24 02:47:01.222036+00:00, run_end_date=2024-05-24 02:47:01.571469+00:00, run_duration=0.349433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:47:00.369128+00:00, queued_by_job_id=1, pid=16372 2024-05-24T02:47:05.375105774Z [2024-05-24T02:47:05.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:47:05.375322648Z [2024-05-24T02:47:05.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:46:00+00:00, run_id=scheduled__2024-05-24T02:46:00+00:00, run_start_date=2024-05-24 02:47:00.307451+00:00, run_end_date=2024-05-24 02:47:05.374927+00:00, run_duration=5.067476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:46:00+00:00, data_interval_end=2024-05-24 02:47:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:47:05.386668105Z [2024-05-24T02:47:05.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:47:00+00:00, run_after=2024-05-24T02:48:00+00:00 2024-05-24T02:47:05.442369699Z [2024-05-24T02:47:05.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status success for try_number 1 2024-05-24T02:47:05.451246192Z [2024-05-24T02:47:05.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:46:00+00:00, map_index=-1, run_start_date=2024-05-24 02:47:02.456391+00:00, run_end_date=2024-05-24 02:47:05.107419+00:00, run_duration=2.651028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:47:00.369128+00:00, queued_by_job_id=1, pid=16391 2024-05-24T02:47:06.511228049Z [2024-05-24T02:47:06.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:47:06.511780309Z [2024-05-24T02:47:06.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:46:00+00:00, run_id=scheduled__2024-05-24T02:46:00+00:00, run_start_date=2024-05-24 02:47:00.308722+00:00, run_end_date=2024-05-24 02:47:06.511123+00:00, run_duration=6.202401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:46:00+00:00, data_interval_end=2024-05-24 02:47:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:47:06.523761634Z [2024-05-24T02:47:06.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:47:00+00:00, run_after=2024-05-24T02:48:00+00:00 2024-05-24T02:47:06.569036462Z [2024-05-24T02:47:06.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status success for try_number 1 2024-05-24T02:47:06.580926443Z [2024-05-24T02:47:06.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:46:00+00:00, map_index=-1, run_start_date=2024-05-24 02:47:02.374435+00:00, run_end_date=2024-05-24 02:47:05.763626+00:00, run_duration=3.389191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:47:00.369128+00:00, queued_by_job_id=1, pid=16390 2024-05-24T02:48:00.518421441Z [2024-05-24T02:48:00.517+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:48:00.535929199Z [2024-05-24T02:48:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:48:00+00:00, run_after=2024-05-24T02:49:00+00:00 2024-05-24T02:48:00.550179825Z [2024-05-24T02:48:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:48:00+00:00, run_after=2024-05-24T02:49:00+00:00 2024-05-24T02:48:00.559702390Z [2024-05-24T02:48:00.559+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-24T02:48:00.677521575Z [2024-05-24T02:48:00.676+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-24T02:48:00.677557778Z 2024-05-24T02:48:00.677566093Z 2024-05-24T02:48:00.677572577Z 2024-05-24T02:48:00.677578812Z 2024-05-24T02:48:00.677585860Z [2024-05-24T02:48:00.677+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-24T02:48:00.677626606Z [2024-05-24T02:48:00.677+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:48:00.677752695Z [2024-05-24T02:48:00.677+0000] {scheduler_job.py:425} INFO - DAG vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd has 0/16 running and queued tasks 2024-05-24T02:48:00.677949452Z [2024-05-24T02:48:00.677+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 has 0/16 running and queued tasks 2024-05-24T02:48:00.680107904Z [2024-05-24T02:48:00.678+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-24T02:48:00.680141086Z 2024-05-24T02:48:00.680150457Z 2024-05-24T02:48:00.680165580Z 2024-05-24T02:48:00.680201075Z 2024-05-24T02:48:00.685282022Z [2024-05-24T02:48:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:48:00.685513324Z [2024-05-24T02:48:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T02:48:00.685686074Z [2024-05-24T02:48:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:48:00.685759726Z [2024-05-24T02:48:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T02:48:00.685775795Z [2024-05-24T02:48:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:48:00.686005505Z [2024-05-24T02:48:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T02:48:00.686034842Z [2024-05-24T02:48:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-24T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-24T02:48:00.686052590Z [2024-05-24T02:48:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T02:48:01.119326723Z [2024-05-24T02:48:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status queued for try_number 1 2024-05-24T02:48:01.119553339Z [2024-05-24T02:48:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:47:00+00:00 exited with status queued for try_number 1 2024-05-24T02:48:01.119763954Z [2024-05-24T02:48:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:47:00+00:00 exited with status queued for try_number 1 2024-05-24T02:48:01.119896786Z [2024-05-24T02:48:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:47:00+00:00 exited with status queued for try_number 1 2024-05-24T02:48:01.128687271Z [2024-05-24T02:48:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 458c2f26-6cf1-42dc-a22a-9b7fa804d326 2024-05-24T02:48:01.128867361Z [2024-05-24T02:48:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e1d23cd-ea02-40ee-98a0-a877665a147b 2024-05-24T02:48:01.129041782Z [2024-05-24T02:48:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to c89127de-9982-4a5b-8967-fc019035528f 2024-05-24T02:48:01.129199261Z [2024-05-24T02:48:01.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1453bd56-62e1-47aa-b595-f5193e8a94b4 2024-05-24T02:48:02.260795801Z [2024-05-24T02:48:02.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:48:02.261055850Z [2024-05-24T02:48:02.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-24 02:46:00+00:00, run_id=scheduled__2024-05-24T02:46:00+00:00, run_start_date=2024-05-24 02:48:00.572725+00:00, run_end_date=2024-05-24 02:48:02.260649+00:00, run_duration=1.687924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:46:00+00:00, data_interval_end=2024-05-24 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-24T02:48:02.268443757Z [2024-05-24T02:48:02.268+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-24T02:48:00+00:00, run_after=2024-05-24T02:50:00+00:00 2024-05-24T02:48:02.274462099Z [2024-05-24T02:48:02.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:48:02.274944220Z [2024-05-24T02:48:02.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, execution_date=2024-05-24 02:47:00+00:00, run_id=scheduled__2024-05-24T02:47:00+00:00, run_start_date=2024-05-24 02:48:00.574360+00:00, run_end_date=2024-05-24 02:48:02.274358+00:00, run_duration=1.699998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:47:00+00:00, data_interval_end=2024-05-24 02:48:00+00:00, dag_hash=04f0dbc58f019577fb73ce68b042cb48 2024-05-24T02:48:02.284238827Z [2024-05-24T02:48:02.283+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3 to 2024-05-24T02:48:00+00:00, run_after=2024-05-24T02:49:00+00:00 2024-05-24T02:48:02.349219505Z [2024-05-24T02:48:02.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-24T02:46:00+00:00 exited with status success for try_number 1 2024-05-24T02:48:02.349424951Z [2024-05-24T02:48:02.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:47:00+00:00 exited with status success for try_number 1 2024-05-24T02:48:02.361305144Z [2024-05-24T02:48:02.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-24T02:46:00+00:00, map_index=-1, run_start_date=2024-05-24 02:48:01.649441+00:00, run_end_date=2024-05-24 02:48:02.031548+00:00, run_duration=0.382107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:48:00.681106+00:00, queued_by_job_id=1, pid=16425 2024-05-24T02:48:02.361651841Z [2024-05-24T02:48:02.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3c0eed1a-02ef-4687-b2a3-a349898417d3, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:47:00+00:00, map_index=-1, run_start_date=2024-05-24 02:48:01.641800+00:00, run_end_date=2024-05-24 02:48:02.084924+00:00, run_duration=0.443124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:48:00.681106+00:00, queued_by_job_id=1, pid=16424 2024-05-24T02:48:05.272237011Z [2024-05-24T02:48:05.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:48:05.273200369Z [2024-05-24T02:48:05.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:47:00+00:00, run_id=scheduled__2024-05-24T02:47:00+00:00, run_start_date=2024-05-24 02:48:00.575942+00:00, run_end_date=2024-05-24 02:48:05.272181+00:00, run_duration=4.696239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:47:00+00:00, data_interval_end=2024-05-24 02:48:00+00:00, dag_hash=e03c80b24e0225febddebfbe1c0a4f41 2024-05-24T02:48:05.297418397Z [2024-05-24T02:48:05.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:48:00+00:00, run_after=2024-05-24T02:49:00+00:00 2024-05-24T02:48:05.370118634Z [2024-05-24T02:48:05.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:47:00+00:00 exited with status success for try_number 1 2024-05-24T02:48:05.374715484Z [2024-05-24T02:48:05.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:47:00+00:00, map_index=-1, run_start_date=2024-05-24 02:48:02.798752+00:00, run_end_date=2024-05-24 02:48:04.461655+00:00, run_duration=1.662903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:48:00.681106+00:00, queued_by_job_id=1, pid=16448 2024-05-24T02:48:06.440082230Z [2024-05-24T02:48:06.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-24T02:48:06.440696824Z [2024-05-24T02:48:06.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, execution_date=2024-05-24 02:47:00+00:00, run_id=scheduled__2024-05-24T02:47:00+00:00, run_start_date=2024-05-24 02:48:00.577193+00:00, run_end_date=2024-05-24 02:48:06.439947+00:00, run_duration=5.862754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-24 02:47:00+00:00, data_interval_end=2024-05-24 02:48:00+00:00, dag_hash=22d7cc92456562901cda69274a2f6741 2024-05-24T02:48:06.456016372Z [2024-05-24T02:48:06.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd to 2024-05-24T02:48:00+00:00, run_after=2024-05-24T02:49:00+00:00 2024-05-24T02:48:06.520372848Z [2024-05-24T02:48:06.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-24T02:47:00+00:00 exited with status success for try_number 1 2024-05-24T02:48:06.528696218Z [2024-05-24T02:48:06.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_d1d7986c-ffd1-4a9c-aec3-61c0185664bd, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-24T02:47:00+00:00, map_index=-1, run_start_date=2024-05-24 02:48:02.888527+00:00, run_end_date=2024-05-24 02:48:05.483601+00:00, run_duration=2.595074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-24 02:48:00.681106+00:00, queued_by_job_id=1, pid=16449 2024-05-23T22:31:31.762353717Z 2024-05-23T22:31:31.772235578Z Cleaning logs every 900 seconds 2024-05-23T22:31:31.772248380Z Trimming airflow logs to 15 days. 2024-05-23T22:45:00.818801049Z Trimming airflow logs to 15 days. 2024-05-23T22:45:01.850358911Z Trimming airflow logs to 15 days. 2024-05-23T23:00:00.899095099Z Trimming airflow logs to 15 days. 2024-05-23T23:00:01.925999092Z Trimming airflow logs to 15 days. 2024-05-23T23:15:00.979681779Z Trimming airflow logs to 15 days. 2024-05-23T23:30:00.025134840Z Trimming airflow logs to 15 days. 2024-05-23T23:30:01.058796605Z Trimming airflow logs to 15 days. 2024-05-23T23:45:00.111432342Z Trimming airflow logs to 15 days. 2024-05-23T23:45:01.136587358Z Trimming airflow logs to 15 days. 2024-05-24T00:00:00.194558229Z Trimming airflow logs to 15 days. 2024-05-24T00:00:01.230992126Z Trimming airflow logs to 15 days. 2024-05-24T00:15:00.278619017Z Trimming airflow logs to 15 days. 2024-05-24T00:15:01.320479325Z Trimming airflow logs to 15 days. 2024-05-24T00:30:00.353558600Z Trimming airflow logs to 15 days. 2024-05-24T00:30:01.386176471Z Trimming airflow logs to 15 days. 2024-05-24T00:45:00.428745517Z Trimming airflow logs to 15 days. 2024-05-24T00:45:01.519317502Z Trimming airflow logs to 15 days. 2024-05-24T01:00:00.573719659Z Trimming airflow logs to 15 days. 2024-05-24T01:00:01.605649499Z Trimming airflow logs to 15 days. 2024-05-24T01:15:00.658810036Z Trimming airflow logs to 15 days. 2024-05-24T01:15:01.679326685Z Trimming airflow logs to 15 days. 2024-05-24T01:30:00.724887686Z Trimming airflow logs to 15 days. 2024-05-24T01:30:01.767073330Z Trimming airflow logs to 15 days. 2024-05-24T01:45:00.804267602Z Trimming airflow logs to 15 days. 2024-05-24T01:45:01.839424050Z Trimming airflow logs to 15 days. 2024-05-24T02:00:00.898922237Z Trimming airflow logs to 15 days. 2024-05-24T02:00:01.933213155Z Trimming airflow logs to 15 days. 2024-05-24T02:15:01.006803396Z Trimming airflow logs to 15 days. 2024-05-24T02:30:00.068255291Z Trimming airflow logs to 15 days. 2024-05-24T02:30:01.102755245Z Trimming airflow logs to 15 days. 2024-05-24T02:45:00.141255447Z Trimming airflow logs to 15 days. 2024-05-24T02:45:01.166732988Z Trimming airflow logs to 15 days.