2024-03-28T23:28:08.638995639Z ..... 2024-03-28T23:28:09.277380051Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-28T23:28:10.022204194Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-28T23:28:15.412991070Z [2024-03-28T23:28:15.411+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-03-28T23:28:16.421612299Z [2024-03-28T23:28:16.421+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-03-28T23:28:17.432107296Z [2024-03-28T23:28:17.431+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-03-28T23:28:35.516951759Z 2024-03-28T23:28:36.419616237Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-28T23:28:37.885728855Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-28T23:28:43.225505869Z ____________ _____________ 2024-03-28T23:28:43.225522755Z ____ |__( )_________ __/__ /________ __ 2024-03-28T23:28:43.225526614Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-03-28T23:28:43.225529680Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-03-28T23:28:43.225532880Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-03-28T23:28:43.225536266Z [2024-03-28T23:28:43.224+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-03-28T23:28:43.226023665Z [2024-03-28T23:28:43.225+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-03-28T23:28:43.550565095Z [2024-03-28T23:28:43.544+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-03-28T23:28:43.565443248Z [2024-03-28T23:28:43.554+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 16 2024-03-28T23:28:43.566907511Z [2024-03-28T23:28:43.566+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-28T23:28:43.599595568Z [2024-03-28T23:28:43.570+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-03-28T23:28:43.601060124Z [2024-03-28T23:28:43.600+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-03-28T23:29:45.952504142Z [2024-03-28T23:29:45.948+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:29:46.044660195Z [2024-03-28T23:29:46.042+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:29:46.044706095Z 2024-03-28T23:29:46.050627558Z [2024-03-28T23:29:46.044+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:29:46.050647182Z [2024-03-28T23:29:46.046+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:29:46.050651032Z 2024-03-28T23:29:46.055043007Z [2024-03-28T23:29:46.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:29:46.055748205Z [2024-03-28T23:29:46.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:29:46.318861346Z [2024-03-28T23:29:46.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:26:00+00:00 exited with status queued for try_number 1 2024-03-28T23:29:46.333359748Z [2024-03-28T23:29:46.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4897d4e-9c3a-47ff-a3db-f607e267d14b 2024-03-28T23:30:18.761770426Z [2024-03-28T23:30:18.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:26:00+00:00 exited with status success for try_number 1 2024-03-28T23:30:18.769566623Z [2024-03-28T23:30:18.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:26:00+00:00, map_index=-1, run_start_date=2024-03-28 23:29:47.307795+00:00, run_end_date=2024-03-28 23:30:17.729561+00:00, run_duration=30.421766, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:29:46.049281+00:00, queued_by_job_id=2, pid=50 2024-03-28T23:30:28.740177727Z [2024-03-28T23:30:28.739+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:30:28.740232453Z 2024-03-28T23:30:28.740263636Z [2024-03-28T23:30:28.740+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:30:28.741356299Z [2024-03-28T23:30:28.741+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:30:28.741369257Z 2024-03-28T23:30:28.744945126Z [2024-03-28T23:30:28.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:26:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:30:28.745026229Z [2024-03-28T23:30:28.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:30:28.800390068Z [2024-03-28T23:30:28.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:26:00+00:00 exited with status queued for try_number 2 2024-03-28T23:30:28.805025404Z [2024-03-28T23:30:28.804+0000] {scheduler_job.py:635} INFO - Setting external_id for to 023e03c8-d091-4068-ac80-d58734fa4576 2024-03-28T23:31:00.521098571Z [2024-03-28T23:31:00.520+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:31:00.521513793Z [2024-03-28T23:31:00.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:26:00+00:00, run_id=scheduled__2024-03-28T23:26:00+00:00, run_start_date=2024-03-28 23:29:45.961908+00:00, run_end_date=2024-03-28 23:31:00.520960+00:00, run_duration=74.559052, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:26:00+00:00, data_interval_end=2024-03-28 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:31:00.529984559Z [2024-03-28T23:31:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:28:00+00:00, run_after=2024-03-28T23:30:00+00:00 2024-03-28T23:31:00.563483826Z [2024-03-28T23:31:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:26:00+00:00 exited with status success for try_number 2 2024-03-28T23:31:00.571968719Z [2024-03-28T23:31:00.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:26:00+00:00, map_index=-1, run_start_date=2024-03-28 23:30:29.324309+00:00, run_end_date=2024-03-28 23:30:59.712041+00:00, run_duration=30.387732, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:30:28.741982+00:00, queued_by_job_id=2, pid=68 2024-03-28T23:31:01.174780837Z [2024-03-28T23:31:01.174+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:31:01.209573164Z [2024-03-28T23:31:01.208+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:31:01.209595944Z 2024-03-28T23:31:01.209760378Z [2024-03-28T23:31:01.209+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:31:01.210705542Z [2024-03-28T23:31:01.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:31:01.210724368Z 2024-03-28T23:31:01.213717594Z [2024-03-28T23:31:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:31:01.213994738Z [2024-03-28T23:31:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:31:01.275169065Z [2024-03-28T23:31:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:28:00+00:00 exited with status queued for try_number 1 2024-03-28T23:31:01.283583655Z [2024-03-28T23:31:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb2d0686-920c-4161-aa8c-3786fa13a004 2024-03-28T23:31:23.915482902Z [2024-03-28T23:31:23.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:31:23.915775085Z [2024-03-28T23:31:23.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:28:00+00:00, run_id=scheduled__2024-03-28T23:28:00+00:00, run_start_date=2024-03-28 23:31:01.184256+00:00, run_end_date=2024-03-28 23:31:23.915458+00:00, run_duration=22.731202, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:28:00+00:00, data_interval_end=2024-03-28 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:31:23.923129579Z [2024-03-28T23:31:23.922+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:30:00+00:00, run_after=2024-03-28T23:32:00+00:00 2024-03-28T23:31:23.947986404Z [2024-03-28T23:31:23.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:28:00+00:00 exited with status success for try_number 1 2024-03-28T23:31:23.954285305Z [2024-03-28T23:31:23.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:28:00+00:00, map_index=-1, run_start_date=2024-03-28 23:31:01.865325+00:00, run_end_date=2024-03-28 23:31:23.007235+00:00, run_duration=21.14191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:31:01.211369+00:00, queued_by_job_id=2, pid=73 2024-03-28T23:32:00.742907401Z [2024-03-28T23:32:00.742+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:32:00.779276570Z [2024-03-28T23:32:00.778+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:32:00.779306351Z 2024-03-28T23:32:00.779321037Z [2024-03-28T23:32:00.779+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:32:00.779868100Z [2024-03-28T23:32:00.779+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:32:00.779876044Z 2024-03-28T23:32:00.782022521Z [2024-03-28T23:32:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:32:00.782109450Z [2024-03-28T23:32:00.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:32:00.829847690Z [2024-03-28T23:32:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:32:00.835617567Z [2024-03-28T23:32:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to f788e6c8-4df9-4935-a0b6-41e4ea04b140 2024-03-28T23:32:01.946326913Z [2024-03-28T23:32:01.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:32:01.946589955Z [2024-03-28T23:32:01.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:30:00+00:00, run_id=scheduled__2024-03-28T23:30:00+00:00, run_start_date=2024-03-28 23:32:00.751949+00:00, run_end_date=2024-03-28 23:32:01.946203+00:00, run_duration=1.194254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:30:00+00:00, data_interval_end=2024-03-28 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:32:01.954110608Z [2024-03-28T23:32:01.953+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:32:00+00:00, run_after=2024-03-28T23:34:00+00:00 2024-03-28T23:32:02.396454774Z [2024-03-28T23:32:02.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:32:02.404423013Z [2024-03-28T23:32:02.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:32:01.533275+00:00, run_end_date=2024-03-28 23:32:01.918901+00:00, run_duration=0.385626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:32:00.780100+00:00, queued_by_job_id=2, pid=93 2024-03-28T23:33:43.824707787Z [2024-03-28T23:33:43.824+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-28T23:34:00.127002783Z [2024-03-28T23:34:00.126+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:34:00.196885097Z [2024-03-28T23:34:00.196+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:34:00.196936333Z 2024-03-28T23:34:00.197080752Z [2024-03-28T23:34:00.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:34:00.197918177Z [2024-03-28T23:34:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:34:00.197935824Z 2024-03-28T23:34:00.199957016Z [2024-03-28T23:34:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:34:00.200084526Z [2024-03-28T23:34:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:34:00.248163122Z [2024-03-28T23:34:00.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:32:00+00:00 exited with status queued for try_number 1 2024-03-28T23:34:00.253115430Z [2024-03-28T23:34:00.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 682dd9bd-553b-4f2d-a69d-13534bcb6d39 2024-03-28T23:34:01.376784484Z [2024-03-28T23:34:01.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:34:01.377337853Z [2024-03-28T23:34:01.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:32:00+00:00, run_id=scheduled__2024-03-28T23:32:00+00:00, run_start_date=2024-03-28 23:34:00.143130+00:00, run_end_date=2024-03-28 23:34:01.376872+00:00, run_duration=1.233742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:32:00+00:00, data_interval_end=2024-03-28 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:34:01.386801560Z [2024-03-28T23:34:01.386+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:34:00+00:00, run_after=2024-03-28T23:36:00+00:00 2024-03-28T23:34:01.417820852Z [2024-03-28T23:34:01.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:32:00+00:00 exited with status success for try_number 1 2024-03-28T23:34:01.424250138Z [2024-03-28T23:34:01.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:32:00+00:00, map_index=-1, run_start_date=2024-03-28 23:34:00.872728+00:00, run_end_date=2024-03-28 23:34:01.253487+00:00, run_duration=0.380759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:34:00.198241+00:00, queued_by_job_id=2, pid=126 2024-03-28T23:36:00.613147515Z [2024-03-28T23:36:00.612+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:36:00.650297899Z [2024-03-28T23:36:00.649+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:36:00.650351458Z 2024-03-28T23:36:00.650614696Z [2024-03-28T23:36:00.650+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:36:00.651238170Z [2024-03-28T23:36:00.651+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:36:00.651250101Z 2024-03-28T23:36:00.653301475Z [2024-03-28T23:36:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:36:00.653525227Z [2024-03-28T23:36:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:36:00.707813352Z [2024-03-28T23:36:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:34:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:00.713730017Z [2024-03-28T23:36:00.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14aab0de-4e41-49b2-85a6-98e07749bb16 2024-03-28T23:36:01.833460790Z [2024-03-28T23:36:01.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:36:01.833965193Z [2024-03-28T23:36:01.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:34:00+00:00, run_id=scheduled__2024-03-28T23:34:00+00:00, run_start_date=2024-03-28 23:36:00.622568+00:00, run_end_date=2024-03-28 23:36:01.833321+00:00, run_duration=1.210753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:34:00+00:00, data_interval_end=2024-03-28 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:36:01.846618255Z [2024-03-28T23:36:01.846+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:36:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:36:01.883479647Z [2024-03-28T23:36:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:34:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:01.889534824Z [2024-03-28T23:36:01.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:34:00+00:00, map_index=-1, run_start_date=2024-03-28 23:36:01.307040+00:00, run_end_date=2024-03-28 23:36:01.683409+00:00, run_duration=0.376369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:00.651662+00:00, queued_by_job_id=2, pid=159 2024-03-28T23:36:07.491573737Z [2024-03-28T23:36:07.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:35:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:36:07.537545528Z [2024-03-28T23:36:07.537+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:36:07.537573209Z 2024-03-28T23:36:07.537873625Z [2024-03-28T23:36:07.537+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:36:07.538576046Z [2024-03-28T23:36:07.538+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:36:07.538589816Z 2024-03-28T23:36:07.540912378Z [2024-03-28T23:36:07.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:36:07.541126250Z [2024-03-28T23:36:07.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:36:07.594365846Z [2024-03-28T23:36:07.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:07.604797324Z [2024-03-28T23:36:07.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 423e3ff5-49c6-4af3-b341-bf930e55ed5e 2024-03-28T23:36:09.804124097Z [2024-03-28T23:36:09.803+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:36:09.804151314Z 2024-03-28T23:36:09.804365444Z [2024-03-28T23:36:09.804+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:36:09.805389712Z [2024-03-28T23:36:09.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:36:09.805418373Z 2024-03-28T23:36:09.810189801Z [2024-03-28T23:36:09.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:36:09.810557703Z [2024-03-28T23:36:09.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:36:09.862197677Z [2024-03-28T23:36:09.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:09.862517361Z [2024-03-28T23:36:09.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:09.868729708Z [2024-03-28T23:36:09.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee13bb4a-0f9c-40ec-8eae-637eca08c451 2024-03-28T23:36:09.868937538Z [2024-03-28T23:36:09.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:36:09.159976+00:00, run_end_date=2024-03-28 23:36:09.474867+00:00, run_duration=0.314891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:07.538992+00:00, queued_by_job_id=2, pid=172 2024-03-28T23:36:12.276194025Z [2024-03-28T23:36:12.275+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:36:12.276231919Z 2024-03-28T23:36:12.276660532Z [2024-03-28T23:36:12.276+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:36:12.277571861Z [2024-03-28T23:36:12.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:36:12.277587187Z 2024-03-28T23:36:12.280843487Z [2024-03-28T23:36:12.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:36:12.281161900Z [2024-03-28T23:36:12.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:36:12.327129293Z [2024-03-28T23:36:12.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:12.327230917Z [2024-03-28T23:36:12.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:12.339487467Z [2024-03-28T23:36:12.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfbb39ef-c607-48bd-b286-84577e6df346 2024-03-28T23:36:12.339662787Z [2024-03-28T23:36:12.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:36:11.360046+00:00, run_end_date=2024-03-28 23:36:11.623786+00:00, run_duration=0.26374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:09.806041+00:00, queued_by_job_id=2, pid=185 2024-03-28T23:36:14.564779977Z [2024-03-28T23:36:14.560+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:36:14.564836721Z 2024-03-28T23:36:14.564842229Z [2024-03-28T23:36:14.560+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:36:14.564889123Z [2024-03-28T23:36:14.561+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:36:14.564893552Z 2024-03-28T23:36:14.564919466Z [2024-03-28T23:36:14.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:36:14.564939887Z [2024-03-28T23:36:14.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:36:14.611965479Z [2024-03-28T23:36:14.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:14.612278228Z [2024-03-28T23:36:14.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:14.619301062Z [2024-03-28T23:36:14.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb0e065f-ed8c-42a0-a01a-aeb5b7696425 2024-03-28T23:36:14.619685524Z [2024-03-28T23:36:14.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=0, run_start_date=2024-03-28 23:36:13.812397+00:00, run_end_date=2024-03-28 23:36:14.092097+00:00, run_duration=0.2797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:12.278204+00:00, queued_by_job_id=2, pid=193 2024-03-28T23:36:17.561617386Z [2024-03-28T23:36:17.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:36:17.562020063Z [2024-03-28T23:36:17.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:30:00+00:00, run_id=scheduled__2024-03-28T23:30:00+00:00, run_start_date=2024-03-28 23:36:07.499729+00:00, run_end_date=2024-03-28 23:36:17.561716+00:00, run_duration=10.061987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:30:00+00:00, data_interval_end=2024-03-28 23:35:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-28T23:36:17.568830906Z [2024-03-28T23:36:17.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:35:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:36:17.595645907Z [2024-03-28T23:36:17.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:17.602107645Z [2024-03-28T23:36:17.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:36:16.240077+00:00, run_end_date=2024-03-28 23:36:16.521101+00:00, run_duration=0.281024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:14.562077+00:00, queued_by_job_id=2, pid=201 2024-03-28T23:36:28.637555339Z [2024-03-28T23:36:28.637+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:36:00+00:00, run_after=2024-03-28T23:37:00+00:00 2024-03-28T23:36:28.666091371Z [2024-03-28T23:36:28.665+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:36:28.666131778Z 2024-03-28T23:36:28.666155169Z [2024-03-28T23:36:28.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:36:28.666697330Z [2024-03-28T23:36:28.666+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:36:28.666727799Z 2024-03-28T23:36:28.668540210Z [2024-03-28T23:36:28.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:36:28.668657128Z [2024-03-28T23:36:28.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:36:28.705264724Z [2024-03-28T23:36:28.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:28.709305345Z [2024-03-28T23:36:28.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4aa2451d-f30e-47e2-b372-34b453e7798b 2024-03-28T23:36:29.809178865Z [2024-03-28T23:36:29.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:36:29.809657569Z [2024-03-28T23:36:29.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:35:00+00:00, run_id=scheduled__2024-03-28T23:35:00+00:00, run_start_date=2024-03-28 23:36:28.645494+00:00, run_end_date=2024-03-28 23:36:29.809097+00:00, run_duration=1.163603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:35:00+00:00, data_interval_end=2024-03-28 23:36:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:36:29.820186803Z [2024-03-28T23:36:29.819+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:36:00+00:00, run_after=2024-03-28T23:37:00+00:00 2024-03-28T23:36:29.851144279Z [2024-03-28T23:36:29.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:29.858920087Z [2024-03-28T23:36:29.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:35:00+00:00, map_index=-1, run_start_date=2024-03-28 23:36:29.275738+00:00, run_end_date=2024-03-28 23:36:29.626207+00:00, run_duration=0.350469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:28.666976+00:00, queued_by_job_id=2, pid=221 2024-03-28T23:36:33.990487260Z [2024-03-28T23:36:33.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:36:00+00:00, run_after=2024-03-28T23:37:00+00:00 2024-03-28T23:36:33.999794458Z [2024-03-28T23:36:33.999+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:36:34.046184938Z [2024-03-28T23:36:34.045+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-28T23:36:34.046229181Z 2024-03-28T23:36:34.046238791Z 2024-03-28T23:36:34.046247294Z [2024-03-28T23:36:34.045+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:36:34.046513361Z [2024-03-28T23:36:34.046+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:36:34.047233088Z [2024-03-28T23:36:34.046+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:36:34.047258598Z 2024-03-28T23:36:34.047271708Z 2024-03-28T23:36:34.051137787Z [2024-03-28T23:36:34.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:36:34.051293746Z [2024-03-28T23:36:34.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:36:34.051809123Z [2024-03-28T23:36:34.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:36:34.052001579Z [2024-03-28T23:36:34.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:36:34.215307767Z [2024-03-28T23:36:34.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:34.215367410Z [2024-03-28T23:36:34.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status queued for try_number 1 2024-03-28T23:36:34.223401152Z [2024-03-28T23:36:34.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5438371-040a-4306-9bba-26fdf71ab640 2024-03-28T23:36:34.223582841Z [2024-03-28T23:36:34.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69e75282-5bbb-46b7-9bbd-31f4046448fc 2024-03-28T23:36:37.697413518Z [2024-03-28T23:36:37.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:36:37.697987275Z [2024-03-28T23:36:37.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:35:00+00:00, run_id=scheduled__2024-03-28T23:35:00+00:00, run_start_date=2024-03-28 23:36:34.009480+00:00, run_end_date=2024-03-28 23:36:37.697315+00:00, run_duration=3.687835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:35:00+00:00, data_interval_end=2024-03-28 23:36:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:36:37.716406943Z [2024-03-28T23:36:37.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:36:00+00:00, run_after=2024-03-28T23:37:00+00:00 2024-03-28T23:36:37.723027694Z [2024-03-28T23:36:37.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:36:37.723227791Z [2024-03-28T23:36:37.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:35:00+00:00, run_id=scheduled__2024-03-28T23:35:00+00:00, run_start_date=2024-03-28 23:36:34.009932+00:00, run_end_date=2024-03-28 23:36:37.722909+00:00, run_duration=3.712977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:35:00+00:00, data_interval_end=2024-03-28 23:36:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:36:37.733602224Z [2024-03-28T23:36:37.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:36:00+00:00, run_after=2024-03-28T23:37:00+00:00 2024-03-28T23:36:37.756686248Z [2024-03-28T23:36:37.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:37.756903669Z [2024-03-28T23:36:37.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status success for try_number 1 2024-03-28T23:36:37.762372185Z [2024-03-28T23:36:37.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:35:00+00:00, map_index=-1, run_start_date=2024-03-28 23:36:35.818597+00:00, run_end_date=2024-03-28 23:36:37.062602+00:00, run_duration=1.244005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:34.047823+00:00, queued_by_job_id=2, pid=241 2024-03-28T23:36:37.762592266Z [2024-03-28T23:36:37.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:35:00+00:00, map_index=-1, run_start_date=2024-03-28 23:36:35.904974+00:00, run_end_date=2024-03-28 23:36:37.401774+00:00, run_duration=1.4968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:36:34.047823+00:00, queued_by_job_id=2, pid=242 2024-03-28T23:37:00.844204499Z [2024-03-28T23:37:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:00.857147434Z [2024-03-28T23:37:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:00.864370846Z [2024-03-28T23:37:00.863+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:37:00.924485783Z [2024-03-28T23:37:00.924+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:37:00.924521106Z 2024-03-28T23:37:00.924525239Z 2024-03-28T23:37:00.924529258Z 2024-03-28T23:37:00.924701380Z [2024-03-28T23:37:00.924+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:37:00.924960035Z [2024-03-28T23:37:00.924+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:37:00.925279751Z [2024-03-28T23:37:00.925+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:37:00.926217089Z [2024-03-28T23:37:00.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:00.926223339Z 2024-03-28T23:37:00.926226962Z 2024-03-28T23:37:00.926230429Z 2024-03-28T23:37:00.930756845Z [2024-03-28T23:37:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:00.931328657Z [2024-03-28T23:37:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:37:00.931686652Z [2024-03-28T23:37:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:00.931847361Z [2024-03-28T23:37:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:37:00.932126197Z [2024-03-28T23:37:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:00.932270870Z [2024-03-28T23:37:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:37:01.230047032Z [2024-03-28T23:37:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:01.230291014Z [2024-03-28T23:37:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:01.230596462Z [2024-03-28T23:37:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:01.260236667Z [2024-03-28T23:37:01.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11caa360-5777-4dd2-8c10-8da1876d1b03 2024-03-28T23:37:01.260503285Z [2024-03-28T23:37:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1524339-c101-479f-9cc6-a093074fdec4 2024-03-28T23:37:01.260725577Z [2024-03-28T23:37:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc76f293-9a08-4d84-89b8-ea725836bc22 2024-03-28T23:37:03.677133102Z [2024-03-28T23:37:03.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:03.677696720Z [2024-03-28T23:37:03.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:37:00.873928+00:00, run_end_date=2024-03-28 23:37:03.677290+00:00, run_duration=2.803362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:37:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:37:03.695574971Z [2024-03-28T23:37:03.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:03.759148390Z [2024-03-28T23:37:03.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:03.767972695Z [2024-03-28T23:37:03.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:01.825398+00:00, run_end_date=2024-03-28 23:37:02.461082+00:00, run_duration=0.635684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:00.927210+00:00, queued_by_job_id=2, pid=261 2024-03-28T23:37:05.937500351Z [2024-03-28T23:37:05.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:05.996332841Z [2024-03-28T23:37:05.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:05.996776207Z [2024-03-28T23:37:05.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:37:00.876424+00:00, run_end_date=2024-03-28 23:37:05.996240+00:00, run_duration=5.119816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:37:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:37:06.006258683Z [2024-03-28T23:37:06.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:06.012967501Z [2024-03-28T23:37:06.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:06.013428011Z [2024-03-28T23:37:06.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:37:00.875295+00:00, run_end_date=2024-03-28 23:37:06.012876+00:00, run_duration=5.137581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:37:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:37:06.051932387Z [2024-03-28T23:37:06.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:06.068297795Z [2024-03-28T23:37:06.067+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:06.068319908Z 2024-03-28T23:37:06.068323501Z [2024-03-28T23:37:06.067+0000] {scheduler_job.py:425} INFO - DAG vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:37:06.069059187Z [2024-03-28T23:37:06.068+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:06.069073186Z 2024-03-28T23:37:06.071486982Z [2024-03-28T23:37:06.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:06.071740127Z [2024-03-28T23:37:06.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:37:06.268760269Z [2024-03-28T23:37:06.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:06.270827630Z [2024-03-28T23:37:06.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:06.270921142Z [2024-03-28T23:37:06.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:06.281801565Z [2024-03-28T23:37:06.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:03.217892+00:00, run_end_date=2024-03-28 23:37:05.000091+00:00, run_duration=1.782199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:00.927210+00:00, queued_by_job_id=2, pid=274 2024-03-28T23:37:06.282122329Z [2024-03-28T23:37:06.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:03.603400+00:00, run_end_date=2024-03-28 23:37:05.099967+00:00, run_duration=1.496567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:00.927210+00:00, queued_by_job_id=2, pid=285 2024-03-28T23:37:06.282325861Z [2024-03-28T23:37:06.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95c2a53d-8e2d-4689-9080-28bb04559ea1 2024-03-28T23:37:06.347332527Z [2024-03-28T23:37:06.347+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:37:06.383939104Z [2024-03-28T23:37:06.383+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:06.383961409Z 2024-03-28T23:37:06.384038027Z [2024-03-28T23:37:06.383+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:37:06.384541786Z [2024-03-28T23:37:06.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:06.384552038Z 2024-03-28T23:37:06.386483362Z [2024-03-28T23:37:06.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:06.386674796Z [2024-03-28T23:37:06.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:37:06.434866511Z [2024-03-28T23:37:06.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:06.439241030Z [2024-03-28T23:37:06.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to 802994a4-8bb7-4812-854f-d639b1247b67 2024-03-28T23:37:10.192590123Z [2024-03-28T23:37:10.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:10.192878247Z [2024-03-28T23:37:10.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:37:05.963489+00:00, run_end_date=2024-03-28 23:37:10.192472+00:00, run_duration=4.228983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:37:00+00:00, dag_hash=03e77761edc5cb7374009cd8be697aa2 2024-03-28T23:37:10.202540380Z [2024-03-28T23:37:10.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:10.208007769Z [2024-03-28T23:37:10.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:10.208361168Z [2024-03-28T23:37:10.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:37:06.355483+00:00, run_end_date=2024-03-28 23:37:10.207940+00:00, run_duration=3.852457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:37:00+00:00, dag_hash=94b4d314d955101c8fae3322cd410f24 2024-03-28T23:37:10.217927302Z [2024-03-28T23:37:10.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:10.249041127Z [2024-03-28T23:37:10.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:10.249233069Z [2024-03-28T23:37:10.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:10.257738458Z [2024-03-28T23:37:10.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:08.040788+00:00, run_end_date=2024-03-28 23:37:09.302705+00:00, run_duration=1.261917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:06.069454+00:00, queued_by_job_id=2, pid=300 2024-03-28T23:37:10.258152331Z [2024-03-28T23:37:10.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:08.352193+00:00, run_end_date=2024-03-28 23:37:09.827938+00:00, run_duration=1.475745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:06.384887+00:00, queued_by_job_id=2, pid=311 2024-03-28T23:37:11.293829044Z [2024-03-28T23:37:11.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:35:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:37:11.325620463Z [2024-03-28T23:37:11.325+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:11.325660933Z 2024-03-28T23:37:11.325696133Z [2024-03-28T23:37:11.325+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:37:11.326081212Z [2024-03-28T23:37:11.325+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:11.326111362Z 2024-03-28T23:37:11.327791447Z [2024-03-28T23:37:11.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:37:11.327937841Z [2024-03-28T23:37:11.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:11.363439038Z [2024-03-28T23:37:11.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:11.368516352Z [2024-03-28T23:37:11.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5c73a6d-270e-4d54-912e-646fa4a75625 2024-03-28T23:37:13.601816749Z [2024-03-28T23:37:13.601+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:13.601842949Z 2024-03-28T23:37:13.602126232Z [2024-03-28T23:37:13.601+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:37:13.602846023Z [2024-03-28T23:37:13.602+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:13.602856633Z 2024-03-28T23:37:13.604879311Z [2024-03-28T23:37:13.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='split_metrics', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:37:13.605075151Z [2024-03-28T23:37:13.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'split_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:13.642485982Z [2024-03-28T23:37:13.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.split_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:13.642731717Z [2024-03-28T23:37:13.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:13.650553151Z [2024-03-28T23:37:13.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd9c25cf-c815-41f3-aac6-1c3b0e91a3a0 2024-03-28T23:37:13.652636773Z [2024-03-28T23:37:13.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:12.952026+00:00, run_end_date=2024-03-28 23:37:13.236516+00:00, run_duration=0.28449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:11.326316+00:00, queued_by_job_id=2, pid=324 2024-03-28T23:37:15.841107373Z [2024-03-28T23:37:15.840+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:15.841148417Z 2024-03-28T23:37:15.841152197Z [2024-03-28T23:37:15.840+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:37:15.841709332Z [2024-03-28T23:37:15.841+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:15.841730256Z 2024-03-28T23:37:15.843731365Z [2024-03-28T23:37:15.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:37:15.843915995Z [2024-03-28T23:37:15.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:37:15.901506820Z [2024-03-28T23:37:15.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:15.901786144Z [2024-03-28T23:37:15.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.split_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:15.913113256Z [2024-03-28T23:37:15.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=split_metrics, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:15.117439+00:00, run_end_date=2024-03-28 23:37:15.461258+00:00, run_duration=0.343819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:13.603206+00:00, queued_by_job_id=2, pid=337 2024-03-28T23:37:15.913512953Z [2024-03-28T23:37:15.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5b4d696-a638-4b12-b979-25038d406c2a 2024-03-28T23:37:18.051157464Z [2024-03-28T23:37:18.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status failed for try_number 1 2024-03-28T23:37:18.056851885Z [2024-03-28T23:37:18.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=0, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:15.842028+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:37:18.057517231Z [2024-03-28T23:37:18.057+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:37:18.059795596Z [2024-03-28T23:37:18.059+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:37:18.091293554Z [2024-03-28T23:37:18.090+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=collect_metrics, map_index=0, execution_date=20240328T233000, start_date=, end_date=20240328T233718 2024-03-28T23:37:28.111576153Z [2024-03-28T23:37:28.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:28.111627217Z 2024-03-28T23:37:28.111634259Z [2024-03-28T23:37:28.111+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:37:28.112177150Z [2024-03-28T23:37:28.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:28.112192303Z 2024-03-28T23:37:28.113919028Z [2024-03-28T23:37:28.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=2, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:37:28.113940985Z [2024-03-28T23:37:28.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:37:28.162790078Z [2024-03-28T23:37:28.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 2 2024-03-28T23:37:28.169811644Z [2024-03-28T23:37:28.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9acc5b5b-7771-40d0-82de-3c015f403336 2024-03-28T23:37:30.395343918Z [2024-03-28T23:37:30.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status failed for try_number 2 2024-03-28T23:37:30.402163621Z [2024-03-28T23:37:30.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=0, run_start_date=None, run_end_date=2024-03-28 23:37:18.075053+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:28.112385+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:37:30.402669451Z [2024-03-28T23:37:30.402+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:37:30.404802874Z [2024-03-28T23:37:30.404+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:37:30.415772687Z [2024-03-28T23:37:30.415+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=collect_metrics, map_index=0, execution_date=20240328T233000, start_date=, end_date=20240328T233730 2024-03-28T23:37:31.686024000Z [2024-03-28T23:37:31.685+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:37:31.686244554Z [2024-03-28T23:37:31.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, execution_date=2024-03-28 23:30:00+00:00, run_id=scheduled__2024-03-28T23:30:00+00:00, run_start_date=2024-03-28 23:37:11.301112+00:00, run_end_date=2024-03-28 23:37:31.685917+00:00, run_duration=20.384805, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:30:00+00:00, data_interval_end=2024-03-28 23:35:00+00:00, dag_hash=458bd76bee547b056e0d8fc9d09338d0 2024-03-28T23:37:31.693474999Z [2024-03-28T23:37:31.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:35:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:37:37.083222176Z [2024-03-28T23:37:37.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:37.115078598Z [2024-03-28T23:37:37.114+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:37.115100441Z 2024-03-28T23:37:37.115293444Z [2024-03-28T23:37:37.115+0000] {scheduler_job.py:425} INFO - DAG vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:37:37.115970959Z [2024-03-28T23:37:37.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:37.115986416Z 2024-03-28T23:37:37.119422059Z [2024-03-28T23:37:37.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:37.119639706Z [2024-03-28T23:37:37.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:37:37.162004995Z [2024-03-28T23:37:37.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:37.167765934Z [2024-03-28T23:37:37.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfcd7c58-8e22-4bc2-b693-b0ff4f16d36b 2024-03-28T23:37:38.388101695Z [2024-03-28T23:37:38.387+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:37:38.445497552Z [2024-03-28T23:37:38.445+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:38.445532495Z 2024-03-28T23:37:38.445790860Z [2024-03-28T23:37:38.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:37:38.446695568Z [2024-03-28T23:37:38.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:38.446714983Z 2024-03-28T23:37:38.449052542Z [2024-03-28T23:37:38.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:38.449342170Z [2024-03-28T23:37:38.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:37:38.502683019Z [2024-03-28T23:37:38.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:38.507936460Z [2024-03-28T23:37:38.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 788735d3-14b7-423d-b5f2-841e421a66d6 2024-03-28T23:37:40.733833172Z [2024-03-28T23:37:40.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:40.734165498Z [2024-03-28T23:37:40.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:37:37.092350+00:00, run_end_date=2024-03-28 23:37:40.733683+00:00, run_duration=3.641333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:37:00+00:00, dag_hash=fdd972e9831cf909d39fce75c0608cd4 2024-03-28T23:37:40.747094177Z [2024-03-28T23:37:40.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:40.782576052Z [2024-03-28T23:37:40.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:40.790016722Z [2024-03-28T23:37:40.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:38.659699+00:00, run_end_date=2024-03-28 23:37:39.945784+00:00, run_duration=1.286085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:37.116353+00:00, queued_by_job_id=2, pid=384 2024-03-28T23:37:41.796535413Z [2024-03-28T23:37:41.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:41.796826098Z [2024-03-28T23:37:41.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:37:38.406590+00:00, run_end_date=2024-03-28 23:37:41.796414+00:00, run_duration=3.389824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:37:00+00:00, dag_hash=a6973ed7017666f4f487c41ec323ea06 2024-03-28T23:37:41.806947414Z [2024-03-28T23:37:41.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:37:00+00:00, run_after=2024-03-28T23:38:00+00:00 2024-03-28T23:37:41.833262408Z [2024-03-28T23:37:41.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:41.839201476Z [2024-03-28T23:37:41.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:39.991097+00:00, run_end_date=2024-03-28 23:37:41.454554+00:00, run_duration=1.463457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:38.447085+00:00, queued_by_job_id=2, pid=396 2024-03-28T23:37:42.883665916Z [2024-03-28T23:37:42.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:35:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:37:42.946743519Z [2024-03-28T23:37:42.946+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:42.946777510Z 2024-03-28T23:37:42.947028488Z [2024-03-28T23:37:42.946+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:37:42.947819510Z [2024-03-28T23:37:42.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:42.947839308Z 2024-03-28T23:37:42.950629335Z [2024-03-28T23:37:42.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:37:42.950831641Z [2024-03-28T23:37:42.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:43.018007826Z [2024-03-28T23:37:43.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:43.024761102Z [2024-03-28T23:37:43.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb691efd-6eb4-4a48-858e-1dc650f74d06 2024-03-28T23:37:45.310804710Z [2024-03-28T23:37:45.310+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:45.310833674Z 2024-03-28T23:37:45.311083901Z [2024-03-28T23:37:45.310+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:37:45.311935809Z [2024-03-28T23:37:45.311+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:45.311950979Z 2024-03-28T23:37:45.314419185Z [2024-03-28T23:37:45.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='split_metrics', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:37:45.314696594Z [2024-03-28T23:37:45.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'split_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:45.361859113Z [2024-03-28T23:37:45.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.split_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:45.362063567Z [2024-03-28T23:37:45.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:45.369350916Z [2024-03-28T23:37:45.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21a17f98-d791-4155-b831-2ccd8f97dc5b 2024-03-28T23:37:45.369953363Z [2024-03-28T23:37:45.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:44.548102+00:00, run_end_date=2024-03-28 23:37:44.869547+00:00, run_duration=0.321445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:42.948251+00:00, queued_by_job_id=2, pid=409 2024-03-28T23:37:48.393145319Z [2024-03-28T23:37:48.392+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:48.393175141Z 2024-03-28T23:37:48.393547268Z [2024-03-28T23:37:48.393+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:37:48.394298317Z [2024-03-28T23:37:48.394+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:48.394312906Z 2024-03-28T23:37:48.396956639Z [2024-03-28T23:37:48.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:37:48.397210104Z [2024-03-28T23:37:48.397+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'collect_metrics', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:37:48.453764315Z [2024-03-28T23:37:48.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:48.453843682Z [2024-03-28T23:37:48.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.split_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:48.462621399Z [2024-03-28T23:37:48.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=split_metrics, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:46.947521+00:00, run_end_date=2024-03-28 23:37:47.296701+00:00, run_duration=0.34918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:45.312449+00:00, queued_by_job_id=2, pid=422 2024-03-28T23:37:48.462927925Z [2024-03-28T23:37:48.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84bcff41-2df9-4964-a274-8a6283b13e3d 2024-03-28T23:37:50.660809757Z [2024-03-28T23:37:50.660+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:37:50.660836757Z 2024-03-28T23:37:50.660911791Z [2024-03-28T23:37:50.660+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:37:50.661724936Z [2024-03-28T23:37:50.661+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:37:50.661735543Z 2024-03-28T23:37:50.664905654Z [2024-03-28T23:37:50.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:37:50.665094056Z [2024-03-28T23:37:50.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'send_prometheus', 'scheduled__2024-03-28T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:37:50.724217679Z [2024-03-28T23:37:50.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.send_prometheus run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status queued for try_number 1 2024-03-28T23:37:50.724249137Z [2024-03-28T23:37:50.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.collect_metrics run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:50.729638567Z [2024-03-28T23:37:50.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=0, run_start_date=2024-03-28 23:37:49.946307+00:00, run_end_date=2024-03-28 23:37:50.253269+00:00, run_duration=0.306962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:48.394808+00:00, queued_by_job_id=2, pid=430 2024-03-28T23:37:50.729717859Z [2024-03-28T23:37:50.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7a94f30-2e97-4c30-bf57-0a477a258b4f 2024-03-28T23:37:53.032360050Z [2024-03-28T23:37:53.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:37:53.032715354Z [2024-03-28T23:37:53.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, execution_date=2024-03-28 23:30:00+00:00, run_id=scheduled__2024-03-28T23:30:00+00:00, run_start_date=2024-03-28 23:37:42.903192+00:00, run_end_date=2024-03-28 23:37:53.032383+00:00, run_duration=10.129191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:30:00+00:00, data_interval_end=2024-03-28 23:35:00+00:00, dag_hash=0bc844fceb06db9809f1306475de0856 2024-03-28T23:37:53.038512554Z [2024-03-28T23:37:53.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:35:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:37:53.065290940Z [2024-03-28T23:37:53.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.send_prometheus run_id=scheduled__2024-03-28T23:30:00+00:00 exited with status success for try_number 1 2024-03-28T23:37:53.070584181Z [2024-03-28T23:37:53.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:30:00+00:00, map_index=-1, run_start_date=2024-03-28 23:37:52.195165+00:00, run_end_date=2024-03-28 23:37:52.500212+00:00, run_duration=0.305047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:37:50.662151+00:00, queued_by_job_id=2, pid=438 2024-03-28T23:38:00.488618711Z [2024-03-28T23:38:00.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:00.495624383Z [2024-03-28T23:38:00.495+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:38:00.506023794Z [2024-03-28T23:38:00.505+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:38:00.520850648Z [2024-03-28T23:38:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:00.528104157Z [2024-03-28T23:38:00.527+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:38:00.539950984Z [2024-03-28T23:38:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:00.553016352Z [2024-03-28T23:38:00.552+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:00.561793328Z [2024-03-28T23:38:00.561+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:38:00.684899174Z [2024-03-28T23:38:00.684+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-03-28T23:38:00.684927767Z 2024-03-28T23:38:00.684933407Z 2024-03-28T23:38:00.684937884Z 2024-03-28T23:38:00.684942249Z 2024-03-28T23:38:00.684946888Z 2024-03-28T23:38:00.684951576Z 2024-03-28T23:38:00.684955846Z 2024-03-28T23:38:00.684960122Z 2024-03-28T23:38:00.685090638Z [2024-03-28T23:38:00.684+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:38:00.685355903Z [2024-03-28T23:38:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:38:00.685576060Z [2024-03-28T23:38:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:38:00.685808773Z [2024-03-28T23:38:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:38:00.686078286Z [2024-03-28T23:38:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:38:00.686356543Z [2024-03-28T23:38:00.686+0000] {scheduler_job.py:425} INFO - DAG vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:38:00.686640257Z [2024-03-28T23:38:00.686+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:38:00.686894295Z [2024-03-28T23:38:00.686+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:38:00.687646317Z [2024-03-28T23:38:00.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:38:00.687653580Z 2024-03-28T23:38:00.687657439Z 2024-03-28T23:38:00.687660580Z 2024-03-28T23:38:00.687663858Z 2024-03-28T23:38:00.687667046Z 2024-03-28T23:38:00.687670087Z 2024-03-28T23:38:00.687673109Z 2024-03-28T23:38:00.687676073Z 2024-03-28T23:38:00.694243994Z [2024-03-28T23:38:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.694471502Z [2024-03-28T23:38:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:38:00.694756934Z [2024-03-28T23:38:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.694943022Z [2024-03-28T23:38:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:00.695218853Z [2024-03-28T23:38:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.695385829Z [2024-03-28T23:38:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:00.695647218Z [2024-03-28T23:38:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.695811963Z [2024-03-28T23:38:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:00.696039042Z [2024-03-28T23:38:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.696205117Z [2024-03-28T23:38:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:00.696604563Z [2024-03-28T23:38:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.696788829Z [2024-03-28T23:38:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:00.697057377Z [2024-03-28T23:38:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.697194894Z [2024-03-28T23:38:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:38:00.697570768Z [2024-03-28T23:38:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:00.697785727Z [2024-03-28T23:38:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:01.331880519Z [2024-03-28T23:38:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.331914978Z [2024-03-28T23:38:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.332176552Z [2024-03-28T23:38:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.332277231Z [2024-03-28T23:38:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.332446418Z [2024-03-28T23:38:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.332554428Z [2024-03-28T23:38:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.332759003Z [2024-03-28T23:38:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.332964456Z [2024-03-28T23:38:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 1 2024-03-28T23:38:01.365652049Z [2024-03-28T23:38:01.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cb2b937-da39-4fa1-a7b8-52198e2d4419 2024-03-28T23:38:01.366421000Z [2024-03-28T23:38:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e50df37-a683-414d-a5ee-973f5bdf251e 2024-03-28T23:38:01.366435956Z [2024-03-28T23:38:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3402445-5192-4498-b066-08401d7724f4 2024-03-28T23:38:01.366584542Z [2024-03-28T23:38:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to b02d56d3-09b9-47d6-8f24-67ca944dc37c 2024-03-28T23:38:01.366782842Z [2024-03-28T23:38:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7273179b-2c09-406a-abef-aece0cacbda7 2024-03-28T23:38:01.366970178Z [2024-03-28T23:38:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to c815a583-4e2c-4422-8568-6fc7820d12ed 2024-03-28T23:38:01.367163985Z [2024-03-28T23:38:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91267138-ae81-4b69-910e-bcb9e036b117 2024-03-28T23:38:01.367447157Z [2024-03-28T23:38:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2d426af-eeed-4c1f-b1cb-dc19bee7d214 2024-03-28T23:38:03.514011529Z [2024-03-28T23:38:03.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:38:03.514400534Z [2024-03-28T23:38:03.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:36:00+00:00, run_id=scheduled__2024-03-28T23:36:00+00:00, run_start_date=2024-03-28 23:38:00.574958+00:00, run_end_date=2024-03-28 23:38:03.513979+00:00, run_duration=2.939021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:36:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:38:03.528657645Z [2024-03-28T23:38:03.528+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:38:03.626244815Z [2024-03-28T23:38:03.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:38:03.626661776Z [2024-03-28T23:38:03.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:37:00+00:00, run_id=scheduled__2024-03-28T23:37:00+00:00, run_start_date=2024-03-28 23:38:00.581420+00:00, run_end_date=2024-03-28 23:38:03.626304+00:00, run_duration=3.044884, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:37:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:38:03.681636646Z [2024-03-28T23:38:03.681+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:03.846613038Z [2024-03-28T23:38:03.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:36:00+00:00 exited with status success for try_number 1 2024-03-28T23:38:03.847118322Z [2024-03-28T23:38:03.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status success for try_number 1 2024-03-28T23:38:03.864705870Z [2024-03-28T23:38:03.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:36:00+00:00, map_index=-1, run_start_date=2024-03-28 23:38:02.692738+00:00, run_end_date=2024-03-28 23:38:03.360151+00:00, run_duration=0.667413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=453 2024-03-28T23:38:03.865118002Z [2024-03-28T23:38:03.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=2024-03-28 23:38:02.246078+00:00, run_end_date=2024-03-28 23:38:03.465525+00:00, run_duration=1.219447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=452 2024-03-28T23:38:05.050636556Z [2024-03-28T23:38:05.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 1 2024-03-28T23:38:05.050723197Z [2024-03-28T23:38:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 1 2024-03-28T23:38:05.066941995Z [2024-03-28T23:38:05.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:05.067280068Z [2024-03-28T23:38:05.067+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:05.072078806Z [2024-03-28T23:38:05.071+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:05.129124311Z [2024-03-28T23:38:05.128+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233805 2024-03-28T23:38:05.172886947Z [2024-03-28T23:38:05.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:05.172914981Z [2024-03-28T23:38:05.168+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:05.189549538Z [2024-03-28T23:38:05.185+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:05.253883253Z [2024-03-28T23:38:05.253+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233805 2024-03-28T23:38:06.399350572Z [2024-03-28T23:38:06.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 1 2024-03-28T23:38:06.399403869Z [2024-03-28T23:38:06.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 1 2024-03-28T23:38:06.405904440Z [2024-03-28T23:38:06.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:06.406258222Z [2024-03-28T23:38:06.406+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:06.408221288Z [2024-03-28T23:38:06.407+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:06.420009893Z [2024-03-28T23:38:06.419+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233806 2024-03-28T23:38:06.426478179Z [2024-03-28T23:38:06.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:06.427176156Z [2024-03-28T23:38:06.426+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:06.429820210Z [2024-03-28T23:38:06.429+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:06.449731391Z [2024-03-28T23:38:06.449+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233806 2024-03-28T23:38:07.466418401Z [2024-03-28T23:38:07.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:38:07.467704785Z [2024-03-28T23:38:07.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:37:00+00:00, run_id=scheduled__2024-03-28T23:37:00+00:00, run_start_date=2024-03-28 23:38:00.579056+00:00, run_end_date=2024-03-28 23:38:07.466321+00:00, run_duration=6.887265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:37:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:38:07.476503660Z [2024-03-28T23:38:07.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:07.611102691Z [2024-03-28T23:38:07.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status success for try_number 1 2024-03-28T23:38:07.620257252Z [2024-03-28T23:38:07.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=2024-03-28 23:38:05.014092+00:00, run_end_date=2024-03-28 23:38:06.739986+00:00, run_duration=1.725894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=505 2024-03-28T23:38:08.697692559Z [2024-03-28T23:38:08.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:38:08.698697434Z [2024-03-28T23:38:08.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:37:00+00:00, run_id=scheduled__2024-03-28T23:37:00+00:00, run_start_date=2024-03-28 23:38:00.576163+00:00, run_end_date=2024-03-28 23:38:08.698280+00:00, run_duration=8.122117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:37:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:38:08.708045202Z [2024-03-28T23:38:08.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:08.777941987Z [2024-03-28T23:38:08.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status success for try_number 1 2024-03-28T23:38:08.782247518Z [2024-03-28T23:38:08.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=2024-03-28 23:38:05.932131+00:00, run_end_date=2024-03-28 23:38:07.579689+00:00, run_duration=1.647558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:00.689091+00:00, queued_by_job_id=2, pid=526 2024-03-28T23:38:16.044141843Z [2024-03-28T23:38:16.043+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-28T23:38:16.044182284Z 2024-03-28T23:38:16.044186555Z 2024-03-28T23:38:16.044542778Z [2024-03-28T23:38:16.044+0000] {scheduler_job.py:425} INFO - DAG vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:38:16.044883426Z [2024-03-28T23:38:16.044+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad has 0/16 running and queued tasks 2024-03-28T23:38:16.045712119Z [2024-03-28T23:38:16.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:38:16.045723388Z 2024-03-28T23:38:16.045738327Z 2024-03-28T23:38:16.048118404Z [2024-03-28T23:38:16.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:16.048147730Z [2024-03-28T23:38:16.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:16.048355852Z [2024-03-28T23:38:16.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:16.048430108Z [2024-03-28T23:38:16.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:16.196654029Z [2024-03-28T23:38:16.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 2 2024-03-28T23:38:16.197517464Z [2024-03-28T23:38:16.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 2 2024-03-28T23:38:16.208327113Z [2024-03-28T23:38:16.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c4f255b-46e2-4187-8fc0-7b498014eac4 2024-03-28T23:38:16.208758661Z [2024-03-28T23:38:16.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to d63c7c3f-660a-449e-b0c7-2a940c0c4e5d 2024-03-28T23:38:16.868238645Z [2024-03-28T23:38:16.867+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-28T23:38:16.868271743Z 2024-03-28T23:38:16.868276918Z 2024-03-28T23:38:16.868921253Z [2024-03-28T23:38:16.868+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:38:16.869222811Z [2024-03-28T23:38:16.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a has 0/16 running and queued tasks 2024-03-28T23:38:16.870111276Z [2024-03-28T23:38:16.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:38:16.870122811Z 2024-03-28T23:38:16.870126296Z 2024-03-28T23:38:16.873247132Z [2024-03-28T23:38:16.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:16.873512659Z [2024-03-28T23:38:16.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:38:16.873841173Z [2024-03-28T23:38:16.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:37:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:38:16.874062505Z [2024-03-28T23:38:16.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:38:17.065218633Z [2024-03-28T23:38:17.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 2 2024-03-28T23:38:17.067512547Z [2024-03-28T23:38:17.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status queued for try_number 2 2024-03-28T23:38:17.078130136Z [2024-03-28T23:38:17.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68fd32b5-0556-46df-9f80-64ff2d03e026 2024-03-28T23:38:17.078246535Z [2024-03-28T23:38:17.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0546d229-5b0b-4701-ba1f-2c8c75304c56 2024-03-28T23:38:18.998437837Z [2024-03-28T23:38:18.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 2 2024-03-28T23:38:18.998718263Z [2024-03-28T23:38:18.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 2 2024-03-28T23:38:18.998911687Z [2024-03-28T23:38:18.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 2 2024-03-28T23:38:18.999090833Z [2024-03-28T23:38:18.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:37:00+00:00 exited with status failed for try_number 2 2024-03-28T23:38:19.012489114Z [2024-03-28T23:38:19.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-28 23:38:05.087307+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:16.046248+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:19.013121936Z [2024-03-28T23:38:19.012+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.015282530Z [2024-03-28T23:38:19.015+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.026708528Z [2024-03-28T23:38:19.026+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233819 2024-03-28T23:38:19.033526693Z [2024-03-28T23:38:19.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-28 23:38:05.206700+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:16.046248+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:19.033903594Z [2024-03-28T23:38:19.033+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.035725562Z [2024-03-28T23:38:19.035+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.047306251Z [2024-03-28T23:38:19.047+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233819 2024-03-28T23:38:19.056287613Z [2024-03-28T23:38:19.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-28 23:38:06.410084+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:16.870830+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:19.057105242Z [2024-03-28T23:38:19.056+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.059855424Z [2024-03-28T23:38:19.059+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.071962855Z [2024-03-28T23:38:19.071+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233819 2024-03-28T23:38:19.079202070Z [2024-03-28T23:38:19.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-28 23:38:06.433101+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:38:16.870830+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:38:19.079598236Z [2024-03-28T23:38:19.079+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.081598280Z [2024-03-28T23:38:19.081+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:38:19.092197029Z [2024-03-28T23:38:19.091+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240328T233700, start_date=, end_date=20240328T233819 2024-03-28T23:38:20.165944420Z [2024-03-28T23:38:20.165+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:38:20.167805251Z [2024-03-28T23:38:20.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, execution_date=2024-03-28 23:37:00+00:00, run_id=scheduled__2024-03-28T23:37:00+00:00, run_start_date=2024-03-28 23:38:00.577147+00:00, run_end_date=2024-03-28 23:38:20.165814+00:00, run_duration=19.588667, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:37:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=03e77761edc5cb7374009cd8be697aa2 2024-03-28T23:38:20.187150344Z [2024-03-28T23:38:20.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:20.195220444Z [2024-03-28T23:38:20.194+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:38:20.195427985Z [2024-03-28T23:38:20.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, execution_date=2024-03-28 23:37:00+00:00, run_id=scheduled__2024-03-28T23:37:00+00:00, run_start_date=2024-03-28 23:38:00.578067+00:00, run_end_date=2024-03-28 23:38:20.195087+00:00, run_duration=19.61702, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:37:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=a6973ed7017666f4f487c41ec323ea06 2024-03-28T23:38:20.204747848Z [2024-03-28T23:38:20.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:20.211661602Z [2024-03-28T23:38:20.211+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:38:20.212010001Z [2024-03-28T23:38:20.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a, execution_date=2024-03-28 23:37:00+00:00, run_id=scheduled__2024-03-28T23:37:00+00:00, run_start_date=2024-03-28 23:38:00.580224+00:00, run_end_date=2024-03-28 23:38:20.211572+00:00, run_duration=19.631348, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:37:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=fdd972e9831cf909d39fce75c0608cd4 2024-03-28T23:38:20.222701863Z [2024-03-28T23:38:20.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ed3012ac-4094-4b1a-a93d-f5b1d38e292a to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:20.236677408Z [2024-03-28T23:38:20.235+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:38:20.237290996Z [2024-03-28T23:38:20.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad, execution_date=2024-03-28 23:37:00+00:00, run_id=scheduled__2024-03-28T23:37:00+00:00, run_start_date=2024-03-28 23:38:00.582548+00:00, run_end_date=2024-03-28 23:38:20.236620+00:00, run_duration=19.654072, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:37:00+00:00, data_interval_end=2024-03-28 23:38:00+00:00, dag_hash=94b4d314d955101c8fae3322cd410f24 2024-03-28T23:38:20.253214870Z [2024-03-28T23:38:20.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_deb13ed7-3a05-4765-b5e0-a45b9d33d8ad to 2024-03-28T23:38:00+00:00, run_after=2024-03-28T23:39:00+00:00 2024-03-28T23:38:43.868358755Z [2024-03-28T23:38:43.867+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-28T23:39:00.461843090Z [2024-03-28T23:39:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:39:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:39:00.475821399Z [2024-03-28T23:39:00.475+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:39:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:39:00.483062716Z [2024-03-28T23:39:00.482+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:39:00.552038709Z [2024-03-28T23:39:00.551+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:39:00.552064717Z 2024-03-28T23:39:00.552068682Z 2024-03-28T23:39:00.552071866Z 2024-03-28T23:39:00.552149466Z [2024-03-28T23:39:00.551+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:39:00.552255716Z [2024-03-28T23:39:00.552+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:39:00.552332261Z [2024-03-28T23:39:00.552+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:39:00.552927415Z [2024-03-28T23:39:00.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:39:00.552934852Z 2024-03-28T23:39:00.552938239Z 2024-03-28T23:39:00.552941315Z 2024-03-28T23:39:00.556774459Z [2024-03-28T23:39:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:39:00.556800981Z [2024-03-28T23:39:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:39:00.557020325Z [2024-03-28T23:39:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:39:00.557115620Z [2024-03-28T23:39:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:39:00.557319042Z [2024-03-28T23:39:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:39:00.557536657Z [2024-03-28T23:39:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:39:00.839973188Z [2024-03-28T23:39:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status queued for try_number 1 2024-03-28T23:39:00.840424974Z [2024-03-28T23:39:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status queued for try_number 1 2024-03-28T23:39:00.840766245Z [2024-03-28T23:39:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status queued for try_number 1 2024-03-28T23:39:00.878027331Z [2024-03-28T23:39:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fe6ca54-a9d5-4c24-bee6-4e6884af880a 2024-03-28T23:39:00.883792927Z [2024-03-28T23:39:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf903436-d0b0-4df8-b66e-c95298234b38 2024-03-28T23:39:00.889270381Z [2024-03-28T23:39:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 052fca32-e269-47c7-9cb0-665044c0329f 2024-03-28T23:39:02.152496076Z [2024-03-28T23:39:02.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:39:02.153292360Z [2024-03-28T23:39:02.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:38:00+00:00, run_id=scheduled__2024-03-28T23:38:00+00:00, run_start_date=2024-03-28 23:39:00.495889+00:00, run_end_date=2024-03-28 23:39:02.152634+00:00, run_duration=1.656745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:38:00+00:00, data_interval_end=2024-03-28 23:39:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:39:02.177969037Z [2024-03-28T23:39:02.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:39:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:39:02.260368358Z [2024-03-28T23:39:02.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status success for try_number 1 2024-03-28T23:39:02.270748230Z [2024-03-28T23:39:02.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:38:00+00:00, map_index=-1, run_start_date=2024-03-28 23:39:01.562148+00:00, run_end_date=2024-03-28 23:39:02.043858+00:00, run_duration=0.48171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:39:00.553703+00:00, queued_by_job_id=2, pid=602 2024-03-28T23:39:04.431580935Z [2024-03-28T23:39:04.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:39:04.431777265Z [2024-03-28T23:39:04.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:38:00+00:00, run_id=scheduled__2024-03-28T23:38:00+00:00, run_start_date=2024-03-28 23:39:00.497324+00:00, run_end_date=2024-03-28 23:39:04.431391+00:00, run_duration=3.934067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:38:00+00:00, data_interval_end=2024-03-28 23:39:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:39:04.441809923Z [2024-03-28T23:39:04.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:39:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:39:04.450099703Z [2024-03-28T23:39:04.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:39:04.450430421Z [2024-03-28T23:39:04.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:38:00+00:00, run_id=scheduled__2024-03-28T23:38:00+00:00, run_start_date=2024-03-28 23:39:00.498591+00:00, run_end_date=2024-03-28 23:39:04.449953+00:00, run_duration=3.951362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:38:00+00:00, data_interval_end=2024-03-28 23:39:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:39:04.461594721Z [2024-03-28T23:39:04.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:39:00+00:00, run_after=2024-03-28T23:40:00+00:00 2024-03-28T23:39:04.495633589Z [2024-03-28T23:39:04.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status success for try_number 1 2024-03-28T23:39:04.495672933Z [2024-03-28T23:39:04.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status success for try_number 1 2024-03-28T23:39:04.504673412Z [2024-03-28T23:39:04.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:38:00+00:00, map_index=-1, run_start_date=2024-03-28 23:39:02.616867+00:00, run_end_date=2024-03-28 23:39:03.892272+00:00, run_duration=1.275405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:39:00.553703+00:00, queued_by_job_id=2, pid=620 2024-03-28T23:39:04.504895683Z [2024-03-28T23:39:04.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:38:00+00:00, map_index=-1, run_start_date=2024-03-28 23:39:02.646983+00:00, run_end_date=2024-03-28 23:39:04.282896+00:00, run_duration=1.635913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:39:00.553703+00:00, queued_by_job_id=2, pid=621 2024-03-28T23:40:00.096466607Z [2024-03-28T23:40:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:40:00.115072568Z [2024-03-28T23:40:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:41:00+00:00 2024-03-28T23:40:00.129384998Z [2024-03-28T23:40:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:45:00+00:00 2024-03-28T23:40:00.142860422Z [2024-03-28T23:40:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:41:00+00:00 2024-03-28T23:40:00.154235843Z [2024-03-28T23:40:00.153+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:40:00.270609344Z [2024-03-28T23:40:00.270+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-28T23:40:00.270641540Z 2024-03-28T23:40:00.270645266Z 2024-03-28T23:40:00.270648983Z 2024-03-28T23:40:00.270652163Z 2024-03-28T23:40:00.270655544Z 2024-03-28T23:40:00.270700140Z [2024-03-28T23:40:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:40:00.270890589Z [2024-03-28T23:40:00.270+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:40:00.271131921Z [2024-03-28T23:40:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:40:00.271285583Z [2024-03-28T23:40:00.271+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:40:00.271480731Z [2024-03-28T23:40:00.271+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:40:00.272144051Z [2024-03-28T23:40:00.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:40:00.272158329Z 2024-03-28T23:40:00.272163853Z 2024-03-28T23:40:00.272170562Z 2024-03-28T23:40:00.272201783Z 2024-03-28T23:40:00.272209146Z 2024-03-28T23:40:00.277755229Z [2024-03-28T23:40:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:40:00.277900615Z [2024-03-28T23:40:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:40:00.278115599Z [2024-03-28T23:40:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:40:00.278138533Z [2024-03-28T23:40:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:40:00.278349143Z [2024-03-28T23:40:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:40:00.278373981Z [2024-03-28T23:40:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:40:00.278571402Z [2024-03-28T23:40:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:40:00.278653618Z [2024-03-28T23:40:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:40:00.278900692Z [2024-03-28T23:40:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:40:00.279093008Z [2024-03-28T23:40:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:40:00.944148121Z [2024-03-28T23:40:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:00.944304124Z [2024-03-28T23:40:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:00.944418828Z [2024-03-28T23:40:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:39:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:00.944550038Z [2024-03-28T23:40:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:39:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:00.944614824Z [2024-03-28T23:40:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:39:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:00.960094299Z [2024-03-28T23:40:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to a812a536-a001-4f50-acce-11944f74a2d7 2024-03-28T23:40:00.960563099Z [2024-03-28T23:40:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to fba00af4-7631-46f0-85a9-55a8e40a64b5 2024-03-28T23:40:00.960846810Z [2024-03-28T23:40:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad970d4a-26d0-45af-90d5-5c174d39c9f5 2024-03-28T23:40:00.961324863Z [2024-03-28T23:40:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21a80bd9-c95e-42e5-a5a6-805b57d597df 2024-03-28T23:40:00.961456910Z [2024-03-28T23:40:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to f64692ad-d8c7-4efc-aa43-e4de3eab5ac8 2024-03-28T23:40:02.175823303Z [2024-03-28T23:40:02.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:40:02.176388656Z [2024-03-28T23:40:02.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:38:00+00:00, run_id=scheduled__2024-03-28T23:38:00+00:00, run_start_date=2024-03-28 23:40:00.176669+00:00, run_end_date=2024-03-28 23:40:02.175992+00:00, run_duration=1.999323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:38:00+00:00, data_interval_end=2024-03-28 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:40:02.191536096Z [2024-03-28T23:40:02.191+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:42:00+00:00 2024-03-28T23:40:02.208090531Z [2024-03-28T23:40:02.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:40:02.208890235Z [2024-03-28T23:40:02.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:39:00+00:00, run_id=scheduled__2024-03-28T23:39:00+00:00, run_start_date=2024-03-28 23:40:00.181347+00:00, run_end_date=2024-03-28 23:40:02.208495+00:00, run_duration=2.027148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:39:00+00:00, data_interval_end=2024-03-28 23:40:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:40:02.222096203Z [2024-03-28T23:40:02.221+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:41:00+00:00 2024-03-28T23:40:02.278815883Z [2024-03-28T23:40:02.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:38:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:02.279159203Z [2024-03-28T23:40:02.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:39:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:02.291608640Z [2024-03-28T23:40:02.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:38:00+00:00, map_index=-1, run_start_date=2024-03-28 23:40:01.382020+00:00, run_end_date=2024-03-28 23:40:01.847042+00:00, run_duration=0.465022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:00.273112+00:00, queued_by_job_id=2, pid=655 2024-03-28T23:40:02.292660106Z [2024-03-28T23:40:02.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:39:00+00:00, map_index=-1, run_start_date=2024-03-28 23:40:01.399166+00:00, run_end_date=2024-03-28 23:40:01.994335+00:00, run_duration=0.595169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:00.273112+00:00, queued_by_job_id=2, pid=656 2024-03-28T23:40:03.798550874Z [2024-03-28T23:40:03.797+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:40:03.798603642Z 2024-03-28T23:40:03.798797402Z [2024-03-28T23:40:03.798+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:40:03.799874208Z [2024-03-28T23:40:03.799+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:40:03.799893246Z 2024-03-28T23:40:03.805881645Z [2024-03-28T23:40:03.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-28T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:40:03.806105036Z [2024-03-28T23:40:03.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:40:03.895847317Z [2024-03-28T23:40:03.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:03.895952939Z [2024-03-28T23:40:03.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:03.905854594Z [2024-03-28T23:40:03.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fc8a5ee-e409-42d6-8e17-be43febc6bc8 2024-03-28T23:40:03.906250479Z [2024-03-28T23:40:03.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:35:00+00:00, map_index=-1, run_start_date=2024-03-28 23:40:03.189207+00:00, run_end_date=2024-03-28 23:40:03.548339+00:00, run_duration=0.359132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:00.273112+00:00, queued_by_job_id=2, pid=688 2024-03-28T23:40:05.239861572Z [2024-03-28T23:40:05.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:40:05.240215169Z [2024-03-28T23:40:05.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:39:00+00:00, run_id=scheduled__2024-03-28T23:39:00+00:00, run_start_date=2024-03-28 23:40:00.179123+00:00, run_end_date=2024-03-28 23:40:05.239843+00:00, run_duration=5.06072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:39:00+00:00, data_interval_end=2024-03-28 23:40:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:40:05.253853693Z [2024-03-28T23:40:05.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:41:00+00:00 2024-03-28T23:40:05.262724143Z [2024-03-28T23:40:05.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:40:05.263091767Z [2024-03-28T23:40:05.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:39:00+00:00, run_id=scheduled__2024-03-28T23:39:00+00:00, run_start_date=2024-03-28 23:40:00.183512+00:00, run_end_date=2024-03-28 23:40:05.262695+00:00, run_duration=5.079183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:39:00+00:00, data_interval_end=2024-03-28 23:40:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:40:05.273312103Z [2024-03-28T23:40:05.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:41:00+00:00 2024-03-28T23:40:05.330134202Z [2024-03-28T23:40:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:39:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:05.332696007Z [2024-03-28T23:40:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:39:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:05.340830107Z [2024-03-28T23:40:05.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:39:00+00:00, map_index=-1, run_start_date=2024-03-28 23:40:03.450008+00:00, run_end_date=2024-03-28 23:40:04.835486+00:00, run_duration=1.385478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:00.273112+00:00, queued_by_job_id=2, pid=696 2024-03-28T23:40:05.341117210Z [2024-03-28T23:40:05.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:39:00+00:00, map_index=-1, run_start_date=2024-03-28 23:40:02.705319+00:00, run_end_date=2024-03-28 23:40:04.415671+00:00, run_duration=1.710352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:00.273112+00:00, queued_by_job_id=2, pid=675 2024-03-28T23:40:06.424390635Z [2024-03-28T23:40:06.423+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:40:06.424475718Z 2024-03-28T23:40:06.424485841Z [2024-03-28T23:40:06.424+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:40:06.425082395Z [2024-03-28T23:40:06.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:40:06.425103500Z 2024-03-28T23:40:06.427756258Z [2024-03-28T23:40:06.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:40:06.427902821Z [2024-03-28T23:40:06.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:40:06.507371183Z [2024-03-28T23:40:06.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:06.510405841Z [2024-03-28T23:40:06.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:06.517479824Z [2024-03-28T23:40:06.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to d856978f-44fc-4ed4-8038-bc339d297435 2024-03-28T23:40:06.517694033Z [2024-03-28T23:40:06.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-28T23:35:00+00:00, map_index=-1, run_start_date=2024-03-28 23:40:05.669781+00:00, run_end_date=2024-03-28 23:40:06.095781+00:00, run_duration=0.426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:03.800547+00:00, queued_by_job_id=2, pid=710 2024-03-28T23:40:09.240341496Z [2024-03-28T23:40:09.239+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:40:09.240398054Z 2024-03-28T23:40:09.240727887Z [2024-03-28T23:40:09.240+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:40:09.241546450Z [2024-03-28T23:40:09.241+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:40:09.241560583Z 2024-03-28T23:40:09.244895935Z [2024-03-28T23:40:09.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:40:09.245144011Z [2024-03-28T23:40:09.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:40:09.302982868Z [2024-03-28T23:40:09.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status queued for try_number 1 2024-03-28T23:40:09.303032174Z [2024-03-28T23:40:09.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:09.309964836Z [2024-03-28T23:40:09.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:35:00+00:00, map_index=0, run_start_date=2024-03-28 23:40:08.443014+00:00, run_end_date=2024-03-28 23:40:08.752372+00:00, run_duration=0.309358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:06.425357+00:00, queued_by_job_id=2, pid=718 2024-03-28T23:40:09.310066618Z [2024-03-28T23:40:09.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa1d023f-62f3-4627-a17b-4f68ea5ea1d2 2024-03-28T23:40:11.572813974Z [2024-03-28T23:40:11.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:40:11.573392807Z [2024-03-28T23:40:11.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:35:00+00:00, run_id=scheduled__2024-03-28T23:35:00+00:00, run_start_date=2024-03-28 23:40:00.173004+00:00, run_end_date=2024-03-28 23:40:11.572695+00:00, run_duration=11.399691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:35:00+00:00, data_interval_end=2024-03-28 23:40:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-28T23:40:11.590985121Z [2024-03-28T23:40:11.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:40:00+00:00, run_after=2024-03-28T23:45:00+00:00 2024-03-28T23:40:11.620297973Z [2024-03-28T23:40:11.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:35:00+00:00 exited with status success for try_number 1 2024-03-28T23:40:11.625718134Z [2024-03-28T23:40:11.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:35:00+00:00, map_index=-1, run_start_date=2024-03-28 23:40:10.914532+00:00, run_end_date=2024-03-28 23:40:11.294613+00:00, run_duration=0.380081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:40:09.242178+00:00, queued_by_job_id=2, pid=726 2024-03-28T23:41:01.067198143Z [2024-03-28T23:41:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:41:00+00:00, run_after=2024-03-28T23:42:00+00:00 2024-03-28T23:41:01.092779473Z [2024-03-28T23:41:01.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:41:00+00:00, run_after=2024-03-28T23:42:00+00:00 2024-03-28T23:41:01.104825145Z [2024-03-28T23:41:01.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:41:01.218727761Z [2024-03-28T23:41:01.218+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:41:01.218757621Z 2024-03-28T23:41:01.218761828Z 2024-03-28T23:41:01.218765580Z 2024-03-28T23:41:01.218916835Z [2024-03-28T23:41:01.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:41:01.219052626Z [2024-03-28T23:41:01.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:41:01.219210561Z [2024-03-28T23:41:01.219+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:41:01.219938456Z [2024-03-28T23:41:01.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:41:01.219957094Z 2024-03-28T23:41:01.219960963Z 2024-03-28T23:41:01.219964552Z 2024-03-28T23:41:01.223268958Z [2024-03-28T23:41:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:41:01.223520627Z [2024-03-28T23:41:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:41:01.223846995Z [2024-03-28T23:41:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:41:01.224014820Z [2024-03-28T23:41:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:41:01.224280757Z [2024-03-28T23:41:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:41:01.224451790Z [2024-03-28T23:41:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:41:01.980109117Z [2024-03-28T23:41:01.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:41:01.983221717Z [2024-03-28T23:41:01.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:41:01.983400253Z [2024-03-28T23:41:01.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:41:02.041652617Z [2024-03-28T23:41:02.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76bf1d97-a666-4226-b316-2cf827e029ee 2024-03-28T23:41:02.134716148Z [2024-03-28T23:41:02.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87edf8cf-11a7-4df5-94ba-32d8c37b6e52 2024-03-28T23:41:02.136972979Z [2024-03-28T23:41:02.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f5a2d96-06d9-4af3-8db9-e369def3d53a 2024-03-28T23:41:05.087101641Z [2024-03-28T23:41:05.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:41:05.087133253Z [2024-03-28T23:41:05.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:40:00+00:00, run_id=scheduled__2024-03-28T23:40:00+00:00, run_start_date=2024-03-28 23:41:01.122661+00:00, run_end_date=2024-03-28 23:41:05.081812+00:00, run_duration=3.959151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:40:00+00:00, data_interval_end=2024-03-28 23:41:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:41:05.129156449Z [2024-03-28T23:41:05.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:41:00+00:00, run_after=2024-03-28T23:42:00+00:00 2024-03-28T23:41:05.250584539Z [2024-03-28T23:41:05.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:41:05.256394135Z [2024-03-28T23:41:05.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:41:03.497348+00:00, run_end_date=2024-03-28 23:41:04.303480+00:00, run_duration=0.806132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:41:01.220744+00:00, queued_by_job_id=2, pid=748 2024-03-28T23:41:08.912258562Z [2024-03-28T23:41:08.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:41:08.913140262Z [2024-03-28T23:41:08.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:40:00+00:00, run_id=scheduled__2024-03-28T23:40:00+00:00, run_start_date=2024-03-28 23:41:01.127031+00:00, run_end_date=2024-03-28 23:41:08.912776+00:00, run_duration=7.785745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:40:00+00:00, data_interval_end=2024-03-28 23:41:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:41:08.955786620Z [2024-03-28T23:41:08.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:41:00+00:00, run_after=2024-03-28T23:42:00+00:00 2024-03-28T23:41:09.096436300Z [2024-03-28T23:41:09.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:41:09.121752965Z [2024-03-28T23:41:09.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:41:06.571525+00:00, run_end_date=2024-03-28 23:41:08.503578+00:00, run_duration=1.932053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:41:01.220744+00:00, queued_by_job_id=2, pid=767 2024-03-28T23:41:10.181775451Z [2024-03-28T23:41:10.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:41:10.182231137Z [2024-03-28T23:41:10.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:40:00+00:00, run_id=scheduled__2024-03-28T23:40:00+00:00, run_start_date=2024-03-28 23:41:01.129762+00:00, run_end_date=2024-03-28 23:41:10.181934+00:00, run_duration=9.052172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:40:00+00:00, data_interval_end=2024-03-28 23:41:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:41:10.191543189Z [2024-03-28T23:41:10.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:41:00+00:00, run_after=2024-03-28T23:42:00+00:00 2024-03-28T23:41:10.221147120Z [2024-03-28T23:41:10.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:41:10.227322295Z [2024-03-28T23:41:10.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:41:06.275028+00:00, run_end_date=2024-03-28 23:41:09.156622+00:00, run_duration=2.881594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:41:01.220744+00:00, queued_by_job_id=2, pid=766 2024-03-28T23:42:00.634229400Z [2024-03-28T23:42:00.633+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:42:00.644859784Z [2024-03-28T23:42:00.644+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:42:00.662908619Z [2024-03-28T23:42:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:42:00+00:00, run_after=2024-03-28T23:43:00+00:00 2024-03-28T23:42:00.677999516Z [2024-03-28T23:42:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:42:00+00:00, run_after=2024-03-28T23:43:00+00:00 2024-03-28T23:42:00.781910754Z [2024-03-28T23:42:00.781+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:42:00.781944729Z 2024-03-28T23:42:00.781952025Z 2024-03-28T23:42:00.781957894Z 2024-03-28T23:42:00.781963597Z 2024-03-28T23:42:00.782037848Z [2024-03-28T23:42:00.781+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:42:00.782319648Z [2024-03-28T23:42:00.782+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:42:00.782656030Z [2024-03-28T23:42:00.782+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:42:00.782902574Z [2024-03-28T23:42:00.782+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:42:00.783903787Z [2024-03-28T23:42:00.783+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:42:00.783916840Z 2024-03-28T23:42:00.783923478Z 2024-03-28T23:42:00.783929220Z 2024-03-28T23:42:00.783935151Z 2024-03-28T23:42:00.788988346Z [2024-03-28T23:42:00.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:42:00.789313891Z [2024-03-28T23:42:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:42:00.789762131Z [2024-03-28T23:42:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:42:00.790043230Z [2024-03-28T23:42:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:42:00.790485116Z [2024-03-28T23:42:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:42:00.790732905Z [2024-03-28T23:42:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:42:00.791110078Z [2024-03-28T23:42:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:42:00.791417007Z [2024-03-28T23:42:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:42:01.216234016Z [2024-03-28T23:42:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:42:01.216520561Z [2024-03-28T23:42:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:41:00+00:00 exited with status queued for try_number 1 2024-03-28T23:42:01.216791266Z [2024-03-28T23:42:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:41:00+00:00 exited with status queued for try_number 1 2024-03-28T23:42:01.217039665Z [2024-03-28T23:42:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:41:00+00:00 exited with status queued for try_number 1 2024-03-28T23:42:01.234091667Z [2024-03-28T23:42:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 183441de-491d-4cc7-bacc-0f8f6047d892 2024-03-28T23:42:01.234798530Z [2024-03-28T23:42:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 998c9a08-0de9-4be5-9f51-55a2d355533e 2024-03-28T23:42:01.235212687Z [2024-03-28T23:42:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to faaedc6b-f4b6-410c-b5e5-4d0d4afb5fbb 2024-03-28T23:42:01.235586849Z [2024-03-28T23:42:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6890d2d-952d-45e4-832a-f4a323a1b8ea 2024-03-28T23:42:02.471692400Z [2024-03-28T23:42:02.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:42:02.472198678Z [2024-03-28T23:42:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:40:00+00:00, run_id=scheduled__2024-03-28T23:40:00+00:00, run_start_date=2024-03-28 23:42:00.694370+00:00, run_end_date=2024-03-28 23:42:02.471767+00:00, run_duration=1.777397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:40:00+00:00, data_interval_end=2024-03-28 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:42:02.482432054Z [2024-03-28T23:42:02.482+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:42:00+00:00, run_after=2024-03-28T23:44:00+00:00 2024-03-28T23:42:02.498749417Z [2024-03-28T23:42:02.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:42:02.499119119Z [2024-03-28T23:42:02.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:41:00+00:00, run_id=scheduled__2024-03-28T23:41:00+00:00, run_start_date=2024-03-28 23:42:00.699100+00:00, run_end_date=2024-03-28 23:42:02.498723+00:00, run_duration=1.799623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:41:00+00:00, data_interval_end=2024-03-28 23:42:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:42:02.517906527Z [2024-03-28T23:42:02.513+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:42:00+00:00, run_after=2024-03-28T23:43:00+00:00 2024-03-28T23:42:02.573861169Z [2024-03-28T23:42:02.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:42:02.574346141Z [2024-03-28T23:42:02.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:41:00+00:00 exited with status success for try_number 1 2024-03-28T23:42:02.585799006Z [2024-03-28T23:42:02.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:42:01.579777+00:00, run_end_date=2024-03-28 23:42:02.079992+00:00, run_duration=0.500215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:42:00.784966+00:00, queued_by_job_id=2, pid=800 2024-03-28T23:42:02.586320584Z [2024-03-28T23:42:02.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:41:00+00:00, map_index=-1, run_start_date=2024-03-28 23:42:01.819825+00:00, run_end_date=2024-03-28 23:42:02.307579+00:00, run_duration=0.487754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:42:00.784966+00:00, queued_by_job_id=2, pid=801 2024-03-28T23:42:05.572141345Z [2024-03-28T23:42:05.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:42:05.572816867Z [2024-03-28T23:42:05.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:41:00+00:00, run_id=scheduled__2024-03-28T23:41:00+00:00, run_start_date=2024-03-28 23:42:00.700927+00:00, run_end_date=2024-03-28 23:42:05.572332+00:00, run_duration=4.871405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:41:00+00:00, data_interval_end=2024-03-28 23:42:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:42:05.590675852Z [2024-03-28T23:42:05.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:42:00+00:00, run_after=2024-03-28T23:43:00+00:00 2024-03-28T23:42:05.600826185Z [2024-03-28T23:42:05.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:42:05.601488363Z [2024-03-28T23:42:05.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:41:00+00:00, run_id=scheduled__2024-03-28T23:41:00+00:00, run_start_date=2024-03-28 23:42:00.696674+00:00, run_end_date=2024-03-28 23:42:05.600987+00:00, run_duration=4.904313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:41:00+00:00, data_interval_end=2024-03-28 23:42:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:42:05.619137709Z [2024-03-28T23:42:05.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:42:00+00:00, run_after=2024-03-28T23:43:00+00:00 2024-03-28T23:42:05.684905405Z [2024-03-28T23:42:05.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:41:00+00:00 exited with status success for try_number 1 2024-03-28T23:42:05.684937679Z [2024-03-28T23:42:05.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:41:00+00:00 exited with status success for try_number 1 2024-03-28T23:42:05.697585063Z [2024-03-28T23:42:05.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:41:00+00:00, map_index=-1, run_start_date=2024-03-28 23:42:03.406950+00:00, run_end_date=2024-03-28 23:42:04.924730+00:00, run_duration=1.51778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:42:00.784966+00:00, queued_by_job_id=2, pid=824 2024-03-28T23:42:05.698089872Z [2024-03-28T23:42:05.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:41:00+00:00, map_index=-1, run_start_date=2024-03-28 23:42:03.590128+00:00, run_end_date=2024-03-28 23:42:05.233416+00:00, run_duration=1.643288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:42:00.784966+00:00, queued_by_job_id=2, pid=825 2024-03-28T23:43:00.993147653Z [2024-03-28T23:43:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:43:00+00:00, run_after=2024-03-28T23:44:00+00:00 2024-03-28T23:43:01.003506479Z [2024-03-28T23:43:01.003+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:43:01.016039037Z [2024-03-28T23:43:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:43:00+00:00, run_after=2024-03-28T23:44:00+00:00 2024-03-28T23:43:01.088817511Z [2024-03-28T23:43:01.088+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:43:01.088843943Z 2024-03-28T23:43:01.088848031Z 2024-03-28T23:43:01.088851382Z 2024-03-28T23:43:01.089259474Z [2024-03-28T23:43:01.088+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:43:01.089577688Z [2024-03-28T23:43:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:43:01.089881348Z [2024-03-28T23:43:01.089+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:43:01.091175709Z [2024-03-28T23:43:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:43:01.091185309Z 2024-03-28T23:43:01.091205727Z 2024-03-28T23:43:01.091208929Z 2024-03-28T23:43:01.097613502Z [2024-03-28T23:43:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:43:01.098707294Z [2024-03-28T23:43:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:43:01.099748393Z [2024-03-28T23:43:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:43:01.100246974Z [2024-03-28T23:43:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:43:01.101069214Z [2024-03-28T23:43:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:43:01.101525365Z [2024-03-28T23:43:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:43:01.334673287Z [2024-03-28T23:43:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status queued for try_number 1 2024-03-28T23:43:01.334840613Z [2024-03-28T23:43:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status queued for try_number 1 2024-03-28T23:43:01.335032675Z [2024-03-28T23:43:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status queued for try_number 1 2024-03-28T23:43:01.342394319Z [2024-03-28T23:43:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0b4b423-80e3-49c4-8afc-63e5ebd83d35 2024-03-28T23:43:01.342536154Z [2024-03-28T23:43:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc43c0df-65f3-480e-aa3f-03515344f6df 2024-03-28T23:43:01.342793808Z [2024-03-28T23:43:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9331041-4086-47bf-8f68-3ff67bda109c 2024-03-28T23:43:03.459349836Z [2024-03-28T23:43:03.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:43:03.459830071Z [2024-03-28T23:43:03.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:42:00+00:00, run_id=scheduled__2024-03-28T23:42:00+00:00, run_start_date=2024-03-28 23:43:01.032563+00:00, run_end_date=2024-03-28 23:43:03.459257+00:00, run_duration=2.426694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:42:00+00:00, data_interval_end=2024-03-28 23:43:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:43:03.470329817Z [2024-03-28T23:43:03.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:43:00+00:00, run_after=2024-03-28T23:44:00+00:00 2024-03-28T23:43:03.522242859Z [2024-03-28T23:43:03.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status success for try_number 1 2024-03-28T23:43:03.528279222Z [2024-03-28T23:43:03.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:42:00+00:00, map_index=-1, run_start_date=2024-03-28 23:43:02.075177+00:00, run_end_date=2024-03-28 23:43:02.539512+00:00, run_duration=0.464335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:43:01.092899+00:00, queued_by_job_id=2, pid=857 2024-03-28T23:43:05.994938459Z [2024-03-28T23:43:05.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:43:05.995317650Z [2024-03-28T23:43:05.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:42:00+00:00, run_id=scheduled__2024-03-28T23:42:00+00:00, run_start_date=2024-03-28 23:43:01.035292+00:00, run_end_date=2024-03-28 23:43:05.994910+00:00, run_duration=4.959618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:42:00+00:00, data_interval_end=2024-03-28 23:43:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:43:06.016756936Z [2024-03-28T23:43:06.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:43:00+00:00, run_after=2024-03-28T23:44:00+00:00 2024-03-28T23:43:06.028768658Z [2024-03-28T23:43:06.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:43:06.029770314Z [2024-03-28T23:43:06.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:42:00+00:00, run_id=scheduled__2024-03-28T23:42:00+00:00, run_start_date=2024-03-28 23:43:01.037100+00:00, run_end_date=2024-03-28 23:43:06.028841+00:00, run_duration=4.991741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:42:00+00:00, data_interval_end=2024-03-28 23:43:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:43:06.045055166Z [2024-03-28T23:43:06.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:43:00+00:00, run_after=2024-03-28T23:44:00+00:00 2024-03-28T23:43:06.077973723Z [2024-03-28T23:43:06.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status success for try_number 1 2024-03-28T23:43:06.078202897Z [2024-03-28T23:43:06.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status success for try_number 1 2024-03-28T23:43:06.084962433Z [2024-03-28T23:43:06.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:42:00+00:00, map_index=-1, run_start_date=2024-03-28 23:43:03.245147+00:00, run_end_date=2024-03-28 23:43:05.326990+00:00, run_duration=2.081843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:43:01.092899+00:00, queued_by_job_id=2, pid=876 2024-03-28T23:43:06.085298037Z [2024-03-28T23:43:06.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:42:00+00:00, map_index=-1, run_start_date=2024-03-28 23:43:03.200999+00:00, run_end_date=2024-03-28 23:43:05.383047+00:00, run_duration=2.182048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:43:01.092899+00:00, queued_by_job_id=2, pid=875 2024-03-28T23:43:43.930446237Z [2024-03-28T23:43:43.929+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-28T23:44:00.278822898Z [2024-03-28T23:44:00.278+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:44:00.305182571Z [2024-03-28T23:44:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:44:00+00:00, run_after=2024-03-28T23:45:00+00:00 2024-03-28T23:44:00.313379090Z [2024-03-28T23:44:00.312+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:44:00.325231120Z [2024-03-28T23:44:00.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:44:00+00:00, run_after=2024-03-28T23:45:00+00:00 2024-03-28T23:44:00.449095120Z [2024-03-28T23:44:00.448+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:44:00.449123680Z 2024-03-28T23:44:00.449128764Z 2024-03-28T23:44:00.449132808Z 2024-03-28T23:44:00.449154705Z 2024-03-28T23:44:00.449159976Z [2024-03-28T23:44:00.448+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:44:00.449482992Z [2024-03-28T23:44:00.449+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:44:00.449492452Z [2024-03-28T23:44:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:44:00.449736565Z [2024-03-28T23:44:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:44:00.450516957Z [2024-03-28T23:44:00.450+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:44:00.450531367Z 2024-03-28T23:44:00.450536077Z 2024-03-28T23:44:00.450540003Z 2024-03-28T23:44:00.450543678Z 2024-03-28T23:44:00.455553943Z [2024-03-28T23:44:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:44:00.455890160Z [2024-03-28T23:44:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:44:00.456238422Z [2024-03-28T23:44:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:44:00.456449094Z [2024-03-28T23:44:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:44:00.456746392Z [2024-03-28T23:44:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:44:00.457001287Z [2024-03-28T23:44:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:44:00.457301558Z [2024-03-28T23:44:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:44:00.457511951Z [2024-03-28T23:44:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:44:00.740808719Z [2024-03-28T23:44:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status queued for try_number 1 2024-03-28T23:44:00.740872913Z [2024-03-28T23:44:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:43:00+00:00 exited with status queued for try_number 1 2024-03-28T23:44:00.741054542Z [2024-03-28T23:44:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:43:00+00:00 exited with status queued for try_number 1 2024-03-28T23:44:00.741140283Z [2024-03-28T23:44:00.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:43:00+00:00 exited with status queued for try_number 1 2024-03-28T23:44:00.749875035Z [2024-03-28T23:44:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fad0f8f-8a3a-402d-bd27-c491248081e8 2024-03-28T23:44:00.749943282Z [2024-03-28T23:44:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e4d8302-ffe3-4ea1-a306-6aad00303c1a 2024-03-28T23:44:00.750234954Z [2024-03-28T23:44:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to a265f5de-5448-4161-8b8b-5aa6dfba35a4 2024-03-28T23:44:00.750503150Z [2024-03-28T23:44:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5ddf2c1-1d93-46dc-97fc-9cfa459fc9bb 2024-03-28T23:44:01.991967136Z [2024-03-28T23:44:01.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:44:01.992506054Z [2024-03-28T23:44:01.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:42:00+00:00, run_id=scheduled__2024-03-28T23:42:00+00:00, run_start_date=2024-03-28 23:44:00.340527+00:00, run_end_date=2024-03-28 23:44:01.991904+00:00, run_duration=1.651377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:42:00+00:00, data_interval_end=2024-03-28 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:44:02.011538596Z [2024-03-28T23:44:02.011+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:44:00+00:00, run_after=2024-03-28T23:46:00+00:00 2024-03-28T23:44:02.113091366Z [2024-03-28T23:44:02.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:42:00+00:00 exited with status success for try_number 1 2024-03-28T23:44:02.128218762Z [2024-03-28T23:44:02.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:42:00+00:00, map_index=-1, run_start_date=2024-03-28 23:44:01.315093+00:00, run_end_date=2024-03-28 23:44:01.687945+00:00, run_duration=0.372852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:44:00.451591+00:00, queued_by_job_id=2, pid=909 2024-03-28T23:44:03.212626597Z [2024-03-28T23:44:03.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:44:03.212658060Z [2024-03-28T23:44:03.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:43:00+00:00, run_id=scheduled__2024-03-28T23:43:00+00:00, run_start_date=2024-03-28 23:44:00.342683+00:00, run_end_date=2024-03-28 23:44:03.210837+00:00, run_duration=2.868154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:43:00+00:00, data_interval_end=2024-03-28 23:44:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:44:03.233899251Z [2024-03-28T23:44:03.233+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:44:00+00:00, run_after=2024-03-28T23:45:00+00:00 2024-03-28T23:44:03.321613066Z [2024-03-28T23:44:03.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:43:00+00:00 exited with status success for try_number 1 2024-03-28T23:44:03.329296888Z [2024-03-28T23:44:03.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:43:00+00:00, map_index=-1, run_start_date=2024-03-28 23:44:01.488787+00:00, run_end_date=2024-03-28 23:44:02.052574+00:00, run_duration=0.563787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:44:00.451591+00:00, queued_by_job_id=2, pid=910 2024-03-28T23:44:05.076882763Z [2024-03-28T23:44:05.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:44:05.077589774Z [2024-03-28T23:44:05.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:43:00+00:00, run_id=scheduled__2024-03-28T23:43:00+00:00, run_start_date=2024-03-28 23:44:00.347190+00:00, run_end_date=2024-03-28 23:44:05.076949+00:00, run_duration=4.729759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:43:00+00:00, data_interval_end=2024-03-28 23:44:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:44:05.098419798Z [2024-03-28T23:44:05.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:44:00+00:00, run_after=2024-03-28T23:45:00+00:00 2024-03-28T23:44:05.109769292Z [2024-03-28T23:44:05.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:44:05.110223019Z [2024-03-28T23:44:05.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:43:00+00:00, run_id=scheduled__2024-03-28T23:43:00+00:00, run_start_date=2024-03-28 23:44:00.345002+00:00, run_end_date=2024-03-28 23:44:05.109671+00:00, run_duration=4.764669, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:43:00+00:00, data_interval_end=2024-03-28 23:44:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:44:05.127658238Z [2024-03-28T23:44:05.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:44:00+00:00, run_after=2024-03-28T23:45:00+00:00 2024-03-28T23:44:05.194491274Z [2024-03-28T23:44:05.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:43:00+00:00 exited with status success for try_number 1 2024-03-28T23:44:05.194515079Z [2024-03-28T23:44:05.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:43:00+00:00 exited with status success for try_number 1 2024-03-28T23:44:05.202593872Z [2024-03-28T23:44:05.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:43:00+00:00, map_index=-1, run_start_date=2024-03-28 23:44:02.948620+00:00, run_end_date=2024-03-28 23:44:04.300621+00:00, run_duration=1.352001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:44:00.451591+00:00, queued_by_job_id=2, pid=934 2024-03-28T23:44:05.202617564Z [2024-03-28T23:44:05.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:43:00+00:00, map_index=-1, run_start_date=2024-03-28 23:44:02.869049+00:00, run_end_date=2024-03-28 23:44:04.731781+00:00, run_duration=1.862732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:44:00.451591+00:00, queued_by_job_id=2, pid=933 2024-03-28T23:45:00.150552159Z [2024-03-28T23:45:00.149+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:45:00.172071090Z [2024-03-28T23:45:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:46:00+00:00 2024-03-28T23:45:00.187048898Z [2024-03-28T23:45:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:46:00+00:00 2024-03-28T23:45:00.198757465Z [2024-03-28T23:45:00.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:45:00.295727550Z [2024-03-28T23:45:00.295+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:45:00.295763905Z 2024-03-28T23:45:00.295772109Z 2024-03-28T23:45:00.295801291Z 2024-03-28T23:45:00.295808026Z 2024-03-28T23:45:00.296083995Z [2024-03-28T23:45:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:45:00.296513935Z [2024-03-28T23:45:00.296+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:45:00.296756444Z [2024-03-28T23:45:00.296+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:45:00.296983233Z [2024-03-28T23:45:00.296+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:45:00.297742203Z [2024-03-28T23:45:00.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:45:00.297752359Z 2024-03-28T23:45:00.297758812Z 2024-03-28T23:45:00.297765242Z 2024-03-28T23:45:00.297771588Z 2024-03-28T23:45:00.301950290Z [2024-03-28T23:45:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:45:00.302356965Z [2024-03-28T23:45:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:45:00.302781966Z [2024-03-28T23:45:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:45:00.303018737Z [2024-03-28T23:45:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:45:00.303368651Z [2024-03-28T23:45:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:45:00.303691130Z [2024-03-28T23:45:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:45:00.304108445Z [2024-03-28T23:45:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:45:00.304301999Z [2024-03-28T23:45:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:45:00.614898404Z [2024-03-28T23:45:00.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:45:00.615171467Z [2024-03-28T23:45:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status queued for try_number 1 2024-03-28T23:45:00.615318667Z [2024-03-28T23:45:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status queued for try_number 1 2024-03-28T23:45:00.615538221Z [2024-03-28T23:45:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status queued for try_number 1 2024-03-28T23:45:00.634993357Z [2024-03-28T23:45:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54e4e322-c2fb-4c50-ad3b-b1b0ac4c897f 2024-03-28T23:45:00.635319591Z [2024-03-28T23:45:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56f546e7-cb23-4e8c-b412-f410637ec516 2024-03-28T23:45:00.635599658Z [2024-03-28T23:45:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to a35ac93e-1c65-45b4-a097-caa0c8c28bdd 2024-03-28T23:45:00.635848568Z [2024-03-28T23:45:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd79b514-cc42-464a-beb5-e69ad440c476 2024-03-28T23:45:02.332237462Z [2024-03-28T23:45:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:45:02.332696014Z [2024-03-28T23:45:02.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:44:00+00:00, run_id=scheduled__2024-03-28T23:44:00+00:00, run_start_date=2024-03-28 23:45:00.214877+00:00, run_end_date=2024-03-28 23:45:02.332145+00:00, run_duration=2.117268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:44:00+00:00, data_interval_end=2024-03-28 23:45:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:45:02.351683565Z [2024-03-28T23:45:02.351+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:46:00+00:00 2024-03-28T23:45:02.447470008Z [2024-03-28T23:45:02.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status success for try_number 1 2024-03-28T23:45:02.456857781Z [2024-03-28T23:45:02.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:44:00+00:00, map_index=-1, run_start_date=2024-03-28 23:45:01.297456+00:00, run_end_date=2024-03-28 23:45:01.767576+00:00, run_duration=0.47012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:45:00.298834+00:00, queued_by_job_id=2, pid=967 2024-03-28T23:45:04.209165991Z [2024-03-28T23:45:04.208+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:45:04.209220023Z 2024-03-28T23:45:04.209695769Z [2024-03-28T23:45:04.209+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:45:04.210898517Z [2024-03-28T23:45:04.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:45:04.210926675Z 2024-03-28T23:45:04.216818315Z [2024-03-28T23:45:04.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:45:04.217697704Z [2024-03-28T23:45:04.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:45:04.287266482Z [2024-03-28T23:45:04.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:45:04.287718912Z [2024-03-28T23:45:04.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:45:04.298266554Z [2024-03-28T23:45:04.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to b438cdfb-769b-497a-8928-1e125f8158f7 2024-03-28T23:45:04.298806286Z [2024-03-28T23:45:04.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:45:02.947016+00:00, run_end_date=2024-03-28 23:45:03.579131+00:00, run_duration=0.632115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:45:00.298834+00:00, queued_by_job_id=2, pid=992 2024-03-28T23:45:05.521382223Z [2024-03-28T23:45:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:45:05.521811971Z [2024-03-28T23:45:05.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:44:00+00:00, run_id=scheduled__2024-03-28T23:44:00+00:00, run_start_date=2024-03-28 23:45:00.213550+00:00, run_end_date=2024-03-28 23:45:05.521279+00:00, run_duration=5.307729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:44:00+00:00, data_interval_end=2024-03-28 23:45:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:45:05.532070735Z [2024-03-28T23:45:05.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:46:00+00:00 2024-03-28T23:45:05.543926705Z [2024-03-28T23:45:05.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:45:05.544399167Z [2024-03-28T23:45:05.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:44:00+00:00, run_id=scheduled__2024-03-28T23:44:00+00:00, run_start_date=2024-03-28 23:45:00.216178+00:00, run_end_date=2024-03-28 23:45:05.544034+00:00, run_duration=5.327856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:44:00+00:00, data_interval_end=2024-03-28 23:45:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:45:05.557562552Z [2024-03-28T23:45:05.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:46:00+00:00 2024-03-28T23:45:05.632871294Z [2024-03-28T23:45:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status success for try_number 1 2024-03-28T23:45:05.632907177Z [2024-03-28T23:45:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status success for try_number 1 2024-03-28T23:45:05.641819216Z [2024-03-28T23:45:05.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:44:00+00:00, map_index=-1, run_start_date=2024-03-28 23:45:03.031862+00:00, run_end_date=2024-03-28 23:45:04.505326+00:00, run_duration=1.473464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:45:00.298834+00:00, queued_by_job_id=2, pid=993 2024-03-28T23:45:05.642328726Z [2024-03-28T23:45:05.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:44:00+00:00, map_index=-1, run_start_date=2024-03-28 23:45:02.819813+00:00, run_end_date=2024-03-28 23:45:04.774042+00:00, run_duration=1.954229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:45:00.298834+00:00, queued_by_job_id=2, pid=991 2024-03-28T23:45:06.813779610Z [2024-03-28T23:45:06.813+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:45:06.813807758Z 2024-03-28T23:45:06.813980521Z [2024-03-28T23:45:06.813+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:45:06.814640461Z [2024-03-28T23:45:06.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:45:06.814655797Z 2024-03-28T23:45:06.817189314Z [2024-03-28T23:45:06.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:45:06.817316278Z [2024-03-28T23:45:06.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:45:06.935523651Z [2024-03-28T23:45:06.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:45:06.938856541Z [2024-03-28T23:45:06.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:45:06.959683118Z [2024-03-28T23:45:06.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5e3e9eb-2abf-42ac-a051-78de58d43249 2024-03-28T23:45:06.965266428Z [2024-03-28T23:45:06.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:45:06.083707+00:00, run_end_date=2024-03-28 23:45:06.435820+00:00, run_duration=0.352113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:45:04.211843+00:00, queued_by_job_id=2, pid=1016 2024-03-28T23:45:09.387734202Z [2024-03-28T23:45:09.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:45:09.387762311Z 2024-03-28T23:45:09.387777757Z [2024-03-28T23:45:09.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:45:09.388424233Z [2024-03-28T23:45:09.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:45:09.388463473Z 2024-03-28T23:45:09.391069702Z [2024-03-28T23:45:09.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:45:09.391148058Z [2024-03-28T23:45:09.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:45:09.445449656Z [2024-03-28T23:45:09.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:45:09.445554738Z [2024-03-28T23:45:09.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:45:09.456135752Z [2024-03-28T23:45:09.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=0, run_start_date=2024-03-28 23:45:08.875602+00:00, run_end_date=2024-03-28 23:45:09.255580+00:00, run_duration=0.379978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:45:06.815059+00:00, queued_by_job_id=2, pid=1024 2024-03-28T23:45:09.456459935Z [2024-03-28T23:45:09.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to e012f514-8592-4dec-a5ef-404662c8c364 2024-03-28T23:45:12.414076294Z [2024-03-28T23:45:12.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:45:12.414430893Z [2024-03-28T23:45:12.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:40:00+00:00, run_id=scheduled__2024-03-28T23:40:00+00:00, run_start_date=2024-03-28 23:45:00.212183+00:00, run_end_date=2024-03-28 23:45:12.413940+00:00, run_duration=12.201757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:40:00+00:00, data_interval_end=2024-03-28 23:45:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-28T23:45:12.421051676Z [2024-03-28T23:45:12.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:45:12.449048624Z [2024-03-28T23:45:12.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:45:12.454842572Z [2024-03-28T23:45:12.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:45:11.042745+00:00, run_end_date=2024-03-28 23:45:11.373037+00:00, run_duration=0.330292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:45:09.388705+00:00, queued_by_job_id=2, pid=1032 2024-03-28T23:46:00.152979322Z [2024-03-28T23:46:00.150+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:46:00.173131435Z [2024-03-28T23:46:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:46:00+00:00, run_after=2024-03-28T23:47:00+00:00 2024-03-28T23:46:00.191455136Z [2024-03-28T23:46:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:46:00+00:00, run_after=2024-03-28T23:47:00+00:00 2024-03-28T23:46:00.199044028Z [2024-03-28T23:46:00.198+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:46:00.279974476Z [2024-03-28T23:46:00.279+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:46:00.279994589Z 2024-03-28T23:46:00.279999071Z 2024-03-28T23:46:00.280006590Z 2024-03-28T23:46:00.280048004Z 2024-03-28T23:46:00.280067336Z [2024-03-28T23:46:00.279+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:46:00.280241653Z [2024-03-28T23:46:00.280+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:46:00.280573847Z [2024-03-28T23:46:00.280+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:46:00.280581298Z [2024-03-28T23:46:00.280+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:46:00.281076071Z [2024-03-28T23:46:00.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:46:00.281086019Z 2024-03-28T23:46:00.281089743Z 2024-03-28T23:46:00.281092972Z 2024-03-28T23:46:00.281096529Z 2024-03-28T23:46:00.284471142Z [2024-03-28T23:46:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:46:00.284581288Z [2024-03-28T23:46:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:46:00.284825114Z [2024-03-28T23:46:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:46:00.284970581Z [2024-03-28T23:46:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:46:00.285285867Z [2024-03-28T23:46:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:46:00.285431116Z [2024-03-28T23:46:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:46:00.285760390Z [2024-03-28T23:46:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:46:00.285896320Z [2024-03-28T23:46:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:46:00.919803547Z [2024-03-28T23:46:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status queued for try_number 1 2024-03-28T23:46:00.920152538Z [2024-03-28T23:46:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:46:00.920459349Z [2024-03-28T23:46:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:46:00.920730661Z [2024-03-28T23:46:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:46:00.944550696Z [2024-03-28T23:46:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 282ccaf6-2fbb-4de5-86bc-fbde3a20d647 2024-03-28T23:46:00.944980339Z [2024-03-28T23:46:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3a58fbf-15d5-4810-b2d7-a7e339b336c9 2024-03-28T23:46:00.945328586Z [2024-03-28T23:46:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 298a5934-b6b5-4ee8-885b-4bf921edd4f3 2024-03-28T23:46:00.945669306Z [2024-03-28T23:46:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b1f7f5f-bf6b-4d53-8e99-db0a08750a32 2024-03-28T23:46:03.125123114Z [2024-03-28T23:46:03.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:46:03.125695928Z [2024-03-28T23:46:03.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:44:00+00:00, run_id=scheduled__2024-03-28T23:44:00+00:00, run_start_date=2024-03-28 23:46:00.209893+00:00, run_end_date=2024-03-28 23:46:03.125028+00:00, run_duration=2.915135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:44:00+00:00, data_interval_end=2024-03-28 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:46:03.138193609Z [2024-03-28T23:46:03.137+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:46:00+00:00, run_after=2024-03-28T23:48:00+00:00 2024-03-28T23:46:04.334533397Z [2024-03-28T23:46:04.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:46:04.334887156Z [2024-03-28T23:46:04.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:45:00+00:00, run_id=scheduled__2024-03-28T23:45:00+00:00, run_start_date=2024-03-28 23:46:00.212675+00:00, run_end_date=2024-03-28 23:46:04.334403+00:00, run_duration=4.121728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:45:00+00:00, data_interval_end=2024-03-28 23:46:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:46:04.368797427Z [2024-03-28T23:46:04.368+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:46:00+00:00, run_after=2024-03-28T23:47:00+00:00 2024-03-28T23:46:04.842702769Z [2024-03-28T23:46:04.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:44:00+00:00 exited with status success for try_number 1 2024-03-28T23:46:04.842772989Z [2024-03-28T23:46:04.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:46:04.855762815Z [2024-03-28T23:46:04.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:44:00+00:00, map_index=-1, run_start_date=2024-03-28 23:46:02.072923+00:00, run_end_date=2024-03-28 23:46:02.906941+00:00, run_duration=0.834018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:46:00.282012+00:00, queued_by_job_id=2, pid=1056 2024-03-28T23:46:04.855958180Z [2024-03-28T23:46:04.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:46:02.215006+00:00, run_end_date=2024-03-28 23:46:03.295558+00:00, run_duration=1.080552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:46:00.282012+00:00, queued_by_job_id=2, pid=1057 2024-03-28T23:46:08.409379695Z [2024-03-28T23:46:08.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:46:08.410553768Z [2024-03-28T23:46:08.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:45:00+00:00, run_id=scheduled__2024-03-28T23:45:00+00:00, run_start_date=2024-03-28 23:46:00.211538+00:00, run_end_date=2024-03-28 23:46:08.409941+00:00, run_duration=8.198403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:45:00+00:00, data_interval_end=2024-03-28 23:46:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:46:08.473611853Z [2024-03-28T23:46:08.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:46:00+00:00, run_after=2024-03-28T23:47:00+00:00 2024-03-28T23:46:08.486800548Z [2024-03-28T23:46:08.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:46:08.486833465Z [2024-03-28T23:46:08.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:45:00+00:00, run_id=scheduled__2024-03-28T23:45:00+00:00, run_start_date=2024-03-28 23:46:00.213747+00:00, run_end_date=2024-03-28 23:46:08.485579+00:00, run_duration=8.271832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:45:00+00:00, data_interval_end=2024-03-28 23:46:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:46:08.565841125Z [2024-03-28T23:46:08.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:46:00+00:00, run_after=2024-03-28T23:47:00+00:00 2024-03-28T23:46:08.675083620Z [2024-03-28T23:46:08.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:46:08.679273369Z [2024-03-28T23:46:08.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:46:08.688752554Z [2024-03-28T23:46:08.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:46:04.931058+00:00, run_end_date=2024-03-28 23:46:07.465850+00:00, run_duration=2.534792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:46:00.282012+00:00, queued_by_job_id=2, pid=1080 2024-03-28T23:46:08.690537507Z [2024-03-28T23:46:08.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:46:04.901263+00:00, run_end_date=2024-03-28 23:46:07.786797+00:00, run_duration=2.885534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:46:00.282012+00:00, queued_by_job_id=2, pid=1081 2024-03-28T23:47:01.050065043Z [2024-03-28T23:47:01.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:47:00+00:00, run_after=2024-03-28T23:48:00+00:00 2024-03-28T23:47:01.069201005Z [2024-03-28T23:47:01.068+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:47:00+00:00, run_after=2024-03-28T23:48:00+00:00 2024-03-28T23:47:01.079490018Z [2024-03-28T23:47:01.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:47:01.157361267Z [2024-03-28T23:47:01.156+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:47:01.157397267Z 2024-03-28T23:47:01.157403060Z 2024-03-28T23:47:01.157408121Z 2024-03-28T23:47:01.157718482Z [2024-03-28T23:47:01.157+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:47:01.157949124Z [2024-03-28T23:47:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:47:01.158251656Z [2024-03-28T23:47:01.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:47:01.159157794Z [2024-03-28T23:47:01.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:47:01.159186916Z 2024-03-28T23:47:01.159195830Z 2024-03-28T23:47:01.159201448Z 2024-03-28T23:47:01.163667439Z [2024-03-28T23:47:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:47:01.163965529Z [2024-03-28T23:47:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:47:01.164267613Z [2024-03-28T23:47:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:47:01.164419869Z [2024-03-28T23:47:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:47:01.164764113Z [2024-03-28T23:47:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:47:01.165053906Z [2024-03-28T23:47:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:47:01.645864274Z [2024-03-28T23:47:01.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status queued for try_number 1 2024-03-28T23:47:01.645899781Z [2024-03-28T23:47:01.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status queued for try_number 1 2024-03-28T23:47:01.646034493Z [2024-03-28T23:47:01.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status queued for try_number 1 2024-03-28T23:47:01.657909603Z [2024-03-28T23:47:01.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5c1b219-7fd2-4a9a-b1b0-bf2b867b2b97 2024-03-28T23:47:01.658143022Z [2024-03-28T23:47:01.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to eab3a899-d392-4fbe-96d2-102b0234b25f 2024-03-28T23:47:01.658487950Z [2024-03-28T23:47:01.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6386507-f761-400e-bf03-d37ef1c41ac6 2024-03-28T23:47:03.477522359Z [2024-03-28T23:47:03.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:47:03.477883671Z [2024-03-28T23:47:03.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:46:00+00:00, run_id=scheduled__2024-03-28T23:46:00+00:00, run_start_date=2024-03-28 23:47:01.093684+00:00, run_end_date=2024-03-28 23:47:03.477541+00:00, run_duration=2.383857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:46:00+00:00, data_interval_end=2024-03-28 23:47:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:47:03.487123970Z [2024-03-28T23:47:03.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:47:00+00:00, run_after=2024-03-28T23:48:00+00:00 2024-03-28T23:47:03.554830823Z [2024-03-28T23:47:03.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status success for try_number 1 2024-03-28T23:47:03.561076068Z [2024-03-28T23:47:03.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:46:00+00:00, map_index=-1, run_start_date=2024-03-28 23:47:02.041795+00:00, run_end_date=2024-03-28 23:47:02.478989+00:00, run_duration=0.437194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:47:01.160205+00:00, queued_by_job_id=2, pid=1113 2024-03-28T23:47:05.129234634Z [2024-03-28T23:47:05.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:47:05.129795409Z [2024-03-28T23:47:05.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:46:00+00:00, run_id=scheduled__2024-03-28T23:46:00+00:00, run_start_date=2024-03-28 23:47:01.092093+00:00, run_end_date=2024-03-28 23:47:05.129332+00:00, run_duration=4.037239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:46:00+00:00, data_interval_end=2024-03-28 23:47:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:47:05.162529460Z [2024-03-28T23:47:05.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:47:00+00:00, run_after=2024-03-28T23:48:00+00:00 2024-03-28T23:47:06.279968588Z [2024-03-28T23:47:06.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:47:06.280485436Z [2024-03-28T23:47:06.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:46:00+00:00, run_id=scheduled__2024-03-28T23:46:00+00:00, run_start_date=2024-03-28 23:47:01.095539+00:00, run_end_date=2024-03-28 23:47:06.280133+00:00, run_duration=5.184594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:46:00+00:00, data_interval_end=2024-03-28 23:47:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:47:06.289447839Z [2024-03-28T23:47:06.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:47:00+00:00, run_after=2024-03-28T23:48:00+00:00 2024-03-28T23:47:06.319554142Z [2024-03-28T23:47:06.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status success for try_number 1 2024-03-28T23:47:06.319897941Z [2024-03-28T23:47:06.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status success for try_number 1 2024-03-28T23:47:06.326506086Z [2024-03-28T23:47:06.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:46:00+00:00, map_index=-1, run_start_date=2024-03-28 23:47:03.107991+00:00, run_end_date=2024-03-28 23:47:05.059727+00:00, run_duration=1.951736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:47:01.160205+00:00, queued_by_job_id=2, pid=1128 2024-03-28T23:47:06.326923257Z [2024-03-28T23:47:06.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:46:00+00:00, map_index=-1, run_start_date=2024-03-28 23:47:03.349394+00:00, run_end_date=2024-03-28 23:47:05.736255+00:00, run_duration=2.386861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:47:01.160205+00:00, queued_by_job_id=2, pid=1132 2024-03-28T23:48:00.782204682Z [2024-03-28T23:48:00.781+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:48:00.791367183Z [2024-03-28T23:48:00.790+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:48:00.809004919Z [2024-03-28T23:48:00.808+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:48:00+00:00, run_after=2024-03-28T23:49:00+00:00 2024-03-28T23:48:00.823303721Z [2024-03-28T23:48:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:48:00+00:00, run_after=2024-03-28T23:49:00+00:00 2024-03-28T23:48:00.903814894Z [2024-03-28T23:48:00.903+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:48:00.903840884Z 2024-03-28T23:48:00.903846485Z 2024-03-28T23:48:00.903850156Z 2024-03-28T23:48:00.903853672Z 2024-03-28T23:48:00.903938512Z [2024-03-28T23:48:00.903+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:48:00.904092359Z [2024-03-28T23:48:00.903+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:48:00.904252723Z [2024-03-28T23:48:00.904+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:48:00.904411754Z [2024-03-28T23:48:00.904+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:48:00.905278738Z [2024-03-28T23:48:00.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:48:00.905302811Z 2024-03-28T23:48:00.905309187Z 2024-03-28T23:48:00.905313964Z 2024-03-28T23:48:00.905318894Z 2024-03-28T23:48:00.909943293Z [2024-03-28T23:48:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:48:00.910258806Z [2024-03-28T23:48:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:48:00.910604536Z [2024-03-28T23:48:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:48:00.910740908Z [2024-03-28T23:48:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:48:00.911010977Z [2024-03-28T23:48:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:48:00.911210012Z [2024-03-28T23:48:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:48:00.911476866Z [2024-03-28T23:48:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:48:00.911644784Z [2024-03-28T23:48:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:48:01.506289088Z [2024-03-28T23:48:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status queued for try_number 1 2024-03-28T23:48:01.506404818Z [2024-03-28T23:48:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:47:00+00:00 exited with status queued for try_number 1 2024-03-28T23:48:01.506535275Z [2024-03-28T23:48:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:47:00+00:00 exited with status queued for try_number 1 2024-03-28T23:48:01.509399635Z [2024-03-28T23:48:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:47:00+00:00 exited with status queued for try_number 1 2024-03-28T23:48:01.531787425Z [2024-03-28T23:48:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46e503c2-626e-4927-821e-1b1a44446611 2024-03-28T23:48:01.532068196Z [2024-03-28T23:48:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99ceefeb-47fc-4ec6-81b3-0cfdb36c74e2 2024-03-28T23:48:01.532274716Z [2024-03-28T23:48:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to e745c1d3-2088-431e-ab39-bf7c032f3ce6 2024-03-28T23:48:01.532480756Z [2024-03-28T23:48:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54782b2a-48a6-43a6-8b6e-a06c8c43ff28 2024-03-28T23:48:02.721323314Z [2024-03-28T23:48:02.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:48:02.722703209Z [2024-03-28T23:48:02.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:46:00+00:00, run_id=scheduled__2024-03-28T23:46:00+00:00, run_start_date=2024-03-28 23:48:00.835325+00:00, run_end_date=2024-03-28 23:48:02.721226+00:00, run_duration=1.885901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:46:00+00:00, data_interval_end=2024-03-28 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:48:02.741248386Z [2024-03-28T23:48:02.740+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:48:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:48:02.769882631Z [2024-03-28T23:48:02.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:48:02.770597565Z [2024-03-28T23:48:02.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:47:00+00:00, run_id=scheduled__2024-03-28T23:47:00+00:00, run_start_date=2024-03-28 23:48:00.837661+00:00, run_end_date=2024-03-28 23:48:02.769814+00:00, run_duration=1.932153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:47:00+00:00, data_interval_end=2024-03-28 23:48:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:48:02.797618938Z [2024-03-28T23:48:02.797+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:48:00+00:00, run_after=2024-03-28T23:49:00+00:00 2024-03-28T23:48:02.857771146Z [2024-03-28T23:48:02.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:46:00+00:00 exited with status success for try_number 1 2024-03-28T23:48:02.858239238Z [2024-03-28T23:48:02.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:47:00+00:00 exited with status success for try_number 1 2024-03-28T23:48:02.870906993Z [2024-03-28T23:48:02.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:46:00+00:00, map_index=-1, run_start_date=2024-03-28 23:48:01.794040+00:00, run_end_date=2024-03-28 23:48:02.185085+00:00, run_duration=0.391045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:48:00.906370+00:00, queued_by_job_id=2, pid=1165 2024-03-28T23:48:02.871613724Z [2024-03-28T23:48:02.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:47:00+00:00, map_index=-1, run_start_date=2024-03-28 23:48:01.982263+00:00, run_end_date=2024-03-28 23:48:02.543726+00:00, run_duration=0.561463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:48:00.906370+00:00, queued_by_job_id=2, pid=1166 2024-03-28T23:48:05.048283754Z [2024-03-28T23:48:05.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:48:05.048870320Z [2024-03-28T23:48:05.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:47:00+00:00, run_id=scheduled__2024-03-28T23:47:00+00:00, run_start_date=2024-03-28 23:48:00.836569+00:00, run_end_date=2024-03-28 23:48:05.048239+00:00, run_duration=4.21167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:47:00+00:00, data_interval_end=2024-03-28 23:48:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:48:05.063534519Z [2024-03-28T23:48:05.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:48:00+00:00, run_after=2024-03-28T23:49:00+00:00 2024-03-28T23:48:05.072654280Z [2024-03-28T23:48:05.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:48:05.073028017Z [2024-03-28T23:48:05.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:47:00+00:00, run_id=scheduled__2024-03-28T23:47:00+00:00, run_start_date=2024-03-28 23:48:00.839122+00:00, run_end_date=2024-03-28 23:48:05.072556+00:00, run_duration=4.233434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:47:00+00:00, data_interval_end=2024-03-28 23:48:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:48:05.084866967Z [2024-03-28T23:48:05.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:48:00+00:00, run_after=2024-03-28T23:49:00+00:00 2024-03-28T23:48:05.174554089Z [2024-03-28T23:48:05.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:47:00+00:00 exited with status success for try_number 1 2024-03-28T23:48:05.185171203Z [2024-03-28T23:48:05.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:47:00+00:00, map_index=-1, run_start_date=2024-03-28 23:48:03.339717+00:00, run_end_date=2024-03-28 23:48:04.581020+00:00, run_duration=1.241303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:48:00.906370+00:00, queued_by_job_id=2, pid=1190 2024-03-28T23:48:05.501818933Z [2024-03-28T23:48:05.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:47:00+00:00 exited with status success for try_number 1 2024-03-28T23:48:05.508340839Z [2024-03-28T23:48:05.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:47:00+00:00, map_index=-1, run_start_date=2024-03-28 23:48:03.296025+00:00, run_end_date=2024-03-28 23:48:04.938007+00:00, run_duration=1.641982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:48:00.906370+00:00, queued_by_job_id=2, pid=1189 2024-03-28T23:48:43.988689055Z [2024-03-28T23:48:43.988+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-28T23:49:00.618338645Z [2024-03-28T23:49:00.617+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:00.626213555Z [2024-03-28T23:49:00.625+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:49:00.640450869Z [2024-03-28T23:49:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:00.713761212Z [2024-03-28T23:49:00.713+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:49:00.713827457Z 2024-03-28T23:49:00.713845641Z 2024-03-28T23:49:00.713859636Z 2024-03-28T23:49:00.713873762Z [2024-03-28T23:49:00.713+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:49:00.713928728Z [2024-03-28T23:49:00.713+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:49:00.714114146Z [2024-03-28T23:49:00.713+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:49:00.715023640Z [2024-03-28T23:49:00.714+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:49:00.715040845Z 2024-03-28T23:49:00.715045570Z 2024-03-28T23:49:00.715049421Z 2024-03-28T23:49:00.718873024Z [2024-03-28T23:49:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:49:00.719134388Z [2024-03-28T23:49:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:49:00.719656409Z [2024-03-28T23:49:00.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:49:00.719685905Z [2024-03-28T23:49:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:49:00.720111993Z [2024-03-28T23:49:00.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:49:00.720151823Z [2024-03-28T23:49:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:49:01.006236313Z [2024-03-28T23:49:01.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:01.006395108Z [2024-03-28T23:49:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:01.006518840Z [2024-03-28T23:49:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:01.017536166Z [2024-03-28T23:49:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5c4375c-570c-45c0-bc53-ec8353e2d59c 2024-03-28T23:49:01.017832087Z [2024-03-28T23:49:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to d187c84a-832d-4c89-9163-835f301ade32 2024-03-28T23:49:01.018145242Z [2024-03-28T23:49:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9b92305-1b3a-494a-a0ce-c21516b00cda 2024-03-28T23:49:02.170125487Z [2024-03-28T23:49:02.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:49:02.170671491Z [2024-03-28T23:49:02.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:48:00+00:00, run_id=scheduled__2024-03-28T23:48:00+00:00, run_start_date=2024-03-28 23:49:00.651544+00:00, run_end_date=2024-03-28 23:49:02.170001+00:00, run_duration=1.518457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:48:00+00:00, data_interval_end=2024-03-28 23:49:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:49:02.181204588Z [2024-03-28T23:49:02.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:02.233366815Z [2024-03-28T23:49:02.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:02.242504296Z [2024-03-28T23:49:02.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:48:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:01.543923+00:00, run_end_date=2024-03-28 23:49:02.006532+00:00, run_duration=0.462609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:00.715957+00:00, queued_by_job_id=2, pid=1222 2024-03-28T23:49:04.714648682Z [2024-03-28T23:49:04.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:49:04.714686915Z [2024-03-28T23:49:04.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:48:00+00:00, run_id=scheduled__2024-03-28T23:48:00+00:00, run_start_date=2024-03-28 23:49:00.653442+00:00, run_end_date=2024-03-28 23:49:04.711465+00:00, run_duration=4.058023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:48:00+00:00, data_interval_end=2024-03-28 23:49:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:49:04.722352075Z [2024-03-28T23:49:04.721+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:04.729668962Z [2024-03-28T23:49:04.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:49:04.729892407Z [2024-03-28T23:49:04.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:48:00+00:00, run_id=scheduled__2024-03-28T23:48:00+00:00, run_start_date=2024-03-28 23:49:00.655070+00:00, run_end_date=2024-03-28 23:49:04.729541+00:00, run_duration=4.074471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:48:00+00:00, data_interval_end=2024-03-28 23:49:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:49:04.740847210Z [2024-03-28T23:49:04.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:04.771289151Z [2024-03-28T23:49:04.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:04.771398717Z [2024-03-28T23:49:04.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:04.780941503Z [2024-03-28T23:49:04.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:48:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:02.911385+00:00, run_end_date=2024-03-28 23:49:04.219897+00:00, run_duration=1.308512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:00.715957+00:00, queued_by_job_id=2, pid=1241 2024-03-28T23:49:04.781097924Z [2024-03-28T23:49:04.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:48:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:02.769475+00:00, run_end_date=2024-03-28 23:49:04.380110+00:00, run_duration=1.610635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:00.715957+00:00, queued_by_job_id=2, pid=1240 2024-03-28T23:49:20.732561848Z [2024-03-28T23:49:20.732+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:49:20.774156087Z [2024-03-28T23:49:20.773+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:49:20.774177966Z 2024-03-28T23:49:20.774212371Z [2024-03-28T23:49:20.774+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:49:20.774915049Z [2024-03-28T23:49:20.774+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:49:20.774929365Z 2024-03-28T23:49:20.777620939Z [2024-03-28T23:49:20.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:49:20.777765295Z [2024-03-28T23:49:20.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:49:20.837124029Z [2024-03-28T23:49:20.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:20.844232647Z [2024-03-28T23:49:20.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2573e56-a9e0-4be9-9bc8-7acf4fc57bde 2024-03-28T23:49:21.967493522Z [2024-03-28T23:49:21.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:22.022208945Z [2024-03-28T23:49:22.021+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:49:22.022249774Z 2024-03-28T23:49:22.022259698Z [2024-03-28T23:49:22.022+0000] {scheduler_job.py:425} INFO - DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:49:22.022902433Z [2024-03-28T23:49:22.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:49:22.022915186Z 2024-03-28T23:49:22.025101189Z [2024-03-28T23:49:22.024+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:49:22.025146636Z [2024-03-28T23:49:22.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:49:22.102812870Z [2024-03-28T23:49:22.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:22.110032201Z [2024-03-28T23:49:22.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd79e5c6-ce8d-4b5b-b04b-f64a70f456c4 2024-03-28T23:49:23.257827339Z [2024-03-28T23:49:23.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:23.312745888Z [2024-03-28T23:49:23.312+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:49:23.312823804Z 2024-03-28T23:49:23.312917409Z [2024-03-28T23:49:23.312+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:49:23.313561970Z [2024-03-28T23:49:23.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:49:23.313573032Z 2024-03-28T23:49:23.315824909Z [2024-03-28T23:49:23.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:49:23.315969814Z [2024-03-28T23:49:23.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:49:23.370758989Z [2024-03-28T23:49:23.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:23.376309466Z [2024-03-28T23:49:23.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b1f2636-6c7b-4ca0-a5bc-3040ee39f8cf 2024-03-28T23:49:24.974575592Z [2024-03-28T23:49:24.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:49:24.974913360Z [2024-03-28T23:49:24.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:48:00+00:00, run_id=scheduled__2024-03-28T23:48:00+00:00, run_start_date=2024-03-28 23:49:20.743918+00:00, run_end_date=2024-03-28 23:49:24.974458+00:00, run_duration=4.23054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:48:00+00:00, data_interval_end=2024-03-28 23:49:00+00:00, dag_hash=c6fee73e84157f9183c68eef86f1b9ab 2024-03-28T23:49:24.984456286Z [2024-03-28T23:49:24.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:25.049866549Z [2024-03-28T23:49:25.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:25.059654626Z [2024-03-28T23:49:25.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:48:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:22.456510+00:00, run_end_date=2024-03-28 23:49:23.980911+00:00, run_duration=1.524401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:20.775249+00:00, queued_by_job_id=2, pid=1273 2024-03-28T23:49:26.106302994Z [2024-03-28T23:49:26.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:49:26.106641199Z [2024-03-28T23:49:26.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:48:00+00:00, run_id=scheduled__2024-03-28T23:48:00+00:00, run_start_date=2024-03-28 23:49:21.979084+00:00, run_end_date=2024-03-28 23:49:26.106149+00:00, run_duration=4.127065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:48:00+00:00, data_interval_end=2024-03-28 23:49:00+00:00, dag_hash=ac2ae3aa1e8659c3e61bee4dce7d42fb 2024-03-28T23:49:26.121122595Z [2024-03-28T23:49:26.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:49:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:26.150246107Z [2024-03-28T23:49:26.149+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:49:26.150324580Z 2024-03-28T23:49:26.150345591Z [2024-03-28T23:49:26.150+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:49:26.151008068Z [2024-03-28T23:49:26.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:49:26.151026265Z 2024-03-28T23:49:26.153055003Z [2024-03-28T23:49:26.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='split_metrics', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:49:26.153198386Z [2024-03-28T23:49:26.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'split_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:49:26.197724269Z [2024-03-28T23:49:26.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.split_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:26.198121707Z [2024-03-28T23:49:26.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:26.198398691Z [2024-03-28T23:49:26.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:26.211211541Z [2024-03-28T23:49:26.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:48:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:23.809167+00:00, run_end_date=2024-03-28 23:49:25.094859+00:00, run_duration=1.285692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:22.023213+00:00, queued_by_job_id=2, pid=1286 2024-03-28T23:49:26.211687852Z [2024-03-28T23:49:26.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee422bbe-1817-4eb2-a7ca-ee09bfa31ef9 2024-03-28T23:49:26.212039007Z [2024-03-28T23:49:26.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:24.991605+00:00, run_end_date=2024-03-28 23:49:25.344889+00:00, run_duration=0.353284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:23.314081+00:00, queued_by_job_id=2, pid=1298 2024-03-28T23:49:28.470573528Z [2024-03-28T23:49:28.470+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:49:28.470619787Z 2024-03-28T23:49:28.470629899Z [2024-03-28T23:49:28.470+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:49:28.471256167Z [2024-03-28T23:49:28.470+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:49:28.471304773Z 2024-03-28T23:49:28.473863207Z [2024-03-28T23:49:28.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:49:28.474195904Z [2024-03-28T23:49:28.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'collect_metrics', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:49:28.517805222Z [2024-03-28T23:49:28.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.collect_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:28.517830688Z [2024-03-28T23:49:28.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.split_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:28.524245950Z [2024-03-28T23:49:28.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01d2fe03-271a-4fba-80c3-cc6884668614 2024-03-28T23:49:28.524553024Z [2024-03-28T23:49:28.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=split_metrics, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:27.785252+00:00, run_end_date=2024-03-28 23:49:28.120586+00:00, run_duration=0.335334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:26.151324+00:00, queued_by_job_id=2, pid=1311 2024-03-28T23:49:31.141107408Z [2024-03-28T23:49:31.140+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:49:31.141151199Z 2024-03-28T23:49:31.141174077Z [2024-03-28T23:49:31.140+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:49:31.141767450Z [2024-03-28T23:49:31.141+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:49:31.141784407Z 2024-03-28T23:49:31.143992739Z [2024-03-28T23:49:31.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:49:31.144126208Z [2024-03-28T23:49:31.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'send_prometheus', 'scheduled__2024-03-28T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:49:31.200627194Z [2024-03-28T23:49:31.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.send_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status queued for try_number 1 2024-03-28T23:49:31.200816589Z [2024-03-28T23:49:31.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.collect_metrics run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:31.207556483Z [2024-03-28T23:49:31.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=0, run_start_date=2024-03-28 23:49:30.086996+00:00, run_end_date=2024-03-28 23:49:30.385133+00:00, run_duration=0.298137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:28.471584+00:00, queued_by_job_id=2, pid=1319 2024-03-28T23:49:31.207831230Z [2024-03-28T23:49:31.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa6ca376-f03d-4577-918c-d98c804fb08f 2024-03-28T23:49:33.430096097Z [2024-03-28T23:49:33.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:49:33.430230836Z [2024-03-28T23:49:33.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:40:00+00:00, run_id=scheduled__2024-03-28T23:40:00+00:00, run_start_date=2024-03-28 23:49:23.267022+00:00, run_end_date=2024-03-28 23:49:33.429920+00:00, run_duration=10.162898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:40:00+00:00, data_interval_end=2024-03-28 23:45:00+00:00, dag_hash=a330ae98676eb1dcaf25a6fd347f75b4 2024-03-28T23:49:33.437198862Z [2024-03-28T23:49:33.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:45:00+00:00, run_after=2024-03-28T23:50:00+00:00 2024-03-28T23:49:33.469242097Z [2024-03-28T23:49:33.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.send_prometheus run_id=scheduled__2024-03-28T23:40:00+00:00 exited with status success for try_number 1 2024-03-28T23:49:33.475627627Z [2024-03-28T23:49:33.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:40:00+00:00, map_index=-1, run_start_date=2024-03-28 23:49:32.934667+00:00, run_end_date=2024-03-28 23:49:33.238340+00:00, run_duration=0.303673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:49:31.142017+00:00, queued_by_job_id=2, pid=1327 2024-03-28T23:50:00.392591237Z [2024-03-28T23:50:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:00.403244936Z [2024-03-28T23:50:00.402+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:50:00.418013320Z [2024-03-28T23:50:00.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:00.430398914Z [2024-03-28T23:50:00.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:50:00.437372599Z [2024-03-28T23:50:00.437+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:50:00.445230746Z [2024-03-28T23:50:00.444+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:50:00.463209426Z [2024-03-28T23:50:00.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:00.478054578Z [2024-03-28T23:50:00.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:50:00.637890833Z [2024-03-28T23:50:00.637+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-03-28T23:50:00.637922561Z 2024-03-28T23:50:00.637927655Z 2024-03-28T23:50:00.637932131Z 2024-03-28T23:50:00.637937906Z 2024-03-28T23:50:00.637942824Z 2024-03-28T23:50:00.637947232Z 2024-03-28T23:50:00.637967335Z 2024-03-28T23:50:00.637972003Z 2024-03-28T23:50:00.638369278Z [2024-03-28T23:50:00.638+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:50:00.638751149Z [2024-03-28T23:50:00.638+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:50:00.639036343Z [2024-03-28T23:50:00.638+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:50:00.639269851Z [2024-03-28T23:50:00.639+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:50:00.639578854Z [2024-03-28T23:50:00.639+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:50:00.640027391Z [2024-03-28T23:50:00.639+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:50:00.640289610Z [2024-03-28T23:50:00.640+0000] {scheduler_job.py:425} INFO - DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:50:00.640484213Z [2024-03-28T23:50:00.640+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:50:00.641443396Z [2024-03-28T23:50:00.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:50:00.641454555Z 2024-03-28T23:50:00.641458913Z 2024-03-28T23:50:00.641463780Z 2024-03-28T23:50:00.641468287Z 2024-03-28T23:50:00.641472659Z 2024-03-28T23:50:00.641495350Z 2024-03-28T23:50:00.641500246Z 2024-03-28T23:50:00.641504287Z 2024-03-28T23:50:00.648912649Z [2024-03-28T23:50:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:50:00.649146693Z [2024-03-28T23:50:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:00.649533384Z [2024-03-28T23:50:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:50:00.649769127Z [2024-03-28T23:50:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:00.650242814Z [2024-03-28T23:50:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:00.650540959Z [2024-03-28T23:50:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:50:00.650962058Z [2024-03-28T23:50:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:00.651155090Z [2024-03-28T23:50:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:50:00.651581055Z [2024-03-28T23:50:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:00.651878831Z [2024-03-28T23:50:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:50:00.652241893Z [2024-03-28T23:50:00.652+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:00.652423659Z [2024-03-28T23:50:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:50:00.652747289Z [2024-03-28T23:50:00.652+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:00.652959932Z [2024-03-28T23:50:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:50:00.653343215Z [2024-03-28T23:50:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:00.653584498Z [2024-03-28T23:50:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:50:01.605837911Z [2024-03-28T23:50:01.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.608176692Z [2024-03-28T23:50:01.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.608556829Z [2024-03-28T23:50:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.608872947Z [2024-03-28T23:50:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.609224381Z [2024-03-28T23:50:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.609548219Z [2024-03-28T23:50:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.609775823Z [2024-03-28T23:50:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.610021882Z [2024-03-28T23:50:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:01.633004559Z [2024-03-28T23:50:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a43d77a-c63e-412f-b117-99192e804ff2 2024-03-28T23:50:01.633706667Z [2024-03-28T23:50:01.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 156dc060-528b-4148-884d-6fe1c9c14a64 2024-03-28T23:50:01.634097684Z [2024-03-28T23:50:01.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe857f23-4e28-4bb1-aeae-6f5dbe1f135d 2024-03-28T23:50:01.634521854Z [2024-03-28T23:50:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac0545d5-3a2e-4e88-a5a4-956310da7710 2024-03-28T23:50:01.634939171Z [2024-03-28T23:50:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebc04907-df65-47a9-9761-014b10b6586c 2024-03-28T23:50:01.635555709Z [2024-03-28T23:50:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ef3fbb8-e909-4cfb-af73-0ca7b4dc8aa2 2024-03-28T23:50:01.636505276Z [2024-03-28T23:50:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to db2de972-436c-4afa-adf6-3a3778776194 2024-03-28T23:50:01.636923555Z [2024-03-28T23:50:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to dad977a2-d728-4e62-88b4-20bdbbf1bb2d 2024-03-28T23:50:04.436724806Z [2024-03-28T23:50:04.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:04.437209055Z [2024-03-28T23:50:04.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:48:00+00:00, run_id=scheduled__2024-03-28T23:48:00+00:00, run_start_date=2024-03-28 23:50:00.492721+00:00, run_end_date=2024-03-28 23:50:04.436608+00:00, run_duration=3.943887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:48:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:50:04.451254014Z [2024-03-28T23:50:04.450+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:50:04.620761586Z [2024-03-28T23:50:04.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:48:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:04.630489963Z [2024-03-28T23:50:04.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:48:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:02.929296+00:00, run_end_date=2024-03-28 23:50:03.765968+00:00, run_duration=0.836672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1342 2024-03-28T23:50:05.774071095Z [2024-03-28T23:50:05.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:05.777843177Z [2024-03-28T23:50:05.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:49:00+00:00, run_id=scheduled__2024-03-28T23:49:00+00:00, run_start_date=2024-03-28 23:50:00.494894+00:00, run_end_date=2024-03-28 23:50:05.777288+00:00, run_duration=5.282394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:49:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:50:05.808925003Z [2024-03-28T23:50:05.808+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:06.102199598Z [2024-03-28T23:50:06.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:06.114112148Z [2024-03-28T23:50:06.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:49:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:03.581165+00:00, run_end_date=2024-03-28 23:50:04.428535+00:00, run_duration=0.84737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1351 2024-03-28T23:50:07.202199571Z [2024-03-28T23:50:07.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:07.202369163Z [2024-03-28T23:50:07.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:49:00+00:00, run_id=scheduled__2024-03-28T23:49:00+00:00, run_start_date=2024-03-28 23:50:00.493809+00:00, run_end_date=2024-03-28 23:50:07.202110+00:00, run_duration=6.708301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:49:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:50:07.229390340Z [2024-03-28T23:50:07.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:07.491213991Z [2024-03-28T23:50:07.490+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-28T23:50:07.491239592Z 2024-03-28T23:50:07.491245269Z 2024-03-28T23:50:07.491302117Z [2024-03-28T23:50:07.491+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:50:07.491388727Z [2024-03-28T23:50:07.491+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:50:07.492104506Z [2024-03-28T23:50:07.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:50:07.492120484Z 2024-03-28T23:50:07.492125785Z 2024-03-28T23:50:07.495214558Z [2024-03-28T23:50:07.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:50:07.495302621Z [2024-03-28T23:50:07.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:07.495499980Z [2024-03-28T23:50:07.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='split_metrics', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:50:07.495557419Z [2024-03-28T23:50:07.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'split_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:07.859189257Z [2024-03-28T23:50:07.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:07.859214868Z [2024-03-28T23:50:07.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.split_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:07.859219236Z [2024-03-28T23:50:07.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:07.859284195Z [2024-03-28T23:50:07.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:07.859288224Z [2024-03-28T23:50:07.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:07.887885243Z [2024-03-28T23:50:07.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:49:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:04.148684+00:00, run_end_date=2024-03-28 23:50:06.932348+00:00, run_duration=2.783664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1358 2024-03-28T23:50:07.888439459Z [2024-03-28T23:50:07.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to f18e9620-c9d1-4824-aca7-a17d97545023 2024-03-28T23:50:07.888692651Z [2024-03-28T23:50:07.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:05.717295+00:00, run_end_date=2024-03-28 23:50:06.855739+00:00, run_duration=1.138444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1394 2024-03-28T23:50:07.888960138Z [2024-03-28T23:50:07.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53f869e8-844b-441a-ad92-e2a90edfedab 2024-03-28T23:50:07.889217659Z [2024-03-28T23:50:07.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:05.938141+00:00, run_end_date=2024-03-28 23:50:06.833215+00:00, run_duration=0.895074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1391 2024-03-28T23:50:09.296167594Z [2024-03-28T23:50:09.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:09.296653127Z [2024-03-28T23:50:09.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:49:00+00:00, run_id=scheduled__2024-03-28T23:49:00+00:00, run_start_date=2024-03-28 23:50:00.497254+00:00, run_end_date=2024-03-28 23:50:09.296194+00:00, run_duration=8.79894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:49:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=ac2ae3aa1e8659c3e61bee4dce7d42fb 2024-03-28T23:50:09.309337811Z [2024-03-28T23:50:09.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:09.318176455Z [2024-03-28T23:50:09.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:09.318483296Z [2024-03-28T23:50:09.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:49:00+00:00, run_id=scheduled__2024-03-28T23:49:00+00:00, run_start_date=2024-03-28 23:50:00.498448+00:00, run_end_date=2024-03-28 23:50:09.318157+00:00, run_duration=8.819709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:49:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=c6fee73e84157f9183c68eef86f1b9ab 2024-03-28T23:50:09.328709520Z [2024-03-28T23:50:09.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:09.419390745Z [2024-03-28T23:50:09.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:09.419553336Z [2024-03-28T23:50:09.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:09.427307524Z [2024-03-28T23:50:09.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:49:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:06.090900+00:00, run_end_date=2024-03-28 23:50:08.655286+00:00, run_duration=2.564386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1398 2024-03-28T23:50:09.427703741Z [2024-03-28T23:50:09.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:49:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:05.016575+00:00, run_end_date=2024-03-28 23:50:08.723880+00:00, run_duration=3.707305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1374 2024-03-28T23:50:09.726979120Z [2024-03-28T23:50:09.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:09.727566811Z [2024-03-28T23:50:09.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:49:00+00:00, run_id=scheduled__2024-03-28T23:49:00+00:00, run_start_date=2024-03-28 23:50:00.496109+00:00, run_end_date=2024-03-28 23:50:09.726976+00:00, run_duration=9.230867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:49:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:50:09.742564017Z [2024-03-28T23:50:09.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:51:00+00:00 2024-03-28T23:50:09.824982939Z [2024-03-28T23:50:09.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:49:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:09.834055665Z [2024-03-28T23:50:09.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:49:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:07.534349+00:00, run_end_date=2024-03-28 23:50:09.564103+00:00, run_duration=2.029754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:00.643987+00:00, queued_by_job_id=2, pid=1419 2024-03-28T23:50:10.958070156Z [2024-03-28T23:50:10.957+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-28T23:50:10.958108228Z 2024-03-28T23:50:10.958114118Z 2024-03-28T23:50:10.958181208Z [2024-03-28T23:50:10.957+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:50:10.958373706Z [2024-03-28T23:50:10.958+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:50:10.959276065Z [2024-03-28T23:50:10.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:50:10.959294104Z 2024-03-28T23:50:10.959297637Z 2024-03-28T23:50:10.964583511Z [2024-03-28T23:50:10.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:50:10.964684375Z [2024-03-28T23:50:10.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:50:10.964968353Z [2024-03-28T23:50:10.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:50:10.965120801Z [2024-03-28T23:50:10.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'collect_metrics', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:50:11.151976589Z [2024-03-28T23:50:11.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:11.152618446Z [2024-03-28T23:50:11.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.collect_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:11.153108441Z [2024-03-28T23:50:11.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:11.153435407Z [2024-03-28T23:50:11.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.split_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:11.164516913Z [2024-03-28T23:50:11.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=split_metrics, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:10.105141+00:00, run_end_date=2024-03-28 23:50:10.550699+00:00, run_duration=0.445558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:07.492677+00:00, queued_by_job_id=2, pid=1440 2024-03-28T23:50:11.165140173Z [2024-03-28T23:50:11.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:10.088833+00:00, run_end_date=2024-03-28 23:50:10.445627+00:00, run_duration=0.356794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:07.492677+00:00, queued_by_job_id=2, pid=1439 2024-03-28T23:50:11.165639017Z [2024-03-28T23:50:11.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d36340d-e9a4-41bf-ae1b-c40cf299fc04 2024-03-28T23:50:11.166035888Z [2024-03-28T23:50:11.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4768873c-d50a-46a4-b557-ac8ac675a6ae 2024-03-28T23:50:13.484910653Z [2024-03-28T23:50:13.484+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-28T23:50:13.484960304Z 2024-03-28T23:50:13.484966710Z 2024-03-28T23:50:13.485384513Z [2024-03-28T23:50:13.485+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:50:13.485719659Z [2024-03-28T23:50:13.485+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:50:13.486936837Z [2024-03-28T23:50:13.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:50:13.486958929Z 2024-03-28T23:50:13.486964457Z 2024-03-28T23:50:13.492651202Z [2024-03-28T23:50:13.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:13.492958492Z [2024-03-28T23:50:13.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:13.493470162Z [2024-03-28T23:50:13.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:50:13.493744844Z [2024-03-28T23:50:13.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'send_prometheus', 'scheduled__2024-03-28T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:50:13.727062182Z [2024-03-28T23:50:13.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:13.727662800Z [2024-03-28T23:50:13.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.send_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status queued for try_number 1 2024-03-28T23:50:13.728059326Z [2024-03-28T23:50:13.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:13.728395968Z [2024-03-28T23:50:13.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.collect_metrics run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:13.746800553Z [2024-03-28T23:50:13.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=0, run_start_date=2024-03-28 23:50:12.682803+00:00, run_end_date=2024-03-28 23:50:13.025740+00:00, run_duration=0.342937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:10.960581+00:00, queued_by_job_id=2, pid=1455 2024-03-28T23:50:13.747253105Z [2024-03-28T23:50:13.746+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2553dd5c-0d3c-47ab-bb46-96c03b563069 2024-03-28T23:50:13.747546740Z [2024-03-28T23:50:13.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31f1fb0b-455f-4781-922c-4358b17b63db 2024-03-28T23:50:13.747930305Z [2024-03-28T23:50:13.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=0, run_start_date=2024-03-28 23:50:12.718759+00:00, run_end_date=2024-03-28 23:50:13.071987+00:00, run_duration=0.353228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:10.960581+00:00, queued_by_job_id=2, pid=1456 2024-03-28T23:50:16.006239998Z [2024-03-28T23:50:16.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:16.006595942Z [2024-03-28T23:50:16.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:45:00+00:00, run_id=scheduled__2024-03-28T23:45:00+00:00, run_start_date=2024-03-28 23:50:00.490156+00:00, run_end_date=2024-03-28 23:50:16.006134+00:00, run_duration=15.515978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:45:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-28T23:50:16.012682998Z [2024-03-28T23:50:16.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:50:16.019112310Z [2024-03-28T23:50:16.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:50:16.019436698Z [2024-03-28T23:50:16.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:45:00+00:00, run_id=scheduled__2024-03-28T23:45:00+00:00, run_start_date=2024-03-28 23:50:00.491551+00:00, run_end_date=2024-03-28 23:50:16.019039+00:00, run_duration=15.527488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:45:00+00:00, data_interval_end=2024-03-28 23:50:00+00:00, dag_hash=a330ae98676eb1dcaf25a6fd347f75b4 2024-03-28T23:50:16.025794945Z [2024-03-28T23:50:16.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:50:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:50:16.054052015Z [2024-03-28T23:50:16.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:16.054087306Z [2024-03-28T23:50:16.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.send_prometheus run_id=scheduled__2024-03-28T23:45:00+00:00 exited with status success for try_number 1 2024-03-28T23:50:16.061139296Z [2024-03-28T23:50:16.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:15.366693+00:00, run_end_date=2024-03-28 23:50:15.777972+00:00, run_duration=0.411279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:13.488157+00:00, queued_by_job_id=2, pid=1472 2024-03-28T23:50:16.061284661Z [2024-03-28T23:50:16.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:45:00+00:00, map_index=-1, run_start_date=2024-03-28 23:50:15.356313+00:00, run_end_date=2024-03-28 23:50:15.692646+00:00, run_duration=0.336333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:50:13.488157+00:00, queued_by_job_id=2, pid=1471 2024-03-28T23:51:00.516240114Z [2024-03-28T23:51:00.515+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:51:00.524093749Z [2024-03-28T23:51:00.523+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:51:00.537712778Z [2024-03-28T23:51:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:00.551225891Z [2024-03-28T23:51:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:00.563643906Z [2024-03-28T23:51:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:00.638174790Z [2024-03-28T23:51:00.637+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-28T23:51:00.638206756Z 2024-03-28T23:51:00.638212877Z 2024-03-28T23:51:00.638217933Z 2024-03-28T23:51:00.638222992Z 2024-03-28T23:51:00.638228158Z 2024-03-28T23:51:00.638252390Z [2024-03-28T23:51:00.637+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:51:00.638408773Z [2024-03-28T23:51:00.638+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:51:00.638660484Z [2024-03-28T23:51:00.638+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:51:00.638851491Z [2024-03-28T23:51:00.638+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:51:00.639043514Z [2024-03-28T23:51:00.638+0000] {scheduler_job.py:425} INFO - DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:51:00.639735361Z [2024-03-28T23:51:00.639+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:51:00.639746811Z 2024-03-28T23:51:00.639750275Z 2024-03-28T23:51:00.639786845Z 2024-03-28T23:51:00.639790755Z 2024-03-28T23:51:00.639793840Z 2024-03-28T23:51:00.643370114Z [2024-03-28T23:51:00.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:51:00.643697622Z [2024-03-28T23:51:00.643+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:51:00.643991038Z [2024-03-28T23:51:00.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:51:00.644232696Z [2024-03-28T23:51:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:51:00.644532488Z [2024-03-28T23:51:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:51:00.644743239Z [2024-03-28T23:51:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:51:00.645040692Z [2024-03-28T23:51:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:51:00.645280020Z [2024-03-28T23:51:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:51:00.645550485Z [2024-03-28T23:51:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:51:00.645737321Z [2024-03-28T23:51:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:51:01.237781552Z [2024-03-28T23:51:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:51:01.237819425Z [2024-03-28T23:51:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:51:01.238120090Z [2024-03-28T23:51:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:51:01.238292542Z [2024-03-28T23:51:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:51:01.238394872Z [2024-03-28T23:51:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:51:01.258411171Z [2024-03-28T23:51:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to b96d1773-3595-4ecc-8d8d-fd0b512cc781 2024-03-28T23:51:01.258506290Z [2024-03-28T23:51:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbd65e16-2b71-482e-b5a5-5e245c786f1b 2024-03-28T23:51:01.258697132Z [2024-03-28T23:51:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40da82d5-71ae-4ff7-a3cb-831672182ea9 2024-03-28T23:51:01.258876087Z [2024-03-28T23:51:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b6a3436-b159-4271-baef-fe44f6dcff48 2024-03-28T23:51:01.259042956Z [2024-03-28T23:51:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2424f48-c247-468a-a655-1919eff267e4 2024-03-28T23:51:02.800254762Z [2024-03-28T23:51:02.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:51:02.801192059Z [2024-03-28T23:51:02.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:50:00+00:00, run_id=scheduled__2024-03-28T23:50:00+00:00, run_start_date=2024-03-28 23:51:00.576204+00:00, run_end_date=2024-03-28 23:51:02.800205+00:00, run_duration=2.224001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:50:00+00:00, data_interval_end=2024-03-28 23:51:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:51:02.829018401Z [2024-03-28T23:51:02.828+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:02.996484604Z [2024-03-28T23:51:02.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:51:03.010819805Z [2024-03-28T23:51:03.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:51:02.131739+00:00, run_end_date=2024-03-28 23:51:02.742110+00:00, run_duration=0.610371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:51:00.640809+00:00, queued_by_job_id=2, pid=1499 2024-03-28T23:51:05.406195650Z [2024-03-28T23:51:05.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:51:05.406475929Z [2024-03-28T23:51:05.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:50:00+00:00, run_id=scheduled__2024-03-28T23:50:00+00:00, run_start_date=2024-03-28 23:51:00.572984+00:00, run_end_date=2024-03-28 23:51:05.406036+00:00, run_duration=4.833052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:50:00+00:00, data_interval_end=2024-03-28 23:51:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:51:05.416987848Z [2024-03-28T23:51:05.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:05.426482222Z [2024-03-28T23:51:05.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:51:05.426789805Z [2024-03-28T23:51:05.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:50:00+00:00, run_id=scheduled__2024-03-28T23:50:00+00:00, run_start_date=2024-03-28 23:51:00.574101+00:00, run_end_date=2024-03-28 23:51:05.426356+00:00, run_duration=4.852255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:50:00+00:00, data_interval_end=2024-03-28 23:51:00+00:00, dag_hash=c6fee73e84157f9183c68eef86f1b9ab 2024-03-28T23:51:05.453358887Z [2024-03-28T23:51:05.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:05.468940144Z [2024-03-28T23:51:05.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:51:05.469221695Z [2024-03-28T23:51:05.468+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:50:00+00:00, run_id=scheduled__2024-03-28T23:50:00+00:00, run_start_date=2024-03-28 23:51:00.577298+00:00, run_end_date=2024-03-28 23:51:05.468827+00:00, run_duration=4.891529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:50:00+00:00, data_interval_end=2024-03-28 23:51:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:51:05.494521200Z [2024-03-28T23:51:05.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:05.507534607Z [2024-03-28T23:51:05.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:51:05.508149944Z [2024-03-28T23:51:05.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:50:00+00:00, run_id=scheduled__2024-03-28T23:50:00+00:00, run_start_date=2024-03-28 23:51:00.575106+00:00, run_end_date=2024-03-28 23:51:05.507687+00:00, run_duration=4.932581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:50:00+00:00, data_interval_end=2024-03-28 23:51:00+00:00, dag_hash=ac2ae3aa1e8659c3e61bee4dce7d42fb 2024-03-28T23:51:05.526915015Z [2024-03-28T23:51:05.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:51:00+00:00, run_after=2024-03-28T23:52:00+00:00 2024-03-28T23:51:05.564620476Z [2024-03-28T23:51:05.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:51:05.564973091Z [2024-03-28T23:51:05.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:51:05.565385279Z [2024-03-28T23:51:05.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:51:05.565728799Z [2024-03-28T23:51:05.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:51:05.573990893Z [2024-03-28T23:51:05.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:51:03.116066+00:00, run_end_date=2024-03-28 23:51:04.905842+00:00, run_duration=1.789776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:51:00.640809+00:00, queued_by_job_id=2, pid=1517 2024-03-28T23:51:05.574330769Z [2024-03-28T23:51:05.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:51:03.097682+00:00, run_end_date=2024-03-28 23:51:04.856886+00:00, run_duration=1.759204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:51:00.640809+00:00, queued_by_job_id=2, pid=1516 2024-03-28T23:51:05.574640597Z [2024-03-28T23:51:05.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:51:03.563500+00:00, run_end_date=2024-03-28 23:51:05.052472+00:00, run_duration=1.488972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:51:00.640809+00:00, queued_by_job_id=2, pid=1539 2024-03-28T23:51:05.574930390Z [2024-03-28T23:51:05.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:51:03.488887+00:00, run_end_date=2024-03-28 23:51:04.969182+00:00, run_duration=1.480295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:51:00.640809+00:00, queued_by_job_id=2, pid=1532 2024-03-28T23:52:01.049947990Z [2024-03-28T23:52:01.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:52:01.064425871Z [2024-03-28T23:52:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:52:01.071880329Z [2024-03-28T23:52:01.070+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:52:01.081995688Z [2024-03-28T23:52:01.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:52:01.101306459Z [2024-03-28T23:52:01.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:52:01.118809762Z [2024-03-28T23:52:01.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:52:01.273378608Z [2024-03-28T23:52:01.272+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-03-28T23:52:01.273468007Z 2024-03-28T23:52:01.273522713Z 2024-03-28T23:52:01.273530829Z 2024-03-28T23:52:01.273538764Z 2024-03-28T23:52:01.273546162Z 2024-03-28T23:52:01.273553504Z 2024-03-28T23:52:01.273647384Z [2024-03-28T23:52:01.273+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:52:01.273722909Z [2024-03-28T23:52:01.273+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:52:01.273858828Z [2024-03-28T23:52:01.273+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:52:01.273993584Z [2024-03-28T23:52:01.273+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:52:01.274092451Z [2024-03-28T23:52:01.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:52:01.274302857Z [2024-03-28T23:52:01.274+0000] {scheduler_job.py:425} INFO - DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:52:01.275157176Z [2024-03-28T23:52:01.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:52:01.275172375Z 2024-03-28T23:52:01.275177134Z 2024-03-28T23:52:01.275180772Z 2024-03-28T23:52:01.275184265Z 2024-03-28T23:52:01.275187598Z 2024-03-28T23:52:01.275190940Z 2024-03-28T23:52:01.284124783Z [2024-03-28T23:52:01.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:01.284242773Z [2024-03-28T23:52:01.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:52:01.284626634Z [2024-03-28T23:52:01.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:01.284741699Z [2024-03-28T23:52:01.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:52:01.284974320Z [2024-03-28T23:52:01.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:01.285087985Z [2024-03-28T23:52:01.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:52:01.285337468Z [2024-03-28T23:52:01.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:01.285544217Z [2024-03-28T23:52:01.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:52:01.285856003Z [2024-03-28T23:52:01.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:01.285966597Z [2024-03-28T23:52:01.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:52:01.286245589Z [2024-03-28T23:52:01.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:01.286338749Z [2024-03-28T23:52:01.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:52:02.162621294Z [2024-03-28T23:52:02.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:52:02.162671749Z [2024-03-28T23:52:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status queued for try_number 1 2024-03-28T23:52:02.162684276Z [2024-03-28T23:52:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status queued for try_number 1 2024-03-28T23:52:02.162745603Z [2024-03-28T23:52:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status queued for try_number 1 2024-03-28T23:52:02.162833325Z [2024-03-28T23:52:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status queued for try_number 1 2024-03-28T23:52:02.162893184Z [2024-03-28T23:52:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status queued for try_number 1 2024-03-28T23:52:02.196941503Z [2024-03-28T23:52:02.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6eebaa38-a2b3-4c3e-8f18-93ad501e538c 2024-03-28T23:52:02.196999908Z [2024-03-28T23:52:02.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21eb7f7c-4131-495b-88fa-0e64786dce74 2024-03-28T23:52:02.197066517Z [2024-03-28T23:52:02.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cbef834-8b5d-4a6e-a653-c1498a33bb3d 2024-03-28T23:52:02.197213581Z [2024-03-28T23:52:02.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6ac678d-69e3-45b2-8d59-3914bc7d3c14 2024-03-28T23:52:02.197276074Z [2024-03-28T23:52:02.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffac7ba4-eab4-4f9b-9173-243f301521aa 2024-03-28T23:52:02.197404540Z [2024-03-28T23:52:02.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to be827057-a845-4e5e-8302-9f329befdd87 2024-03-28T23:52:03.651520459Z [2024-03-28T23:52:03.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:52:03.653616728Z [2024-03-28T23:52:03.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:50:00+00:00, run_id=scheduled__2024-03-28T23:50:00+00:00, run_start_date=2024-03-28 23:52:01.129239+00:00, run_end_date=2024-03-28 23:52:03.651398+00:00, run_duration=2.522159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:50:00+00:00, data_interval_end=2024-03-28 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:52:03.668813105Z [2024-03-28T23:52:03.668+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:54:00+00:00 2024-03-28T23:52:03.706952655Z [2024-03-28T23:52:03.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:52:03.710621656Z [2024-03-28T23:52:03.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:51:00+00:00, run_id=scheduled__2024-03-28T23:51:00+00:00, run_start_date=2024-03-28 23:52:01.131532+00:00, run_end_date=2024-03-28 23:52:03.706851+00:00, run_duration=2.575319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:51:00+00:00, data_interval_end=2024-03-28 23:52:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:52:03.727976990Z [2024-03-28T23:52:03.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:52:03.875747408Z [2024-03-28T23:52:03.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:52:03.875782542Z [2024-03-28T23:52:03.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status success for try_number 1 2024-03-28T23:52:03.889665863Z [2024-03-28T23:52:03.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:52:02.445063+00:00, run_end_date=2024-03-28 23:52:03.006766+00:00, run_duration=0.561703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:01.276689+00:00, queued_by_job_id=2, pid=1574 2024-03-28T23:52:03.890879147Z [2024-03-28T23:52:03.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:51:00+00:00, map_index=-1, run_start_date=2024-03-28 23:52:02.875119+00:00, run_end_date=2024-03-28 23:52:03.415253+00:00, run_duration=0.540134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:01.276689+00:00, queued_by_job_id=2, pid=1576 2024-03-28T23:52:04.779019600Z [2024-03-28T23:52:04.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status failed for try_number 1 2024-03-28T23:52:04.779351682Z [2024-03-28T23:52:04.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status failed for try_number 1 2024-03-28T23:52:04.793111655Z [2024-03-28T23:52:04.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:01.276689+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:52:04.794099141Z [2024-03-28T23:52:04.793+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:04.797436822Z [2024-03-28T23:52:04.796+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:04.818162877Z [2024-03-28T23:52:04.817+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240328T235100, start_date=, end_date=20240328T235204 2024-03-28T23:52:04.834167165Z [2024-03-28T23:52:04.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:01.276689+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:52:04.835128547Z [2024-03-28T23:52:04.834+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:04.837982062Z [2024-03-28T23:52:04.837+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:04.855598443Z [2024-03-28T23:52:04.855+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240328T235100, start_date=, end_date=20240328T235204 2024-03-28T23:52:05.913398812Z [2024-03-28T23:52:05.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:52:05.913940761Z [2024-03-28T23:52:05.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:51:00+00:00, run_id=scheduled__2024-03-28T23:51:00+00:00, run_start_date=2024-03-28 23:52:01.133482+00:00, run_end_date=2024-03-28 23:52:05.913529+00:00, run_duration=4.780047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:51:00+00:00, data_interval_end=2024-03-28 23:52:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:52:05.928043109Z [2024-03-28T23:52:05.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:52:06.610555415Z [2024-03-28T23:52:06.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status success for try_number 1 2024-03-28T23:52:06.616158018Z [2024-03-28T23:52:06.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:51:00+00:00, map_index=-1, run_start_date=2024-03-28 23:52:03.978325+00:00, run_end_date=2024-03-28 23:52:05.857493+00:00, run_duration=1.879168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:01.276689+00:00, queued_by_job_id=2, pid=1595 2024-03-28T23:52:08.471012264Z [2024-03-28T23:52:08.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:52:08.471611153Z [2024-03-28T23:52:08.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:51:00+00:00, run_id=scheduled__2024-03-28T23:51:00+00:00, run_start_date=2024-03-28 23:52:01.130472+00:00, run_end_date=2024-03-28 23:52:08.471035+00:00, run_duration=7.340563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:51:00+00:00, data_interval_end=2024-03-28 23:52:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:52:08.504119936Z [2024-03-28T23:52:08.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:52:08.565568759Z [2024-03-28T23:52:08.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status success for try_number 1 2024-03-28T23:52:08.577279024Z [2024-03-28T23:52:08.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:51:00+00:00, map_index=-1, run_start_date=2024-03-28 23:52:04.473185+00:00, run_end_date=2024-03-28 23:52:07.958353+00:00, run_duration=3.485168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:01.276689+00:00, queued_by_job_id=2, pid=1616 2024-03-28T23:52:14.939629898Z [2024-03-28T23:52:14.939+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-28T23:52:14.939664415Z 2024-03-28T23:52:14.939669685Z 2024-03-28T23:52:14.939864654Z [2024-03-28T23:52:14.939+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:52:14.940029785Z [2024-03-28T23:52:14.939+0000] {scheduler_job.py:425} INFO - DAG vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e has 0/16 running and queued tasks 2024-03-28T23:52:14.940677219Z [2024-03-28T23:52:14.940+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:52:14.940696554Z 2024-03-28T23:52:14.940701750Z 2024-03-28T23:52:14.943681246Z [2024-03-28T23:52:14.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:51:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:14.943901294Z [2024-03-28T23:52:14.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:52:14.944622669Z [2024-03-28T23:52:14.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:51:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:52:14.944827696Z [2024-03-28T23:52:14.944+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:52:15.115638165Z [2024-03-28T23:52:15.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status queued for try_number 2 2024-03-28T23:52:15.115791522Z [2024-03-28T23:52:15.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status queued for try_number 2 2024-03-28T23:52:15.125087262Z [2024-03-28T23:52:15.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6282931a-e66c-4c88-b710-8b1143e428ab 2024-03-28T23:52:15.125286713Z [2024-03-28T23:52:15.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to abd2229b-178c-4dc9-a67d-5919b52cd0d1 2024-03-28T23:52:17.412909822Z [2024-03-28T23:52:17.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status failed for try_number 2 2024-03-28T23:52:17.413010715Z [2024-03-28T23:52:17.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:51:00+00:00 exited with status failed for try_number 2 2024-03-28T23:52:17.423948400Z [2024-03-28T23:52:17.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-28 23:52:04.801384+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:14.941267+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:52:17.424735538Z [2024-03-28T23:52:17.424+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:17.427606505Z [2024-03-28T23:52:17.427+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:17.446685763Z [2024-03-28T23:52:17.446+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240328T235100, start_date=, end_date=20240328T235217 2024-03-28T23:52:17.457873374Z [2024-03-28T23:52:17.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-28 23:52:04.841396+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:52:14.941267+00:00, queued_by_job_id=2, pid=None 2024-03-28T23:52:17.458381888Z [2024-03-28T23:52:17.458+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:17.462237384Z [2024-03-28T23:52:17.461+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-28T23:52:17.482548411Z [2024-03-28T23:52:17.479+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240328T235100, start_date=, end_date=20240328T235217 2024-03-28T23:52:17.528278741Z [2024-03-28T23:52:17.527+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:52:17.528525828Z [2024-03-28T23:52:17.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:51:00+00:00, run_id=scheduled__2024-03-28T23:51:00+00:00, run_start_date=2024-03-28 23:52:01.132523+00:00, run_end_date=2024-03-28 23:52:17.528118+00:00, run_duration=16.395595, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:51:00+00:00, data_interval_end=2024-03-28 23:52:00+00:00, dag_hash=c6fee73e84157f9183c68eef86f1b9ab 2024-03-28T23:52:17.540701424Z [2024-03-28T23:52:17.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:52:17.548187870Z [2024-03-28T23:52:17.547+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-28T23:52:17.548359883Z [2024-03-28T23:52:17.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e, execution_date=2024-03-28 23:51:00+00:00, run_id=scheduled__2024-03-28T23:51:00+00:00, run_start_date=2024-03-28 23:52:01.134431+00:00, run_end_date=2024-03-28 23:52:17.548102+00:00, run_duration=16.413671, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:51:00+00:00, data_interval_end=2024-03-28 23:52:00+00:00, dag_hash=ac2ae3aa1e8659c3e61bee4dce7d42fb 2024-03-28T23:52:17.557923465Z [2024-03-28T23:52:17.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_67a6b27a-f372-41de-9ed6-f091deefbd3e to 2024-03-28T23:52:00+00:00, run_after=2024-03-28T23:53:00+00:00 2024-03-28T23:53:00.102218920Z [2024-03-28T23:53:00.101+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:53:00+00:00, run_after=2024-03-28T23:54:00+00:00 2024-03-28T23:53:00.109612759Z [2024-03-28T23:53:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:53:00.123658156Z [2024-03-28T23:53:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:53:00+00:00, run_after=2024-03-28T23:54:00+00:00 2024-03-28T23:53:00.198982948Z [2024-03-28T23:53:00.198+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:53:00.199027328Z 2024-03-28T23:53:00.199031628Z 2024-03-28T23:53:00.199034782Z 2024-03-28T23:53:00.199142856Z [2024-03-28T23:53:00.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:53:00.199359028Z [2024-03-28T23:53:00.199+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:53:00.199528888Z [2024-03-28T23:53:00.199+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:53:00.200134299Z [2024-03-28T23:53:00.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:53:00.200153864Z 2024-03-28T23:53:00.200159220Z 2024-03-28T23:53:00.200163833Z 2024-03-28T23:53:00.203483782Z [2024-03-28T23:53:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:53:00.203869607Z [2024-03-28T23:53:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:53:00.204432149Z [2024-03-28T23:53:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:53:00.204769221Z [2024-03-28T23:53:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:53:00.205308170Z [2024-03-28T23:53:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:53:00.205655788Z [2024-03-28T23:53:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:53:00.549341378Z [2024-03-28T23:53:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status queued for try_number 1 2024-03-28T23:53:00.549607917Z [2024-03-28T23:53:00.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status queued for try_number 1 2024-03-28T23:53:00.549802193Z [2024-03-28T23:53:00.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status queued for try_number 1 2024-03-28T23:53:00.560624257Z [2024-03-28T23:53:00.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a65126b-d08f-4302-a4fc-df31c4d42e37 2024-03-28T23:53:00.560957781Z [2024-03-28T23:53:00.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cee1931-0d0f-44f1-bb7c-e526384c50e5 2024-03-28T23:53:00.561202931Z [2024-03-28T23:53:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 167dd415-f2dc-4f70-a35d-4d7d82eb9d5f 2024-03-28T23:53:02.969714850Z [2024-03-28T23:53:02.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:53:02.971025056Z [2024-03-28T23:53:02.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:52:00+00:00, run_id=scheduled__2024-03-28T23:52:00+00:00, run_start_date=2024-03-28 23:53:00.135892+00:00, run_end_date=2024-03-28 23:53:02.969627+00:00, run_duration=2.833735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:52:00+00:00, data_interval_end=2024-03-28 23:53:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:53:02.992406460Z [2024-03-28T23:53:02.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:53:00+00:00, run_after=2024-03-28T23:54:00+00:00 2024-03-28T23:53:03.089510155Z [2024-03-28T23:53:03.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status success for try_number 1 2024-03-28T23:53:03.101771245Z [2024-03-28T23:53:03.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:52:00+00:00, map_index=-1, run_start_date=2024-03-28 23:53:01.214468+00:00, run_end_date=2024-03-28 23:53:01.787618+00:00, run_duration=0.57315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:53:00.200802+00:00, queued_by_job_id=2, pid=1677 2024-03-28T23:53:05.264947923Z [2024-03-28T23:53:05.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:53:05.265104211Z [2024-03-28T23:53:05.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:52:00+00:00, run_id=scheduled__2024-03-28T23:52:00+00:00, run_start_date=2024-03-28 23:53:00.137590+00:00, run_end_date=2024-03-28 23:53:05.264832+00:00, run_duration=5.127242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:52:00+00:00, data_interval_end=2024-03-28 23:53:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:53:05.274200364Z [2024-03-28T23:53:05.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:53:00+00:00, run_after=2024-03-28T23:54:00+00:00 2024-03-28T23:53:05.281586910Z [2024-03-28T23:53:05.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:53:05.281709153Z [2024-03-28T23:53:05.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:52:00+00:00, run_id=scheduled__2024-03-28T23:52:00+00:00, run_start_date=2024-03-28 23:53:00.139034+00:00, run_end_date=2024-03-28 23:53:05.281474+00:00, run_duration=5.14244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:52:00+00:00, data_interval_end=2024-03-28 23:53:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:53:05.296355424Z [2024-03-28T23:53:05.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:53:00+00:00, run_after=2024-03-28T23:54:00+00:00 2024-03-28T23:53:05.334070628Z [2024-03-28T23:53:05.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status success for try_number 1 2024-03-28T23:53:05.334101271Z [2024-03-28T23:53:05.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status success for try_number 1 2024-03-28T23:53:05.343922623Z [2024-03-28T23:53:05.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:52:00+00:00, map_index=-1, run_start_date=2024-03-28 23:53:02.437639+00:00, run_end_date=2024-03-28 23:53:04.261548+00:00, run_duration=1.823909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:53:00.200802+00:00, queued_by_job_id=2, pid=1695 2024-03-28T23:53:05.344387200Z [2024-03-28T23:53:05.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:52:00+00:00, map_index=-1, run_start_date=2024-03-28 23:53:02.721900+00:00, run_end_date=2024-03-28 23:53:04.713606+00:00, run_duration=1.991706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:53:00.200802+00:00, queued_by_job_id=2, pid=1696 2024-03-28T23:53:44.054101051Z [2024-03-28T23:53:44.053+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-28T23:54:00.906137775Z [2024-03-28T23:54:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:54:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:54:00.915044885Z [2024-03-28T23:54:00.914+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:54:00.924196775Z [2024-03-28T23:54:00.923+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:54:00.941385005Z [2024-03-28T23:54:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:54:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:54:01.033054768Z [2024-03-28T23:54:01.032+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:54:01.033100187Z 2024-03-28T23:54:01.033111146Z 2024-03-28T23:54:01.033119909Z 2024-03-28T23:54:01.033128537Z 2024-03-28T23:54:01.033138297Z [2024-03-28T23:54:01.032+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:54:01.033146840Z [2024-03-28T23:54:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:54:01.033184683Z [2024-03-28T23:54:01.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:54:01.033203728Z [2024-03-28T23:54:01.033+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:54:01.033701015Z [2024-03-28T23:54:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:54:01.033725782Z 2024-03-28T23:54:01.033730603Z 2024-03-28T23:54:01.033733977Z 2024-03-28T23:54:01.033754343Z 2024-03-28T23:54:01.037743267Z [2024-03-28T23:54:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:54:01.037767166Z [2024-03-28T23:54:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:54:01.037977942Z [2024-03-28T23:54:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:54:01.038081900Z [2024-03-28T23:54:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:54:01.038201847Z [2024-03-28T23:54:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:54:01.038283489Z [2024-03-28T23:54:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:54:01.038530431Z [2024-03-28T23:54:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:54:01.038672478Z [2024-03-28T23:54:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:54:01.351503403Z [2024-03-28T23:54:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status queued for try_number 1 2024-03-28T23:54:01.351584224Z [2024-03-28T23:54:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:53:00+00:00 exited with status queued for try_number 1 2024-03-28T23:54:01.351593663Z [2024-03-28T23:54:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:53:00+00:00 exited with status queued for try_number 1 2024-03-28T23:54:01.351672236Z [2024-03-28T23:54:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:53:00+00:00 exited with status queued for try_number 1 2024-03-28T23:54:01.361572315Z [2024-03-28T23:54:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39eab75a-f2fa-4332-bbd9-b29fba3811ca 2024-03-28T23:54:01.361667328Z [2024-03-28T23:54:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9148288b-08b0-4571-ac7b-ac29b3e155d9 2024-03-28T23:54:01.361878300Z [2024-03-28T23:54:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a4888b7-ba98-468a-bac4-1f97d0ef69d6 2024-03-28T23:54:01.362021738Z [2024-03-28T23:54:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52343cdd-ecd3-44c9-a31b-f6e7dbbcd5fc 2024-03-28T23:54:03.849884848Z [2024-03-28T23:54:03.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:54:03.850600726Z [2024-03-28T23:54:03.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:52:00+00:00, run_id=scheduled__2024-03-28T23:52:00+00:00, run_start_date=2024-03-28 23:54:00.955678+00:00, run_end_date=2024-03-28 23:54:03.849959+00:00, run_duration=2.894281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:52:00+00:00, data_interval_end=2024-03-28 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:54:03.863961373Z [2024-03-28T23:54:03.863+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:54:00+00:00, run_after=2024-03-28T23:56:00+00:00 2024-03-28T23:54:03.876992664Z [2024-03-28T23:54:03.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:54:03.877513866Z [2024-03-28T23:54:03.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:53:00+00:00, run_id=scheduled__2024-03-28T23:53:00+00:00, run_start_date=2024-03-28 23:54:00.957189+00:00, run_end_date=2024-03-28 23:54:03.877049+00:00, run_duration=2.91986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:53:00+00:00, data_interval_end=2024-03-28 23:54:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:54:03.892529466Z [2024-03-28T23:54:03.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:54:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:54:03.981547944Z [2024-03-28T23:54:03.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:52:00+00:00 exited with status success for try_number 1 2024-03-28T23:54:03.981675799Z [2024-03-28T23:54:03.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:53:00+00:00 exited with status success for try_number 1 2024-03-28T23:54:03.991606655Z [2024-03-28T23:54:03.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:52:00+00:00, map_index=-1, run_start_date=2024-03-28 23:54:02.424951+00:00, run_end_date=2024-03-28 23:54:03.206033+00:00, run_duration=0.781082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:54:01.034644+00:00, queued_by_job_id=2, pid=1730 2024-03-28T23:54:03.991772260Z [2024-03-28T23:54:03.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:53:00+00:00, map_index=-1, run_start_date=2024-03-28 23:54:02.320709+00:00, run_end_date=2024-03-28 23:54:03.192418+00:00, run_duration=0.871709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:54:01.034644+00:00, queued_by_job_id=2, pid=1729 2024-03-28T23:54:05.813534216Z [2024-03-28T23:54:05.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:54:05.822585816Z [2024-03-28T23:54:05.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:53:00+00:00, run_id=scheduled__2024-03-28T23:53:00+00:00, run_start_date=2024-03-28 23:54:00.960616+00:00, run_end_date=2024-03-28 23:54:05.813196+00:00, run_duration=4.85258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:53:00+00:00, data_interval_end=2024-03-28 23:54:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:54:05.858581760Z [2024-03-28T23:54:05.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:54:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:54:05.998035097Z [2024-03-28T23:54:05.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:53:00+00:00 exited with status success for try_number 1 2024-03-28T23:54:06.009514982Z [2024-03-28T23:54:06.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:53:00+00:00, map_index=-1, run_start_date=2024-03-28 23:54:03.884933+00:00, run_end_date=2024-03-28 23:54:05.357561+00:00, run_duration=1.472628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:54:01.034644+00:00, queued_by_job_id=2, pid=1748 2024-03-28T23:54:08.149823348Z [2024-03-28T23:54:08.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:54:08.150544007Z [2024-03-28T23:54:08.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:53:00+00:00, run_id=scheduled__2024-03-28T23:53:00+00:00, run_start_date=2024-03-28 23:54:00.958630+00:00, run_end_date=2024-03-28 23:54:08.149702+00:00, run_duration=7.191072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:53:00+00:00, data_interval_end=2024-03-28 23:54:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:54:08.167629692Z [2024-03-28T23:54:08.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:54:00+00:00, run_after=2024-03-28T23:55:00+00:00 2024-03-28T23:54:08.200721595Z [2024-03-28T23:54:08.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:53:00+00:00 exited with status success for try_number 1 2024-03-28T23:54:08.207163981Z [2024-03-28T23:54:08.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:53:00+00:00, map_index=-1, run_start_date=2024-03-28 23:54:04.495744+00:00, run_end_date=2024-03-28 23:54:07.510870+00:00, run_duration=3.015126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:54:01.034644+00:00, queued_by_job_id=2, pid=1759 2024-03-28T23:55:00.718208551Z [2024-03-28T23:55:00.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:55:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:55:00.740307877Z [2024-03-28T23:55:00.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:55:00+00:00, run_after=2024-03-28T23:56:00+00:00 2024-03-28T23:55:00.747953124Z [2024-03-28T23:55:00.747+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:55:00.762043144Z [2024-03-28T23:55:00.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:55:00+00:00, run_after=2024-03-28T23:56:00+00:00 2024-03-28T23:55:00.850087859Z [2024-03-28T23:55:00.849+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:55:00.850114504Z 2024-03-28T23:55:00.850118835Z 2024-03-28T23:55:00.850122900Z 2024-03-28T23:55:00.850126197Z 2024-03-28T23:55:00.850371351Z [2024-03-28T23:55:00.850+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:55:00.850659803Z [2024-03-28T23:55:00.850+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:55:00.850873914Z [2024-03-28T23:55:00.850+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:55:00.851083212Z [2024-03-28T23:55:00.850+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:55:00.851800102Z [2024-03-28T23:55:00.851+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:55:00.851811330Z 2024-03-28T23:55:00.851815062Z 2024-03-28T23:55:00.851818413Z 2024-03-28T23:55:00.851821624Z 2024-03-28T23:55:00.855309586Z [2024-03-28T23:55:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-28T23:55:00.855591447Z [2024-03-28T23:55:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:55:00.855949639Z [2024-03-28T23:55:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:55:00.856176805Z [2024-03-28T23:55:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:55:00.856568050Z [2024-03-28T23:55:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:55:00.856817439Z [2024-03-28T23:55:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:55:00.857146682Z [2024-03-28T23:55:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:55:00.857319874Z [2024-03-28T23:55:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:55:01.183013990Z [2024-03-28T23:55:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:55:01.183148895Z [2024-03-28T23:55:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status queued for try_number 1 2024-03-28T23:55:01.183244051Z [2024-03-28T23:55:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status queued for try_number 1 2024-03-28T23:55:01.183386372Z [2024-03-28T23:55:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status queued for try_number 1 2024-03-28T23:55:01.196123239Z [2024-03-28T23:55:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to 255bbf66-cc9c-4529-8824-5a05679eff95 2024-03-28T23:55:01.196337873Z [2024-03-28T23:55:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 238cd5f5-c93e-4a1d-8721-eeb25397a486 2024-03-28T23:55:01.196519376Z [2024-03-28T23:55:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd3f3417-8e51-43a3-9b21-c52abfa6d74d 2024-03-28T23:55:01.196817090Z [2024-03-28T23:55:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78bae502-9f81-44da-b325-f0ee649f99e3 2024-03-28T23:55:03.600255333Z [2024-03-28T23:55:03.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:55:03.600751784Z [2024-03-28T23:55:03.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:54:00+00:00, run_id=scheduled__2024-03-28T23:54:00+00:00, run_start_date=2024-03-28 23:55:00.775981+00:00, run_end_date=2024-03-28 23:55:03.600165+00:00, run_duration=2.824184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:54:00+00:00, data_interval_end=2024-03-28 23:55:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:55:03.616782997Z [2024-03-28T23:55:03.616+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:55:00+00:00, run_after=2024-03-28T23:56:00+00:00 2024-03-28T23:55:03.784402233Z [2024-03-28T23:55:03.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status success for try_number 1 2024-03-28T23:55:03.795315238Z [2024-03-28T23:55:03.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:54:00+00:00, map_index=-1, run_start_date=2024-03-28 23:55:02.037091+00:00, run_end_date=2024-03-28 23:55:02.559154+00:00, run_duration=0.522063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:55:00.852775+00:00, queued_by_job_id=2, pid=1788 2024-03-28T23:55:04.769257677Z [2024-03-28T23:55:04.768+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:55:04.769284505Z 2024-03-28T23:55:04.769295071Z [2024-03-28T23:55:04.769+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:55:04.769753514Z [2024-03-28T23:55:04.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:55:04.769759414Z 2024-03-28T23:55:04.772667911Z [2024-03-28T23:55:04.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-28T23:55:04.772684063Z [2024-03-28T23:55:04.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:55:04.817560355Z [2024-03-28T23:55:04.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:55:04.817902686Z [2024-03-28T23:55:04.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:55:04.824063735Z [2024-03-28T23:55:04.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbfe9be2-4c6a-4afb-97be-49c87fff3f53 2024-03-28T23:55:04.824533143Z [2024-03-28T23:55:04.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:55:03.344977+00:00, run_end_date=2024-03-28 23:55:03.852581+00:00, run_duration=0.507604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:55:00.852775+00:00, queued_by_job_id=2, pid=1813 2024-03-28T23:55:04.906437041Z [2024-03-28T23:55:04.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:55:04.906490189Z [2024-03-28T23:55:04.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:54:00+00:00, run_id=scheduled__2024-03-28T23:54:00+00:00, run_start_date=2024-03-28 23:55:00.778744+00:00, run_end_date=2024-03-28 23:55:04.905889+00:00, run_duration=4.127145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:54:00+00:00, data_interval_end=2024-03-28 23:55:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:55:04.924191931Z [2024-03-28T23:55:04.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:55:00+00:00, run_after=2024-03-28T23:56:00+00:00 2024-03-28T23:55:05.042823805Z [2024-03-28T23:55:05.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status success for try_number 1 2024-03-28T23:55:05.055300198Z [2024-03-28T23:55:05.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:54:00+00:00, map_index=-1, run_start_date=2024-03-28 23:55:03.151300+00:00, run_end_date=2024-03-28 23:55:04.746701+00:00, run_duration=1.595401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:55:00.852775+00:00, queued_by_job_id=2, pid=1811 2024-03-28T23:55:06.110412648Z [2024-03-28T23:55:06.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:55:06.111000947Z [2024-03-28T23:55:06.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:54:00+00:00, run_id=scheduled__2024-03-28T23:54:00+00:00, run_start_date=2024-03-28 23:55:00.777442+00:00, run_end_date=2024-03-28 23:55:06.110497+00:00, run_duration=5.333055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:54:00+00:00, data_interval_end=2024-03-28 23:55:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:55:06.125766736Z [2024-03-28T23:55:06.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:55:00+00:00, run_after=2024-03-28T23:56:00+00:00 2024-03-28T23:55:06.195786766Z [2024-03-28T23:55:06.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status success for try_number 1 2024-03-28T23:55:06.203740950Z [2024-03-28T23:55:06.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:54:00+00:00, map_index=-1, run_start_date=2024-03-28 23:55:03.313013+00:00, run_end_date=2024-03-28 23:55:05.005897+00:00, run_duration=1.692884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:55:00.852775+00:00, queued_by_job_id=2, pid=1812 2024-03-28T23:55:08.554505835Z [2024-03-28T23:55:08.554+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:55:08.554542247Z 2024-03-28T23:55:08.554834528Z [2024-03-28T23:55:08.554+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:55:08.555560814Z [2024-03-28T23:55:08.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:55:08.555573165Z 2024-03-28T23:55:08.558717973Z [2024-03-28T23:55:08.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-28T23:55:08.558835108Z [2024-03-28T23:55:08.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T23:55:08.605199452Z [2024-03-28T23:55:08.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:55:08.605498413Z [2024-03-28T23:55:08.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:55:08.613695720Z [2024-03-28T23:55:08.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to b83f4390-9f1e-4db6-a725-f0ef6c9698cf 2024-03-28T23:55:08.614162377Z [2024-03-28T23:55:08.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:55:06.965932+00:00, run_end_date=2024-03-28 23:55:07.495610+00:00, run_duration=0.529678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:55:04.770035+00:00, queued_by_job_id=2, pid=1836 2024-03-28T23:55:11.012280782Z [2024-03-28T23:55:11.011+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-28T23:55:11.012313502Z 2024-03-28T23:55:11.012555588Z [2024-03-28T23:55:11.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:55:11.013201829Z [2024-03-28T23:55:11.012+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:55:11.013211796Z 2024-03-28T23:55:11.016532601Z [2024-03-28T23:55:11.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:55:11.016838269Z [2024-03-28T23:55:11.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T23:55:11.090779977Z [2024-03-28T23:55:11.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status queued for try_number 1 2024-03-28T23:55:11.091042237Z [2024-03-28T23:55:11.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:55:11.105120497Z [2024-03-28T23:55:11.104+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a235e11-f7fd-43ad-9123-a0daffc7d4fb 2024-03-28T23:55:11.105465744Z [2024-03-28T23:55:11.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=0, run_start_date=2024-03-28 23:55:10.244105+00:00, run_end_date=2024-03-28 23:55:10.668237+00:00, run_duration=0.424132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:55:08.555900+00:00, queued_by_job_id=2, pid=1844 2024-03-28T23:55:13.392386694Z [2024-03-28T23:55:13.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:55:13.393175925Z [2024-03-28T23:55:13.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:50:00+00:00, run_id=scheduled__2024-03-28T23:50:00+00:00, run_start_date=2024-03-28 23:55:00.774378+00:00, run_end_date=2024-03-28 23:55:13.392496+00:00, run_duration=12.618118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:50:00+00:00, data_interval_end=2024-03-28 23:55:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-28T23:55:13.405310433Z [2024-03-28T23:55:13.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:55:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:55:14.511495560Z [2024-03-28T23:55:14.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:50:00+00:00 exited with status success for try_number 1 2024-03-28T23:55:14.517037251Z [2024-03-28T23:55:14.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:50:00+00:00, map_index=-1, run_start_date=2024-03-28 23:55:12.955984+00:00, run_end_date=2024-03-28 23:55:13.327261+00:00, run_duration=0.371277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:55:11.013639+00:00, queued_by_job_id=2, pid=1852 2024-03-28T23:56:00.510255271Z [2024-03-28T23:56:00.509+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:56:00.523289590Z [2024-03-28T23:56:00.522+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:56:00+00:00, run_after=2024-03-28T23:57:00+00:00 2024-03-28T23:56:00.536004124Z [2024-03-28T23:56:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:56:00+00:00, run_after=2024-03-28T23:57:00+00:00 2024-03-28T23:56:00.543501928Z [2024-03-28T23:56:00.543+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:56:00.623593146Z [2024-03-28T23:56:00.623+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:56:00.623651531Z 2024-03-28T23:56:00.623657594Z 2024-03-28T23:56:00.623661871Z 2024-03-28T23:56:00.623666291Z 2024-03-28T23:56:00.623700172Z [2024-03-28T23:56:00.623+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:56:00.623724036Z [2024-03-28T23:56:00.623+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:56:00.623865364Z [2024-03-28T23:56:00.623+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:56:00.624001021Z [2024-03-28T23:56:00.623+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:56:00.624542089Z [2024-03-28T23:56:00.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:56:00.624570682Z 2024-03-28T23:56:00.624575937Z 2024-03-28T23:56:00.624584368Z 2024-03-28T23:56:00.624591406Z 2024-03-28T23:56:00.628654471Z [2024-03-28T23:56:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:56:00.628688554Z [2024-03-28T23:56:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:56:00.628902286Z [2024-03-28T23:56:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:56:00.634777496Z [2024-03-28T23:56:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:56:00.634838637Z [2024-03-28T23:56:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:56:00.637090796Z [2024-03-28T23:56:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:56:00.637875613Z [2024-03-28T23:56:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:56:00.638185931Z [2024-03-28T23:56:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:56:01.130295076Z [2024-03-28T23:56:01.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status queued for try_number 1 2024-03-28T23:56:01.130358058Z [2024-03-28T23:56:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status queued for try_number 1 2024-03-28T23:56:01.130400495Z [2024-03-28T23:56:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status queued for try_number 1 2024-03-28T23:56:01.130659493Z [2024-03-28T23:56:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status queued for try_number 1 2024-03-28T23:56:01.142157474Z [2024-03-28T23:56:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to f43738f5-20f9-45e0-b4c6-28a4c155c547 2024-03-28T23:56:01.142226657Z [2024-03-28T23:56:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to aae01127-7d6a-4740-8bb0-849496c6c79e 2024-03-28T23:56:01.142328079Z [2024-03-28T23:56:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52778983-3c3a-4cb2-a354-5432ee3b2098 2024-03-28T23:56:01.142681867Z [2024-03-28T23:56:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf75dca-bdcb-4435-ba4c-c212c2757031 2024-03-28T23:56:02.405430167Z [2024-03-28T23:56:02.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:56:02.406983049Z [2024-03-28T23:56:02.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:54:00+00:00, run_id=scheduled__2024-03-28T23:54:00+00:00, run_start_date=2024-03-28 23:56:00.558000+00:00, run_end_date=2024-03-28 23:56:02.405363+00:00, run_duration=1.847363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:54:00+00:00, data_interval_end=2024-03-28 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:56:02.430381036Z [2024-03-28T23:56:02.429+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:56:00+00:00, run_after=2024-03-28T23:58:00+00:00 2024-03-28T23:56:02.566979052Z [2024-03-28T23:56:02.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:54:00+00:00 exited with status success for try_number 1 2024-03-28T23:56:02.573693029Z [2024-03-28T23:56:02.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:54:00+00:00, map_index=-1, run_start_date=2024-03-28 23:56:01.612350+00:00, run_end_date=2024-03-28 23:56:02.193918+00:00, run_duration=0.581568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:56:00.625444+00:00, queued_by_job_id=2, pid=1874 2024-03-28T23:56:03.637276105Z [2024-03-28T23:56:03.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:56:03.638288936Z [2024-03-28T23:56:03.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:55:00+00:00, run_id=scheduled__2024-03-28T23:55:00+00:00, run_start_date=2024-03-28 23:56:00.561400+00:00, run_end_date=2024-03-28 23:56:03.637167+00:00, run_duration=3.075767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:55:00+00:00, data_interval_end=2024-03-28 23:56:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:56:03.677897662Z [2024-03-28T23:56:03.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:56:00+00:00, run_after=2024-03-28T23:57:00+00:00 2024-03-28T23:56:03.741679637Z [2024-03-28T23:56:03.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status success for try_number 1 2024-03-28T23:56:03.747908794Z [2024-03-28T23:56:03.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:55:00+00:00, map_index=-1, run_start_date=2024-03-28 23:56:01.862700+00:00, run_end_date=2024-03-28 23:56:02.495212+00:00, run_duration=0.632512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:56:00.625444+00:00, queued_by_job_id=2, pid=1875 2024-03-28T23:56:05.917115603Z [2024-03-28T23:56:05.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:56:05.917526911Z [2024-03-28T23:56:05.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:55:00+00:00, run_id=scheduled__2024-03-28T23:55:00+00:00, run_start_date=2024-03-28 23:56:00.559870+00:00, run_end_date=2024-03-28 23:56:05.917034+00:00, run_duration=5.357164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:55:00+00:00, data_interval_end=2024-03-28 23:56:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:56:05.927288414Z [2024-03-28T23:56:05.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:56:00+00:00, run_after=2024-03-28T23:57:00+00:00 2024-03-28T23:56:05.934608618Z [2024-03-28T23:56:05.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:56:05.935017200Z [2024-03-28T23:56:05.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:55:00+00:00, run_id=scheduled__2024-03-28T23:55:00+00:00, run_start_date=2024-03-28 23:56:00.562651+00:00, run_end_date=2024-03-28 23:56:05.934533+00:00, run_duration=5.371882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:55:00+00:00, data_interval_end=2024-03-28 23:56:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:56:05.949740477Z [2024-03-28T23:56:05.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:56:00+00:00, run_after=2024-03-28T23:57:00+00:00 2024-03-28T23:56:05.978064137Z [2024-03-28T23:56:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status success for try_number 1 2024-03-28T23:56:05.978218450Z [2024-03-28T23:56:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status success for try_number 1 2024-03-28T23:56:05.984607103Z [2024-03-28T23:56:05.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:55:00+00:00, map_index=-1, run_start_date=2024-03-28 23:56:03.357346+00:00, run_end_date=2024-03-28 23:56:05.769930+00:00, run_duration=2.412584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:56:00.625444+00:00, queued_by_job_id=2, pid=1898 2024-03-28T23:56:05.984904455Z [2024-03-28T23:56:05.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:55:00+00:00, map_index=-1, run_start_date=2024-03-28 23:56:03.532867+00:00, run_end_date=2024-03-28 23:56:05.401854+00:00, run_duration=1.868987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:56:00.625444+00:00, queued_by_job_id=2, pid=1899 2024-03-28T23:57:00.168771298Z [2024-03-28T23:57:00.168+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:57:00.188192266Z [2024-03-28T23:57:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:57:00+00:00, run_after=2024-03-28T23:58:00+00:00 2024-03-28T23:57:00.214613119Z [2024-03-28T23:57:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:57:00+00:00, run_after=2024-03-28T23:58:00+00:00 2024-03-28T23:57:00.281525920Z [2024-03-28T23:57:00.280+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:57:00.281552626Z 2024-03-28T23:57:00.281556642Z 2024-03-28T23:57:00.281560230Z 2024-03-28T23:57:00.281642181Z [2024-03-28T23:57:00.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:57:00.281936970Z [2024-03-28T23:57:00.281+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:57:00.282226092Z [2024-03-28T23:57:00.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:57:00.284202462Z [2024-03-28T23:57:00.283+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:57:00.284219166Z 2024-03-28T23:57:00.284223391Z 2024-03-28T23:57:00.284228188Z 2024-03-28T23:57:00.289818446Z [2024-03-28T23:57:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:57:00.290013001Z [2024-03-28T23:57:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:57:00.290471619Z [2024-03-28T23:57:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:57:00.290856055Z [2024-03-28T23:57:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:57:00.291267121Z [2024-03-28T23:57:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:57:00.291566336Z [2024-03-28T23:57:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:57:00.529856057Z [2024-03-28T23:57:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status queued for try_number 1 2024-03-28T23:57:00.529934326Z [2024-03-28T23:57:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status queued for try_number 1 2024-03-28T23:57:00.530015276Z [2024-03-28T23:57:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status queued for try_number 1 2024-03-28T23:57:00.540148342Z [2024-03-28T23:57:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8714f045-30d2-4c76-9667-3f441b926618 2024-03-28T23:57:00.540619481Z [2024-03-28T23:57:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08776b6e-9ab0-40a5-a611-dd93b47c09dd 2024-03-28T23:57:00.540953767Z [2024-03-28T23:57:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d003a1f-444e-4cfb-a68b-bad2c897346e 2024-03-28T23:57:01.716375129Z [2024-03-28T23:57:01.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:57:01.716600110Z [2024-03-28T23:57:01.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:56:00+00:00, run_id=scheduled__2024-03-28T23:56:00+00:00, run_start_date=2024-03-28 23:57:00.228779+00:00, run_end_date=2024-03-28 23:57:01.716256+00:00, run_duration=1.487477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:56:00+00:00, data_interval_end=2024-03-28 23:57:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:57:01.742655518Z [2024-03-28T23:57:01.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:57:00+00:00, run_after=2024-03-28T23:58:00+00:00 2024-03-28T23:57:01.798257611Z [2024-03-28T23:57:01.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status success for try_number 1 2024-03-28T23:57:01.805859971Z [2024-03-28T23:57:01.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:56:00+00:00, map_index=-1, run_start_date=2024-03-28 23:57:01.111117+00:00, run_end_date=2024-03-28 23:57:01.481384+00:00, run_duration=0.370267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:57:00.285631+00:00, queued_by_job_id=2, pid=1932 2024-03-28T23:57:04.193055244Z [2024-03-28T23:57:04.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:57:04.193095313Z [2024-03-28T23:57:04.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:56:00+00:00, run_id=scheduled__2024-03-28T23:56:00+00:00, run_start_date=2024-03-28 23:57:00.227358+00:00, run_end_date=2024-03-28 23:57:04.192409+00:00, run_duration=3.965051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:56:00+00:00, data_interval_end=2024-03-28 23:57:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:57:04.201613579Z [2024-03-28T23:57:04.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:57:00+00:00, run_after=2024-03-28T23:58:00+00:00 2024-03-28T23:57:04.213381250Z [2024-03-28T23:57:04.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:57:04.213917943Z [2024-03-28T23:57:04.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:56:00+00:00, run_id=scheduled__2024-03-28T23:56:00+00:00, run_start_date=2024-03-28 23:57:00.229947+00:00, run_end_date=2024-03-28 23:57:04.213442+00:00, run_duration=3.983495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:56:00+00:00, data_interval_end=2024-03-28 23:57:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:57:04.237134159Z [2024-03-28T23:57:04.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:57:00+00:00, run_after=2024-03-28T23:58:00+00:00 2024-03-28T23:57:04.280415237Z [2024-03-28T23:57:04.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status success for try_number 1 2024-03-28T23:57:04.280719515Z [2024-03-28T23:57:04.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status success for try_number 1 2024-03-28T23:57:04.289223320Z [2024-03-28T23:57:04.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:56:00+00:00, map_index=-1, run_start_date=2024-03-28 23:57:02.285991+00:00, run_end_date=2024-03-28 23:57:04.079724+00:00, run_duration=1.793733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:57:00.285631+00:00, queued_by_job_id=2, pid=1951 2024-03-28T23:57:04.289554238Z [2024-03-28T23:57:04.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:56:00+00:00, map_index=-1, run_start_date=2024-03-28 23:57:02.187779+00:00, run_end_date=2024-03-28 23:57:03.427905+00:00, run_duration=1.240126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:57:00.285631+00:00, queued_by_job_id=2, pid=1950 2024-03-28T23:58:01.012057701Z [2024-03-28T23:58:01.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:58:00+00:00, run_after=2024-03-28T23:59:00+00:00 2024-03-28T23:58:01.023387085Z [2024-03-28T23:58:01.022+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:58:01.033170725Z [2024-03-28T23:58:01.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:58:01.062008916Z [2024-03-28T23:58:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:58:00+00:00, run_after=2024-03-28T23:59:00+00:00 2024-03-28T23:58:01.180074272Z [2024-03-28T23:58:01.179+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-28T23:58:01.180161769Z 2024-03-28T23:58:01.180170016Z 2024-03-28T23:58:01.180175832Z 2024-03-28T23:58:01.180180460Z 2024-03-28T23:58:01.180209498Z [2024-03-28T23:58:01.179+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-28T23:58:01.180342357Z [2024-03-28T23:58:01.180+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:58:01.180538466Z [2024-03-28T23:58:01.180+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:58:01.181010810Z [2024-03-28T23:58:01.180+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:58:01.181929507Z [2024-03-28T23:58:01.181+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:58:01.181937929Z 2024-03-28T23:58:01.181942360Z 2024-03-28T23:58:01.181946657Z 2024-03-28T23:58:01.181951136Z 2024-03-28T23:58:01.187304626Z [2024-03-28T23:58:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:58:01.187631369Z [2024-03-28T23:58:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T23:58:01.187976987Z [2024-03-28T23:58:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:58:01.188205376Z [2024-03-28T23:58:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:58:01.188601967Z [2024-03-28T23:58:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:58:01.188782673Z [2024-03-28T23:58:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:58:01.189053489Z [2024-03-28T23:58:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:58:01.189377851Z [2024-03-28T23:58:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:58:01.670474467Z [2024-03-28T23:58:01.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status queued for try_number 1 2024-03-28T23:58:01.670604079Z [2024-03-28T23:58:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:57:00+00:00 exited with status queued for try_number 1 2024-03-28T23:58:01.670761024Z [2024-03-28T23:58:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:57:00+00:00 exited with status queued for try_number 1 2024-03-28T23:58:01.674001801Z [2024-03-28T23:58:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:57:00+00:00 exited with status queued for try_number 1 2024-03-28T23:58:01.688407987Z [2024-03-28T23:58:01.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29e4964e-23a2-49f3-ab6d-3019064be5f7 2024-03-28T23:58:01.688520082Z [2024-03-28T23:58:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d2998b5-b633-49b0-af80-f314f59c15ab 2024-03-28T23:58:01.688789955Z [2024-03-28T23:58:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to e66dec67-1294-47b8-897a-be3f67b7f7f4 2024-03-28T23:58:01.688986928Z [2024-03-28T23:58:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39af4611-d49b-4ce5-b270-08435501ed89 2024-03-28T23:58:04.033077127Z [2024-03-28T23:58:04.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:58:04.033572274Z [2024-03-28T23:58:04.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:56:00+00:00, run_id=scheduled__2024-03-28T23:56:00+00:00, run_start_date=2024-03-28 23:58:01.087982+00:00, run_end_date=2024-03-28 23:58:04.033131+00:00, run_duration=2.945149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:56:00+00:00, data_interval_end=2024-03-28 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-28T23:58:04.043222354Z [2024-03-28T23:58:04.042+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-28T23:58:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:58:04.071477592Z [2024-03-28T23:58:04.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:58:04.072049279Z [2024-03-28T23:58:04.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:57:00+00:00, run_id=scheduled__2024-03-28T23:57:00+00:00, run_start_date=2024-03-28 23:58:01.093578+00:00, run_end_date=2024-03-28 23:58:04.071543+00:00, run_duration=2.977965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:57:00+00:00, data_interval_end=2024-03-28 23:58:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:58:04.092479277Z [2024-03-28T23:58:04.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:58:00+00:00, run_after=2024-03-28T23:59:00+00:00 2024-03-28T23:58:04.132027396Z [2024-03-28T23:58:04.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:56:00+00:00 exited with status success for try_number 1 2024-03-28T23:58:04.132062570Z [2024-03-28T23:58:04.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:57:00+00:00 exited with status success for try_number 1 2024-03-28T23:58:04.139794850Z [2024-03-28T23:58:04.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:56:00+00:00, map_index=-1, run_start_date=2024-03-28 23:58:02.420883+00:00, run_end_date=2024-03-28 23:58:02.917596+00:00, run_duration=0.496713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:58:01.183489+00:00, queued_by_job_id=2, pid=1986 2024-03-28T23:58:04.140334222Z [2024-03-28T23:58:04.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:57:00+00:00, map_index=-1, run_start_date=2024-03-28 23:58:02.420067+00:00, run_end_date=2024-03-28 23:58:02.902238+00:00, run_duration=0.482171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:58:01.183489+00:00, queued_by_job_id=2, pid=1985 2024-03-28T23:58:06.312257470Z [2024-03-28T23:58:06.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:58:06.314095732Z [2024-03-28T23:58:06.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:57:00+00:00, run_id=scheduled__2024-03-28T23:57:00+00:00, run_start_date=2024-03-28 23:58:01.089898+00:00, run_end_date=2024-03-28 23:58:06.313754+00:00, run_duration=5.223856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:57:00+00:00, data_interval_end=2024-03-28 23:58:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:58:06.328829127Z [2024-03-28T23:58:06.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:58:00+00:00, run_after=2024-03-28T23:59:00+00:00 2024-03-28T23:58:06.346789739Z [2024-03-28T23:58:06.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:58:06.347224017Z [2024-03-28T23:58:06.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:57:00+00:00, run_id=scheduled__2024-03-28T23:57:00+00:00, run_start_date=2024-03-28 23:58:01.091869+00:00, run_end_date=2024-03-28 23:58:06.346835+00:00, run_duration=5.254966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:57:00+00:00, data_interval_end=2024-03-28 23:58:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:58:06.383562806Z [2024-03-28T23:58:06.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:58:00+00:00, run_after=2024-03-28T23:59:00+00:00 2024-03-28T23:58:06.425824049Z [2024-03-28T23:58:06.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:57:00+00:00 exited with status success for try_number 1 2024-03-28T23:58:06.425884986Z [2024-03-28T23:58:06.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:57:00+00:00 exited with status success for try_number 1 2024-03-28T23:58:06.445810895Z [2024-03-28T23:58:06.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:57:00+00:00, map_index=-1, run_start_date=2024-03-28 23:58:03.520161+00:00, run_end_date=2024-03-28 23:58:05.567330+00:00, run_duration=2.047169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:58:01.183489+00:00, queued_by_job_id=2, pid=2009 2024-03-28T23:58:06.445929035Z [2024-03-28T23:58:06.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:57:00+00:00, map_index=-1, run_start_date=2024-03-28 23:58:03.638081+00:00, run_end_date=2024-03-28 23:58:06.064360+00:00, run_duration=2.426279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:58:01.183489+00:00, queued_by_job_id=2, pid=2010 2024-03-28T23:58:44.127902085Z [2024-03-28T23:58:44.127+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-28T23:59:00.922086154Z [2024-03-28T23:59:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:59:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:59:00.930775860Z [2024-03-28T23:59:00.930+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-28T23:59:00.943976777Z [2024-03-28T23:59:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:59:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:59:01.023734678Z [2024-03-28T23:59:01.023+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-28T23:59:01.023761653Z 2024-03-28T23:59:01.023765497Z 2024-03-28T23:59:01.023769306Z 2024-03-28T23:59:01.024030950Z [2024-03-28T23:59:01.023+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:59:01.024234639Z [2024-03-28T23:59:01.024+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-28T23:59:01.024462802Z [2024-03-28T23:59:01.024+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-28T23:59:01.025793514Z [2024-03-28T23:59:01.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-28T23:59:01.025806927Z 2024-03-28T23:59:01.025810340Z 2024-03-28T23:59:01.025813533Z 2024-03-28T23:59:01.029832527Z [2024-03-28T23:59:01.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:59:01.030322670Z [2024-03-28T23:59:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T23:59:01.030760110Z [2024-03-28T23:59:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:59:01.031270059Z [2024-03-28T23:59:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T23:59:01.031582780Z [2024-03-28T23:59:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-28T23:59:01.031658565Z [2024-03-28T23:59:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T23:59:01.293314482Z [2024-03-28T23:59:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status queued for try_number 1 2024-03-28T23:59:01.299076499Z [2024-03-28T23:59:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status queued for try_number 1 2024-03-28T23:59:01.299340774Z [2024-03-28T23:59:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status queued for try_number 1 2024-03-28T23:59:01.321170831Z [2024-03-28T23:59:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbaa8694-00b4-42dc-a9bd-d19c2a752e6b 2024-03-28T23:59:01.321621644Z [2024-03-28T23:59:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 167b7243-5fa4-48bd-927b-6467253c1127 2024-03-28T23:59:01.321987984Z [2024-03-28T23:59:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffc056ae-58ff-4b57-8836-c2ebc7459bf0 2024-03-28T23:59:02.507612104Z [2024-03-28T23:59:02.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:59:02.507970873Z [2024-03-28T23:59:02.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:58:00+00:00, run_id=scheduled__2024-03-28T23:58:00+00:00, run_start_date=2024-03-28 23:59:00.958819+00:00, run_end_date=2024-03-28 23:59:02.507502+00:00, run_duration=1.548683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:58:00+00:00, data_interval_end=2024-03-28 23:59:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-28T23:59:02.521725720Z [2024-03-28T23:59:02.521+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-28T23:59:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:59:02.607493845Z [2024-03-28T23:59:02.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status success for try_number 1 2024-03-28T23:59:02.613206547Z [2024-03-28T23:59:02.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:58:00+00:00, map_index=-1, run_start_date=2024-03-28 23:59:01.986314+00:00, run_end_date=2024-03-28 23:59:02.435410+00:00, run_duration=0.449096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:59:01.026673+00:00, queued_by_job_id=2, pid=2042 2024-03-28T23:59:06.134877516Z [2024-03-28T23:59:06.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:59:06.134995019Z [2024-03-28T23:59:06.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:58:00+00:00, run_id=scheduled__2024-03-28T23:58:00+00:00, run_start_date=2024-03-28 23:59:00.956167+00:00, run_end_date=2024-03-28 23:59:06.134745+00:00, run_duration=5.178578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:58:00+00:00, data_interval_end=2024-03-28 23:59:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-28T23:59:06.143599394Z [2024-03-28T23:59:06.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:59:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:59:06.149985460Z [2024-03-28T23:59:06.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-28T23:59:06.150123617Z [2024-03-28T23:59:06.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:58:00+00:00, run_id=scheduled__2024-03-28T23:58:00+00:00, run_start_date=2024-03-28 23:59:00.957632+00:00, run_end_date=2024-03-28 23:59:06.149827+00:00, run_duration=5.192195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:58:00+00:00, data_interval_end=2024-03-28 23:59:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-28T23:59:06.159439481Z [2024-03-28T23:59:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-28T23:59:00+00:00, run_after=2024-03-29T00:00:00+00:00 2024-03-28T23:59:06.189170509Z [2024-03-28T23:59:06.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status success for try_number 1 2024-03-28T23:59:06.189192126Z [2024-03-28T23:59:06.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status success for try_number 1 2024-03-28T23:59:06.194898279Z [2024-03-28T23:59:06.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:58:00+00:00, map_index=-1, run_start_date=2024-03-28 23:59:03.190171+00:00, run_end_date=2024-03-28 23:59:05.075871+00:00, run_duration=1.8857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:59:01.026673+00:00, queued_by_job_id=2, pid=2061 2024-03-28T23:59:06.195000509Z [2024-03-28T23:59:06.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:58:00+00:00, map_index=-1, run_start_date=2024-03-28 23:59:03.110203+00:00, run_end_date=2024-03-28 23:59:05.272286+00:00, run_duration=2.162083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-28 23:59:01.026673+00:00, queued_by_job_id=2, pid=2060 2024-03-29T00:00:00.735972493Z [2024-03-29T00:00:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:01:00+00:00 2024-03-29T00:00:00.744442331Z [2024-03-29T00:00:00.744+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:00:00.754135713Z [2024-03-29T00:00:00.753+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:00:00.787614748Z [2024-03-29T00:00:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:01:00+00:00 2024-03-29T00:00:00.803376342Z [2024-03-29T00:00:00.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:05:00+00:00 2024-03-29T00:00:01.019953878Z [2024-03-29T00:00:01.019+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T00:00:01.019981327Z 2024-03-29T00:00:01.020000811Z 2024-03-29T00:00:01.020005489Z 2024-03-29T00:00:01.020008955Z 2024-03-29T00:00:01.020012094Z 2024-03-29T00:00:01.020476053Z [2024-03-29T00:00:01.019+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:00:01.020488637Z [2024-03-29T00:00:01.020+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:00:01.020699210Z [2024-03-29T00:00:01.020+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:00:01.020950777Z [2024-03-29T00:00:01.020+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:00:01.021274527Z [2024-03-29T00:00:01.021+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:00:01.022352077Z [2024-03-29T00:00:01.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:00:01.022369709Z 2024-03-29T00:00:01.022375481Z 2024-03-29T00:00:01.022379087Z 2024-03-29T00:00:01.022382551Z 2024-03-29T00:00:01.022388907Z 2024-03-29T00:00:01.033123749Z [2024-03-29T00:00:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-28T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:00:01.033349725Z [2024-03-29T00:00:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:00:01.037855995Z [2024-03-29T00:00:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-28T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:00:01.037913330Z [2024-03-29T00:00:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:00:01.037938777Z [2024-03-29T00:00:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:00:01.037943469Z [2024-03-29T00:00:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:00:01.039649266Z [2024-03-29T00:00:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:00:01.039666151Z [2024-03-29T00:00:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:00:01.039669639Z [2024-03-29T00:00:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-28T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:00:01.039673031Z [2024-03-29T00:00:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:00:02.522094092Z [2024-03-29T00:00:02.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:02.522781270Z [2024-03-29T00:00:02.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:02.523623244Z [2024-03-29T00:00:02.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:59:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:02.523904886Z [2024-03-29T00:00:02.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:59:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:02.524144512Z [2024-03-29T00:00:02.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:59:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:02.552366712Z [2024-03-29T00:00:02.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a1d25ae-c9a2-4e0c-bda8-2d0893388771 2024-03-29T00:00:02.556221289Z [2024-03-29T00:00:02.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03e22d10-c7f8-4034-9526-8c170a1ae898 2024-03-29T00:00:02.557539509Z [2024-03-29T00:00:02.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a47a9d1-446a-4fbc-bc69-86220ac5f50e 2024-03-29T00:00:02.561741706Z [2024-03-29T00:00:02.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45da14ef-c71f-4c0e-acf6-debd31bf7c60 2024-03-29T00:00:02.561765190Z [2024-03-29T00:00:02.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70f6b054-df0e-49e3-923c-0c9bbe057cd2 2024-03-29T00:00:11.157286120Z [2024-03-29T00:00:11.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:00:11.175349135Z [2024-03-29T00:00:11.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-28 23:59:00+00:00, run_id=scheduled__2024-03-28T23:59:00+00:00, run_start_date=2024-03-29 00:00:00.862935+00:00, run_end_date=2024-03-29 00:00:11.174301+00:00, run_duration=10.311366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:59:00+00:00, data_interval_end=2024-03-29 00:00:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:00:11.394535355Z [2024-03-29T00:00:11.394+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:01:00+00:00 2024-03-29T00:00:12.546621163Z [2024-03-29T00:00:12.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:59:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:12.709001706Z [2024-03-29T00:00:12.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:59:00+00:00, map_index=-1, run_start_date=2024-03-29 00:00:07.602499+00:00, run_end_date=2024-03-29 00:00:10.051911+00:00, run_duration=2.449412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:01.024608+00:00, queued_by_job_id=2, pid=2095 2024-03-29T00:00:15.357693705Z [2024-03-29T00:00:15.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-28T23:58:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:15.363957787Z [2024-03-29T00:00:15.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-28T23:58:00+00:00, map_index=-1, run_start_date=2024-03-29 00:00:09.747966+00:00, run_end_date=2024-03-29 00:00:14.362290+00:00, run_duration=4.614324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:01.024608+00:00, queued_by_job_id=2, pid=2103 2024-03-29T00:00:16.762641135Z [2024-03-29T00:00:16.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:00:16.762680226Z [2024-03-29T00:00:16.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-28 23:58:00+00:00, run_id=scheduled__2024-03-28T23:58:00+00:00, run_start_date=2024-03-29 00:00:00.857361+00:00, run_end_date=2024-03-29 00:00:16.755152+00:00, run_duration=15.897791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:58:00+00:00, data_interval_end=2024-03-29 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:00:16.841827843Z [2024-03-29T00:00:16.840+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:02:00+00:00 2024-03-29T00:00:18.062162678Z [2024-03-29T00:00:18.061+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:00:18.062189810Z 2024-03-29T00:00:18.066369539Z [2024-03-29T00:00:18.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:00:18.067007016Z [2024-03-29T00:00:18.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:00:18.067016263Z 2024-03-29T00:00:18.090006201Z [2024-03-29T00:00:18.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-28T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:00:18.094579022Z [2024-03-29T00:00:18.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:00:18.625156147Z [2024-03-29T00:00:18.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:18.625186924Z [2024-03-29T00:00:18.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:18.639778392Z [2024-03-29T00:00:18.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b06f0e1-96aa-4eca-8131-12c9e5f0fe2a 2024-03-29T00:00:18.639889023Z [2024-03-29T00:00:18.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-28T23:55:00+00:00, map_index=-1, run_start_date=2024-03-29 00:00:15.384592+00:00, run_end_date=2024-03-29 00:00:17.691899+00:00, run_duration=2.307307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:01.024608+00:00, queued_by_job_id=2, pid=2115 2024-03-29T00:00:21.343511329Z [2024-03-29T00:00:21.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:00:21.356859207Z [2024-03-29T00:00:21.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:59:00+00:00, run_id=scheduled__2024-03-28T23:59:00+00:00, run_start_date=2024-03-29 00:00:00.860073+00:00, run_end_date=2024-03-29 00:00:21.343418+00:00, run_duration=20.483345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:59:00+00:00, data_interval_end=2024-03-29 00:00:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:00:21.404469444Z [2024-03-29T00:00:21.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:01:00+00:00 2024-03-29T00:00:21.747257015Z [2024-03-29T00:00:21.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:59:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:21.781870851Z [2024-03-29T00:00:21.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:59:00+00:00, map_index=-1, run_start_date=2024-03-29 00:00:17.967438+00:00, run_end_date=2024-03-29 00:00:20.694615+00:00, run_duration=2.727177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:01.024608+00:00, queued_by_job_id=2, pid=2142 2024-03-29T00:00:22.878919217Z [2024-03-29T00:00:22.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:00:22.879078329Z [2024-03-29T00:00:22.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:59:00+00:00, run_id=scheduled__2024-03-28T23:59:00+00:00, run_start_date=2024-03-29 00:00:00.861564+00:00, run_end_date=2024-03-29 00:00:22.878828+00:00, run_duration=22.017264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:59:00+00:00, data_interval_end=2024-03-29 00:00:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:00:22.888322786Z [2024-03-29T00:00:22.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:01:00+00:00 2024-03-29T00:00:23.030538989Z [2024-03-29T00:00:23.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-28T23:59:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:23.057099700Z [2024-03-29T00:00:23.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-28T23:59:00+00:00, map_index=-1, run_start_date=2024-03-29 00:00:17.765259+00:00, run_end_date=2024-03-29 00:00:21.421576+00:00, run_duration=3.656317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:01.024608+00:00, queued_by_job_id=2, pid=2141 2024-03-29T00:00:26.169528304Z [2024-03-29T00:00:26.169+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:00:26.169573561Z 2024-03-29T00:00:26.169584633Z [2024-03-29T00:00:26.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:00:26.170342116Z [2024-03-29T00:00:26.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:00:26.170360753Z 2024-03-29T00:00:26.172953860Z [2024-03-29T00:00:26.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-28T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:00:26.172992882Z [2024-03-29T00:00:26.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:00:26.242715803Z [2024-03-29T00:00:26.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:26.242762366Z [2024-03-29T00:00:26.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:26.254564502Z [2024-03-29T00:00:26.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b429565-1dc0-488a-a091-53bdf7c064f4 2024-03-29T00:00:26.254724844Z [2024-03-29T00:00:26.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-28T23:55:00+00:00, map_index=-1, run_start_date=2024-03-29 00:00:24.052980+00:00, run_end_date=2024-03-29 00:00:25.046214+00:00, run_duration=0.993234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:18.067483+00:00, queued_by_job_id=2, pid=2163 2024-03-29T00:00:30.137486393Z [2024-03-29T00:00:30.136+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:00:30.137503376Z 2024-03-29T00:00:30.137953497Z [2024-03-29T00:00:30.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:00:30.138626792Z [2024-03-29T00:00:30.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:00:30.138638591Z 2024-03-29T00:00:30.148636061Z [2024-03-29T00:00:30.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-28T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:00:30.149103550Z [2024-03-29T00:00:30.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-28T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:00:30.319364286Z [2024-03-29T00:00:30.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status queued for try_number 1 2024-03-29T00:00:30.319387114Z [2024-03-29T00:00:30.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:30.332403530Z [2024-03-29T00:00:30.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64a8ac67-aa07-4daf-b6df-562733af2f68 2024-03-29T00:00:30.337035607Z [2024-03-29T00:00:30.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-28T23:55:00+00:00, map_index=0, run_start_date=2024-03-29 00:00:28.506495+00:00, run_end_date=2024-03-29 00:00:29.150220+00:00, run_duration=0.643725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:26.170693+00:00, queued_by_job_id=2, pid=2171 2024-03-29T00:00:35.280382731Z [2024-03-29T00:00:35.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:00:35.280825570Z [2024-03-29T00:00:35.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-28 23:55:00+00:00, run_id=scheduled__2024-03-28T23:55:00+00:00, run_start_date=2024-03-29 00:00:00.848731+00:00, run_end_date=2024-03-29 00:00:35.280346+00:00, run_duration=34.431615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-28 23:55:00+00:00, data_interval_end=2024-03-29 00:00:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:00:35.288099587Z [2024-03-29T00:00:35.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:00:00+00:00, run_after=2024-03-29T00:05:00+00:00 2024-03-29T00:00:35.323688760Z [2024-03-29T00:00:35.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-28T23:55:00+00:00 exited with status success for try_number 1 2024-03-29T00:00:35.328116180Z [2024-03-29T00:00:35.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-28T23:55:00+00:00, map_index=-1, run_start_date=2024-03-29 00:00:33.771380+00:00, run_end_date=2024-03-29 00:00:34.206521+00:00, run_duration=0.435141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:00:30.139265+00:00, queued_by_job_id=2, pid=2179 2024-03-29T00:01:00.514361783Z [2024-03-29T00:01:00.513+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:01:00.533187444Z [2024-03-29T00:01:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:01:00+00:00, run_after=2024-03-29T00:02:00+00:00 2024-03-29T00:01:00.550077488Z [2024-03-29T00:01:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:01:00+00:00, run_after=2024-03-29T00:02:00+00:00 2024-03-29T00:01:00.665872486Z [2024-03-29T00:01:00.665+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:01:00.665918113Z 2024-03-29T00:01:00.665922085Z 2024-03-29T00:01:00.665928881Z 2024-03-29T00:01:00.666039283Z [2024-03-29T00:01:00.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:01:00.666366712Z [2024-03-29T00:01:00.666+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:01:00.666790644Z [2024-03-29T00:01:00.666+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:01:00.667652101Z [2024-03-29T00:01:00.667+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:01:00.667926353Z 2024-03-29T00:01:00.667934140Z 2024-03-29T00:01:00.667937440Z 2024-03-29T00:01:00.672875359Z [2024-03-29T00:01:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:01:00.673053897Z [2024-03-29T00:01:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:01:00.673462455Z [2024-03-29T00:01:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:01:00.673662169Z [2024-03-29T00:01:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:01:00.673927992Z [2024-03-29T00:01:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:01:00.674057950Z [2024-03-29T00:01:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:01:01.348314296Z [2024-03-29T00:01:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:01:01.351277123Z [2024-03-29T00:01:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:01:01.351601533Z [2024-03-29T00:01:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:01:01.371267669Z [2024-03-29T00:01:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88c80355-39aa-4736-a529-fd91815c9af2 2024-03-29T00:01:01.373161515Z [2024-03-29T00:01:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3be30a05-cb2c-445a-bbf6-06071d2a71a4 2024-03-29T00:01:01.374166628Z [2024-03-29T00:01:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1927e2ba-f957-48bf-a643-da9b6fdbe8ab 2024-03-29T00:01:04.281665945Z [2024-03-29T00:01:04.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:01:04.286337780Z [2024-03-29T00:01:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:00:00+00:00, run_id=scheduled__2024-03-29T00:00:00+00:00, run_start_date=2024-03-29 00:01:00.565577+00:00, run_end_date=2024-03-29 00:01:04.281535+00:00, run_duration=3.715958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:00:00+00:00, data_interval_end=2024-03-29 00:01:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:01:04.348532194Z [2024-03-29T00:01:04.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:01:00+00:00, run_after=2024-03-29T00:02:00+00:00 2024-03-29T00:01:04.822209332Z [2024-03-29T00:01:04.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:01:04.831265303Z [2024-03-29T00:01:04.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=-1, run_start_date=2024-03-29 00:01:02.973641+00:00, run_end_date=2024-03-29 00:01:04.009483+00:00, run_duration=1.035842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:01:00.668866+00:00, queued_by_job_id=2, pid=2188 2024-03-29T00:01:09.821275518Z [2024-03-29T00:01:09.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:01:09.821843869Z [2024-03-29T00:01:09.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:00:00+00:00, run_id=scheduled__2024-03-29T00:00:00+00:00, run_start_date=2024-03-29 00:01:00.567009+00:00, run_end_date=2024-03-29 00:01:09.821214+00:00, run_duration=9.254205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:00:00+00:00, data_interval_end=2024-03-29 00:01:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:01:09.844806437Z [2024-03-29T00:01:09.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:01:00+00:00, run_after=2024-03-29T00:02:00+00:00 2024-03-29T00:01:09.860739828Z [2024-03-29T00:01:09.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:01:09.861402246Z [2024-03-29T00:01:09.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:00:00+00:00, run_id=scheduled__2024-03-29T00:00:00+00:00, run_start_date=2024-03-29 00:01:00.568131+00:00, run_end_date=2024-03-29 00:01:09.860875+00:00, run_duration=9.292744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:00:00+00:00, data_interval_end=2024-03-29 00:01:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:01:09.881597576Z [2024-03-29T00:01:09.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:01:00+00:00, run_after=2024-03-29T00:02:00+00:00 2024-03-29T00:01:09.939283639Z [2024-03-29T00:01:09.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:01:09.939613702Z [2024-03-29T00:01:09.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:01:09.950969951Z [2024-03-29T00:01:09.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=-1, run_start_date=2024-03-29 00:01:06.092566+00:00, run_end_date=2024-03-29 00:01:08.870582+00:00, run_duration=2.778016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:01:00.668866+00:00, queued_by_job_id=2, pid=2202 2024-03-29T00:01:09.951767191Z [2024-03-29T00:01:09.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=-1, run_start_date=2024-03-29 00:01:06.846520+00:00, run_end_date=2024-03-29 00:01:09.559543+00:00, run_duration=2.713023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:01:00.668866+00:00, queued_by_job_id=2, pid=2210 2024-03-29T00:02:00.575190036Z [2024-03-29T00:02:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:02:00+00:00, run_after=2024-03-29T00:03:00+00:00 2024-03-29T00:02:00.584519045Z [2024-03-29T00:02:00.584+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:02:00.598814762Z [2024-03-29T00:02:00.598+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:02:00+00:00, run_after=2024-03-29T00:03:00+00:00 2024-03-29T00:02:00.606196579Z [2024-03-29T00:02:00.605+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:02:00.700201310Z [2024-03-29T00:02:00.699+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:02:00.700233367Z 2024-03-29T00:02:00.700240309Z 2024-03-29T00:02:00.700246070Z 2024-03-29T00:02:00.700251730Z 2024-03-29T00:02:00.700455146Z [2024-03-29T00:02:00.700+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:02:00.700695730Z [2024-03-29T00:02:00.700+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:02:00.700921055Z [2024-03-29T00:02:00.700+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:02:00.701115124Z [2024-03-29T00:02:00.700+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:02:00.701748871Z [2024-03-29T00:02:00.701+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:02:00.701764507Z 2024-03-29T00:02:00.701771214Z 2024-03-29T00:02:00.701777116Z 2024-03-29T00:02:00.701782194Z 2024-03-29T00:02:00.710873762Z [2024-03-29T00:02:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:02:00.711356332Z [2024-03-29T00:02:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:02:00.711708094Z [2024-03-29T00:02:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:02:00.711885272Z [2024-03-29T00:02:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:02:00.712166625Z [2024-03-29T00:02:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:02:00.712340220Z [2024-03-29T00:02:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:02:00.712615445Z [2024-03-29T00:02:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:02:00.712793858Z [2024-03-29T00:02:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:02:01.154697919Z [2024-03-29T00:02:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:02:01.157334522Z [2024-03-29T00:02:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:01:00+00:00 exited with status queued for try_number 1 2024-03-29T00:02:01.157558277Z [2024-03-29T00:02:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:01:00+00:00 exited with status queued for try_number 1 2024-03-29T00:02:01.157727335Z [2024-03-29T00:02:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:01:00+00:00 exited with status queued for try_number 1 2024-03-29T00:02:01.171020383Z [2024-03-29T00:02:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa80cebe-44c8-40d7-88cf-5c6e38cdb365 2024-03-29T00:02:01.171376662Z [2024-03-29T00:02:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5abd2686-daae-4de5-8490-d3ce9d85ce66 2024-03-29T00:02:01.171704472Z [2024-03-29T00:02:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85fe7226-53bf-48c3-8235-e2acd64670c8 2024-03-29T00:02:01.171969301Z [2024-03-29T00:02:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bc65ebf-fcf9-407f-9cae-1659965fcf72 2024-03-29T00:02:03.074374854Z [2024-03-29T00:02:03.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:02:03.075213817Z [2024-03-29T00:02:03.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:00:00+00:00, run_id=scheduled__2024-03-29T00:00:00+00:00, run_start_date=2024-03-29 00:02:00.617668+00:00, run_end_date=2024-03-29 00:02:03.074543+00:00, run_duration=2.456875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:00:00+00:00, data_interval_end=2024-03-29 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:02:03.091208495Z [2024-03-29T00:02:03.090+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:02:00+00:00, run_after=2024-03-29T00:04:00+00:00 2024-03-29T00:02:03.107699726Z [2024-03-29T00:02:03.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:02:03.108240386Z [2024-03-29T00:02:03.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:01:00+00:00, run_id=scheduled__2024-03-29T00:01:00+00:00, run_start_date=2024-03-29 00:02:00.619185+00:00, run_end_date=2024-03-29 00:02:03.107759+00:00, run_duration=2.488574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:01:00+00:00, data_interval_end=2024-03-29 00:02:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:02:03.128761038Z [2024-03-29T00:02:03.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:02:00+00:00, run_after=2024-03-29T00:03:00+00:00 2024-03-29T00:02:03.235139207Z [2024-03-29T00:02:03.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:02:03.235610507Z [2024-03-29T00:02:03.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:01:00+00:00 exited with status success for try_number 1 2024-03-29T00:02:03.256611062Z [2024-03-29T00:02:03.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=-1, run_start_date=2024-03-29 00:02:01.707015+00:00, run_end_date=2024-03-29 00:02:02.283882+00:00, run_duration=0.576867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:02:00.707427+00:00, queued_by_job_id=2, pid=2240 2024-03-29T00:02:03.257207298Z [2024-03-29T00:02:03.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:01:00+00:00, map_index=-1, run_start_date=2024-03-29 00:02:02.105769+00:00, run_end_date=2024-03-29 00:02:02.642166+00:00, run_duration=0.536397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:02:00.707427+00:00, queued_by_job_id=2, pid=2241 2024-03-29T00:02:05.415233505Z [2024-03-29T00:02:05.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:02:05.415416744Z [2024-03-29T00:02:05.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:01:00+00:00, run_id=scheduled__2024-03-29T00:01:00+00:00, run_start_date=2024-03-29 00:02:00.621987+00:00, run_end_date=2024-03-29 00:02:05.415112+00:00, run_duration=4.793125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:01:00+00:00, data_interval_end=2024-03-29 00:02:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:02:05.432693687Z [2024-03-29T00:02:05.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:02:00+00:00, run_after=2024-03-29T00:03:00+00:00 2024-03-29T00:02:05.445485752Z [2024-03-29T00:02:05.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:02:05.446065100Z [2024-03-29T00:02:05.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:01:00+00:00, run_id=scheduled__2024-03-29T00:01:00+00:00, run_start_date=2024-03-29 00:02:00.620435+00:00, run_end_date=2024-03-29 00:02:05.445511+00:00, run_duration=4.825076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:01:00+00:00, data_interval_end=2024-03-29 00:02:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:02:05.466929158Z [2024-03-29T00:02:05.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:02:00+00:00, run_after=2024-03-29T00:03:00+00:00 2024-03-29T00:02:05.516767503Z [2024-03-29T00:02:05.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:01:00+00:00 exited with status success for try_number 1 2024-03-29T00:02:05.517107318Z [2024-03-29T00:02:05.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:01:00+00:00 exited with status success for try_number 1 2024-03-29T00:02:05.528135763Z [2024-03-29T00:02:05.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:01:00+00:00, map_index=-1, run_start_date=2024-03-29 00:02:03.220010+00:00, run_end_date=2024-03-29 00:02:05.052411+00:00, run_duration=1.832401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:02:00.707427+00:00, queued_by_job_id=2, pid=2259 2024-03-29T00:02:05.528685417Z [2024-03-29T00:02:05.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:01:00+00:00, map_index=-1, run_start_date=2024-03-29 00:02:03.482332+00:00, run_end_date=2024-03-29 00:02:04.716762+00:00, run_duration=1.23443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:02:00.707427+00:00, queued_by_job_id=2, pid=2265 2024-03-29T00:03:00.099737946Z [2024-03-29T00:03:00.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:03:00+00:00, run_after=2024-03-29T00:04:00+00:00 2024-03-29T00:03:00.107543034Z [2024-03-29T00:03:00.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:03:00.119892101Z [2024-03-29T00:03:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:03:00+00:00, run_after=2024-03-29T00:04:00+00:00 2024-03-29T00:03:00.208953577Z [2024-03-29T00:03:00.208+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:03:00.208979271Z 2024-03-29T00:03:00.208984152Z 2024-03-29T00:03:00.208988606Z 2024-03-29T00:03:00.209001244Z [2024-03-29T00:03:00.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:03:00.209158963Z [2024-03-29T00:03:00.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:03:00.209333346Z [2024-03-29T00:03:00.209+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:03:00.210152086Z [2024-03-29T00:03:00.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:03:00.210168028Z 2024-03-29T00:03:00.210175553Z 2024-03-29T00:03:00.210239455Z 2024-03-29T00:03:00.218757533Z [2024-03-29T00:03:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:03:00.218793361Z [2024-03-29T00:03:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:03:00.218800509Z [2024-03-29T00:03:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:03:00.218826442Z [2024-03-29T00:03:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:03:00.218832951Z [2024-03-29T00:03:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:03:00.226917618Z [2024-03-29T00:03:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:03:00.602424414Z [2024-03-29T00:03:00.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status queued for try_number 1 2024-03-29T00:03:00.602679358Z [2024-03-29T00:03:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status queued for try_number 1 2024-03-29T00:03:00.602823536Z [2024-03-29T00:03:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status queued for try_number 1 2024-03-29T00:03:00.618561092Z [2024-03-29T00:03:00.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2426a46-ddc0-4036-b6e0-44543ade1925 2024-03-29T00:03:00.618773830Z [2024-03-29T00:03:00.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5f485fb-a0db-4a67-996a-bc9638eb249e 2024-03-29T00:03:00.619038013Z [2024-03-29T00:03:00.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6fb8db8-1949-4039-b790-0edb9ee60867 2024-03-29T00:03:01.819545442Z [2024-03-29T00:03:01.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:03:01.820152080Z [2024-03-29T00:03:01.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:02:00+00:00, run_id=scheduled__2024-03-29T00:02:00+00:00, run_start_date=2024-03-29 00:03:00.134199+00:00, run_end_date=2024-03-29 00:03:01.819480+00:00, run_duration=1.685281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:02:00+00:00, data_interval_end=2024-03-29 00:03:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:03:01.838876999Z [2024-03-29T00:03:01.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:03:00+00:00, run_after=2024-03-29T00:04:00+00:00 2024-03-29T00:03:01.919012269Z [2024-03-29T00:03:01.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status success for try_number 1 2024-03-29T00:03:01.928673165Z [2024-03-29T00:03:01.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:02:00+00:00, map_index=-1, run_start_date=2024-03-29 00:03:01.139560+00:00, run_end_date=2024-03-29 00:03:01.671369+00:00, run_duration=0.531809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:03:00.210776+00:00, queued_by_job_id=2, pid=2297 2024-03-29T00:03:04.512682756Z [2024-03-29T00:03:04.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:03:04.513212814Z [2024-03-29T00:03:04.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:02:00+00:00, run_id=scheduled__2024-03-29T00:02:00+00:00, run_start_date=2024-03-29 00:03:00.136174+00:00, run_end_date=2024-03-29 00:03:04.512520+00:00, run_duration=4.376346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:02:00+00:00, data_interval_end=2024-03-29 00:03:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:03:04.527455468Z [2024-03-29T00:03:04.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:03:00+00:00, run_after=2024-03-29T00:04:00+00:00 2024-03-29T00:03:04.535140792Z [2024-03-29T00:03:04.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:03:04.535459081Z [2024-03-29T00:03:04.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:02:00+00:00, run_id=scheduled__2024-03-29T00:02:00+00:00, run_start_date=2024-03-29 00:03:00.137429+00:00, run_end_date=2024-03-29 00:03:04.535046+00:00, run_duration=4.397617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:02:00+00:00, data_interval_end=2024-03-29 00:03:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:03:04.548726985Z [2024-03-29T00:03:04.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:03:00+00:00, run_after=2024-03-29T00:04:00+00:00 2024-03-29T00:03:04.579981434Z [2024-03-29T00:03:04.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status success for try_number 1 2024-03-29T00:03:04.580012441Z [2024-03-29T00:03:04.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status success for try_number 1 2024-03-29T00:03:04.587109632Z [2024-03-29T00:03:04.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:02:00+00:00, map_index=-1, run_start_date=2024-03-29 00:03:02.525373+00:00, run_end_date=2024-03-29 00:03:04.323905+00:00, run_duration=1.798532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:03:00.210776+00:00, queued_by_job_id=2, pid=2315 2024-03-29T00:03:04.587368616Z [2024-03-29T00:03:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:02:00+00:00, map_index=-1, run_start_date=2024-03-29 00:03:02.524461+00:00, run_end_date=2024-03-29 00:03:03.949772+00:00, run_duration=1.425311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:03:00.210776+00:00, queued_by_job_id=2, pid=2316 2024-03-29T00:03:44.186858690Z [2024-03-29T00:03:44.186+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:04:00.938807138Z [2024-03-29T00:04:00.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:04:00+00:00, run_after=2024-03-29T00:05:00+00:00 2024-03-29T00:04:00.950682646Z [2024-03-29T00:04:00.950+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:04:00.961978615Z [2024-03-29T00:04:00.961+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:04:00.984534721Z [2024-03-29T00:04:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:04:00+00:00, run_after=2024-03-29T00:05:00+00:00 2024-03-29T00:04:01.091749734Z [2024-03-29T00:04:01.091+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:04:01.091782542Z 2024-03-29T00:04:01.091788851Z 2024-03-29T00:04:01.091793915Z 2024-03-29T00:04:01.091798977Z 2024-03-29T00:04:01.092076769Z [2024-03-29T00:04:01.091+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:04:01.092367317Z [2024-03-29T00:04:01.092+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:04:01.092617580Z [2024-03-29T00:04:01.092+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:04:01.092861252Z [2024-03-29T00:04:01.092+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:04:01.093768595Z [2024-03-29T00:04:01.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:04:01.093785772Z 2024-03-29T00:04:01.093791888Z 2024-03-29T00:04:01.093821281Z 2024-03-29T00:04:01.093826364Z 2024-03-29T00:04:01.099995737Z [2024-03-29T00:04:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:04:01.100438282Z [2024-03-29T00:04:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:04:01.101017952Z [2024-03-29T00:04:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:04:01.101311802Z [2024-03-29T00:04:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:04:01.101901316Z [2024-03-29T00:04:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:04:01.102288765Z [2024-03-29T00:04:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:04:01.102836293Z [2024-03-29T00:04:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:04:01.103169978Z [2024-03-29T00:04:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:04:01.769412744Z [2024-03-29T00:04:01.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status queued for try_number 1 2024-03-29T00:04:01.769733475Z [2024-03-29T00:04:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:03:00+00:00 exited with status queued for try_number 1 2024-03-29T00:04:01.770140088Z [2024-03-29T00:04:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:03:00+00:00 exited with status queued for try_number 1 2024-03-29T00:04:01.770359963Z [2024-03-29T00:04:01.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:03:00+00:00 exited with status queued for try_number 1 2024-03-29T00:04:01.781750907Z [2024-03-29T00:04:01.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c135f8e-a3c2-4664-80b2-448649c38324 2024-03-29T00:04:01.782203279Z [2024-03-29T00:04:01.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34c46de1-079f-4eb1-989d-ce8a18a9a8b3 2024-03-29T00:04:01.782635960Z [2024-03-29T00:04:01.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89bfd40e-7d12-453a-b955-29758f0faf07 2024-03-29T00:04:01.782899130Z [2024-03-29T00:04:01.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95cc6c1f-cf9b-4387-bf19-2ea0711acb68 2024-03-29T00:04:02.703196670Z [2024-03-29T00:04:02.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:04:02.703820453Z [2024-03-29T00:04:02.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:02:00+00:00, run_id=scheduled__2024-03-29T00:02:00+00:00, run_start_date=2024-03-29 00:04:01.002137+00:00, run_end_date=2024-03-29 00:04:02.703397+00:00, run_duration=1.70126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:02:00+00:00, data_interval_end=2024-03-29 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:04:02.716474689Z [2024-03-29T00:04:02.716+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:04:00+00:00, run_after=2024-03-29T00:06:00+00:00 2024-03-29T00:04:02.941150540Z [2024-03-29T00:04:02.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:02:00+00:00 exited with status success for try_number 1 2024-03-29T00:04:02.952341647Z [2024-03-29T00:04:02.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:02:00+00:00, map_index=-1, run_start_date=2024-03-29 00:04:02.185543+00:00, run_end_date=2024-03-29 00:04:02.628331+00:00, run_duration=0.442788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:04:01.095770+00:00, queued_by_job_id=2, pid=2349 2024-03-29T00:04:04.022304945Z [2024-03-29T00:04:04.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:04:04.022778632Z [2024-03-29T00:04:04.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:03:00+00:00, run_id=scheduled__2024-03-29T00:03:00+00:00, run_start_date=2024-03-29 00:04:01.008234+00:00, run_end_date=2024-03-29 00:04:04.022161+00:00, run_duration=3.013927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:03:00+00:00, data_interval_end=2024-03-29 00:04:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:04:04.035489534Z [2024-03-29T00:04:04.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:04:00+00:00, run_after=2024-03-29T00:05:00+00:00 2024-03-29T00:04:04.087145159Z [2024-03-29T00:04:04.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:03:00+00:00 exited with status success for try_number 1 2024-03-29T00:04:04.093586962Z [2024-03-29T00:04:04.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:03:00+00:00, map_index=-1, run_start_date=2024-03-29 00:04:02.313543+00:00, run_end_date=2024-03-29 00:04:02.866571+00:00, run_duration=0.553028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:04:01.095770+00:00, queued_by_job_id=2, pid=2350 2024-03-29T00:04:06.275225969Z [2024-03-29T00:04:06.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:04:06.275626893Z [2024-03-29T00:04:06.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:03:00+00:00, run_id=scheduled__2024-03-29T00:03:00+00:00, run_start_date=2024-03-29 00:04:01.004615+00:00, run_end_date=2024-03-29 00:04:06.275127+00:00, run_duration=5.270512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:03:00+00:00, data_interval_end=2024-03-29 00:04:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:04:06.285267214Z [2024-03-29T00:04:06.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:04:00+00:00, run_after=2024-03-29T00:05:00+00:00 2024-03-29T00:04:06.292109190Z [2024-03-29T00:04:06.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:04:06.292412753Z [2024-03-29T00:04:06.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:03:00+00:00, run_id=scheduled__2024-03-29T00:03:00+00:00, run_start_date=2024-03-29 00:04:01.006596+00:00, run_end_date=2024-03-29 00:04:06.292016+00:00, run_duration=5.28542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:03:00+00:00, data_interval_end=2024-03-29 00:04:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:04:06.319535354Z [2024-03-29T00:04:06.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:04:00+00:00, run_after=2024-03-29T00:05:00+00:00 2024-03-29T00:04:06.349215714Z [2024-03-29T00:04:06.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:03:00+00:00 exited with status success for try_number 1 2024-03-29T00:04:06.349513827Z [2024-03-29T00:04:06.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:03:00+00:00 exited with status success for try_number 1 2024-03-29T00:04:06.361695518Z [2024-03-29T00:04:06.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:03:00+00:00, map_index=-1, run_start_date=2024-03-29 00:04:03.453649+00:00, run_end_date=2024-03-29 00:04:05.237546+00:00, run_duration=1.783897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:04:01.095770+00:00, queued_by_job_id=2, pid=2373 2024-03-29T00:04:06.361956266Z [2024-03-29T00:04:06.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:03:00+00:00, map_index=-1, run_start_date=2024-03-29 00:04:03.436587+00:00, run_end_date=2024-03-29 00:04:05.757403+00:00, run_duration=2.320816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:04:01.095770+00:00, queued_by_job_id=2, pid=2374 2024-03-29T00:05:00.762846410Z [2024-03-29T00:05:00.760+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:05:00+00:00, run_after=2024-03-29T00:06:00+00:00 2024-03-29T00:05:00.772403431Z [2024-03-29T00:05:00.772+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:05:00.786829522Z [2024-03-29T00:05:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:05:00+00:00, run_after=2024-03-29T00:06:00+00:00 2024-03-29T00:05:00.812451553Z [2024-03-29T00:05:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:05:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:05:00.902321913Z [2024-03-29T00:05:00.901+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:05:00.902358418Z 2024-03-29T00:05:00.902370728Z 2024-03-29T00:05:00.902376628Z 2024-03-29T00:05:00.902382934Z 2024-03-29T00:05:00.902664965Z [2024-03-29T00:05:00.902+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:05:00.902942961Z [2024-03-29T00:05:00.902+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:05:00.903143739Z [2024-03-29T00:05:00.902+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:05:00.903364329Z [2024-03-29T00:05:00.903+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:05:00.904158389Z [2024-03-29T00:05:00.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:05:00.904169732Z 2024-03-29T00:05:00.904241209Z 2024-03-29T00:05:00.904246018Z 2024-03-29T00:05:00.904250295Z 2024-03-29T00:05:00.909496312Z [2024-03-29T00:05:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:05:00.909791359Z [2024-03-29T00:05:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:05:00.910145526Z [2024-03-29T00:05:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:05:00.910377363Z [2024-03-29T00:05:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:05:00.910765796Z [2024-03-29T00:05:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:05:00.910916886Z [2024-03-29T00:05:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:05:00.911209695Z [2024-03-29T00:05:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:05:00.911412395Z [2024-03-29T00:05:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:05:01.169062777Z [2024-03-29T00:05:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:05:01.169097516Z [2024-03-29T00:05:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status queued for try_number 1 2024-03-29T00:05:01.169176509Z [2024-03-29T00:05:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status queued for try_number 1 2024-03-29T00:05:01.169247123Z [2024-03-29T00:05:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status queued for try_number 1 2024-03-29T00:05:01.180432202Z [2024-03-29T00:05:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbe7c41c-2ff8-4551-8848-1294f03000f6 2024-03-29T00:05:01.180462583Z [2024-03-29T00:05:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22f5d83e-d0ac-40c9-a2ca-1919c3d08eee 2024-03-29T00:05:01.180548090Z [2024-03-29T00:05:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88867fbd-6e0c-4007-ad5d-56f855da1c59 2024-03-29T00:05:01.180663489Z [2024-03-29T00:05:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfa554e3-eb71-421c-a257-0e37ce76c353 2024-03-29T00:05:02.410467994Z [2024-03-29T00:05:02.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:05:02.410909982Z [2024-03-29T00:05:02.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:04:00+00:00, run_id=scheduled__2024-03-29T00:04:00+00:00, run_start_date=2024-03-29 00:05:00.824975+00:00, run_end_date=2024-03-29 00:05:02.410489+00:00, run_duration=1.585514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:04:00+00:00, data_interval_end=2024-03-29 00:05:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:05:02.422540283Z [2024-03-29T00:05:02.422+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:05:00+00:00, run_after=2024-03-29T00:06:00+00:00 2024-03-29T00:05:03.275741101Z [2024-03-29T00:05:03.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status success for try_number 1 2024-03-29T00:05:03.283929797Z [2024-03-29T00:05:03.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:04:00+00:00, map_index=-1, run_start_date=2024-03-29 00:05:01.811140+00:00, run_end_date=2024-03-29 00:05:02.323734+00:00, run_duration=0.512594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:05:00.905571+00:00, queued_by_job_id=2, pid=2406 2024-03-29T00:05:03.758481801Z [2024-03-29T00:05:03.758+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:05:03.758520046Z 2024-03-29T00:05:03.758561173Z [2024-03-29T00:05:03.758+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:05:03.759159396Z [2024-03-29T00:05:03.758+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:05:03.759172406Z 2024-03-29T00:05:03.761702608Z [2024-03-29T00:05:03.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:05:03.761734659Z [2024-03-29T00:05:03.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:05:03.841177908Z [2024-03-29T00:05:03.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:05:03.855576401Z [2024-03-29T00:05:03.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2c9caa7-f133-4abf-81de-5362537424d4 2024-03-29T00:05:03.980299774Z [2024-03-29T00:05:03.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:05:03.989435367Z [2024-03-29T00:05:03.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=-1, run_start_date=2024-03-29 00:05:03.189871+00:00, run_end_date=2024-03-29 00:05:03.617602+00:00, run_duration=0.427731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:05:00.905571+00:00, queued_by_job_id=2, pid=2430 2024-03-29T00:05:06.256951957Z [2024-03-29T00:05:06.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:05:06.258771094Z [2024-03-29T00:05:06.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:04:00+00:00, run_id=scheduled__2024-03-29T00:04:00+00:00, run_start_date=2024-03-29 00:05:00.826010+00:00, run_end_date=2024-03-29 00:05:06.256850+00:00, run_duration=5.43084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:04:00+00:00, data_interval_end=2024-03-29 00:05:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:05:06.274225064Z [2024-03-29T00:05:06.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:05:00+00:00, run_after=2024-03-29T00:06:00+00:00 2024-03-29T00:05:06.286038855Z [2024-03-29T00:05:06.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:05:06.286328968Z [2024-03-29T00:05:06.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:04:00+00:00, run_id=scheduled__2024-03-29T00:04:00+00:00, run_start_date=2024-03-29 00:05:00.827029+00:00, run_end_date=2024-03-29 00:05:06.285941+00:00, run_duration=5.458912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:04:00+00:00, data_interval_end=2024-03-29 00:05:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:05:06.299167900Z [2024-03-29T00:05:06.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:05:00+00:00, run_after=2024-03-29T00:06:00+00:00 2024-03-29T00:05:06.391319825Z [2024-03-29T00:05:06.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status success for try_number 1 2024-03-29T00:05:06.391690922Z [2024-03-29T00:05:06.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status success for try_number 1 2024-03-29T00:05:06.401334405Z [2024-03-29T00:05:06.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:04:00+00:00, map_index=-1, run_start_date=2024-03-29 00:05:03.334991+00:00, run_end_date=2024-03-29 00:05:05.181704+00:00, run_duration=1.846713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:05:00.905571+00:00, queued_by_job_id=2, pid=2432 2024-03-29T00:05:06.402710266Z [2024-03-29T00:05:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:04:00+00:00, map_index=-1, run_start_date=2024-03-29 00:05:03.216094+00:00, run_end_date=2024-03-29 00:05:05.331574+00:00, run_duration=2.11548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:05:00.905571+00:00, queued_by_job_id=2, pid=2431 2024-03-29T00:05:07.503536963Z [2024-03-29T00:05:07.503+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:05:07.503583190Z 2024-03-29T00:05:07.503660786Z [2024-03-29T00:05:07.503+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:05:07.504545286Z [2024-03-29T00:05:07.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:05:07.504559161Z 2024-03-29T00:05:07.507989605Z [2024-03-29T00:05:07.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:05:07.508130975Z [2024-03-29T00:05:07.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:05:07.622934132Z [2024-03-29T00:05:07.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:05:07.623439827Z [2024-03-29T00:05:07.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:05:07.631944173Z [2024-03-29T00:05:07.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 361e64fd-af9e-42ee-9d85-d9ee556d12d8 2024-03-29T00:05:07.632435304Z [2024-03-29T00:05:07.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=-1, run_start_date=2024-03-29 00:05:06.070230+00:00, run_end_date=2024-03-29 00:05:06.463752+00:00, run_duration=0.393522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:05:03.759485+00:00, queued_by_job_id=2, pid=2455 2024-03-29T00:05:10.032739755Z [2024-03-29T00:05:10.032+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:05:10.032773881Z 2024-03-29T00:05:10.033162465Z [2024-03-29T00:05:10.032+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:05:10.034246332Z [2024-03-29T00:05:10.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:05:10.034264232Z 2024-03-29T00:05:10.041452558Z [2024-03-29T00:05:10.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:05:10.042069807Z [2024-03-29T00:05:10.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:05:10.097736667Z [2024-03-29T00:05:10.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status queued for try_number 1 2024-03-29T00:05:10.097846111Z [2024-03-29T00:05:10.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:05:10.106094311Z [2024-03-29T00:05:10.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ebd9e9e-23ba-4ea3-b615-d893c459c6f7 2024-03-29T00:05:10.106613855Z [2024-03-29T00:05:10.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=0, run_start_date=2024-03-29 00:05:09.409647+00:00, run_end_date=2024-03-29 00:05:09.774749+00:00, run_duration=0.365102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:05:07.505022+00:00, queued_by_job_id=2, pid=2463 2024-03-29T00:05:13.194716764Z [2024-03-29T00:05:13.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:05:13.195364919Z [2024-03-29T00:05:13.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:00:00+00:00, run_id=scheduled__2024-03-29T00:00:00+00:00, run_start_date=2024-03-29 00:05:00.823529+00:00, run_end_date=2024-03-29 00:05:13.194834+00:00, run_duration=12.371305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:00:00+00:00, data_interval_end=2024-03-29 00:05:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:05:13.202830631Z [2024-03-29T00:05:13.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:05:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:05:13.238826190Z [2024-03-29T00:05:13.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:00:00+00:00 exited with status success for try_number 1 2024-03-29T00:05:13.248431887Z [2024-03-29T00:05:13.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:00:00+00:00, map_index=-1, run_start_date=2024-03-29 00:05:11.823152+00:00, run_end_date=2024-03-29 00:05:12.275815+00:00, run_duration=0.452663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:05:10.037574+00:00, queued_by_job_id=2, pid=2471 2024-03-29T00:06:00.602311284Z [2024-03-29T00:06:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:06:00+00:00, run_after=2024-03-29T00:07:00+00:00 2024-03-29T00:06:00.615122244Z [2024-03-29T00:06:00.614+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:06:00.626076652Z [2024-03-29T00:06:00.625+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:06:00.646947734Z [2024-03-29T00:06:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:06:00+00:00, run_after=2024-03-29T00:07:00+00:00 2024-03-29T00:06:00.745720043Z [2024-03-29T00:06:00.745+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:06:00.745792909Z 2024-03-29T00:06:00.745804784Z 2024-03-29T00:06:00.745810607Z 2024-03-29T00:06:00.745841288Z 2024-03-29T00:06:00.745890622Z [2024-03-29T00:06:00.745+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:06:00.746012648Z [2024-03-29T00:06:00.745+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:06:00.746288570Z [2024-03-29T00:06:00.746+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:06:00.746423933Z [2024-03-29T00:06:00.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:06:00.747175500Z [2024-03-29T00:06:00.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:06:00.747193007Z 2024-03-29T00:06:00.747198217Z 2024-03-29T00:06:00.747202692Z 2024-03-29T00:06:00.747207171Z 2024-03-29T00:06:00.752396585Z [2024-03-29T00:06:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:06:00.752616030Z [2024-03-29T00:06:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:06:00.753029353Z [2024-03-29T00:06:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:06:00.753254315Z [2024-03-29T00:06:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:06:00.753643211Z [2024-03-29T00:06:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:06:00.753873493Z [2024-03-29T00:06:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:06:00.754300251Z [2024-03-29T00:06:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:06:00.754600052Z [2024-03-29T00:06:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:06:01.093602390Z [2024-03-29T00:06:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status queued for try_number 1 2024-03-29T00:06:01.094058616Z [2024-03-29T00:06:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status queued for try_number 1 2024-03-29T00:06:01.094359036Z [2024-03-29T00:06:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status queued for try_number 1 2024-03-29T00:06:01.094717226Z [2024-03-29T00:06:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status queued for try_number 1 2024-03-29T00:06:01.124042274Z [2024-03-29T00:06:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to fed58821-3f95-40d7-a9cb-b3e4949efdbd 2024-03-29T00:06:01.124595183Z [2024-03-29T00:06:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to b08d80c2-47bc-4092-b6d6-d69283c4d109 2024-03-29T00:06:01.125112582Z [2024-03-29T00:06:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b7b4552-2dac-4ec3-8818-cb9fead1301f 2024-03-29T00:06:01.126285223Z [2024-03-29T00:06:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28773302-2538-40bd-bcce-ced9520300e5 2024-03-29T00:06:02.420146312Z [2024-03-29T00:06:02.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:06:02.421447516Z [2024-03-29T00:06:02.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:05:00+00:00, run_id=scheduled__2024-03-29T00:05:00+00:00, run_start_date=2024-03-29 00:06:00.665744+00:00, run_end_date=2024-03-29 00:06:02.420118+00:00, run_duration=1.754374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:05:00+00:00, data_interval_end=2024-03-29 00:06:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:06:02.433001718Z [2024-03-29T00:06:02.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:06:00+00:00, run_after=2024-03-29T00:07:00+00:00 2024-03-29T00:06:02.493688061Z [2024-03-29T00:06:02.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status success for try_number 1 2024-03-29T00:06:02.505618593Z [2024-03-29T00:06:02.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:05:00+00:00, map_index=-1, run_start_date=2024-03-29 00:06:01.820672+00:00, run_end_date=2024-03-29 00:06:02.235079+00:00, run_duration=0.414407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:06:00.748263+00:00, queued_by_job_id=2, pid=2494 2024-03-29T00:06:03.557456434Z [2024-03-29T00:06:03.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:06:03.558000760Z [2024-03-29T00:06:03.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:04:00+00:00, run_id=scheduled__2024-03-29T00:04:00+00:00, run_start_date=2024-03-29 00:06:00.663216+00:00, run_end_date=2024-03-29 00:06:03.557472+00:00, run_duration=2.894256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:04:00+00:00, data_interval_end=2024-03-29 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:06:03.579307240Z [2024-03-29T00:06:03.578+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:06:00+00:00, run_after=2024-03-29T00:08:00+00:00 2024-03-29T00:06:03.682009328Z [2024-03-29T00:06:03.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:04:00+00:00 exited with status success for try_number 1 2024-03-29T00:06:03.689265441Z [2024-03-29T00:06:03.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:04:00+00:00, map_index=-1, run_start_date=2024-03-29 00:06:01.890769+00:00, run_end_date=2024-03-29 00:06:02.479653+00:00, run_duration=0.588884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:06:00.748263+00:00, queued_by_job_id=2, pid=2495 2024-03-29T00:06:05.691613616Z [2024-03-29T00:06:05.691+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:06:05.692173837Z [2024-03-29T00:06:05.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:05:00+00:00, run_id=scheduled__2024-03-29T00:05:00+00:00, run_start_date=2024-03-29 00:06:00.667470+00:00, run_end_date=2024-03-29 00:06:05.691524+00:00, run_duration=5.024054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:05:00+00:00, data_interval_end=2024-03-29 00:06:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:06:05.705919592Z [2024-03-29T00:06:05.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:06:00+00:00, run_after=2024-03-29T00:07:00+00:00 2024-03-29T00:06:05.732544161Z [2024-03-29T00:06:05.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:06:05.732621910Z [2024-03-29T00:06:05.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:05:00+00:00, run_id=scheduled__2024-03-29T00:05:00+00:00, run_start_date=2024-03-29 00:06:00.668849+00:00, run_end_date=2024-03-29 00:06:05.726306+00:00, run_duration=5.057457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:05:00+00:00, data_interval_end=2024-03-29 00:06:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:06:05.747285495Z [2024-03-29T00:06:05.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:06:00+00:00, run_after=2024-03-29T00:07:00+00:00 2024-03-29T00:06:05.788170694Z [2024-03-29T00:06:05.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status success for try_number 1 2024-03-29T00:06:05.788342486Z [2024-03-29T00:06:05.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status success for try_number 1 2024-03-29T00:06:05.797526562Z [2024-03-29T00:06:05.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:05:00+00:00, map_index=-1, run_start_date=2024-03-29 00:06:03.333613+00:00, run_end_date=2024-03-29 00:06:04.688063+00:00, run_duration=1.35445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:06:00.748263+00:00, queued_by_job_id=2, pid=2518 2024-03-29T00:06:05.797780806Z [2024-03-29T00:06:05.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:05:00+00:00, map_index=-1, run_start_date=2024-03-29 00:06:03.383050+00:00, run_end_date=2024-03-29 00:06:05.056082+00:00, run_duration=1.673032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:06:00.748263+00:00, queued_by_job_id=2, pid=2519 2024-03-29T00:07:00.291287441Z [2024-03-29T00:07:00.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:07:00+00:00, run_after=2024-03-29T00:08:00+00:00 2024-03-29T00:07:00.305092384Z [2024-03-29T00:07:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:07:00+00:00, run_after=2024-03-29T00:08:00+00:00 2024-03-29T00:07:00.313261312Z [2024-03-29T00:07:00.312+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:07:00.383728570Z [2024-03-29T00:07:00.383+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:07:00.383764551Z 2024-03-29T00:07:00.383769256Z 2024-03-29T00:07:00.383773269Z 2024-03-29T00:07:00.384046915Z [2024-03-29T00:07:00.383+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:07:00.384274789Z [2024-03-29T00:07:00.384+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:07:00.384438894Z [2024-03-29T00:07:00.384+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:07:00.385297107Z [2024-03-29T00:07:00.385+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:07:00.385313886Z 2024-03-29T00:07:00.385319088Z 2024-03-29T00:07:00.385323866Z 2024-03-29T00:07:00.389647467Z [2024-03-29T00:07:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:07:00.389998547Z [2024-03-29T00:07:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:07:00.390526804Z [2024-03-29T00:07:00.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:07:00.390824044Z [2024-03-29T00:07:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:07:00.391115306Z [2024-03-29T00:07:00.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:07:00.391308213Z [2024-03-29T00:07:00.391+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:07:00.627635618Z [2024-03-29T00:07:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status queued for try_number 1 2024-03-29T00:07:00.627825858Z [2024-03-29T00:07:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status queued for try_number 1 2024-03-29T00:07:00.627973714Z [2024-03-29T00:07:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status queued for try_number 1 2024-03-29T00:07:00.638922558Z [2024-03-29T00:07:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87ec0a90-0da6-499d-83aa-fa3a94a0f58d 2024-03-29T00:07:00.639129848Z [2024-03-29T00:07:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1d2bf6e-faad-40d1-8e56-6e4b53ade53f 2024-03-29T00:07:00.639298328Z [2024-03-29T00:07:00.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c4e90ec-2e31-40ad-b70b-79fea7c33d1b 2024-03-29T00:07:01.773652245Z [2024-03-29T00:07:01.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:07:01.773873645Z [2024-03-29T00:07:01.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:06:00+00:00, run_id=scheduled__2024-03-29T00:06:00+00:00, run_start_date=2024-03-29 00:07:00.324676+00:00, run_end_date=2024-03-29 00:07:01.773531+00:00, run_duration=1.448855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:06:00+00:00, data_interval_end=2024-03-29 00:07:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:07:01.785949317Z [2024-03-29T00:07:01.785+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:07:00+00:00, run_after=2024-03-29T00:08:00+00:00 2024-03-29T00:07:01.851964289Z [2024-03-29T00:07:01.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status success for try_number 1 2024-03-29T00:07:01.861708612Z [2024-03-29T00:07:01.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:06:00+00:00, map_index=-1, run_start_date=2024-03-29 00:07:01.151573+00:00, run_end_date=2024-03-29 00:07:01.550065+00:00, run_duration=0.398492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:07:00.386247+00:00, queued_by_job_id=2, pid=2552 2024-03-29T00:07:05.097922369Z [2024-03-29T00:07:05.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:07:05.098177573Z [2024-03-29T00:07:05.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:06:00+00:00, run_id=scheduled__2024-03-29T00:06:00+00:00, run_start_date=2024-03-29 00:07:00.325953+00:00, run_end_date=2024-03-29 00:07:05.097820+00:00, run_duration=4.771867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:06:00+00:00, data_interval_end=2024-03-29 00:07:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:07:05.107543973Z [2024-03-29T00:07:05.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:07:00+00:00, run_after=2024-03-29T00:08:00+00:00 2024-03-29T00:07:05.115275778Z [2024-03-29T00:07:05.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:07:05.115571255Z [2024-03-29T00:07:05.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:06:00+00:00, run_id=scheduled__2024-03-29T00:06:00+00:00, run_start_date=2024-03-29 00:07:00.327066+00:00, run_end_date=2024-03-29 00:07:05.115186+00:00, run_duration=4.78812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:06:00+00:00, data_interval_end=2024-03-29 00:07:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:07:05.127346787Z [2024-03-29T00:07:05.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:07:00+00:00, run_after=2024-03-29T00:08:00+00:00 2024-03-29T00:07:05.216980416Z [2024-03-29T00:07:05.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status success for try_number 1 2024-03-29T00:07:05.217008162Z [2024-03-29T00:07:05.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status success for try_number 1 2024-03-29T00:07:05.223703276Z [2024-03-29T00:07:05.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:06:00+00:00, map_index=-1, run_start_date=2024-03-29 00:07:02.196855+00:00, run_end_date=2024-03-29 00:07:04.305654+00:00, run_duration=2.108799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:07:00.386247+00:00, queued_by_job_id=2, pid=2570 2024-03-29T00:07:05.223887933Z [2024-03-29T00:07:05.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:06:00+00:00, map_index=-1, run_start_date=2024-03-29 00:07:02.259801+00:00, run_end_date=2024-03-29 00:07:04.336755+00:00, run_duration=2.076954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:07:00.386247+00:00, queued_by_job_id=2, pid=2571 2024-03-29T00:08:00.797484640Z [2024-03-29T00:08:00.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:08:00+00:00, run_after=2024-03-29T00:09:00+00:00 2024-03-29T00:08:00.813383271Z [2024-03-29T00:08:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:08:00+00:00, run_after=2024-03-29T00:09:00+00:00 2024-03-29T00:08:00.821499563Z [2024-03-29T00:08:00.820+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:08:00.828339279Z [2024-03-29T00:08:00.828+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:08:00.902489574Z [2024-03-29T00:08:00.902+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:08:00.902514785Z 2024-03-29T00:08:00.902522633Z 2024-03-29T00:08:00.902526230Z 2024-03-29T00:08:00.902529551Z 2024-03-29T00:08:00.902664220Z [2024-03-29T00:08:00.902+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:08:00.902796265Z [2024-03-29T00:08:00.902+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:08:00.902917021Z [2024-03-29T00:08:00.902+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:08:00.903049846Z [2024-03-29T00:08:00.902+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:08:00.903683207Z [2024-03-29T00:08:00.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:08:00.903695319Z 2024-03-29T00:08:00.903699008Z 2024-03-29T00:08:00.903702141Z 2024-03-29T00:08:00.903705314Z 2024-03-29T00:08:00.907280063Z [2024-03-29T00:08:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:08:00.907451138Z [2024-03-29T00:08:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:08:00.907702068Z [2024-03-29T00:08:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:08:00.907908636Z [2024-03-29T00:08:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:08:00.908149678Z [2024-03-29T00:08:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:08:00.908387418Z [2024-03-29T00:08:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:08:00.908649643Z [2024-03-29T00:08:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:08:00.908676225Z [2024-03-29T00:08:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:08:01.249702595Z [2024-03-29T00:08:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status queued for try_number 1 2024-03-29T00:08:01.250027413Z [2024-03-29T00:08:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:07:00+00:00 exited with status queued for try_number 1 2024-03-29T00:08:01.250249945Z [2024-03-29T00:08:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:07:00+00:00 exited with status queued for try_number 1 2024-03-29T00:08:01.250399622Z [2024-03-29T00:08:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:07:00+00:00 exited with status queued for try_number 1 2024-03-29T00:08:01.273175917Z [2024-03-29T00:08:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 223cea11-ff5f-424f-977d-53680f064410 2024-03-29T00:08:01.277187573Z [2024-03-29T00:08:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4274d983-14c3-4b95-8b13-6d5fdec72d7d 2024-03-29T00:08:01.277374394Z [2024-03-29T00:08:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f156672-f8cc-4028-ac4e-3b47518d8f3a 2024-03-29T00:08:01.277577149Z [2024-03-29T00:08:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b975bbc-fe4b-4652-9e02-06001c5f6f77 2024-03-29T00:08:03.755712129Z [2024-03-29T00:08:03.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:08:03.756176996Z [2024-03-29T00:08:03.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:06:00+00:00, run_id=scheduled__2024-03-29T00:06:00+00:00, run_start_date=2024-03-29 00:08:00.838899+00:00, run_end_date=2024-03-29 00:08:03.755731+00:00, run_duration=2.916832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:06:00+00:00, data_interval_end=2024-03-29 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:08:03.765315093Z [2024-03-29T00:08:03.764+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:08:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:08:03.773571675Z [2024-03-29T00:08:03.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:08:03.774026474Z [2024-03-29T00:08:03.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:07:00+00:00, run_id=scheduled__2024-03-29T00:07:00+00:00, run_start_date=2024-03-29 00:08:00.840303+00:00, run_end_date=2024-03-29 00:08:03.773574+00:00, run_duration=2.933271, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:07:00+00:00, data_interval_end=2024-03-29 00:08:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:08:03.788136437Z [2024-03-29T00:08:03.787+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:08:00+00:00, run_after=2024-03-29T00:09:00+00:00 2024-03-29T00:08:03.866189653Z [2024-03-29T00:08:03.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:06:00+00:00 exited with status success for try_number 1 2024-03-29T00:08:03.866650879Z [2024-03-29T00:08:03.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:07:00+00:00 exited with status success for try_number 1 2024-03-29T00:08:03.877930135Z [2024-03-29T00:08:03.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:06:00+00:00, map_index=-1, run_start_date=2024-03-29 00:08:02.345420+00:00, run_end_date=2024-03-29 00:08:02.863431+00:00, run_duration=0.518011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:08:00.904512+00:00, queued_by_job_id=2, pid=2604 2024-03-29T00:08:03.878410268Z [2024-03-29T00:08:03.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:07:00+00:00, map_index=-1, run_start_date=2024-03-29 00:08:02.698161+00:00, run_end_date=2024-03-29 00:08:03.198523+00:00, run_duration=0.500362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:08:00.904512+00:00, queued_by_job_id=2, pid=2607 2024-03-29T00:08:05.496714152Z [2024-03-29T00:08:05.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:08:05.497465116Z [2024-03-29T00:08:05.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:07:00+00:00, run_id=scheduled__2024-03-29T00:07:00+00:00, run_start_date=2024-03-29 00:08:00.841415+00:00, run_end_date=2024-03-29 00:08:05.496840+00:00, run_duration=4.655425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:07:00+00:00, data_interval_end=2024-03-29 00:08:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:08:05.510576248Z [2024-03-29T00:08:05.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:08:00+00:00, run_after=2024-03-29T00:09:00+00:00 2024-03-29T00:08:05.526560075Z [2024-03-29T00:08:05.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:08:05.526847878Z [2024-03-29T00:08:05.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:07:00+00:00, run_id=scheduled__2024-03-29T00:07:00+00:00, run_start_date=2024-03-29 00:08:00.842507+00:00, run_end_date=2024-03-29 00:08:05.526388+00:00, run_duration=4.683881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:07:00+00:00, data_interval_end=2024-03-29 00:08:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:08:05.539439350Z [2024-03-29T00:08:05.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:08:00+00:00, run_after=2024-03-29T00:09:00+00:00 2024-03-29T00:08:05.576317653Z [2024-03-29T00:08:05.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:07:00+00:00 exited with status success for try_number 1 2024-03-29T00:08:05.576387341Z [2024-03-29T00:08:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:07:00+00:00 exited with status success for try_number 1 2024-03-29T00:08:05.587066977Z [2024-03-29T00:08:05.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:07:00+00:00, map_index=-1, run_start_date=2024-03-29 00:08:03.577726+00:00, run_end_date=2024-03-29 00:08:04.924761+00:00, run_duration=1.347035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:08:00.904512+00:00, queued_by_job_id=2, pid=2629 2024-03-29T00:08:05.587422887Z [2024-03-29T00:08:05.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:07:00+00:00, map_index=-1, run_start_date=2024-03-29 00:08:03.400684+00:00, run_end_date=2024-03-29 00:08:05.346011+00:00, run_duration=1.945327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:08:00.904512+00:00, queued_by_job_id=2, pid=2628 2024-03-29T00:08:44.275949472Z [2024-03-29T00:08:44.275+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:09:00.385643652Z [2024-03-29T00:09:00.385+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:09:00.398230919Z [2024-03-29T00:09:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:09:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:09:00.414928317Z [2024-03-29T00:09:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:09:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:09:00.488038752Z [2024-03-29T00:09:00.487+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:09:00.488096784Z 2024-03-29T00:09:00.488103252Z 2024-03-29T00:09:00.488107928Z 2024-03-29T00:09:00.488146051Z [2024-03-29T00:09:00.487+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:09:00.488211572Z [2024-03-29T00:09:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:09:00.488219978Z [2024-03-29T00:09:00.488+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:09:00.488916548Z [2024-03-29T00:09:00.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:09:00.488936739Z 2024-03-29T00:09:00.488943325Z 2024-03-29T00:09:00.488981188Z 2024-03-29T00:09:00.493184434Z [2024-03-29T00:09:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:09:00.493244302Z [2024-03-29T00:09:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:09:00.493417986Z [2024-03-29T00:09:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:09:00.493445446Z [2024-03-29T00:09:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:09:00.493621517Z [2024-03-29T00:09:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:09:00.493682572Z [2024-03-29T00:09:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:09:00.813467732Z [2024-03-29T00:09:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status queued for try_number 1 2024-03-29T00:09:00.813772011Z [2024-03-29T00:09:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status queued for try_number 1 2024-03-29T00:09:00.813977574Z [2024-03-29T00:09:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status queued for try_number 1 2024-03-29T00:09:00.824392881Z [2024-03-29T00:09:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe1911da-a57a-4a30-af9b-9719613be34c 2024-03-29T00:09:00.824692756Z [2024-03-29T00:09:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ff2a46a-b0aa-4f77-9525-152f5218a057 2024-03-29T00:09:00.824949432Z [2024-03-29T00:09:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 907eb976-5023-4f02-829f-b471b5639fdf 2024-03-29T00:09:02.308957048Z [2024-03-29T00:09:02.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:09:02.309449457Z [2024-03-29T00:09:02.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:08:00+00:00, run_id=scheduled__2024-03-29T00:08:00+00:00, run_start_date=2024-03-29 00:09:00.425821+00:00, run_end_date=2024-03-29 00:09:02.308945+00:00, run_duration=1.883124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:08:00+00:00, data_interval_end=2024-03-29 00:09:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:09:02.339646685Z [2024-03-29T00:09:02.339+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:09:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:09:03.546074420Z [2024-03-29T00:09:03.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status success for try_number 1 2024-03-29T00:09:03.557503010Z [2024-03-29T00:09:03.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:08:00+00:00, map_index=-1, run_start_date=2024-03-29 00:09:01.722005+00:00, run_end_date=2024-03-29 00:09:02.231306+00:00, run_duration=0.509301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:09:00.489732+00:00, queued_by_job_id=2, pid=2662 2024-03-29T00:09:04.613702366Z [2024-03-29T00:09:04.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:09:04.613978667Z [2024-03-29T00:09:04.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:08:00+00:00, run_id=scheduled__2024-03-29T00:08:00+00:00, run_start_date=2024-03-29 00:09:00.427166+00:00, run_end_date=2024-03-29 00:09:04.613607+00:00, run_duration=4.186441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:08:00+00:00, data_interval_end=2024-03-29 00:09:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:09:04.623105960Z [2024-03-29T00:09:04.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:09:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:09:04.661062709Z [2024-03-29T00:09:04.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status success for try_number 1 2024-03-29T00:09:04.672052090Z [2024-03-29T00:09:04.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:08:00+00:00, map_index=-1, run_start_date=2024-03-29 00:09:02.770619+00:00, run_end_date=2024-03-29 00:09:04.265799+00:00, run_duration=1.49518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:09:00.489732+00:00, queued_by_job_id=2, pid=2680 2024-03-29T00:09:04.802290970Z [2024-03-29T00:09:04.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:09:04.807335501Z [2024-03-29T00:09:04.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:08:00+00:00, run_id=scheduled__2024-03-29T00:08:00+00:00, run_start_date=2024-03-29 00:09:00.428225+00:00, run_end_date=2024-03-29 00:09:04.806510+00:00, run_duration=4.378285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:08:00+00:00, data_interval_end=2024-03-29 00:09:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:09:04.828944898Z [2024-03-29T00:09:04.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:09:00+00:00, run_after=2024-03-29T00:10:00+00:00 2024-03-29T00:09:04.869423310Z [2024-03-29T00:09:04.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status success for try_number 1 2024-03-29T00:09:04.875187554Z [2024-03-29T00:09:04.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:08:00+00:00, map_index=-1, run_start_date=2024-03-29 00:09:02.718252+00:00, run_end_date=2024-03-29 00:09:04.603693+00:00, run_duration=1.885441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:09:00.489732+00:00, queued_by_job_id=2, pid=2679 2024-03-29T00:10:00.230590879Z [2024-03-29T00:10:00.229+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:10:00.241495857Z [2024-03-29T00:10:00.240+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:10:00.264774401Z [2024-03-29T00:10:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:11:00+00:00 2024-03-29T00:10:00.278688446Z [2024-03-29T00:10:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:11:00+00:00 2024-03-29T00:10:00.294580073Z [2024-03-29T00:10:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:15:00+00:00 2024-03-29T00:10:00.437553420Z [2024-03-29T00:10:00.436+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T00:10:00.437587033Z 2024-03-29T00:10:00.437593482Z 2024-03-29T00:10:00.437599188Z 2024-03-29T00:10:00.437604334Z 2024-03-29T00:10:00.437609601Z 2024-03-29T00:10:00.437614482Z [2024-03-29T00:10:00.437+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:10:00.437949882Z [2024-03-29T00:10:00.437+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:10:00.438230308Z [2024-03-29T00:10:00.437+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:10:00.438546980Z [2024-03-29T00:10:00.438+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:10:00.438855905Z [2024-03-29T00:10:00.438+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:10:00.439854877Z [2024-03-29T00:10:00.439+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:10:00.439875640Z 2024-03-29T00:10:00.439884235Z 2024-03-29T00:10:00.439890796Z 2024-03-29T00:10:00.439895516Z 2024-03-29T00:10:00.439900365Z 2024-03-29T00:10:00.445664681Z [2024-03-29T00:10:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:10:00.445962647Z [2024-03-29T00:10:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:10:00.446324390Z [2024-03-29T00:10:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:10:00.446597653Z [2024-03-29T00:10:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:10:00.446937765Z [2024-03-29T00:10:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:10:00.447157369Z [2024-03-29T00:10:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:10:00.447534375Z [2024-03-29T00:10:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:10:00.447808915Z [2024-03-29T00:10:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:10:00.448334487Z [2024-03-29T00:10:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:10:00.448710449Z [2024-03-29T00:10:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:10:01.108638426Z [2024-03-29T00:10:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:01.108892536Z [2024-03-29T00:10:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:01.109131742Z [2024-03-29T00:10:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:09:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:01.109339515Z [2024-03-29T00:10:01.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:09:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:01.109625281Z [2024-03-29T00:10:01.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:09:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:01.125790565Z [2024-03-29T00:10:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85a1f991-9e36-436b-a4c0-1cfd4dabfbbc 2024-03-29T00:10:01.126175005Z [2024-03-29T00:10:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to d62c4b68-eb2f-471a-94d0-878d34a0edb4 2024-03-29T00:10:01.126470815Z [2024-03-29T00:10:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4372f91-1251-4de8-be3a-c80d371d2dbc 2024-03-29T00:10:01.126827024Z [2024-03-29T00:10:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 605b61d8-94e3-4b06-bef1-e58258b49acf 2024-03-29T00:10:01.127096408Z [2024-03-29T00:10:01.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcc258f2-cd45-47a6-9b62-89b8a470cf59 2024-03-29T00:10:02.465393249Z [2024-03-29T00:10:02.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:10:02.465707481Z [2024-03-29T00:10:02.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:08:00+00:00, run_id=scheduled__2024-03-29T00:08:00+00:00, run_start_date=2024-03-29 00:10:00.307333+00:00, run_end_date=2024-03-29 00:10:02.465221+00:00, run_duration=2.157888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:08:00+00:00, data_interval_end=2024-03-29 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:10:02.475346215Z [2024-03-29T00:10:02.474+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:12:00+00:00 2024-03-29T00:10:02.492486142Z [2024-03-29T00:10:02.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:10:02.492947927Z [2024-03-29T00:10:02.492+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:09:00+00:00, run_id=scheduled__2024-03-29T00:09:00+00:00, run_start_date=2024-03-29 00:10:00.308485+00:00, run_end_date=2024-03-29 00:10:02.492320+00:00, run_duration=2.183835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:09:00+00:00, data_interval_end=2024-03-29 00:10:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:10:02.504407134Z [2024-03-29T00:10:02.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:11:00+00:00 2024-03-29T00:10:02.608812158Z [2024-03-29T00:10:02.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:08:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:02.608840568Z [2024-03-29T00:10:02.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:09:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:02.617377808Z [2024-03-29T00:10:02.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:09:00+00:00, map_index=-1, run_start_date=2024-03-29 00:10:01.574894+00:00, run_end_date=2024-03-29 00:10:02.139811+00:00, run_duration=0.564917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:00.441372+00:00, queued_by_job_id=2, pid=2714 2024-03-29T00:10:02.617755704Z [2024-03-29T00:10:02.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:08:00+00:00, map_index=-1, run_start_date=2024-03-29 00:10:01.547627+00:00, run_end_date=2024-03-29 00:10:02.002997+00:00, run_duration=0.45537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:00.441372+00:00, queued_by_job_id=2, pid=2713 2024-03-29T00:10:05.202547864Z [2024-03-29T00:10:05.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:10:05.202583466Z [2024-03-29T00:10:05.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:09:00+00:00, run_id=scheduled__2024-03-29T00:09:00+00:00, run_start_date=2024-03-29 00:10:00.309505+00:00, run_end_date=2024-03-29 00:10:05.199407+00:00, run_duration=4.889902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:09:00+00:00, data_interval_end=2024-03-29 00:10:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:10:05.234554151Z [2024-03-29T00:10:05.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:11:00+00:00 2024-03-29T00:10:05.276574649Z [2024-03-29T00:10:05.276+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:10:05.276606821Z 2024-03-29T00:10:05.276899322Z [2024-03-29T00:10:05.276+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:10:05.277734296Z [2024-03-29T00:10:05.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:10:05.277748755Z 2024-03-29T00:10:05.282351506Z [2024-03-29T00:10:05.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:10:05.282693493Z [2024-03-29T00:10:05.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:10:05.341028996Z [2024-03-29T00:10:05.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:05.341354689Z [2024-03-29T00:10:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:05.341543145Z [2024-03-29T00:10:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:09:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:05.349277305Z [2024-03-29T00:10:05.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:05:00+00:00, map_index=-1, run_start_date=2024-03-29 00:10:03.806656+00:00, run_end_date=2024-03-29 00:10:04.329362+00:00, run_duration=0.522706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:00.441372+00:00, queued_by_job_id=2, pid=2749 2024-03-29T00:10:05.349697264Z [2024-03-29T00:10:05.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6cfa519-229c-44e3-a89d-af597dd2e385 2024-03-29T00:10:05.349960138Z [2024-03-29T00:10:05.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:09:00+00:00, map_index=-1, run_start_date=2024-03-29 00:10:03.263994+00:00, run_end_date=2024-03-29 00:10:04.704165+00:00, run_duration=1.440171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:00.441372+00:00, queued_by_job_id=2, pid=2733 2024-03-29T00:10:06.545145696Z [2024-03-29T00:10:06.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:10:06.545908462Z [2024-03-29T00:10:06.545+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:09:00+00:00, run_id=scheduled__2024-03-29T00:09:00+00:00, run_start_date=2024-03-29 00:10:00.310529+00:00, run_end_date=2024-03-29 00:10:06.545004+00:00, run_duration=6.234475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:09:00+00:00, data_interval_end=2024-03-29 00:10:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:10:06.567998428Z [2024-03-29T00:10:06.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:11:00+00:00 2024-03-29T00:10:06.680589445Z [2024-03-29T00:10:06.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:09:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:06.700520058Z [2024-03-29T00:10:06.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:09:00+00:00, map_index=-1, run_start_date=2024-03-29 00:10:03.787774+00:00, run_end_date=2024-03-29 00:10:05.543959+00:00, run_duration=1.756185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:00.441372+00:00, queued_by_job_id=2, pid=2750 2024-03-29T00:10:09.611203903Z [2024-03-29T00:10:09.610+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:10:09.611251927Z 2024-03-29T00:10:09.611592792Z [2024-03-29T00:10:09.611+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:10:09.612534605Z [2024-03-29T00:10:09.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:10:09.612555213Z 2024-03-29T00:10:09.615614256Z [2024-03-29T00:10:09.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:10:09.615814022Z [2024-03-29T00:10:09.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:10:09.696259000Z [2024-03-29T00:10:09.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:09.696479818Z [2024-03-29T00:10:09.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:09.709513228Z [2024-03-29T00:10:09.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f8b2788-46e1-4f26-a81f-88b343da905f 2024-03-29T00:10:09.709954281Z [2024-03-29T00:10:09.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:05:00+00:00, map_index=-1, run_start_date=2024-03-29 00:10:08.164340+00:00, run_end_date=2024-03-29 00:10:08.731800+00:00, run_duration=0.56746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:05.278898+00:00, queued_by_job_id=2, pid=2768 2024-03-29T00:10:13.058256471Z [2024-03-29T00:10:13.057+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:10:13.058285609Z 2024-03-29T00:10:13.058778805Z [2024-03-29T00:10:13.058+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:10:13.059724836Z [2024-03-29T00:10:13.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:10:13.059738036Z 2024-03-29T00:10:13.062262921Z [2024-03-29T00:10:13.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:10:13.062630802Z [2024-03-29T00:10:13.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:10:13.110004228Z [2024-03-29T00:10:13.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status queued for try_number 1 2024-03-29T00:10:13.110196655Z [2024-03-29T00:10:13.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:13.117275978Z [2024-03-29T00:10:13.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ae7a6b1-0be6-4393-81c4-d4939879cf5a 2024-03-29T00:10:13.117481267Z [2024-03-29T00:10:13.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:05:00+00:00, map_index=0, run_start_date=2024-03-29 00:10:11.412026+00:00, run_end_date=2024-03-29 00:10:11.839965+00:00, run_duration=0.427939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:09.612978+00:00, queued_by_job_id=2, pid=2776 2024-03-29T00:10:15.406836127Z [2024-03-29T00:10:15.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:10:15.407109334Z [2024-03-29T00:10:15.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:05:00+00:00, run_id=scheduled__2024-03-29T00:05:00+00:00, run_start_date=2024-03-29 00:10:00.305730+00:00, run_end_date=2024-03-29 00:10:15.406696+00:00, run_duration=15.100966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:05:00+00:00, data_interval_end=2024-03-29 00:10:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:10:15.417689883Z [2024-03-29T00:10:15.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:10:00+00:00, run_after=2024-03-29T00:15:00+00:00 2024-03-29T00:10:15.457250341Z [2024-03-29T00:10:15.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:05:00+00:00 exited with status success for try_number 1 2024-03-29T00:10:15.462844253Z [2024-03-29T00:10:15.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:05:00+00:00, map_index=-1, run_start_date=2024-03-29 00:10:14.697219+00:00, run_end_date=2024-03-29 00:10:15.069823+00:00, run_duration=0.372604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:10:13.060165+00:00, queued_by_job_id=2, pid=2784 2024-03-29T00:11:00.250786370Z [2024-03-29T00:11:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:11:00+00:00, run_after=2024-03-29T00:12:00+00:00 2024-03-29T00:11:00.258017330Z [2024-03-29T00:11:00.257+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:11:00.269638422Z [2024-03-29T00:11:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:11:00+00:00, run_after=2024-03-29T00:12:00+00:00 2024-03-29T00:11:00.348499969Z [2024-03-29T00:11:00.347+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:11:00.348525017Z 2024-03-29T00:11:00.348528903Z 2024-03-29T00:11:00.348532446Z 2024-03-29T00:11:00.349014259Z [2024-03-29T00:11:00.348+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:11:00.349464601Z [2024-03-29T00:11:00.349+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:11:00.349996587Z [2024-03-29T00:11:00.349+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:11:00.351571290Z [2024-03-29T00:11:00.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:11:00.351585449Z 2024-03-29T00:11:00.351589420Z 2024-03-29T00:11:00.351593200Z 2024-03-29T00:11:00.355804904Z [2024-03-29T00:11:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:11:00.356073063Z [2024-03-29T00:11:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:11:00.356487219Z [2024-03-29T00:11:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:11:00.356754816Z [2024-03-29T00:11:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:11:00.357075194Z [2024-03-29T00:11:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:11:00.357300514Z [2024-03-29T00:11:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:11:00.541897811Z [2024-03-29T00:11:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:11:00.541960372Z [2024-03-29T00:11:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:11:00.542007110Z [2024-03-29T00:11:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:11:00.549944259Z [2024-03-29T00:11:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe3656dc-10b3-4d95-9f2b-8d979139572a 2024-03-29T00:11:00.549972879Z [2024-03-29T00:11:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 006b6ca8-7bc5-4e0c-acfc-aa43e9a00ca0 2024-03-29T00:11:00.550107915Z [2024-03-29T00:11:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d1210db-bd11-45f2-92f9-d2fb09103409 2024-03-29T00:11:01.705372314Z [2024-03-29T00:11:01.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:11:01.705589832Z [2024-03-29T00:11:01.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:10:00+00:00, run_id=scheduled__2024-03-29T00:10:00+00:00, run_start_date=2024-03-29 00:11:00.281223+00:00, run_end_date=2024-03-29 00:11:01.705261+00:00, run_duration=1.424038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:10:00+00:00, data_interval_end=2024-03-29 00:11:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:11:01.742896291Z [2024-03-29T00:11:01.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:11:00+00:00, run_after=2024-03-29T00:12:00+00:00 2024-03-29T00:11:01.821388555Z [2024-03-29T00:11:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:11:01.829816438Z [2024-03-29T00:11:01.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=-1, run_start_date=2024-03-29 00:11:01.124309+00:00, run_end_date=2024-03-29 00:11:01.555083+00:00, run_duration=0.430774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:11:00.352768+00:00, queued_by_job_id=2, pid=2806 2024-03-29T00:11:03.983435491Z [2024-03-29T00:11:03.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:11:03.984131306Z [2024-03-29T00:11:03.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:10:00+00:00, run_id=scheduled__2024-03-29T00:10:00+00:00, run_start_date=2024-03-29 00:11:00.283842+00:00, run_end_date=2024-03-29 00:11:03.983154+00:00, run_duration=3.699312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:10:00+00:00, data_interval_end=2024-03-29 00:11:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:11:03.996099097Z [2024-03-29T00:11:03.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:11:00+00:00, run_after=2024-03-29T00:12:00+00:00 2024-03-29T00:11:04.005618354Z [2024-03-29T00:11:04.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:11:04.006162272Z [2024-03-29T00:11:04.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:10:00+00:00, run_id=scheduled__2024-03-29T00:10:00+00:00, run_start_date=2024-03-29 00:11:00.285924+00:00, run_end_date=2024-03-29 00:11:04.005425+00:00, run_duration=3.719501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:10:00+00:00, data_interval_end=2024-03-29 00:11:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:11:04.019149811Z [2024-03-29T00:11:04.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:11:00+00:00, run_after=2024-03-29T00:12:00+00:00 2024-03-29T00:11:04.054995588Z [2024-03-29T00:11:04.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:11:04.061308706Z [2024-03-29T00:11:04.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=-1, run_start_date=2024-03-29 00:11:02.217530+00:00, run_end_date=2024-03-29 00:11:03.468697+00:00, run_duration=1.251167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:11:00.352768+00:00, queued_by_job_id=2, pid=2825 2024-03-29T00:11:04.288405750Z [2024-03-29T00:11:04.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:11:04.294288579Z [2024-03-29T00:11:04.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=-1, run_start_date=2024-03-29 00:11:02.199863+00:00, run_end_date=2024-03-29 00:11:03.923462+00:00, run_duration=1.723599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:11:00.352768+00:00, queued_by_job_id=2, pid=2824 2024-03-29T00:12:00.099456083Z [2024-03-29T00:12:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:12:00+00:00, run_after=2024-03-29T00:13:00+00:00 2024-03-29T00:12:00.105774138Z [2024-03-29T00:12:00.105+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:12:00.117674654Z [2024-03-29T00:12:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:12:00+00:00, run_after=2024-03-29T00:13:00+00:00 2024-03-29T00:12:00.125462270Z [2024-03-29T00:12:00.125+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:12:00.206543980Z [2024-03-29T00:12:00.206+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:12:00.206575415Z 2024-03-29T00:12:00.206582212Z 2024-03-29T00:12:00.206603752Z 2024-03-29T00:12:00.206630359Z 2024-03-29T00:12:00.206649435Z [2024-03-29T00:12:00.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:12:00.206655426Z [2024-03-29T00:12:00.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:12:00.206736026Z [2024-03-29T00:12:00.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:12:00.206821267Z [2024-03-29T00:12:00.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:12:00.207371441Z [2024-03-29T00:12:00.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:12:00.207473451Z 2024-03-29T00:12:00.207479807Z 2024-03-29T00:12:00.207484427Z 2024-03-29T00:12:00.207488724Z 2024-03-29T00:12:00.212446154Z [2024-03-29T00:12:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:12:00.212502771Z [2024-03-29T00:12:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:12:00.212703855Z [2024-03-29T00:12:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:12:00.212774945Z [2024-03-29T00:12:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:12:00.212919799Z [2024-03-29T00:12:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:12:00.213018667Z [2024-03-29T00:12:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:12:00.213144477Z [2024-03-29T00:12:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:12:00.213214009Z [2024-03-29T00:12:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:12:00.486260388Z [2024-03-29T00:12:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:12:00.486286965Z [2024-03-29T00:12:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:11:00+00:00 exited with status queued for try_number 1 2024-03-29T00:12:00.486328680Z [2024-03-29T00:12:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:11:00+00:00 exited with status queued for try_number 1 2024-03-29T00:12:00.486346141Z [2024-03-29T00:12:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:11:00+00:00 exited with status queued for try_number 1 2024-03-29T00:12:00.494294495Z [2024-03-29T00:12:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 044ce870-6cf8-424b-bba9-d61e27260f3e 2024-03-29T00:12:00.494352429Z [2024-03-29T00:12:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to d916dd5d-0ca9-439d-8a87-3e65ae7c3c24 2024-03-29T00:12:00.494470791Z [2024-03-29T00:12:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd7e3231-0922-42ca-868a-32c581ee12b8 2024-03-29T00:12:00.494583688Z [2024-03-29T00:12:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9a8bc4a-c927-4ab6-9de2-5c629bd79e6d 2024-03-29T00:12:01.686422442Z [2024-03-29T00:12:01.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:12:01.686913482Z [2024-03-29T00:12:01.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:10:00+00:00, run_id=scheduled__2024-03-29T00:10:00+00:00, run_start_date=2024-03-29 00:12:00.142180+00:00, run_end_date=2024-03-29 00:12:01.686430+00:00, run_duration=1.54425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:10:00+00:00, data_interval_end=2024-03-29 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:12:01.698167803Z [2024-03-29T00:12:01.697+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:12:00+00:00, run_after=2024-03-29T00:14:00+00:00 2024-03-29T00:12:01.781905906Z [2024-03-29T00:12:01.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:12:01.792688322Z [2024-03-29T00:12:01.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=-1, run_start_date=2024-03-29 00:12:01.061582+00:00, run_end_date=2024-03-29 00:12:01.529488+00:00, run_duration=0.467906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:12:00.208134+00:00, queued_by_job_id=2, pid=2858 2024-03-29T00:12:02.838327644Z [2024-03-29T00:12:02.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:12:02.838945696Z [2024-03-29T00:12:02.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:11:00+00:00, run_id=scheduled__2024-03-29T00:11:00+00:00, run_start_date=2024-03-29 00:12:00.143636+00:00, run_end_date=2024-03-29 00:12:02.838521+00:00, run_duration=2.694885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:11:00+00:00, data_interval_end=2024-03-29 00:12:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:12:02.851267137Z [2024-03-29T00:12:02.850+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:12:00+00:00, run_after=2024-03-29T00:13:00+00:00 2024-03-29T00:12:02.910219930Z [2024-03-29T00:12:02.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:11:00+00:00 exited with status success for try_number 1 2024-03-29T00:12:02.917785321Z [2024-03-29T00:12:02.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:11:00+00:00, map_index=-1, run_start_date=2024-03-29 00:12:01.296468+00:00, run_end_date=2024-03-29 00:12:01.797081+00:00, run_duration=0.500613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:12:00.208134+00:00, queued_by_job_id=2, pid=2859 2024-03-29T00:12:03.955283822Z [2024-03-29T00:12:03.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:12:03.955495020Z [2024-03-29T00:12:03.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:11:00+00:00, run_id=scheduled__2024-03-29T00:11:00+00:00, run_start_date=2024-03-29 00:12:00.144759+00:00, run_end_date=2024-03-29 00:12:03.955195+00:00, run_duration=3.810436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:11:00+00:00, data_interval_end=2024-03-29 00:12:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:12:03.964589479Z [2024-03-29T00:12:03.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:12:00+00:00, run_after=2024-03-29T00:13:00+00:00 2024-03-29T00:12:04.016442941Z [2024-03-29T00:12:04.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:11:00+00:00 exited with status success for try_number 1 2024-03-29T00:12:04.023100624Z [2024-03-29T00:12:04.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:11:00+00:00, map_index=-1, run_start_date=2024-03-29 00:12:02.249410+00:00, run_end_date=2024-03-29 00:12:03.386500+00:00, run_duration=1.13709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:12:00.208134+00:00, queued_by_job_id=2, pid=2882 2024-03-29T00:12:05.064050089Z [2024-03-29T00:12:05.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:12:05.064522519Z [2024-03-29T00:12:05.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:11:00+00:00, run_id=scheduled__2024-03-29T00:11:00+00:00, run_start_date=2024-03-29 00:12:00.145840+00:00, run_end_date=2024-03-29 00:12:05.063959+00:00, run_duration=4.918119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:11:00+00:00, data_interval_end=2024-03-29 00:12:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:12:05.076047661Z [2024-03-29T00:12:05.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:12:00+00:00, run_after=2024-03-29T00:13:00+00:00 2024-03-29T00:12:05.103669994Z [2024-03-29T00:12:05.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:11:00+00:00 exited with status success for try_number 1 2024-03-29T00:12:05.111282241Z [2024-03-29T00:12:05.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:11:00+00:00, map_index=-1, run_start_date=2024-03-29 00:12:02.360986+00:00, run_end_date=2024-03-29 00:12:03.941691+00:00, run_duration=1.580705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:12:00.208134+00:00, queued_by_job_id=2, pid=2883 2024-03-29T00:13:00.753653495Z [2024-03-29T00:13:00.753+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:13:00.778859981Z [2024-03-29T00:13:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:13:00+00:00, run_after=2024-03-29T00:14:00+00:00 2024-03-29T00:13:00.800460313Z [2024-03-29T00:13:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:13:00+00:00, run_after=2024-03-29T00:14:00+00:00 2024-03-29T00:13:00.903386607Z [2024-03-29T00:13:00.902+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:13:00.903429075Z 2024-03-29T00:13:00.903434900Z 2024-03-29T00:13:00.903455743Z 2024-03-29T00:13:00.903615436Z [2024-03-29T00:13:00.903+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:13:00.903884569Z [2024-03-29T00:13:00.903+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:13:00.904033883Z [2024-03-29T00:13:00.903+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:13:00.905192186Z [2024-03-29T00:13:00.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:13:00.905204055Z 2024-03-29T00:13:00.905210222Z 2024-03-29T00:13:00.905216342Z 2024-03-29T00:13:00.910677851Z [2024-03-29T00:13:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:13:00.910899805Z [2024-03-29T00:13:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:13:00.911376934Z [2024-03-29T00:13:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:13:00.911577682Z [2024-03-29T00:13:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:13:00.911913320Z [2024-03-29T00:13:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:13:00.912056775Z [2024-03-29T00:13:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:13:01.183229873Z [2024-03-29T00:13:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status queued for try_number 1 2024-03-29T00:13:01.183359963Z [2024-03-29T00:13:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status queued for try_number 1 2024-03-29T00:13:01.183486164Z [2024-03-29T00:13:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status queued for try_number 1 2024-03-29T00:13:01.191781616Z [2024-03-29T00:13:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4c2e952-bbb9-490b-89e9-c86cc4d06239 2024-03-29T00:13:01.192043128Z [2024-03-29T00:13:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1c28981-1a22-4ea9-bfd3-f61ed40b6051 2024-03-29T00:13:01.192321809Z [2024-03-29T00:13:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fd2adce-05f8-4329-beaa-cc069c880902 2024-03-29T00:13:02.519439073Z [2024-03-29T00:13:02.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:13:02.520264485Z [2024-03-29T00:13:02.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:12:00+00:00, run_id=scheduled__2024-03-29T00:12:00+00:00, run_start_date=2024-03-29 00:13:00.815942+00:00, run_end_date=2024-03-29 00:13:02.519343+00:00, run_duration=1.703401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:12:00+00:00, data_interval_end=2024-03-29 00:13:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:13:02.550643676Z [2024-03-29T00:13:02.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:13:00+00:00, run_after=2024-03-29T00:14:00+00:00 2024-03-29T00:13:02.647027658Z [2024-03-29T00:13:02.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status success for try_number 1 2024-03-29T00:13:02.660636228Z [2024-03-29T00:13:02.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:12:00+00:00, map_index=-1, run_start_date=2024-03-29 00:13:01.739018+00:00, run_end_date=2024-03-29 00:13:02.170732+00:00, run_duration=0.431714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:13:00.906287+00:00, queued_by_job_id=2, pid=2915 2024-03-29T00:13:04.824375254Z [2024-03-29T00:13:04.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:13:04.824806779Z [2024-03-29T00:13:04.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:12:00+00:00, run_id=scheduled__2024-03-29T00:12:00+00:00, run_start_date=2024-03-29 00:13:00.819141+00:00, run_end_date=2024-03-29 00:13:04.824428+00:00, run_duration=4.005287, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:12:00+00:00, data_interval_end=2024-03-29 00:13:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:13:04.836115290Z [2024-03-29T00:13:04.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:13:00+00:00, run_after=2024-03-29T00:14:00+00:00 2024-03-29T00:13:04.845287573Z [2024-03-29T00:13:04.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:13:04.845635013Z [2024-03-29T00:13:04.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:12:00+00:00, run_id=scheduled__2024-03-29T00:12:00+00:00, run_start_date=2024-03-29 00:13:00.817606+00:00, run_end_date=2024-03-29 00:13:04.845337+00:00, run_duration=4.027731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:12:00+00:00, data_interval_end=2024-03-29 00:13:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:13:04.861520725Z [2024-03-29T00:13:04.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:13:00+00:00, run_after=2024-03-29T00:14:00+00:00 2024-03-29T00:13:04.898388207Z [2024-03-29T00:13:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status success for try_number 1 2024-03-29T00:13:04.898540464Z [2024-03-29T00:13:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status success for try_number 1 2024-03-29T00:13:04.906199006Z [2024-03-29T00:13:04.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:12:00+00:00, map_index=-1, run_start_date=2024-03-29 00:13:02.807389+00:00, run_end_date=2024-03-29 00:13:04.550557+00:00, run_duration=1.743168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:13:00.906287+00:00, queued_by_job_id=2, pid=2934 2024-03-29T00:13:04.906640436Z [2024-03-29T00:13:04.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:12:00+00:00, map_index=-1, run_start_date=2024-03-29 00:13:02.819990+00:00, run_end_date=2024-03-29 00:13:04.109906+00:00, run_duration=1.289916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:13:00.906287+00:00, queued_by_job_id=2, pid=2933 2024-03-29T00:13:44.339161890Z [2024-03-29T00:13:44.338+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:14:01.021041173Z [2024-03-29T00:14:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:14:01.032973997Z [2024-03-29T00:14:01.032+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:14:01.055540562Z [2024-03-29T00:14:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:14:00+00:00, run_after=2024-03-29T00:15:00+00:00 2024-03-29T00:14:01.092339359Z [2024-03-29T00:14:01.091+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:14:00+00:00, run_after=2024-03-29T00:15:00+00:00 2024-03-29T00:14:01.172539597Z [2024-03-29T00:14:01.171+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:14:01.172580282Z 2024-03-29T00:14:01.172587793Z 2024-03-29T00:14:01.172594021Z 2024-03-29T00:14:01.172599849Z 2024-03-29T00:14:01.172607932Z [2024-03-29T00:14:01.172+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:14:01.172818246Z [2024-03-29T00:14:01.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:14:01.173093496Z [2024-03-29T00:14:01.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:14:01.173331812Z [2024-03-29T00:14:01.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:14:01.174378145Z [2024-03-29T00:14:01.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:14:01.174396830Z 2024-03-29T00:14:01.174402148Z 2024-03-29T00:14:01.174406649Z 2024-03-29T00:14:01.174410906Z 2024-03-29T00:14:01.179266610Z [2024-03-29T00:14:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:14:01.179504685Z [2024-03-29T00:14:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:14:01.179940024Z [2024-03-29T00:14:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:14:01.180133369Z [2024-03-29T00:14:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:14:01.180433495Z [2024-03-29T00:14:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:14:01.180656297Z [2024-03-29T00:14:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:14:01.180955682Z [2024-03-29T00:14:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:14:01.181129947Z [2024-03-29T00:14:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:14:01.532634824Z [2024-03-29T00:14:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status queued for try_number 1 2024-03-29T00:14:01.534806893Z [2024-03-29T00:14:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:13:00+00:00 exited with status queued for try_number 1 2024-03-29T00:14:01.538871564Z [2024-03-29T00:14:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:13:00+00:00 exited with status queued for try_number 1 2024-03-29T00:14:01.539081880Z [2024-03-29T00:14:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:13:00+00:00 exited with status queued for try_number 1 2024-03-29T00:14:01.556821199Z [2024-03-29T00:14:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9eb63946-c8d3-4205-84a3-3722b45e470d 2024-03-29T00:14:01.557164185Z [2024-03-29T00:14:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9876b3b5-e57d-437e-9176-6bbcb6c83aa0 2024-03-29T00:14:01.557360137Z [2024-03-29T00:14:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59e06b9e-381a-4347-a312-83669c1d4a32 2024-03-29T00:14:01.557539936Z [2024-03-29T00:14:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 859704ad-4cac-4f9d-a96a-f3115ed0eb6b 2024-03-29T00:14:03.532695134Z [2024-03-29T00:14:03.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:14:03.533176832Z [2024-03-29T00:14:03.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:12:00+00:00, run_id=scheduled__2024-03-29T00:12:00+00:00, run_start_date=2024-03-29 00:14:01.107741+00:00, run_end_date=2024-03-29 00:14:03.532614+00:00, run_duration=2.424873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:12:00+00:00, data_interval_end=2024-03-29 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:14:03.542960516Z [2024-03-29T00:14:03.542+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:14:00+00:00, run_after=2024-03-29T00:16:00+00:00 2024-03-29T00:14:03.553328065Z [2024-03-29T00:14:03.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:14:03.554278145Z [2024-03-29T00:14:03.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:13:00+00:00, run_id=scheduled__2024-03-29T00:13:00+00:00, run_start_date=2024-03-29 00:14:01.110789+00:00, run_end_date=2024-03-29 00:14:03.553567+00:00, run_duration=2.442778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:13:00+00:00, data_interval_end=2024-03-29 00:14:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:14:03.598926609Z [2024-03-29T00:14:03.588+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:14:00+00:00, run_after=2024-03-29T00:15:00+00:00 2024-03-29T00:14:03.684823161Z [2024-03-29T00:14:03.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:12:00+00:00 exited with status success for try_number 1 2024-03-29T00:14:03.687439494Z [2024-03-29T00:14:03.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:13:00+00:00 exited with status success for try_number 1 2024-03-29T00:14:03.696777596Z [2024-03-29T00:14:03.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:12:00+00:00, map_index=-1, run_start_date=2024-03-29 00:14:02.219319+00:00, run_end_date=2024-03-29 00:14:02.703757+00:00, run_duration=0.484438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:14:01.175805+00:00, queued_by_job_id=2, pid=2967 2024-03-29T00:14:03.697119889Z [2024-03-29T00:14:03.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:13:00+00:00, map_index=-1, run_start_date=2024-03-29 00:14:02.339747+00:00, run_end_date=2024-03-29 00:14:02.825643+00:00, run_duration=0.485896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:14:01.175805+00:00, queued_by_job_id=2, pid=2968 2024-03-29T00:14:05.873803956Z [2024-03-29T00:14:05.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:14:05.874552205Z [2024-03-29T00:14:05.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:13:00+00:00, run_id=scheduled__2024-03-29T00:13:00+00:00, run_start_date=2024-03-29 00:14:01.112554+00:00, run_end_date=2024-03-29 00:14:05.874027+00:00, run_duration=4.761473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:13:00+00:00, data_interval_end=2024-03-29 00:14:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:14:05.894210093Z [2024-03-29T00:14:05.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:14:00+00:00, run_after=2024-03-29T00:15:00+00:00 2024-03-29T00:14:05.903662250Z [2024-03-29T00:14:05.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:14:05.904050790Z [2024-03-29T00:14:05.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:13:00+00:00, run_id=scheduled__2024-03-29T00:13:00+00:00, run_start_date=2024-03-29 00:14:01.113970+00:00, run_end_date=2024-03-29 00:14:05.903580+00:00, run_duration=4.78961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:13:00+00:00, data_interval_end=2024-03-29 00:14:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:14:05.914049340Z [2024-03-29T00:14:05.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:14:00+00:00, run_after=2024-03-29T00:15:00+00:00 2024-03-29T00:14:05.997077705Z [2024-03-29T00:14:05.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:13:00+00:00 exited with status success for try_number 1 2024-03-29T00:14:06.016142017Z [2024-03-29T00:14:06.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:13:00+00:00, map_index=-1, run_start_date=2024-03-29 00:14:03.691113+00:00, run_end_date=2024-03-29 00:14:05.650883+00:00, run_duration=1.95977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:14:01.175805+00:00, queued_by_job_id=2, pid=2992 2024-03-29T00:14:06.783289328Z [2024-03-29T00:14:06.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:13:00+00:00 exited with status success for try_number 1 2024-03-29T00:14:06.789530744Z [2024-03-29T00:14:06.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:13:00+00:00, map_index=-1, run_start_date=2024-03-29 00:14:03.425821+00:00, run_end_date=2024-03-29 00:14:05.823466+00:00, run_duration=2.397645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:14:01.175805+00:00, queued_by_job_id=2, pid=2991 2024-03-29T00:15:00.384728803Z [2024-03-29T00:15:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:15:00+00:00, run_after=2024-03-29T00:16:00+00:00 2024-03-29T00:15:00.406590494Z [2024-03-29T00:15:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:15:00+00:00, run_after=2024-03-29T00:16:00+00:00 2024-03-29T00:15:00.425323685Z [2024-03-29T00:15:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:15:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:15:00.434528224Z [2024-03-29T00:15:00.433+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:15:00.549568746Z [2024-03-29T00:15:00.549+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:15:00.549604017Z 2024-03-29T00:15:00.549612397Z 2024-03-29T00:15:00.549619206Z 2024-03-29T00:15:00.549625674Z 2024-03-29T00:15:00.550013878Z [2024-03-29T00:15:00.549+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:15:00.550378164Z [2024-03-29T00:15:00.550+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:15:00.550761220Z [2024-03-29T00:15:00.550+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:15:00.551127780Z [2024-03-29T00:15:00.550+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:15:00.552409081Z [2024-03-29T00:15:00.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:15:00.552430032Z 2024-03-29T00:15:00.552436964Z 2024-03-29T00:15:00.552486430Z 2024-03-29T00:15:00.552494332Z 2024-03-29T00:15:00.561468836Z [2024-03-29T00:15:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:15:00.561961731Z [2024-03-29T00:15:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:15:00.562508835Z [2024-03-29T00:15:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:15:00.562798325Z [2024-03-29T00:15:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:15:00.563236497Z [2024-03-29T00:15:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:15:00.563508318Z [2024-03-29T00:15:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:15:00.563916120Z [2024-03-29T00:15:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:15:00.564211299Z [2024-03-29T00:15:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:15:00.891757811Z [2024-03-29T00:15:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:15:00.892019634Z [2024-03-29T00:15:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status queued for try_number 1 2024-03-29T00:15:00.892257589Z [2024-03-29T00:15:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status queued for try_number 1 2024-03-29T00:15:00.892393137Z [2024-03-29T00:15:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status queued for try_number 1 2024-03-29T00:15:00.902778798Z [2024-03-29T00:15:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82d273de-6017-4748-87d7-6f6c28d63e1b 2024-03-29T00:15:00.903057876Z [2024-03-29T00:15:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to a26cab1b-490c-46fc-89fd-750d055b974c 2024-03-29T00:15:00.903325533Z [2024-03-29T00:15:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7b67ca5-475f-4f76-b336-bdd2a5561dd1 2024-03-29T00:15:00.903561356Z [2024-03-29T00:15:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99097b62-e088-44e0-a481-da24c8342da9 2024-03-29T00:15:03.326849941Z [2024-03-29T00:15:03.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:15:03.327081895Z [2024-03-29T00:15:03.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:14:00+00:00, run_id=scheduled__2024-03-29T00:14:00+00:00, run_start_date=2024-03-29 00:15:00.458322+00:00, run_end_date=2024-03-29 00:15:03.326713+00:00, run_duration=2.868391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:14:00+00:00, data_interval_end=2024-03-29 00:15:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:15:03.337482224Z [2024-03-29T00:15:03.336+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:15:00+00:00, run_after=2024-03-29T00:16:00+00:00 2024-03-29T00:15:03.403930606Z [2024-03-29T00:15:03.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status success for try_number 1 2024-03-29T00:15:03.412587358Z [2024-03-29T00:15:03.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:14:00+00:00, map_index=-1, run_start_date=2024-03-29 00:15:01.655193+00:00, run_end_date=2024-03-29 00:15:02.419849+00:00, run_duration=0.764656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:15:00.554097+00:00, queued_by_job_id=2, pid=3025 2024-03-29T00:15:04.541262934Z [2024-03-29T00:15:04.540+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:15:04.541293591Z 2024-03-29T00:15:04.541299110Z [2024-03-29T00:15:04.541+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:15:04.541858240Z [2024-03-29T00:15:04.541+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:15:04.541870370Z 2024-03-29T00:15:04.544994830Z [2024-03-29T00:15:04.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:15:04.545008603Z [2024-03-29T00:15:04.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:15:04.602005374Z [2024-03-29T00:15:04.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:15:04.602058114Z [2024-03-29T00:15:04.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:15:04.612618812Z [2024-03-29T00:15:04.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to f71f34c1-f858-4ed9-8f5e-37f43c3d5992 2024-03-29T00:15:04.612915606Z [2024-03-29T00:15:04.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=-1, run_start_date=2024-03-29 00:15:03.481294+00:00, run_end_date=2024-03-29 00:15:04.017990+00:00, run_duration=0.536696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:15:00.554097+00:00, queued_by_job_id=2, pid=3049 2024-03-29T00:15:05.878610227Z [2024-03-29T00:15:05.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:15:05.878652168Z [2024-03-29T00:15:05.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:14:00+00:00, run_id=scheduled__2024-03-29T00:14:00+00:00, run_start_date=2024-03-29 00:15:00.461437+00:00, run_end_date=2024-03-29 00:15:05.875947+00:00, run_duration=5.41451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:14:00+00:00, data_interval_end=2024-03-29 00:15:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:15:05.891299709Z [2024-03-29T00:15:05.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:15:00+00:00, run_after=2024-03-29T00:16:00+00:00 2024-03-29T00:15:05.899469112Z [2024-03-29T00:15:05.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:15:05.899496049Z [2024-03-29T00:15:05.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:14:00+00:00, run_id=scheduled__2024-03-29T00:14:00+00:00, run_start_date=2024-03-29 00:15:00.459926+00:00, run_end_date=2024-03-29 00:15:05.895228+00:00, run_duration=5.435302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:14:00+00:00, data_interval_end=2024-03-29 00:15:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:15:05.906833058Z [2024-03-29T00:15:05.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:15:00+00:00, run_after=2024-03-29T00:16:00+00:00 2024-03-29T00:15:05.979751529Z [2024-03-29T00:15:05.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status success for try_number 1 2024-03-29T00:15:05.979937402Z [2024-03-29T00:15:05.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status success for try_number 1 2024-03-29T00:15:05.989062897Z [2024-03-29T00:15:05.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:14:00+00:00, map_index=-1, run_start_date=2024-03-29 00:15:03.745697+00:00, run_end_date=2024-03-29 00:15:05.376869+00:00, run_duration=1.631172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:15:00.554097+00:00, queued_by_job_id=2, pid=3051 2024-03-29T00:15:05.994623666Z [2024-03-29T00:15:05.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:14:00+00:00, map_index=-1, run_start_date=2024-03-29 00:15:03.556686+00:00, run_end_date=2024-03-29 00:15:05.550006+00:00, run_duration=1.99332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:15:00.554097+00:00, queued_by_job_id=2, pid=3050 2024-03-29T00:15:07.265589973Z [2024-03-29T00:15:07.258+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:15:07.265641531Z 2024-03-29T00:15:07.265646746Z [2024-03-29T00:15:07.260+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:15:07.265652377Z [2024-03-29T00:15:07.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:15:07.265656902Z 2024-03-29T00:15:07.270817599Z [2024-03-29T00:15:07.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:15:07.270844973Z [2024-03-29T00:15:07.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:15:07.376297025Z [2024-03-29T00:15:07.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:15:07.378830848Z [2024-03-29T00:15:07.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:15:07.405527075Z [2024-03-29T00:15:07.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5f67f1c-01f1-4ff3-99db-0e81180d60d6 2024-03-29T00:15:07.406735709Z [2024-03-29T00:15:07.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=-1, run_start_date=2024-03-29 00:15:06.436168+00:00, run_end_date=2024-03-29 00:15:06.861012+00:00, run_duration=0.424844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:15:04.542205+00:00, queued_by_job_id=2, pid=3074 2024-03-29T00:15:12.847545174Z [2024-03-29T00:15:12.847+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:15:12.847576790Z 2024-03-29T00:15:12.848010889Z [2024-03-29T00:15:12.847+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:15:12.849013584Z [2024-03-29T00:15:12.848+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:15:12.849027448Z 2024-03-29T00:15:12.853948476Z [2024-03-29T00:15:12.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:15:12.854574579Z [2024-03-29T00:15:12.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:15:12.925971771Z [2024-03-29T00:15:12.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status queued for try_number 1 2024-03-29T00:15:12.926382120Z [2024-03-29T00:15:12.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:15:12.936301426Z [2024-03-29T00:15:12.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfae4e40-3170-4f00-a3ec-37c889e155f3 2024-03-29T00:15:12.937056212Z [2024-03-29T00:15:12.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=0, run_start_date=2024-03-29 00:15:09.111631+00:00, run_end_date=2024-03-29 00:15:12.079952+00:00, run_duration=2.968321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:15:07.261663+00:00, queued_by_job_id=2, pid=3082 2024-03-29T00:15:15.754816485Z [2024-03-29T00:15:15.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:15:15.755362270Z [2024-03-29T00:15:15.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:10:00+00:00, run_id=scheduled__2024-03-29T00:10:00+00:00, run_start_date=2024-03-29 00:15:00.456631+00:00, run_end_date=2024-03-29 00:15:15.754944+00:00, run_duration=15.298313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:10:00+00:00, data_interval_end=2024-03-29 00:15:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:15:15.763648883Z [2024-03-29T00:15:15.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:15:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:15:15.795210931Z [2024-03-29T00:15:15.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:10:00+00:00 exited with status success for try_number 1 2024-03-29T00:15:15.801356846Z [2024-03-29T00:15:15.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:10:00+00:00, map_index=-1, run_start_date=2024-03-29 00:15:14.678963+00:00, run_end_date=2024-03-29 00:15:15.045872+00:00, run_duration=0.366909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:15:12.850379+00:00, queued_by_job_id=2, pid=3095 2024-03-29T00:16:00.217027764Z [2024-03-29T00:16:00.216+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:16:00+00:00, run_after=2024-03-29T00:17:00+00:00 2024-03-29T00:16:00.226366655Z [2024-03-29T00:16:00.226+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:16:00.235702676Z [2024-03-29T00:16:00.235+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:16:00.250144729Z [2024-03-29T00:16:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:16:00+00:00, run_after=2024-03-29T00:17:00+00:00 2024-03-29T00:16:00.325358745Z [2024-03-29T00:16:00.325+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:16:00.325383292Z 2024-03-29T00:16:00.325387949Z 2024-03-29T00:16:00.325391079Z 2024-03-29T00:16:00.325394143Z 2024-03-29T00:16:00.325397719Z [2024-03-29T00:16:00.325+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:16:00.325512372Z [2024-03-29T00:16:00.325+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:16:00.325561748Z [2024-03-29T00:16:00.325+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:16:00.325604634Z [2024-03-29T00:16:00.325+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:16:00.326182290Z [2024-03-29T00:16:00.325+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:16:00.326198543Z 2024-03-29T00:16:00.326202383Z 2024-03-29T00:16:00.326205803Z 2024-03-29T00:16:00.326209000Z 2024-03-29T00:16:00.329360316Z [2024-03-29T00:16:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:16:00.329497970Z [2024-03-29T00:16:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:16:00.329632194Z [2024-03-29T00:16:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:16:00.329755731Z [2024-03-29T00:16:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:16:00.329953159Z [2024-03-29T00:16:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:16:00.330000247Z [2024-03-29T00:16:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:16:00.330267624Z [2024-03-29T00:16:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:16:00.330276214Z [2024-03-29T00:16:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:16:00.657472628Z [2024-03-29T00:16:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status queued for try_number 1 2024-03-29T00:16:00.659599607Z [2024-03-29T00:16:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status queued for try_number 1 2024-03-29T00:16:00.659704964Z [2024-03-29T00:16:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status queued for try_number 1 2024-03-29T00:16:00.659804636Z [2024-03-29T00:16:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status queued for try_number 1 2024-03-29T00:16:00.668462708Z [2024-03-29T00:16:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbbbdbea-7128-48f6-8a33-cde0514cba8e 2024-03-29T00:16:00.668639207Z [2024-03-29T00:16:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a350316-1c76-4a29-955e-78fb5d5774c9 2024-03-29T00:16:00.668763529Z [2024-03-29T00:16:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31b81878-700f-406e-bd44-de1c2c923bdb 2024-03-29T00:16:00.668908720Z [2024-03-29T00:16:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4016b286-52d6-432a-8f7a-cd96d1a5f435 2024-03-29T00:16:01.862175719Z [2024-03-29T00:16:01.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:16:01.862623063Z [2024-03-29T00:16:01.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:14:00+00:00, run_id=scheduled__2024-03-29T00:14:00+00:00, run_start_date=2024-03-29 00:16:00.260245+00:00, run_end_date=2024-03-29 00:16:01.862074+00:00, run_duration=1.601829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:14:00+00:00, data_interval_end=2024-03-29 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:16:01.872982850Z [2024-03-29T00:16:01.872+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:16:00+00:00, run_after=2024-03-29T00:18:00+00:00 2024-03-29T00:16:01.882548356Z [2024-03-29T00:16:01.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:16:01.882790073Z [2024-03-29T00:16:01.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:15:00+00:00, run_id=scheduled__2024-03-29T00:15:00+00:00, run_start_date=2024-03-29 00:16:00.261502+00:00, run_end_date=2024-03-29 00:16:01.882326+00:00, run_duration=1.620824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:15:00+00:00, data_interval_end=2024-03-29 00:16:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:16:01.893398490Z [2024-03-29T00:16:01.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:16:00+00:00, run_after=2024-03-29T00:17:00+00:00 2024-03-29T00:16:01.949940386Z [2024-03-29T00:16:01.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:14:00+00:00 exited with status success for try_number 1 2024-03-29T00:16:01.959995624Z [2024-03-29T00:16:01.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:14:00+00:00, map_index=-1, run_start_date=2024-03-29 00:16:01.180093+00:00, run_end_date=2024-03-29 00:16:01.662592+00:00, run_duration=0.482499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:16:00.327001+00:00, queued_by_job_id=2, pid=3118 2024-03-29T00:16:03.074515163Z [2024-03-29T00:16:03.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status success for try_number 1 2024-03-29T00:16:03.081680149Z [2024-03-29T00:16:03.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:15:00+00:00, map_index=-1, run_start_date=2024-03-29 00:16:01.282303+00:00, run_end_date=2024-03-29 00:16:01.836361+00:00, run_duration=0.554058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:16:00.327001+00:00, queued_by_job_id=2, pid=3119 2024-03-29T00:16:04.129846659Z [2024-03-29T00:16:04.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:16:04.130294004Z [2024-03-29T00:16:04.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:15:00+00:00, run_id=scheduled__2024-03-29T00:15:00+00:00, run_start_date=2024-03-29 00:16:00.264138+00:00, run_end_date=2024-03-29 00:16:04.129715+00:00, run_duration=3.865577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:15:00+00:00, data_interval_end=2024-03-29 00:16:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:16:04.145904511Z [2024-03-29T00:16:04.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:16:00+00:00, run_after=2024-03-29T00:17:00+00:00 2024-03-29T00:16:04.199051670Z [2024-03-29T00:16:04.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status success for try_number 1 2024-03-29T00:16:04.207025672Z [2024-03-29T00:16:04.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:15:00+00:00, map_index=-1, run_start_date=2024-03-29 00:16:02.514749+00:00, run_end_date=2024-03-29 00:16:03.916209+00:00, run_duration=1.40146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:16:00.327001+00:00, queued_by_job_id=2, pid=3143 2024-03-29T00:16:05.263685440Z [2024-03-29T00:16:05.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:16:05.264023428Z [2024-03-29T00:16:05.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:15:00+00:00, run_id=scheduled__2024-03-29T00:15:00+00:00, run_start_date=2024-03-29 00:16:00.266525+00:00, run_end_date=2024-03-29 00:16:05.263593+00:00, run_duration=4.997068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:15:00+00:00, data_interval_end=2024-03-29 00:16:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:16:05.273086445Z [2024-03-29T00:16:05.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:16:00+00:00, run_after=2024-03-29T00:17:00+00:00 2024-03-29T00:16:05.313512083Z [2024-03-29T00:16:05.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status success for try_number 1 2024-03-29T00:16:05.323895250Z [2024-03-29T00:16:05.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:15:00+00:00, map_index=-1, run_start_date=2024-03-29 00:16:02.458557+00:00, run_end_date=2024-03-29 00:16:04.387256+00:00, run_duration=1.928699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:16:00.327001+00:00, queued_by_job_id=2, pid=3142 2024-03-29T00:17:00.938203172Z [2024-03-29T00:17:00.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:17:00+00:00, run_after=2024-03-29T00:18:00+00:00 2024-03-29T00:17:00.951952661Z [2024-03-29T00:17:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:17:00+00:00, run_after=2024-03-29T00:18:00+00:00 2024-03-29T00:17:00.960975261Z [2024-03-29T00:17:00.960+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:17:01.037038675Z [2024-03-29T00:17:01.036+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:17:01.037072842Z 2024-03-29T00:17:01.037079831Z 2024-03-29T00:17:01.037085724Z 2024-03-29T00:17:01.037127682Z [2024-03-29T00:17:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:17:01.037245499Z [2024-03-29T00:17:01.036+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:17:01.037395570Z [2024-03-29T00:17:01.037+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:17:01.038087538Z [2024-03-29T00:17:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:17:01.038104104Z 2024-03-29T00:17:01.038109454Z 2024-03-29T00:17:01.038114086Z 2024-03-29T00:17:01.042075860Z [2024-03-29T00:17:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:17:01.042186964Z [2024-03-29T00:17:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:17:01.042744335Z [2024-03-29T00:17:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:17:01.042923103Z [2024-03-29T00:17:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:17:01.043223473Z [2024-03-29T00:17:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:17:01.043464284Z [2024-03-29T00:17:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:17:01.478857801Z [2024-03-29T00:17:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status queued for try_number 1 2024-03-29T00:17:01.478889655Z [2024-03-29T00:17:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status queued for try_number 1 2024-03-29T00:17:01.478952215Z [2024-03-29T00:17:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status queued for try_number 1 2024-03-29T00:17:01.506671928Z [2024-03-29T00:17:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 604e1f53-a3f6-4503-90bb-d0922117f89e 2024-03-29T00:17:01.512153584Z [2024-03-29T00:17:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8729bc02-fb99-46e5-a9f1-9ff061d5e53d 2024-03-29T00:17:01.512392211Z [2024-03-29T00:17:01.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a197d13-d982-4ebe-8d5f-0c102103f423 2024-03-29T00:17:02.728046696Z [2024-03-29T00:17:02.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:17:02.728667460Z [2024-03-29T00:17:02.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:16:00+00:00, run_id=scheduled__2024-03-29T00:16:00+00:00, run_start_date=2024-03-29 00:17:00.970910+00:00, run_end_date=2024-03-29 00:17:02.728260+00:00, run_duration=1.75735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:16:00+00:00, data_interval_end=2024-03-29 00:17:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:17:02.742035516Z [2024-03-29T00:17:02.741+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:17:00+00:00, run_after=2024-03-29T00:18:00+00:00 2024-03-29T00:17:02.795148534Z [2024-03-29T00:17:02.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status success for try_number 1 2024-03-29T00:17:02.801932351Z [2024-03-29T00:17:02.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:16:00+00:00, map_index=-1, run_start_date=2024-03-29 00:17:02.063941+00:00, run_end_date=2024-03-29 00:17:02.516167+00:00, run_duration=0.452226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:17:01.038990+00:00, queued_by_job_id=2, pid=3175 2024-03-29T00:17:04.923680121Z [2024-03-29T00:17:04.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:17:04.923941725Z [2024-03-29T00:17:04.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:16:00+00:00, run_id=scheduled__2024-03-29T00:16:00+00:00, run_start_date=2024-03-29 00:17:00.973205+00:00, run_end_date=2024-03-29 00:17:04.923594+00:00, run_duration=3.950389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:16:00+00:00, data_interval_end=2024-03-29 00:17:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:17:04.942636399Z [2024-03-29T00:17:04.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:17:00+00:00, run_after=2024-03-29T00:18:00+00:00 2024-03-29T00:17:06.099858245Z [2024-03-29T00:17:06.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:17:06.100244315Z [2024-03-29T00:17:06.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:16:00+00:00, run_id=scheduled__2024-03-29T00:16:00+00:00, run_start_date=2024-03-29 00:17:00.974785+00:00, run_end_date=2024-03-29 00:17:06.099774+00:00, run_duration=5.124989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:16:00+00:00, data_interval_end=2024-03-29 00:17:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:17:06.109497149Z [2024-03-29T00:17:06.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:17:00+00:00, run_after=2024-03-29T00:18:00+00:00 2024-03-29T00:17:06.143876055Z [2024-03-29T00:17:06.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status success for try_number 1 2024-03-29T00:17:06.144067889Z [2024-03-29T00:17:06.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status success for try_number 1 2024-03-29T00:17:06.151879754Z [2024-03-29T00:17:06.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:16:00+00:00, map_index=-1, run_start_date=2024-03-29 00:17:03.293025+00:00, run_end_date=2024-03-29 00:17:04.860499+00:00, run_duration=1.567474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:17:01.038990+00:00, queued_by_job_id=2, pid=3194 2024-03-29T00:17:06.152640342Z [2024-03-29T00:17:06.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:16:00+00:00, map_index=-1, run_start_date=2024-03-29 00:17:03.227473+00:00, run_end_date=2024-03-29 00:17:05.399636+00:00, run_duration=2.172163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:17:01.038990+00:00, queued_by_job_id=2, pid=3193 2024-03-29T00:18:00.706715455Z [2024-03-29T00:18:00.706+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:18:00.725514804Z [2024-03-29T00:18:00.725+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:18:00+00:00, run_after=2024-03-29T00:19:00+00:00 2024-03-29T00:18:00.734382095Z [2024-03-29T00:18:00.734+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:18:00.746495154Z [2024-03-29T00:18:00.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:18:00+00:00, run_after=2024-03-29T00:19:00+00:00 2024-03-29T00:18:00.847703937Z [2024-03-29T00:18:00.847+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:18:00.847734713Z 2024-03-29T00:18:00.847741459Z 2024-03-29T00:18:00.847747436Z 2024-03-29T00:18:00.847754123Z 2024-03-29T00:18:00.847966265Z [2024-03-29T00:18:00.847+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:18:00.848193975Z [2024-03-29T00:18:00.847+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:18:00.848425525Z [2024-03-29T00:18:00.848+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:18:00.848661223Z [2024-03-29T00:18:00.848+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:18:00.849656726Z [2024-03-29T00:18:00.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:18:00.849673438Z 2024-03-29T00:18:00.849679470Z 2024-03-29T00:18:00.849684899Z 2024-03-29T00:18:00.849689987Z 2024-03-29T00:18:00.856192713Z [2024-03-29T00:18:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:18:00.856537659Z [2024-03-29T00:18:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:18:00.857133195Z [2024-03-29T00:18:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:18:00.857422383Z [2024-03-29T00:18:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:18:00.857900650Z [2024-03-29T00:18:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:18:00.858183286Z [2024-03-29T00:18:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:18:00.858696903Z [2024-03-29T00:18:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:18:00.858981656Z [2024-03-29T00:18:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:18:01.400494457Z [2024-03-29T00:18:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status queued for try_number 1 2024-03-29T00:18:01.400796398Z [2024-03-29T00:18:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:17:00+00:00 exited with status queued for try_number 1 2024-03-29T00:18:01.401093637Z [2024-03-29T00:18:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:17:00+00:00 exited with status queued for try_number 1 2024-03-29T00:18:01.401387212Z [2024-03-29T00:18:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:17:00+00:00 exited with status queued for try_number 1 2024-03-29T00:18:01.428476444Z [2024-03-29T00:18:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89767171-40ed-406e-abee-72a369570402 2024-03-29T00:18:01.428773212Z [2024-03-29T00:18:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 293e1e22-517e-4b7e-8eaf-920ded2b5582 2024-03-29T00:18:01.429041187Z [2024-03-29T00:18:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to da2963ee-03f4-4e9f-8fee-f2dad2dfc63b 2024-03-29T00:18:01.429308674Z [2024-03-29T00:18:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to bed2252a-50ea-4f17-a0eb-eb47530e96f0 2024-03-29T00:18:02.759749645Z [2024-03-29T00:18:02.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:18:02.760426179Z [2024-03-29T00:18:02.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:16:00+00:00, run_id=scheduled__2024-03-29T00:16:00+00:00, run_start_date=2024-03-29 00:18:00.760313+00:00, run_end_date=2024-03-29 00:18:02.759654+00:00, run_duration=1.999341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:16:00+00:00, data_interval_end=2024-03-29 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:18:02.775270368Z [2024-03-29T00:18:02.774+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:18:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:18:02.798334492Z [2024-03-29T00:18:02.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:18:02.798977977Z [2024-03-29T00:18:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:17:00+00:00, run_id=scheduled__2024-03-29T00:17:00+00:00, run_start_date=2024-03-29 00:18:00.762243+00:00, run_end_date=2024-03-29 00:18:02.798219+00:00, run_duration=2.035976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:17:00+00:00, data_interval_end=2024-03-29 00:18:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:18:02.824156695Z [2024-03-29T00:18:02.823+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:18:00+00:00, run_after=2024-03-29T00:19:00+00:00 2024-03-29T00:18:02.904230980Z [2024-03-29T00:18:02.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:16:00+00:00 exited with status success for try_number 1 2024-03-29T00:18:02.904295522Z [2024-03-29T00:18:02.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:17:00+00:00 exited with status success for try_number 1 2024-03-29T00:18:02.912504380Z [2024-03-29T00:18:02.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:16:00+00:00, map_index=-1, run_start_date=2024-03-29 00:18:01.748514+00:00, run_end_date=2024-03-29 00:18:02.205440+00:00, run_duration=0.456926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:18:00.851700+00:00, queued_by_job_id=2, pid=3228 2024-03-29T00:18:02.912620705Z [2024-03-29T00:18:02.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:17:00+00:00, map_index=-1, run_start_date=2024-03-29 00:18:01.985599+00:00, run_end_date=2024-03-29 00:18:02.481530+00:00, run_duration=0.495931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:18:00.851700+00:00, queued_by_job_id=2, pid=3229 2024-03-29T00:18:05.122006363Z [2024-03-29T00:18:05.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:18:05.122510946Z [2024-03-29T00:18:05.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:17:00+00:00, run_id=scheduled__2024-03-29T00:17:00+00:00, run_start_date=2024-03-29 00:18:00.765979+00:00, run_end_date=2024-03-29 00:18:05.122129+00:00, run_duration=4.35615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:17:00+00:00, data_interval_end=2024-03-29 00:18:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:18:05.141803168Z [2024-03-29T00:18:05.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:18:00+00:00, run_after=2024-03-29T00:19:00+00:00 2024-03-29T00:18:05.182563515Z [2024-03-29T00:18:05.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:18:05.182586572Z [2024-03-29T00:18:05.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:17:00+00:00, run_id=scheduled__2024-03-29T00:17:00+00:00, run_start_date=2024-03-29 00:18:00.764307+00:00, run_end_date=2024-03-29 00:18:05.167044+00:00, run_duration=4.402737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:17:00+00:00, data_interval_end=2024-03-29 00:18:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:18:05.203427067Z [2024-03-29T00:18:05.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:18:00+00:00, run_after=2024-03-29T00:19:00+00:00 2024-03-29T00:18:05.262007318Z [2024-03-29T00:18:05.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:17:00+00:00 exited with status success for try_number 1 2024-03-29T00:18:05.264801573Z [2024-03-29T00:18:05.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:17:00+00:00 exited with status success for try_number 1 2024-03-29T00:18:05.280675484Z [2024-03-29T00:18:05.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:17:00+00:00, map_index=-1, run_start_date=2024-03-29 00:18:03.225422+00:00, run_end_date=2024-03-29 00:18:04.932935+00:00, run_duration=1.707513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:18:00.851700+00:00, queued_by_job_id=2, pid=3247 2024-03-29T00:18:05.281143033Z [2024-03-29T00:18:05.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:17:00+00:00, map_index=-1, run_start_date=2024-03-29 00:18:03.509502+00:00, run_end_date=2024-03-29 00:18:04.881336+00:00, run_duration=1.371834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:18:00.851700+00:00, queued_by_job_id=2, pid=3253 2024-03-29T00:18:44.419342555Z [2024-03-29T00:18:44.418+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:19:00.999367144Z [2024-03-29T00:19:00.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:19:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:19:01.015507984Z [2024-03-29T00:19:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:19:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:19:01.025450812Z [2024-03-29T00:19:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:19:01.096140714Z [2024-03-29T00:19:01.095+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:19:01.096183389Z 2024-03-29T00:19:01.096187763Z 2024-03-29T00:19:01.096191048Z 2024-03-29T00:19:01.096418825Z [2024-03-29T00:19:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:19:01.096710407Z [2024-03-29T00:19:01.096+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:19:01.096887170Z [2024-03-29T00:19:01.096+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:19:01.097916080Z [2024-03-29T00:19:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:19:01.097928722Z 2024-03-29T00:19:01.097932225Z 2024-03-29T00:19:01.097935568Z 2024-03-29T00:19:01.102658845Z [2024-03-29T00:19:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:19:01.103024875Z [2024-03-29T00:19:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:19:01.103527759Z [2024-03-29T00:19:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:19:01.103935756Z [2024-03-29T00:19:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:19:01.104490961Z [2024-03-29T00:19:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:19:01.104733268Z [2024-03-29T00:19:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:19:01.355883551Z [2024-03-29T00:19:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status queued for try_number 1 2024-03-29T00:19:01.356010408Z [2024-03-29T00:19:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status queued for try_number 1 2024-03-29T00:19:01.356292511Z [2024-03-29T00:19:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status queued for try_number 1 2024-03-29T00:19:01.374326227Z [2024-03-29T00:19:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef1c85db-de74-4bf5-aff7-0c0020b439eb 2024-03-29T00:19:01.374572234Z [2024-03-29T00:19:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to b77f4124-06de-46ac-84f7-344065436753 2024-03-29T00:19:01.374836185Z [2024-03-29T00:19:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42c241c9-d928-4cc7-8ac6-44a5984e3c80 2024-03-29T00:19:02.457093854Z [2024-03-29T00:19:02.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:19:02.457851937Z [2024-03-29T00:19:02.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:18:00+00:00, run_id=scheduled__2024-03-29T00:18:00+00:00, run_start_date=2024-03-29 00:19:01.037248+00:00, run_end_date=2024-03-29 00:19:02.457024+00:00, run_duration=1.419776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:18:00+00:00, data_interval_end=2024-03-29 00:19:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:19:02.481583158Z [2024-03-29T00:19:02.479+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:19:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:19:03.754420993Z [2024-03-29T00:19:03.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status success for try_number 1 2024-03-29T00:19:03.763490089Z [2024-03-29T00:19:03.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:18:00+00:00, map_index=-1, run_start_date=2024-03-29 00:19:01.956552+00:00, run_end_date=2024-03-29 00:19:02.384822+00:00, run_duration=0.42827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:19:01.099222+00:00, queued_by_job_id=2, pid=3285 2024-03-29T00:19:04.805881934Z [2024-03-29T00:19:04.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:19:04.806135405Z [2024-03-29T00:19:04.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:18:00+00:00, run_id=scheduled__2024-03-29T00:18:00+00:00, run_start_date=2024-03-29 00:19:01.038810+00:00, run_end_date=2024-03-29 00:19:04.805743+00:00, run_duration=3.766933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:18:00+00:00, data_interval_end=2024-03-29 00:19:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:19:04.816184357Z [2024-03-29T00:19:04.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:19:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:19:04.873865575Z [2024-03-29T00:19:04.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status success for try_number 1 2024-03-29T00:19:04.884759825Z [2024-03-29T00:19:04.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:18:00+00:00, map_index=-1, run_start_date=2024-03-29 00:19:03.106975+00:00, run_end_date=2024-03-29 00:19:04.441079+00:00, run_duration=1.334104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:19:01.099222+00:00, queued_by_job_id=2, pid=3303 2024-03-29T00:19:05.951532875Z [2024-03-29T00:19:05.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:19:05.952063606Z [2024-03-29T00:19:05.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:18:00+00:00, run_id=scheduled__2024-03-29T00:18:00+00:00, run_start_date=2024-03-29 00:19:01.040189+00:00, run_end_date=2024-03-29 00:19:05.951687+00:00, run_duration=4.911498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:18:00+00:00, data_interval_end=2024-03-29 00:19:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:19:05.961252740Z [2024-03-29T00:19:05.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:19:00+00:00, run_after=2024-03-29T00:20:00+00:00 2024-03-29T00:19:06.000567957Z [2024-03-29T00:19:05.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status success for try_number 1 2024-03-29T00:19:06.008007615Z [2024-03-29T00:19:06.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:18:00+00:00, map_index=-1, run_start_date=2024-03-29 00:19:03.134470+00:00, run_end_date=2024-03-29 00:19:04.881506+00:00, run_duration=1.747036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:19:01.099222+00:00, queued_by_job_id=2, pid=3304 2024-03-29T00:20:00.158484443Z [2024-03-29T00:20:00.157+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:20:00.170918801Z [2024-03-29T00:20:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:25:00+00:00 2024-03-29T00:20:00.183185898Z [2024-03-29T00:20:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:21:00+00:00 2024-03-29T00:20:00.195296979Z [2024-03-29T00:20:00.194+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:20:00.207078258Z [2024-03-29T00:20:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:21:00+00:00 2024-03-29T00:20:00.305411264Z [2024-03-29T00:20:00.304+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T00:20:00.305438685Z 2024-03-29T00:20:00.305443152Z 2024-03-29T00:20:00.305447488Z 2024-03-29T00:20:00.305451409Z 2024-03-29T00:20:00.305455417Z 2024-03-29T00:20:00.305857836Z [2024-03-29T00:20:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:20:00.306217051Z [2024-03-29T00:20:00.305+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:20:00.306602258Z [2024-03-29T00:20:00.306+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:20:00.306955029Z [2024-03-29T00:20:00.306+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:20:00.307291440Z [2024-03-29T00:20:00.307+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:20:00.308501573Z [2024-03-29T00:20:00.308+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:20:00.308517732Z 2024-03-29T00:20:00.308524440Z 2024-03-29T00:20:00.308529049Z 2024-03-29T00:20:00.308532723Z 2024-03-29T00:20:00.308536483Z 2024-03-29T00:20:00.314117994Z [2024-03-29T00:20:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:20:00.314471538Z [2024-03-29T00:20:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:20:00.314883615Z [2024-03-29T00:20:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:20:00.315179362Z [2024-03-29T00:20:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:20:00.315630967Z [2024-03-29T00:20:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:20:00.315989181Z [2024-03-29T00:20:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:20:00.316353341Z [2024-03-29T00:20:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:20:00.316580943Z [2024-03-29T00:20:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:20:00.316878076Z [2024-03-29T00:20:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:20:00.317095455Z [2024-03-29T00:20:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:20:00.867154556Z [2024-03-29T00:20:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:00.867346950Z [2024-03-29T00:20:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:00.867514126Z [2024-03-29T00:20:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:19:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:00.867635769Z [2024-03-29T00:20:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:19:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:00.867800757Z [2024-03-29T00:20:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:19:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:00.896244351Z [2024-03-29T00:20:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff43e355-3d55-4e2f-b4e2-66d8e260b8b2 2024-03-29T00:20:00.900943410Z [2024-03-29T00:20:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1119d20-3769-4907-ab24-34d106142698 2024-03-29T00:20:00.901170348Z [2024-03-29T00:20:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7077cde-3f4d-411d-a066-f9b79644eff2 2024-03-29T00:20:00.901350784Z [2024-03-29T00:20:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to dec776ca-d4d6-4aa3-9960-98c7cdfdd115 2024-03-29T00:20:00.901864847Z [2024-03-29T00:20:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8738fe0-e2be-4675-a05e-8da118a0eb46 2024-03-29T00:20:02.258205467Z [2024-03-29T00:20:02.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:20:02.260746466Z [2024-03-29T00:20:02.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:18:00+00:00, run_id=scheduled__2024-03-29T00:18:00+00:00, run_start_date=2024-03-29 00:20:00.220934+00:00, run_end_date=2024-03-29 00:20:02.258115+00:00, run_duration=2.037181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:18:00+00:00, data_interval_end=2024-03-29 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:20:02.284381939Z [2024-03-29T00:20:02.284+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:22:00+00:00 2024-03-29T00:20:02.298260718Z [2024-03-29T00:20:02.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:20:02.299444649Z [2024-03-29T00:20:02.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:19:00+00:00, run_id=scheduled__2024-03-29T00:19:00+00:00, run_start_date=2024-03-29 00:20:00.222172+00:00, run_end_date=2024-03-29 00:20:02.298154+00:00, run_duration=2.075982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:19:00+00:00, data_interval_end=2024-03-29 00:20:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:20:02.322075154Z [2024-03-29T00:20:02.321+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:21:00+00:00 2024-03-29T00:20:02.420295763Z [2024-03-29T00:20:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:18:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:02.420443107Z [2024-03-29T00:20:02.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:19:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:02.433166016Z [2024-03-29T00:20:02.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:19:00+00:00, map_index=-1, run_start_date=2024-03-29 00:20:01.361622+00:00, run_end_date=2024-03-29 00:20:01.979014+00:00, run_duration=0.617392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:00.310434+00:00, queued_by_job_id=2, pid=3338 2024-03-29T00:20:02.434224905Z [2024-03-29T00:20:02.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:18:00+00:00, map_index=-1, run_start_date=2024-03-29 00:20:01.436668+00:00, run_end_date=2024-03-29 00:20:02.032362+00:00, run_duration=0.595694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:00.310434+00:00, queued_by_job_id=2, pid=3339 2024-03-29T00:20:04.573926131Z [2024-03-29T00:20:04.573+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:20:04.573959220Z 2024-03-29T00:20:04.574121282Z [2024-03-29T00:20:04.573+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:20:04.574976533Z [2024-03-29T00:20:04.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:20:04.574991835Z 2024-03-29T00:20:04.577847716Z [2024-03-29T00:20:04.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:20:04.578152773Z [2024-03-29T00:20:04.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:20:04.640229666Z [2024-03-29T00:20:04.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:04.640358755Z [2024-03-29T00:20:04.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:04.654949125Z [2024-03-29T00:20:04.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d11f93d-aae8-43b9-88ae-9d5461c5e811 2024-03-29T00:20:04.655362142Z [2024-03-29T00:20:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:15:00+00:00, map_index=-1, run_start_date=2024-03-29 00:20:02.932030+00:00, run_end_date=2024-03-29 00:20:03.439960+00:00, run_duration=0.50793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:00.310434+00:00, queued_by_job_id=2, pid=3363 2024-03-29T00:20:04.712158850Z [2024-03-29T00:20:04.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:20:04.712186441Z [2024-03-29T00:20:04.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:19:00+00:00, run_id=scheduled__2024-03-29T00:19:00+00:00, run_start_date=2024-03-29 00:20:00.223933+00:00, run_end_date=2024-03-29 00:20:04.710913+00:00, run_duration=4.48698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:19:00+00:00, data_interval_end=2024-03-29 00:20:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:20:04.723808524Z [2024-03-29T00:20:04.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:21:00+00:00 2024-03-29T00:20:04.800590316Z [2024-03-29T00:20:04.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:19:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:04.807704326Z [2024-03-29T00:20:04.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:19:00+00:00, map_index=-1, run_start_date=2024-03-29 00:20:03.304019+00:00, run_end_date=2024-03-29 00:20:04.604463+00:00, run_duration=1.300444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:00.310434+00:00, queued_by_job_id=2, pid=3374 2024-03-29T00:20:05.860495781Z [2024-03-29T00:20:05.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:20:05.860696389Z [2024-03-29T00:20:05.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:19:00+00:00, run_id=scheduled__2024-03-29T00:19:00+00:00, run_start_date=2024-03-29 00:20:00.225210+00:00, run_end_date=2024-03-29 00:20:05.860408+00:00, run_duration=5.635198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:19:00+00:00, data_interval_end=2024-03-29 00:20:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:20:05.892254229Z [2024-03-29T00:20:05.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:21:00+00:00 2024-03-29T00:20:06.102341793Z [2024-03-29T00:20:06.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:19:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:06.120712269Z [2024-03-29T00:20:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:19:00+00:00, map_index=-1, run_start_date=2024-03-29 00:20:03.016329+00:00, run_end_date=2024-03-29 00:20:04.688869+00:00, run_duration=1.67254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:00.310434+00:00, queued_by_job_id=2, pid=3369 2024-03-29T00:20:08.419577373Z [2024-03-29T00:20:08.419+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:20:08.419611296Z 2024-03-29T00:20:08.419817914Z [2024-03-29T00:20:08.419+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:20:08.420757636Z [2024-03-29T00:20:08.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:20:08.420770555Z 2024-03-29T00:20:08.423470131Z [2024-03-29T00:20:08.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:20:08.423663856Z [2024-03-29T00:20:08.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:20:08.480528359Z [2024-03-29T00:20:08.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:08.480859646Z [2024-03-29T00:20:08.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:08.488411321Z [2024-03-29T00:20:08.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91b13d33-4aac-4277-9bdf-504e49f81b4b 2024-03-29T00:20:08.488694496Z [2024-03-29T00:20:08.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:15:00+00:00, map_index=-1, run_start_date=2024-03-29 00:20:06.701241+00:00, run_end_date=2024-03-29 00:20:07.092457+00:00, run_duration=0.391216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:04.575431+00:00, queued_by_job_id=2, pid=3393 2024-03-29T00:20:11.189063255Z [2024-03-29T00:20:11.188+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:20:11.189107431Z 2024-03-29T00:20:11.189113128Z [2024-03-29T00:20:11.188+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:20:11.189639562Z [2024-03-29T00:20:11.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:20:11.189689180Z 2024-03-29T00:20:11.192252306Z [2024-03-29T00:20:11.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:20:11.192295259Z [2024-03-29T00:20:11.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:20:11.265145173Z [2024-03-29T00:20:11.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status queued for try_number 1 2024-03-29T00:20:11.265174614Z [2024-03-29T00:20:11.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:11.277297005Z [2024-03-29T00:20:11.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6712f21-93ec-4d54-b468-564e6559cc5b 2024-03-29T00:20:11.277689967Z [2024-03-29T00:20:11.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:15:00+00:00, map_index=0, run_start_date=2024-03-29 00:20:10.077023+00:00, run_end_date=2024-03-29 00:20:10.457523+00:00, run_duration=0.3805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:08.421272+00:00, queued_by_job_id=2, pid=3401 2024-03-29T00:20:13.500879122Z [2024-03-29T00:20:13.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:20:13.501533780Z [2024-03-29T00:20:13.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:15:00+00:00, run_id=scheduled__2024-03-29T00:15:00+00:00, run_start_date=2024-03-29 00:20:00.219700+00:00, run_end_date=2024-03-29 00:20:13.500752+00:00, run_duration=13.281052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:15:00+00:00, data_interval_end=2024-03-29 00:20:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:20:13.514587674Z [2024-03-29T00:20:13.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:20:00+00:00, run_after=2024-03-29T00:25:00+00:00 2024-03-29T00:20:13.550392235Z [2024-03-29T00:20:13.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:15:00+00:00 exited with status success for try_number 1 2024-03-29T00:20:13.557842130Z [2024-03-29T00:20:13.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:15:00+00:00, map_index=-1, run_start_date=2024-03-29 00:20:12.870903+00:00, run_end_date=2024-03-29 00:20:13.235469+00:00, run_duration=0.364566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:20:11.190096+00:00, queued_by_job_id=2, pid=3409 2024-03-29T00:21:00.433226177Z [2024-03-29T00:21:00.432+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:21:00.448196629Z [2024-03-29T00:21:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:21:00+00:00, run_after=2024-03-29T00:22:00+00:00 2024-03-29T00:21:00.464757621Z [2024-03-29T00:21:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:21:00+00:00, run_after=2024-03-29T00:22:00+00:00 2024-03-29T00:21:00.563005994Z [2024-03-29T00:21:00.562+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:21:00.563035397Z 2024-03-29T00:21:00.563040432Z 2024-03-29T00:21:00.563045015Z 2024-03-29T00:21:00.563059665Z [2024-03-29T00:21:00.562+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:21:00.563112038Z [2024-03-29T00:21:00.563+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:21:00.563237351Z [2024-03-29T00:21:00.563+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:21:00.564357052Z [2024-03-29T00:21:00.564+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:21:00.564390185Z 2024-03-29T00:21:00.564393620Z 2024-03-29T00:21:00.564396742Z 2024-03-29T00:21:00.568750068Z [2024-03-29T00:21:00.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:21:00.568897592Z [2024-03-29T00:21:00.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:21:00.569252897Z [2024-03-29T00:21:00.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:21:00.569279427Z [2024-03-29T00:21:00.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:21:00.569551053Z [2024-03-29T00:21:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:21:00.569664270Z [2024-03-29T00:21:00.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:21:00.792027760Z [2024-03-29T00:21:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:21:00.792328162Z [2024-03-29T00:21:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:21:00.792464269Z [2024-03-29T00:21:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:21:00.803680187Z [2024-03-29T00:21:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7ea6bd7-ae80-4d1b-9fac-8789962eebb4 2024-03-29T00:21:00.804074393Z [2024-03-29T00:21:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81090012-0c54-40f3-b302-414aea607d88 2024-03-29T00:21:00.804417809Z [2024-03-29T00:21:00.804+0000] {scheduler_job.py:635} INFO - Setting external_id for to 243ecb8b-ab0b-4610-acb7-f68020bf9077 2024-03-29T00:21:01.983061791Z [2024-03-29T00:21:01.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:21:01.983425053Z [2024-03-29T00:21:01.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:20:00+00:00, run_id=scheduled__2024-03-29T00:20:00+00:00, run_start_date=2024-03-29 00:21:00.485295+00:00, run_end_date=2024-03-29 00:21:01.983022+00:00, run_duration=1.497727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:20:00+00:00, data_interval_end=2024-03-29 00:21:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:21:01.993917670Z [2024-03-29T00:21:01.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:21:00+00:00, run_after=2024-03-29T00:22:00+00:00 2024-03-29T00:21:03.200208015Z [2024-03-29T00:21:03.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:21:03.210975464Z [2024-03-29T00:21:03.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=-1, run_start_date=2024-03-29 00:21:01.454844+00:00, run_end_date=2024-03-29 00:21:01.914649+00:00, run_duration=0.459805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:21:00.565825+00:00, queued_by_job_id=2, pid=3431 2024-03-29T00:21:04.154224182Z [2024-03-29T00:21:04.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:21:04.154930259Z [2024-03-29T00:21:04.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:20:00+00:00, run_id=scheduled__2024-03-29T00:20:00+00:00, run_start_date=2024-03-29 00:21:00.487200+00:00, run_end_date=2024-03-29 00:21:04.154304+00:00, run_duration=3.667104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:20:00+00:00, data_interval_end=2024-03-29 00:21:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:21:04.170654186Z [2024-03-29T00:21:04.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:21:00+00:00, run_after=2024-03-29T00:22:00+00:00 2024-03-29T00:21:04.211387437Z [2024-03-29T00:21:04.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:21:04.217065888Z [2024-03-29T00:21:04.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=-1, run_start_date=2024-03-29 00:21:02.559310+00:00, run_end_date=2024-03-29 00:21:03.894387+00:00, run_duration=1.335077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:21:00.565825+00:00, queued_by_job_id=2, pid=3449 2024-03-29T00:21:05.274490218Z [2024-03-29T00:21:05.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:21:05.274943184Z [2024-03-29T00:21:05.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:20:00+00:00, run_id=scheduled__2024-03-29T00:20:00+00:00, run_start_date=2024-03-29 00:21:00.488959+00:00, run_end_date=2024-03-29 00:21:05.274389+00:00, run_duration=4.78543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:20:00+00:00, data_interval_end=2024-03-29 00:21:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:21:05.289539169Z [2024-03-29T00:21:05.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:21:00+00:00, run_after=2024-03-29T00:22:00+00:00 2024-03-29T00:21:05.326273641Z [2024-03-29T00:21:05.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:21:05.333477788Z [2024-03-29T00:21:05.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=-1, run_start_date=2024-03-29 00:21:02.741414+00:00, run_end_date=2024-03-29 00:21:04.675116+00:00, run_duration=1.933702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:21:00.565825+00:00, queued_by_job_id=2, pid=3450 2024-03-29T00:22:00.979241384Z [2024-03-29T00:22:00.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:22:00+00:00, run_after=2024-03-29T00:23:00+00:00 2024-03-29T00:22:01.003197778Z [2024-03-29T00:22:01.002+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:22:00+00:00, run_after=2024-03-29T00:23:00+00:00 2024-03-29T00:22:01.014526658Z [2024-03-29T00:22:01.014+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:22:01.023114744Z [2024-03-29T00:22:01.022+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:22:01.113425049Z [2024-03-29T00:22:01.112+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:22:01.113452749Z 2024-03-29T00:22:01.113457618Z 2024-03-29T00:22:01.113461075Z 2024-03-29T00:22:01.113482394Z 2024-03-29T00:22:01.113701876Z [2024-03-29T00:22:01.113+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:22:01.113969344Z [2024-03-29T00:22:01.113+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:22:01.114187742Z [2024-03-29T00:22:01.113+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:22:01.114429848Z [2024-03-29T00:22:01.114+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:22:01.115454244Z [2024-03-29T00:22:01.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:22:01.115470115Z 2024-03-29T00:22:01.115474329Z 2024-03-29T00:22:01.115477653Z 2024-03-29T00:22:01.115481262Z 2024-03-29T00:22:01.121548144Z [2024-03-29T00:22:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:22:01.121854345Z [2024-03-29T00:22:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:22:01.122334156Z [2024-03-29T00:22:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:22:01.122671937Z [2024-03-29T00:22:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:22:01.123108766Z [2024-03-29T00:22:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:22:01.123409329Z [2024-03-29T00:22:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:22:01.123920285Z [2024-03-29T00:22:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:22:01.124189531Z [2024-03-29T00:22:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:22:01.444459536Z [2024-03-29T00:22:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:22:01.445106974Z [2024-03-29T00:22:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:21:00+00:00 exited with status queued for try_number 1 2024-03-29T00:22:01.445351228Z [2024-03-29T00:22:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:21:00+00:00 exited with status queued for try_number 1 2024-03-29T00:22:01.445706943Z [2024-03-29T00:22:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:21:00+00:00 exited with status queued for try_number 1 2024-03-29T00:22:01.457260255Z [2024-03-29T00:22:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13dbab21-ac46-47c1-9d32-19de3070d411 2024-03-29T00:22:01.457473220Z [2024-03-29T00:22:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ad21964-3dfe-418b-bde6-732172ef4e0d 2024-03-29T00:22:01.457696230Z [2024-03-29T00:22:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3f81a03-02d1-4fc8-b112-706ce8df0335 2024-03-29T00:22:01.457977023Z [2024-03-29T00:22:01.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddff83d8-2486-4fee-bfad-5058baabcb92 2024-03-29T00:22:03.788137093Z [2024-03-29T00:22:03.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:22:03.788334789Z [2024-03-29T00:22:03.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:21:00+00:00, run_id=scheduled__2024-03-29T00:21:00+00:00, run_start_date=2024-03-29 00:22:01.039203+00:00, run_end_date=2024-03-29 00:22:03.788007+00:00, run_duration=2.748804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:21:00+00:00, data_interval_end=2024-03-29 00:22:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:22:03.797496072Z [2024-03-29T00:22:03.797+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:22:00+00:00, run_after=2024-03-29T00:23:00+00:00 2024-03-29T00:22:03.805046505Z [2024-03-29T00:22:03.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:22:03.805274575Z [2024-03-29T00:22:03.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:20:00+00:00, run_id=scheduled__2024-03-29T00:20:00+00:00, run_start_date=2024-03-29 00:22:01.037045+00:00, run_end_date=2024-03-29 00:22:03.804910+00:00, run_duration=2.767865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:20:00+00:00, data_interval_end=2024-03-29 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:22:03.813573926Z [2024-03-29T00:22:03.813+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:22:00+00:00, run_after=2024-03-29T00:24:00+00:00 2024-03-29T00:22:03.865235500Z [2024-03-29T00:22:03.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:22:03.865266750Z [2024-03-29T00:22:03.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:21:00+00:00 exited with status success for try_number 1 2024-03-29T00:22:03.873471156Z [2024-03-29T00:22:03.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=-1, run_start_date=2024-03-29 00:22:02.120376+00:00, run_end_date=2024-03-29 00:22:02.633060+00:00, run_duration=0.512684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:22:01.117261+00:00, queued_by_job_id=2, pid=3484 2024-03-29T00:22:03.873613915Z [2024-03-29T00:22:03.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:21:00+00:00, map_index=-1, run_start_date=2024-03-29 00:22:02.424216+00:00, run_end_date=2024-03-29 00:22:02.988451+00:00, run_duration=0.564235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:22:01.117261+00:00, queued_by_job_id=2, pid=3485 2024-03-29T00:22:06.044426134Z [2024-03-29T00:22:06.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:22:06.049379988Z [2024-03-29T00:22:06.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:21:00+00:00, run_id=scheduled__2024-03-29T00:21:00+00:00, run_start_date=2024-03-29 00:22:01.041261+00:00, run_end_date=2024-03-29 00:22:06.048801+00:00, run_duration=5.00754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:21:00+00:00, data_interval_end=2024-03-29 00:22:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:22:06.063507706Z [2024-03-29T00:22:06.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:22:00+00:00, run_after=2024-03-29T00:23:00+00:00 2024-03-29T00:22:06.071395802Z [2024-03-29T00:22:06.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:22:06.071887974Z [2024-03-29T00:22:06.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:21:00+00:00, run_id=scheduled__2024-03-29T00:21:00+00:00, run_start_date=2024-03-29 00:22:01.043409+00:00, run_end_date=2024-03-29 00:22:06.071507+00:00, run_duration=5.028098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:21:00+00:00, data_interval_end=2024-03-29 00:22:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:22:06.085154226Z [2024-03-29T00:22:06.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:22:00+00:00, run_after=2024-03-29T00:23:00+00:00 2024-03-29T00:22:06.115089811Z [2024-03-29T00:22:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:21:00+00:00 exited with status success for try_number 1 2024-03-29T00:22:06.115168102Z [2024-03-29T00:22:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:21:00+00:00 exited with status success for try_number 1 2024-03-29T00:22:06.122776266Z [2024-03-29T00:22:06.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:21:00+00:00, map_index=-1, run_start_date=2024-03-29 00:22:03.900302+00:00, run_end_date=2024-03-29 00:22:05.691210+00:00, run_duration=1.790908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:22:01.117261+00:00, queued_by_job_id=2, pid=3509 2024-03-29T00:22:06.123150307Z [2024-03-29T00:22:06.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:21:00+00:00, map_index=-1, run_start_date=2024-03-29 00:22:03.708351+00:00, run_end_date=2024-03-29 00:22:05.875747+00:00, run_duration=2.167396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:22:01.117261+00:00, queued_by_job_id=2, pid=3508 2024-03-29T00:23:00.070114294Z [2024-03-29T00:23:00.069+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:23:00+00:00, run_after=2024-03-29T00:24:00+00:00 2024-03-29T00:23:00.085119688Z [2024-03-29T00:23:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:23:00+00:00, run_after=2024-03-29T00:24:00+00:00 2024-03-29T00:23:00.092605454Z [2024-03-29T00:23:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:23:00.157049472Z [2024-03-29T00:23:00.156+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:23:00.157090255Z 2024-03-29T00:23:00.157100684Z 2024-03-29T00:23:00.157109870Z 2024-03-29T00:23:00.157195725Z [2024-03-29T00:23:00.156+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:23:00.157307675Z [2024-03-29T00:23:00.157+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:23:00.157479151Z [2024-03-29T00:23:00.157+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:23:00.158195483Z [2024-03-29T00:23:00.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:23:00.158203221Z 2024-03-29T00:23:00.158206391Z 2024-03-29T00:23:00.158209676Z 2024-03-29T00:23:00.161930222Z [2024-03-29T00:23:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:23:00.161981600Z [2024-03-29T00:23:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:23:00.162128819Z [2024-03-29T00:23:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:23:00.162310811Z [2024-03-29T00:23:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:23:00.162662914Z [2024-03-29T00:23:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:23:00.162843202Z [2024-03-29T00:23:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:23:00.373520995Z [2024-03-29T00:23:00.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status queued for try_number 1 2024-03-29T00:23:00.373558113Z [2024-03-29T00:23:00.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status queued for try_number 1 2024-03-29T00:23:00.373638582Z [2024-03-29T00:23:00.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status queued for try_number 1 2024-03-29T00:23:00.381183636Z [2024-03-29T00:23:00.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d713193-11e4-4442-9a7b-9185ab2d70f6 2024-03-29T00:23:00.381237222Z [2024-03-29T00:23:00.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35fe3364-4c42-47e4-b271-52dd622b69bf 2024-03-29T00:23:00.381365268Z [2024-03-29T00:23:00.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43b5a1b0-23bf-4c1a-9452-330a1ae5946f 2024-03-29T00:23:01.855010000Z [2024-03-29T00:23:01.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:23:01.855689075Z [2024-03-29T00:23:01.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:22:00+00:00, run_id=scheduled__2024-03-29T00:22:00+00:00, run_start_date=2024-03-29 00:23:00.103556+00:00, run_end_date=2024-03-29 00:23:01.855060+00:00, run_duration=1.751504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:22:00+00:00, data_interval_end=2024-03-29 00:23:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:23:01.880286131Z [2024-03-29T00:23:01.879+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:23:00+00:00, run_after=2024-03-29T00:24:00+00:00 2024-03-29T00:23:01.979795130Z [2024-03-29T00:23:01.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status success for try_number 1 2024-03-29T00:23:01.986592598Z [2024-03-29T00:23:01.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:22:00+00:00, map_index=-1, run_start_date=2024-03-29 00:23:01.038827+00:00, run_end_date=2024-03-29 00:23:01.516558+00:00, run_duration=0.477731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:23:00.159173+00:00, queued_by_job_id=2, pid=3541 2024-03-29T00:23:04.121267247Z [2024-03-29T00:23:04.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:23:04.121742461Z [2024-03-29T00:23:04.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:22:00+00:00, run_id=scheduled__2024-03-29T00:22:00+00:00, run_start_date=2024-03-29 00:23:00.104893+00:00, run_end_date=2024-03-29 00:23:04.121163+00:00, run_duration=4.01627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:22:00+00:00, data_interval_end=2024-03-29 00:23:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:23:04.135270973Z [2024-03-29T00:23:04.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:23:00+00:00, run_after=2024-03-29T00:24:00+00:00 2024-03-29T00:23:04.143500910Z [2024-03-29T00:23:04.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:23:04.143742074Z [2024-03-29T00:23:04.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:22:00+00:00, run_id=scheduled__2024-03-29T00:22:00+00:00, run_start_date=2024-03-29 00:23:00.106213+00:00, run_end_date=2024-03-29 00:23:04.143397+00:00, run_duration=4.037184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:22:00+00:00, data_interval_end=2024-03-29 00:23:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:23:04.153431733Z [2024-03-29T00:23:04.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:23:00+00:00, run_after=2024-03-29T00:24:00+00:00 2024-03-29T00:23:04.189336909Z [2024-03-29T00:23:04.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status success for try_number 1 2024-03-29T00:23:04.189374564Z [2024-03-29T00:23:04.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status success for try_number 1 2024-03-29T00:23:04.196256920Z [2024-03-29T00:23:04.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:22:00+00:00, map_index=-1, run_start_date=2024-03-29 00:23:02.352583+00:00, run_end_date=2024-03-29 00:23:03.628535+00:00, run_duration=1.275952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:23:00.159173+00:00, queued_by_job_id=2, pid=3560 2024-03-29T00:23:04.196776886Z [2024-03-29T00:23:04.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:22:00+00:00, map_index=-1, run_start_date=2024-03-29 00:23:02.107003+00:00, run_end_date=2024-03-29 00:23:03.691270+00:00, run_duration=1.584267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:23:00.159173+00:00, queued_by_job_id=2, pid=3556 2024-03-29T00:23:44.451099669Z [2024-03-29T00:23:44.450+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:24:00.913392615Z [2024-03-29T00:24:00.912+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:24:00.928703974Z [2024-03-29T00:24:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:24:00+00:00, run_after=2024-03-29T00:25:00+00:00 2024-03-29T00:24:00.942574688Z [2024-03-29T00:24:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:24:00+00:00, run_after=2024-03-29T00:25:00+00:00 2024-03-29T00:24:00.951138361Z [2024-03-29T00:24:00.950+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:24:01.029045831Z [2024-03-29T00:24:01.028+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:24:01.029079377Z 2024-03-29T00:24:01.029087736Z 2024-03-29T00:24:01.029092481Z 2024-03-29T00:24:01.029096874Z 2024-03-29T00:24:01.029184264Z [2024-03-29T00:24:01.028+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:24:01.029399916Z [2024-03-29T00:24:01.029+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:24:01.029638552Z [2024-03-29T00:24:01.029+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:24:01.029864641Z [2024-03-29T00:24:01.029+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:24:01.030580815Z [2024-03-29T00:24:01.030+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:24:01.030596803Z 2024-03-29T00:24:01.030600782Z 2024-03-29T00:24:01.030604285Z 2024-03-29T00:24:01.030607671Z 2024-03-29T00:24:01.034419072Z [2024-03-29T00:24:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:24:01.034650754Z [2024-03-29T00:24:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:24:01.034947994Z [2024-03-29T00:24:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:24:01.035114538Z [2024-03-29T00:24:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:24:01.035362015Z [2024-03-29T00:24:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:24:01.035518287Z [2024-03-29T00:24:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:24:01.035828592Z [2024-03-29T00:24:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:24:01.036004546Z [2024-03-29T00:24:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:24:01.519924142Z [2024-03-29T00:24:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status queued for try_number 1 2024-03-29T00:24:01.522579955Z [2024-03-29T00:24:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:23:00+00:00 exited with status queued for try_number 1 2024-03-29T00:24:01.522981236Z [2024-03-29T00:24:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:23:00+00:00 exited with status queued for try_number 1 2024-03-29T00:24:01.523211836Z [2024-03-29T00:24:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:23:00+00:00 exited with status queued for try_number 1 2024-03-29T00:24:01.540447767Z [2024-03-29T00:24:01.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b28eec5-2af2-4ca7-887f-a7e38eb3a943 2024-03-29T00:24:01.543070962Z [2024-03-29T00:24:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dc18e4f-7291-401d-805c-8a9c4f03c719 2024-03-29T00:24:01.543478581Z [2024-03-29T00:24:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 202c837e-4951-43ff-8712-6a9a9e982ac2 2024-03-29T00:24:01.543853335Z [2024-03-29T00:24:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ff68f2d-f280-4fc6-8963-246fa482653a 2024-03-29T00:24:02.793374634Z [2024-03-29T00:24:02.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:24:02.793804259Z [2024-03-29T00:24:02.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:22:00+00:00, run_id=scheduled__2024-03-29T00:22:00+00:00, run_start_date=2024-03-29 00:24:00.964794+00:00, run_end_date=2024-03-29 00:24:02.793328+00:00, run_duration=1.828534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:22:00+00:00, data_interval_end=2024-03-29 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:24:02.803282368Z [2024-03-29T00:24:02.802+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:24:00+00:00, run_after=2024-03-29T00:26:00+00:00 2024-03-29T00:24:02.867549652Z [2024-03-29T00:24:02.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:22:00+00:00 exited with status success for try_number 1 2024-03-29T00:24:02.867860266Z [2024-03-29T00:24:02.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:23:00+00:00 exited with status success for try_number 1 2024-03-29T00:24:02.878158473Z [2024-03-29T00:24:02.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:22:00+00:00, map_index=-1, run_start_date=2024-03-29 00:24:02.015612+00:00, run_end_date=2024-03-29 00:24:02.535559+00:00, run_duration=0.519947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:24:01.031553+00:00, queued_by_job_id=2, pid=3593 2024-03-29T00:24:02.879126721Z [2024-03-29T00:24:02.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:23:00+00:00, map_index=-1, run_start_date=2024-03-29 00:24:02.153209+00:00, run_end_date=2024-03-29 00:24:02.673173+00:00, run_duration=0.519964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:24:01.031553+00:00, queued_by_job_id=2, pid=3594 2024-03-29T00:24:03.921123972Z [2024-03-29T00:24:03.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:24:03.921429723Z [2024-03-29T00:24:03.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:23:00+00:00, run_id=scheduled__2024-03-29T00:23:00+00:00, run_start_date=2024-03-29 00:24:00.966082+00:00, run_end_date=2024-03-29 00:24:03.921103+00:00, run_duration=2.955021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:23:00+00:00, data_interval_end=2024-03-29 00:24:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:24:03.931886905Z [2024-03-29T00:24:03.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:24:00+00:00, run_after=2024-03-29T00:25:00+00:00 2024-03-29T00:24:06.152030813Z [2024-03-29T00:24:06.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:24:06.155837569Z [2024-03-29T00:24:06.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:23:00+00:00, run_id=scheduled__2024-03-29T00:23:00+00:00, run_start_date=2024-03-29 00:24:00.968529+00:00, run_end_date=2024-03-29 00:24:06.154587+00:00, run_duration=5.186058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:23:00+00:00, data_interval_end=2024-03-29 00:24:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:24:06.181265626Z [2024-03-29T00:24:06.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:24:00+00:00, run_after=2024-03-29T00:25:00+00:00 2024-03-29T00:24:06.196037292Z [2024-03-29T00:24:06.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:24:06.196239222Z [2024-03-29T00:24:06.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:23:00+00:00, run_id=scheduled__2024-03-29T00:23:00+00:00, run_start_date=2024-03-29 00:24:00.967263+00:00, run_end_date=2024-03-29 00:24:06.195940+00:00, run_duration=5.228677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:23:00+00:00, data_interval_end=2024-03-29 00:24:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:24:06.206690470Z [2024-03-29T00:24:06.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:24:00+00:00, run_after=2024-03-29T00:25:00+00:00 2024-03-29T00:24:06.245472182Z [2024-03-29T00:24:06.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:23:00+00:00 exited with status success for try_number 1 2024-03-29T00:24:06.245542296Z [2024-03-29T00:24:06.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:23:00+00:00 exited with status success for try_number 1 2024-03-29T00:24:06.251185289Z [2024-03-29T00:24:06.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:23:00+00:00, map_index=-1, run_start_date=2024-03-29 00:24:03.560571+00:00, run_end_date=2024-03-29 00:24:05.096918+00:00, run_duration=1.536347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:24:01.031553+00:00, queued_by_job_id=2, pid=3618 2024-03-29T00:24:06.251247041Z [2024-03-29T00:24:06.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:23:00+00:00, map_index=-1, run_start_date=2024-03-29 00:24:03.338511+00:00, run_end_date=2024-03-29 00:24:05.128547+00:00, run_duration=1.790036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:24:01.031553+00:00, queued_by_job_id=2, pid=3617 2024-03-29T00:25:00.078007766Z [2024-03-29T00:25:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:25:00+00:00, run_after=2024-03-29T00:26:00+00:00 2024-03-29T00:25:00.094076631Z [2024-03-29T00:25:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:25:00.108885967Z [2024-03-29T00:25:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:25:00+00:00, run_after=2024-03-29T00:26:00+00:00 2024-03-29T00:25:00.120253451Z [2024-03-29T00:25:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:25:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:25:00.216687306Z [2024-03-29T00:25:00.216+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:25:00.216714111Z 2024-03-29T00:25:00.216718820Z 2024-03-29T00:25:00.216722629Z 2024-03-29T00:25:00.216726218Z 2024-03-29T00:25:00.217130000Z [2024-03-29T00:25:00.216+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:25:00.217526574Z [2024-03-29T00:25:00.217+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:25:00.217894448Z [2024-03-29T00:25:00.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:25:00.218250738Z [2024-03-29T00:25:00.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:25:00.219878814Z [2024-03-29T00:25:00.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:25:00.219888086Z 2024-03-29T00:25:00.219891674Z 2024-03-29T00:25:00.219894906Z 2024-03-29T00:25:00.219898007Z 2024-03-29T00:25:00.225559427Z [2024-03-29T00:25:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:25:00.225894336Z [2024-03-29T00:25:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:25:00.226294472Z [2024-03-29T00:25:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:25:00.226581283Z [2024-03-29T00:25:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:25:00.226974687Z [2024-03-29T00:25:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:25:00.227177538Z [2024-03-29T00:25:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:25:00.227799100Z [2024-03-29T00:25:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:25:00.228132902Z [2024-03-29T00:25:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:25:00.626816996Z [2024-03-29T00:25:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:25:00.626898764Z [2024-03-29T00:25:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status queued for try_number 1 2024-03-29T00:25:00.626958366Z [2024-03-29T00:25:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status queued for try_number 1 2024-03-29T00:25:00.627009388Z [2024-03-29T00:25:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status queued for try_number 1 2024-03-29T00:25:00.644827731Z [2024-03-29T00:25:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b724f17-2365-49d1-9a37-24918210ad7f 2024-03-29T00:25:00.645133094Z [2024-03-29T00:25:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0577f9b8-8ef6-4c5a-954b-670ee586b009 2024-03-29T00:25:00.645432604Z [2024-03-29T00:25:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to bae9673b-1428-4662-94eb-af2ba18c0945 2024-03-29T00:25:00.645713668Z [2024-03-29T00:25:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55826afb-a005-47f4-8102-2d0978b260f9 2024-03-29T00:25:01.912135979Z [2024-03-29T00:25:01.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:25:01.912400115Z [2024-03-29T00:25:01.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:24:00+00:00, run_id=scheduled__2024-03-29T00:24:00+00:00, run_start_date=2024-03-29 00:25:00.132913+00:00, run_end_date=2024-03-29 00:25:01.912047+00:00, run_duration=1.779134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:24:00+00:00, data_interval_end=2024-03-29 00:25:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:25:01.926839779Z [2024-03-29T00:25:01.926+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:25:00+00:00, run_after=2024-03-29T00:26:00+00:00 2024-03-29T00:25:02.449567587Z [2024-03-29T00:25:02.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status success for try_number 1 2024-03-29T00:25:02.463823464Z [2024-03-29T00:25:02.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:24:00+00:00, map_index=-1, run_start_date=2024-03-29 00:25:01.382161+00:00, run_end_date=2024-03-29 00:25:01.856682+00:00, run_duration=0.474521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:25:00.221933+00:00, queued_by_job_id=2, pid=3653 2024-03-29T00:25:03.584598541Z [2024-03-29T00:25:03.584+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:25:03.584632558Z 2024-03-29T00:25:03.584799082Z [2024-03-29T00:25:03.584+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:25:03.585671614Z [2024-03-29T00:25:03.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:25:03.585686358Z 2024-03-29T00:25:03.589834770Z [2024-03-29T00:25:03.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:25:03.590022581Z [2024-03-29T00:25:03.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:25:03.639587566Z [2024-03-29T00:25:03.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:25:03.639642395Z [2024-03-29T00:25:03.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:25:03.651445338Z [2024-03-29T00:25:03.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45c677df-25f8-459c-8f61-92a936b9067d 2024-03-29T00:25:03.656963781Z [2024-03-29T00:25:03.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=-1, run_start_date=2024-03-29 00:25:02.470183+00:00, run_end_date=2024-03-29 00:25:03.015724+00:00, run_duration=0.545541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:25:00.221933+00:00, queued_by_job_id=2, pid=3672 2024-03-29T00:25:04.833787800Z [2024-03-29T00:25:04.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:25:04.834271070Z [2024-03-29T00:25:04.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:24:00+00:00, run_id=scheduled__2024-03-29T00:24:00+00:00, run_start_date=2024-03-29 00:25:00.133982+00:00, run_end_date=2024-03-29 00:25:04.833893+00:00, run_duration=4.699911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:24:00+00:00, data_interval_end=2024-03-29 00:25:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:25:04.850803185Z [2024-03-29T00:25:04.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:25:00+00:00, run_after=2024-03-29T00:26:00+00:00 2024-03-29T00:25:04.860970077Z [2024-03-29T00:25:04.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:25:04.861364703Z [2024-03-29T00:25:04.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:24:00+00:00, run_id=scheduled__2024-03-29T00:24:00+00:00, run_start_date=2024-03-29 00:25:00.135265+00:00, run_end_date=2024-03-29 00:25:04.860832+00:00, run_duration=4.725567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:24:00+00:00, data_interval_end=2024-03-29 00:25:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:25:04.871673990Z [2024-03-29T00:25:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:25:00+00:00, run_after=2024-03-29T00:26:00+00:00 2024-03-29T00:25:04.935502471Z [2024-03-29T00:25:04.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status success for try_number 1 2024-03-29T00:25:04.935892293Z [2024-03-29T00:25:04.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status success for try_number 1 2024-03-29T00:25:04.945934382Z [2024-03-29T00:25:04.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:24:00+00:00, map_index=-1, run_start_date=2024-03-29 00:25:02.436184+00:00, run_end_date=2024-03-29 00:25:04.030969+00:00, run_duration=1.594785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:25:00.221933+00:00, queued_by_job_id=2, pid=3671 2024-03-29T00:25:04.946671002Z [2024-03-29T00:25:04.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:24:00+00:00, map_index=-1, run_start_date=2024-03-29 00:25:02.895609+00:00, run_end_date=2024-03-29 00:25:04.606994+00:00, run_duration=1.711385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:25:00.221933+00:00, queued_by_job_id=2, pid=3688 2024-03-29T00:25:07.207636479Z [2024-03-29T00:25:07.207+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:25:07.207675236Z 2024-03-29T00:25:07.207692843Z [2024-03-29T00:25:07.207+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:25:07.208856049Z [2024-03-29T00:25:07.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:25:07.208881935Z 2024-03-29T00:25:07.212521996Z [2024-03-29T00:25:07.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:25:07.212552022Z [2024-03-29T00:25:07.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:25:07.416099910Z [2024-03-29T00:25:07.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:25:07.416201997Z [2024-03-29T00:25:07.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:25:07.427739552Z [2024-03-29T00:25:07.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fc6953f-8599-4017-aca9-bbfe43eb87d6 2024-03-29T00:25:07.428096347Z [2024-03-29T00:25:07.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=-1, run_start_date=2024-03-29 00:25:05.756929+00:00, run_end_date=2024-03-29 00:25:06.270931+00:00, run_duration=0.514002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:25:03.586777+00:00, queued_by_job_id=2, pid=3701 2024-03-29T00:25:10.789540758Z [2024-03-29T00:25:10.788+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:25:10.789619895Z 2024-03-29T00:25:10.789824019Z [2024-03-29T00:25:10.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:25:10.790805298Z [2024-03-29T00:25:10.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:25:10.790819433Z 2024-03-29T00:25:10.794047209Z [2024-03-29T00:25:10.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:25:10.794331299Z [2024-03-29T00:25:10.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:25:10.874049953Z [2024-03-29T00:25:10.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status queued for try_number 1 2024-03-29T00:25:10.874086173Z [2024-03-29T00:25:10.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:25:10.886843018Z [2024-03-29T00:25:10.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22e620ca-3198-448d-a1b7-2c5d756b2e27 2024-03-29T00:25:10.887238161Z [2024-03-29T00:25:10.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=0, run_start_date=2024-03-29 00:25:09.297911+00:00, run_end_date=2024-03-29 00:25:09.673565+00:00, run_duration=0.375654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:25:07.209472+00:00, queued_by_job_id=2, pid=3709 2024-03-29T00:25:13.686071255Z [2024-03-29T00:25:13.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:25:13.686565088Z [2024-03-29T00:25:13.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:20:00+00:00, run_id=scheduled__2024-03-29T00:20:00+00:00, run_start_date=2024-03-29 00:25:00.131494+00:00, run_end_date=2024-03-29 00:25:13.685961+00:00, run_duration=13.554467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:20:00+00:00, data_interval_end=2024-03-29 00:25:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:25:13.692860168Z [2024-03-29T00:25:13.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:25:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:25:13.722372433Z [2024-03-29T00:25:13.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:20:00+00:00 exited with status success for try_number 1 2024-03-29T00:25:13.728829959Z [2024-03-29T00:25:13.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:20:00+00:00, map_index=-1, run_start_date=2024-03-29 00:25:12.586812+00:00, run_end_date=2024-03-29 00:25:12.985515+00:00, run_duration=0.398703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:25:10.791377+00:00, queued_by_job_id=2, pid=3717 2024-03-29T00:26:00.384712142Z [2024-03-29T00:26:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:26:00+00:00, run_after=2024-03-29T00:27:00+00:00 2024-03-29T00:26:00.401849282Z [2024-03-29T00:26:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:26:00+00:00, run_after=2024-03-29T00:27:00+00:00 2024-03-29T00:26:00.409506410Z [2024-03-29T00:26:00.409+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:26:00.418411139Z [2024-03-29T00:26:00.418+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:26:00.509624457Z [2024-03-29T00:26:00.509+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:26:00.509652986Z 2024-03-29T00:26:00.509658333Z 2024-03-29T00:26:00.509662728Z 2024-03-29T00:26:00.509667133Z 2024-03-29T00:26:00.510005277Z [2024-03-29T00:26:00.509+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:26:00.510200451Z [2024-03-29T00:26:00.509+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:26:00.510259655Z [2024-03-29T00:26:00.510+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:26:00.510376454Z [2024-03-29T00:26:00.510+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:26:00.511308663Z [2024-03-29T00:26:00.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:26:00.511332596Z 2024-03-29T00:26:00.511340341Z 2024-03-29T00:26:00.511346298Z 2024-03-29T00:26:00.511352393Z 2024-03-29T00:26:00.515194198Z [2024-03-29T00:26:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:26:00.515567154Z [2024-03-29T00:26:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:26:00.515921751Z [2024-03-29T00:26:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:26:00.516220809Z [2024-03-29T00:26:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:26:00.516604467Z [2024-03-29T00:26:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:26:00.516950554Z [2024-03-29T00:26:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:26:00.517261549Z [2024-03-29T00:26:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:26:00.517415491Z [2024-03-29T00:26:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:26:00.848750279Z [2024-03-29T00:26:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status queued for try_number 1 2024-03-29T00:26:00.848788272Z [2024-03-29T00:26:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status queued for try_number 1 2024-03-29T00:26:00.848912575Z [2024-03-29T00:26:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status queued for try_number 1 2024-03-29T00:26:00.849002498Z [2024-03-29T00:26:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status queued for try_number 1 2024-03-29T00:26:00.857191784Z [2024-03-29T00:26:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to c99b7c5d-6fcb-4fee-884c-fb9017d62c13 2024-03-29T00:26:00.857295819Z [2024-03-29T00:26:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b7bc345-4da6-4ed4-b415-2c0fd2d6f8a6 2024-03-29T00:26:00.857488374Z [2024-03-29T00:26:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fcae1b3-c72c-4348-b32f-421dfb58d92c 2024-03-29T00:26:00.857641790Z [2024-03-29T00:26:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2cbd34d-2110-4b3b-a498-60248f505114 2024-03-29T00:26:03.346082706Z [2024-03-29T00:26:03.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:26:03.346997616Z [2024-03-29T00:26:03.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:24:00+00:00, run_id=scheduled__2024-03-29T00:24:00+00:00, run_start_date=2024-03-29 00:26:00.439977+00:00, run_end_date=2024-03-29 00:26:03.346243+00:00, run_duration=2.906266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:24:00+00:00, data_interval_end=2024-03-29 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:26:03.357691769Z [2024-03-29T00:26:03.357+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:26:00+00:00, run_after=2024-03-29T00:28:00+00:00 2024-03-29T00:26:03.371593016Z [2024-03-29T00:26:03.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:26:03.372307880Z [2024-03-29T00:26:03.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:25:00+00:00, run_id=scheduled__2024-03-29T00:25:00+00:00, run_start_date=2024-03-29 00:26:00.441882+00:00, run_end_date=2024-03-29 00:26:03.371484+00:00, run_duration=2.929602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:25:00+00:00, data_interval_end=2024-03-29 00:26:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:26:03.389153880Z [2024-03-29T00:26:03.388+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:26:00+00:00, run_after=2024-03-29T00:27:00+00:00 2024-03-29T00:26:03.478578710Z [2024-03-29T00:26:03.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:24:00+00:00 exited with status success for try_number 1 2024-03-29T00:26:03.478742487Z [2024-03-29T00:26:03.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status success for try_number 1 2024-03-29T00:26:03.495231207Z [2024-03-29T00:26:03.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:24:00+00:00, map_index=-1, run_start_date=2024-03-29 00:26:01.723518+00:00, run_end_date=2024-03-29 00:26:02.483911+00:00, run_duration=0.760393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:26:00.512471+00:00, queued_by_job_id=2, pid=3741 2024-03-29T00:26:03.495574264Z [2024-03-29T00:26:03.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:25:00+00:00, map_index=-1, run_start_date=2024-03-29 00:26:01.604646+00:00, run_end_date=2024-03-29 00:26:02.402380+00:00, run_duration=0.797734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:26:00.512471+00:00, queued_by_job_id=2, pid=3740 2024-03-29T00:26:06.798888954Z [2024-03-29T00:26:06.798+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:26:06.799050757Z [2024-03-29T00:26:06.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:25:00+00:00, run_id=scheduled__2024-03-29T00:25:00+00:00, run_start_date=2024-03-29 00:26:00.443735+00:00, run_end_date=2024-03-29 00:26:06.798770+00:00, run_duration=6.355035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:25:00+00:00, data_interval_end=2024-03-29 00:26:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:26:06.808593496Z [2024-03-29T00:26:06.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:26:00+00:00, run_after=2024-03-29T00:27:00+00:00 2024-03-29T00:26:06.845019541Z [2024-03-29T00:26:06.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status success for try_number 1 2024-03-29T00:26:06.855171265Z [2024-03-29T00:26:06.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:25:00+00:00, map_index=-1, run_start_date=2024-03-29 00:26:04.100505+00:00, run_end_date=2024-03-29 00:26:06.644230+00:00, run_duration=2.543725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:26:00.512471+00:00, queued_by_job_id=2, pid=3765 2024-03-29T00:26:07.903150149Z [2024-03-29T00:26:07.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:26:07.903505304Z [2024-03-29T00:26:07.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:25:00+00:00, run_id=scheduled__2024-03-29T00:25:00+00:00, run_start_date=2024-03-29 00:26:00.445363+00:00, run_end_date=2024-03-29 00:26:07.903047+00:00, run_duration=7.457684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:25:00+00:00, data_interval_end=2024-03-29 00:26:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:26:07.919820521Z [2024-03-29T00:26:07.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:26:00+00:00, run_after=2024-03-29T00:27:00+00:00 2024-03-29T00:26:07.948038347Z [2024-03-29T00:26:07.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status success for try_number 1 2024-03-29T00:26:07.953848081Z [2024-03-29T00:26:07.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:25:00+00:00, map_index=-1, run_start_date=2024-03-29 00:26:04.040384+00:00, run_end_date=2024-03-29 00:26:07.064276+00:00, run_duration=3.023892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:26:00.512471+00:00, queued_by_job_id=2, pid=3764 2024-03-29T00:27:00.187878206Z [2024-03-29T00:27:00.187+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:27:00.201861283Z [2024-03-29T00:27:00.201+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:27:00+00:00, run_after=2024-03-29T00:28:00+00:00 2024-03-29T00:27:00.215015165Z [2024-03-29T00:27:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:27:00+00:00, run_after=2024-03-29T00:28:00+00:00 2024-03-29T00:27:00.294222895Z [2024-03-29T00:27:00.293+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:27:00.294255720Z 2024-03-29T00:27:00.294260700Z 2024-03-29T00:27:00.294265157Z 2024-03-29T00:27:00.294549234Z [2024-03-29T00:27:00.294+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:27:00.294916578Z [2024-03-29T00:27:00.294+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:27:00.295241930Z [2024-03-29T00:27:00.294+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:27:00.296264517Z [2024-03-29T00:27:00.295+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:27:00.296288782Z 2024-03-29T00:27:00.296296403Z 2024-03-29T00:27:00.296302416Z 2024-03-29T00:27:00.301207848Z [2024-03-29T00:27:00.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:27:00.301488217Z [2024-03-29T00:27:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:27:00.301985496Z [2024-03-29T00:27:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:27:00.302372049Z [2024-03-29T00:27:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:27:00.302925771Z [2024-03-29T00:27:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:27:00.303295756Z [2024-03-29T00:27:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:27:00.532880734Z [2024-03-29T00:27:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status queued for try_number 1 2024-03-29T00:27:00.533100746Z [2024-03-29T00:27:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status queued for try_number 1 2024-03-29T00:27:00.533248997Z [2024-03-29T00:27:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status queued for try_number 1 2024-03-29T00:27:00.540964852Z [2024-03-29T00:27:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad8c3701-2e61-4ecd-9989-a931d1975fc5 2024-03-29T00:27:00.541128462Z [2024-03-29T00:27:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbfb630d-c6c6-428a-9ee4-fa34d5c6b444 2024-03-29T00:27:00.541399550Z [2024-03-29T00:27:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1276ec3f-6d17-4553-afa7-305d5f066b60 2024-03-29T00:27:02.317426237Z [2024-03-29T00:27:02.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:27:02.318500969Z [2024-03-29T00:27:02.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:26:00+00:00, run_id=scheduled__2024-03-29T00:26:00+00:00, run_start_date=2024-03-29 00:27:00.226043+00:00, run_end_date=2024-03-29 00:27:02.317499+00:00, run_duration=2.091456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:26:00+00:00, data_interval_end=2024-03-29 00:27:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:27:02.332238177Z [2024-03-29T00:27:02.331+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:27:00+00:00, run_after=2024-03-29T00:28:00+00:00 2024-03-29T00:27:02.397541412Z [2024-03-29T00:27:02.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status success for try_number 1 2024-03-29T00:27:02.404347885Z [2024-03-29T00:27:02.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:26:00+00:00, map_index=-1, run_start_date=2024-03-29 00:27:01.296201+00:00, run_end_date=2024-03-29 00:27:01.688520+00:00, run_duration=0.392319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:27:00.297624+00:00, queued_by_job_id=2, pid=3797 2024-03-29T00:27:03.842764159Z [2024-03-29T00:27:03.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:27:03.843388817Z [2024-03-29T00:27:03.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:26:00+00:00, run_id=scheduled__2024-03-29T00:26:00+00:00, run_start_date=2024-03-29 00:27:00.227495+00:00, run_end_date=2024-03-29 00:27:03.842770+00:00, run_duration=3.615275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:26:00+00:00, data_interval_end=2024-03-29 00:27:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:27:03.856073906Z [2024-03-29T00:27:03.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:27:00+00:00, run_after=2024-03-29T00:28:00+00:00 2024-03-29T00:27:03.903134484Z [2024-03-29T00:27:03.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status success for try_number 1 2024-03-29T00:27:03.909633902Z [2024-03-29T00:27:03.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:26:00+00:00, map_index=-1, run_start_date=2024-03-29 00:27:02.184080+00:00, run_end_date=2024-03-29 00:27:03.451734+00:00, run_duration=1.267654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:27:00.297624+00:00, queued_by_job_id=2, pid=3810 2024-03-29T00:27:05.331804022Z [2024-03-29T00:27:05.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:27:05.332303782Z [2024-03-29T00:27:05.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:26:00+00:00, run_id=scheduled__2024-03-29T00:26:00+00:00, run_start_date=2024-03-29 00:27:00.228666+00:00, run_end_date=2024-03-29 00:27:05.331945+00:00, run_duration=5.103279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:26:00+00:00, data_interval_end=2024-03-29 00:27:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:27:05.342173636Z [2024-03-29T00:27:05.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:27:00+00:00, run_after=2024-03-29T00:28:00+00:00 2024-03-29T00:27:05.373835393Z [2024-03-29T00:27:05.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status success for try_number 1 2024-03-29T00:27:05.379421632Z [2024-03-29T00:27:05.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:26:00+00:00, map_index=-1, run_start_date=2024-03-29 00:27:02.545080+00:00, run_end_date=2024-03-29 00:27:04.246062+00:00, run_duration=1.700982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:27:00.297624+00:00, queued_by_job_id=2, pid=3821 2024-03-29T00:28:01.054426787Z [2024-03-29T00:28:01.053+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:28:01.065757390Z [2024-03-29T00:28:01.065+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:28:01.088386854Z [2024-03-29T00:28:01.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:28:00+00:00, run_after=2024-03-29T00:29:00+00:00 2024-03-29T00:28:01.109431899Z [2024-03-29T00:28:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:28:00+00:00, run_after=2024-03-29T00:29:00+00:00 2024-03-29T00:28:01.221962336Z [2024-03-29T00:28:01.221+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:28:01.221989013Z 2024-03-29T00:28:01.221996226Z 2024-03-29T00:28:01.222001004Z 2024-03-29T00:28:01.222005598Z 2024-03-29T00:28:01.222127550Z [2024-03-29T00:28:01.221+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:28:01.222285565Z [2024-03-29T00:28:01.222+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:28:01.222424680Z [2024-03-29T00:28:01.222+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:28:01.222659603Z [2024-03-29T00:28:01.222+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:28:01.223566249Z [2024-03-29T00:28:01.223+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:28:01.223603097Z 2024-03-29T00:28:01.223609485Z 2024-03-29T00:28:01.223614054Z 2024-03-29T00:28:01.223618762Z 2024-03-29T00:28:01.228473051Z [2024-03-29T00:28:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:28:01.228496537Z [2024-03-29T00:28:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:28:01.228793961Z [2024-03-29T00:28:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:28:01.228925104Z [2024-03-29T00:28:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:28:01.229220724Z [2024-03-29T00:28:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:28:01.229339538Z [2024-03-29T00:28:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:28:01.229623341Z [2024-03-29T00:28:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:28:01.229775814Z [2024-03-29T00:28:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:28:01.806881330Z [2024-03-29T00:28:01.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status queued for try_number 1 2024-03-29T00:28:01.809754341Z [2024-03-29T00:28:01.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:27:00+00:00 exited with status queued for try_number 1 2024-03-29T00:28:01.810187215Z [2024-03-29T00:28:01.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:27:00+00:00 exited with status queued for try_number 1 2024-03-29T00:28:01.810791483Z [2024-03-29T00:28:01.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:27:00+00:00 exited with status queued for try_number 1 2024-03-29T00:28:01.829478404Z [2024-03-29T00:28:01.828+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccadbb48-6287-4956-9b93-c9d753bbf767 2024-03-29T00:28:01.829762664Z [2024-03-29T00:28:01.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff0976b3-cef9-4e89-bea7-dcbf229bf993 2024-03-29T00:28:01.830148740Z [2024-03-29T00:28:01.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91870630-21d6-45e5-a9c8-be9935c7ce2e 2024-03-29T00:28:01.830708555Z [2024-03-29T00:28:01.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81be4ba6-9746-4f86-9fc5-1d5e46449f5f 2024-03-29T00:28:03.094136793Z [2024-03-29T00:28:03.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:28:03.094546546Z [2024-03-29T00:28:03.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:26:00+00:00, run_id=scheduled__2024-03-29T00:26:00+00:00, run_start_date=2024-03-29 00:28:01.129141+00:00, run_end_date=2024-03-29 00:28:03.094106+00:00, run_duration=1.964965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:26:00+00:00, data_interval_end=2024-03-29 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:28:03.106631025Z [2024-03-29T00:28:03.106+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:28:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:28:03.126940133Z [2024-03-29T00:28:03.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:28:03.127318993Z [2024-03-29T00:28:03.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:27:00+00:00, run_id=scheduled__2024-03-29T00:27:00+00:00, run_start_date=2024-03-29 00:28:01.131151+00:00, run_end_date=2024-03-29 00:28:03.126984+00:00, run_duration=1.995833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:27:00+00:00, data_interval_end=2024-03-29 00:28:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:28:03.140944439Z [2024-03-29T00:28:03.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:28:00+00:00, run_after=2024-03-29T00:29:00+00:00 2024-03-29T00:28:03.288094861Z [2024-03-29T00:28:03.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:26:00+00:00 exited with status success for try_number 1 2024-03-29T00:28:03.302368526Z [2024-03-29T00:28:03.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:26:00+00:00, map_index=-1, run_start_date=2024-03-29 00:28:02.079507+00:00, run_end_date=2024-03-29 00:28:02.574217+00:00, run_duration=0.49471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:28:01.224867+00:00, queued_by_job_id=2, pid=3845 2024-03-29T00:28:04.414627122Z [2024-03-29T00:28:04.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:27:00+00:00 exited with status success for try_number 1 2024-03-29T00:28:04.421913161Z [2024-03-29T00:28:04.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:27:00+00:00, map_index=-1, run_start_date=2024-03-29 00:28:02.547598+00:00, run_end_date=2024-03-29 00:28:03.089464+00:00, run_duration=0.541866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:28:01.224867+00:00, queued_by_job_id=2, pid=3856 2024-03-29T00:28:06.209689434Z [2024-03-29T00:28:06.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:28:06.209929036Z [2024-03-29T00:28:06.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:27:00+00:00, run_id=scheduled__2024-03-29T00:27:00+00:00, run_start_date=2024-03-29 00:28:01.134578+00:00, run_end_date=2024-03-29 00:28:06.209633+00:00, run_duration=5.075055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:27:00+00:00, data_interval_end=2024-03-29 00:28:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:28:06.221151458Z [2024-03-29T00:28:06.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:28:00+00:00, run_after=2024-03-29T00:29:00+00:00 2024-03-29T00:28:06.229094991Z [2024-03-29T00:28:06.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:28:06.229545268Z [2024-03-29T00:28:06.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:27:00+00:00, run_id=scheduled__2024-03-29T00:27:00+00:00, run_start_date=2024-03-29 00:28:01.132827+00:00, run_end_date=2024-03-29 00:28:06.229237+00:00, run_duration=5.09641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:27:00+00:00, data_interval_end=2024-03-29 00:28:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:28:06.250105418Z [2024-03-29T00:28:06.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:28:00+00:00, run_after=2024-03-29T00:29:00+00:00 2024-03-29T00:28:06.284830106Z [2024-03-29T00:28:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:27:00+00:00 exited with status success for try_number 1 2024-03-29T00:28:06.285063589Z [2024-03-29T00:28:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:27:00+00:00 exited with status success for try_number 1 2024-03-29T00:28:06.292474965Z [2024-03-29T00:28:06.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:27:00+00:00, map_index=-1, run_start_date=2024-03-29 00:28:03.927856+00:00, run_end_date=2024-03-29 00:28:06.042645+00:00, run_duration=2.114789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:28:01.224867+00:00, queued_by_job_id=2, pid=3879 2024-03-29T00:28:06.292726641Z [2024-03-29T00:28:06.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:27:00+00:00, map_index=-1, run_start_date=2024-03-29 00:28:03.585443+00:00, run_end_date=2024-03-29 00:28:05.555477+00:00, run_duration=1.970034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:28:01.224867+00:00, queued_by_job_id=2, pid=3869 2024-03-29T00:28:44.519540561Z [2024-03-29T00:28:44.519+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:29:00.121474859Z [2024-03-29T00:29:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:29:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:29:00.133700598Z [2024-03-29T00:29:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:29:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:29:00.142871157Z [2024-03-29T00:29:00.142+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:29:00.210379114Z [2024-03-29T00:29:00.209+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:29:00.210423260Z 2024-03-29T00:29:00.210433054Z 2024-03-29T00:29:00.210495891Z 2024-03-29T00:29:00.210623413Z [2024-03-29T00:29:00.210+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:29:00.210645835Z [2024-03-29T00:29:00.210+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:29:00.210860150Z [2024-03-29T00:29:00.210+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:29:00.211782619Z [2024-03-29T00:29:00.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:29:00.211798743Z 2024-03-29T00:29:00.211803560Z 2024-03-29T00:29:00.211825358Z 2024-03-29T00:29:00.215899124Z [2024-03-29T00:29:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:29:00.216191483Z [2024-03-29T00:29:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:29:00.216604632Z [2024-03-29T00:29:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:29:00.216874960Z [2024-03-29T00:29:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:29:00.217325429Z [2024-03-29T00:29:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:29:00.217659189Z [2024-03-29T00:29:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:29:00.470914947Z [2024-03-29T00:29:00.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status queued for try_number 1 2024-03-29T00:29:00.471022450Z [2024-03-29T00:29:00.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status queued for try_number 1 2024-03-29T00:29:00.471147689Z [2024-03-29T00:29:00.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status queued for try_number 1 2024-03-29T00:29:00.481903955Z [2024-03-29T00:29:00.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5fc8e9b-75d6-4bac-9639-f5b42e96d4b7 2024-03-29T00:29:00.482136598Z [2024-03-29T00:29:00.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35e82579-bbc1-4de6-afd7-302ceb60eb88 2024-03-29T00:29:00.482344833Z [2024-03-29T00:29:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6066ae32-b755-43de-9861-f859fb784fd5 2024-03-29T00:29:02.065001905Z [2024-03-29T00:29:02.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:29:02.065189442Z [2024-03-29T00:29:02.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:28:00+00:00, run_id=scheduled__2024-03-29T00:28:00+00:00, run_start_date=2024-03-29 00:29:00.152253+00:00, run_end_date=2024-03-29 00:29:02.064833+00:00, run_duration=1.91258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:28:00+00:00, data_interval_end=2024-03-29 00:29:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:29:02.077215413Z [2024-03-29T00:29:02.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:29:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:29:02.145999835Z [2024-03-29T00:29:02.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status success for try_number 1 2024-03-29T00:29:02.151684720Z [2024-03-29T00:29:02.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:28:00+00:00, map_index=-1, run_start_date=2024-03-29 00:29:00.969228+00:00, run_end_date=2024-03-29 00:29:01.394309+00:00, run_duration=0.425081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:29:00.212748+00:00, queued_by_job_id=2, pid=3908 2024-03-29T00:29:03.748314447Z [2024-03-29T00:29:03.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:29:03.748780932Z [2024-03-29T00:29:03.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:28:00+00:00, run_id=scheduled__2024-03-29T00:28:00+00:00, run_start_date=2024-03-29 00:29:00.153502+00:00, run_end_date=2024-03-29 00:29:03.748336+00:00, run_duration=3.594834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:28:00+00:00, data_interval_end=2024-03-29 00:29:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:29:03.761243471Z [2024-03-29T00:29:03.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:29:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:29:03.797789781Z [2024-03-29T00:29:03.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status success for try_number 1 2024-03-29T00:29:03.803037436Z [2024-03-29T00:29:03.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:28:00+00:00, map_index=-1, run_start_date=2024-03-29 00:29:02.033227+00:00, run_end_date=2024-03-29 00:29:03.383119+00:00, run_duration=1.349892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:29:00.212748+00:00, queued_by_job_id=2, pid=3926 2024-03-29T00:29:04.849745436Z [2024-03-29T00:29:04.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:29:04.850344428Z [2024-03-29T00:29:04.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:28:00+00:00, run_id=scheduled__2024-03-29T00:28:00+00:00, run_start_date=2024-03-29 00:29:00.154553+00:00, run_end_date=2024-03-29 00:29:04.849643+00:00, run_duration=4.69509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:28:00+00:00, data_interval_end=2024-03-29 00:29:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:29:04.864311011Z [2024-03-29T00:29:04.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:29:00+00:00, run_after=2024-03-29T00:30:00+00:00 2024-03-29T00:29:04.926171753Z [2024-03-29T00:29:04.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status success for try_number 1 2024-03-29T00:29:04.931792106Z [2024-03-29T00:29:04.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:28:00+00:00, map_index=-1, run_start_date=2024-03-29 00:29:02.179240+00:00, run_end_date=2024-03-29 00:29:03.724087+00:00, run_duration=1.544847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:29:00.212748+00:00, queued_by_job_id=2, pid=3927 2024-03-29T00:30:01.016789026Z [2024-03-29T00:30:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:31:00+00:00 2024-03-29T00:30:01.030054895Z [2024-03-29T00:30:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:35:00+00:00 2024-03-29T00:30:01.039122885Z [2024-03-29T00:30:01.038+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:30:01.055534866Z [2024-03-29T00:30:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:31:00+00:00 2024-03-29T00:30:01.066660379Z [2024-03-29T00:30:01.066+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:30:01.181220832Z [2024-03-29T00:30:01.180+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T00:30:01.181253457Z 2024-03-29T00:30:01.181260055Z 2024-03-29T00:30:01.181273425Z 2024-03-29T00:30:01.181301601Z 2024-03-29T00:30:01.181307167Z 2024-03-29T00:30:01.181322592Z [2024-03-29T00:30:01.181+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:30:01.181501071Z [2024-03-29T00:30:01.181+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:30:01.181716488Z [2024-03-29T00:30:01.181+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:30:01.181940022Z [2024-03-29T00:30:01.181+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:30:01.182187161Z [2024-03-29T00:30:01.182+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:30:01.183092571Z [2024-03-29T00:30:01.182+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:30:01.183111022Z 2024-03-29T00:30:01.183116994Z 2024-03-29T00:30:01.183122795Z 2024-03-29T00:30:01.183127764Z 2024-03-29T00:30:01.183132694Z 2024-03-29T00:30:01.188722947Z [2024-03-29T00:30:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:30:01.188754675Z [2024-03-29T00:30:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:30:01.189073740Z [2024-03-29T00:30:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:30:01.189265115Z [2024-03-29T00:30:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:30:01.189585352Z [2024-03-29T00:30:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:30:01.189738594Z [2024-03-29T00:30:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:30:01.190027153Z [2024-03-29T00:30:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:30:01.190095092Z [2024-03-29T00:30:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:30:01.190492819Z [2024-03-29T00:30:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:30:01.190681884Z [2024-03-29T00:30:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:30:01.695495837Z [2024-03-29T00:30:01.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:01.695881696Z [2024-03-29T00:30:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:01.696129118Z [2024-03-29T00:30:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:29:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:01.696410577Z [2024-03-29T00:30:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:29:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:01.696604880Z [2024-03-29T00:30:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:29:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:01.711793556Z [2024-03-29T00:30:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0842c95-cb99-4851-acd4-f86cd2ac116d 2024-03-29T00:30:01.712247463Z [2024-03-29T00:30:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed45df8c-3050-482d-bdff-71353a1ff695 2024-03-29T00:30:01.712607494Z [2024-03-29T00:30:01.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fa64abb-6750-4ec6-ac92-5fa9a1f07b3e 2024-03-29T00:30:01.712922414Z [2024-03-29T00:30:01.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d5a4952-195e-44d2-bfb3-0caf32d01095 2024-03-29T00:30:01.713231210Z [2024-03-29T00:30:01.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ca961e7-0322-4b6d-909a-0ff8865baab1 2024-03-29T00:30:03.707360195Z [2024-03-29T00:30:03.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:30:03.707699437Z [2024-03-29T00:30:03.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:28:00+00:00, run_id=scheduled__2024-03-29T00:28:00+00:00, run_start_date=2024-03-29 00:30:01.084785+00:00, run_end_date=2024-03-29 00:30:03.707247+00:00, run_duration=2.622462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:28:00+00:00, data_interval_end=2024-03-29 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:30:03.717028036Z [2024-03-29T00:30:03.716+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:32:00+00:00 2024-03-29T00:30:03.741534469Z [2024-03-29T00:30:03.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:30:03.741881410Z [2024-03-29T00:30:03.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:29:00+00:00, run_id=scheduled__2024-03-29T00:29:00+00:00, run_start_date=2024-03-29 00:30:01.086709+00:00, run_end_date=2024-03-29 00:30:03.741446+00:00, run_duration=2.654737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:29:00+00:00, data_interval_end=2024-03-29 00:30:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:30:03.758067647Z [2024-03-29T00:30:03.757+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:31:00+00:00 2024-03-29T00:30:03.827445517Z [2024-03-29T00:30:03.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:28:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:03.827544978Z [2024-03-29T00:30:03.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:29:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:03.840295661Z [2024-03-29T00:30:03.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:29:00+00:00, map_index=-1, run_start_date=2024-03-29 00:30:02.997426+00:00, run_end_date=2024-03-29 00:30:03.567230+00:00, run_duration=0.569804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:01.184631+00:00, queued_by_job_id=2, pid=3963 2024-03-29T00:30:03.840506681Z [2024-03-29T00:30:03.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:28:00+00:00, map_index=-1, run_start_date=2024-03-29 00:30:02.588833+00:00, run_end_date=2024-03-29 00:30:03.171543+00:00, run_duration=0.58271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:01.184631+00:00, queued_by_job_id=2, pid=3957 2024-03-29T00:30:05.351091096Z [2024-03-29T00:30:05.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:30:05.351597687Z [2024-03-29T00:30:05.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:29:00+00:00, run_id=scheduled__2024-03-29T00:29:00+00:00, run_start_date=2024-03-29 00:30:01.088646+00:00, run_end_date=2024-03-29 00:30:05.350970+00:00, run_duration=4.262324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:29:00+00:00, data_interval_end=2024-03-29 00:30:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:30:05.365181543Z [2024-03-29T00:30:05.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:31:00+00:00 2024-03-29T00:30:05.414219293Z [2024-03-29T00:30:05.413+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:30:05.414244540Z 2024-03-29T00:30:05.414611101Z [2024-03-29T00:30:05.414+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:30:05.415272791Z [2024-03-29T00:30:05.415+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:30:05.415285078Z 2024-03-29T00:30:05.418199738Z [2024-03-29T00:30:05.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:30:05.418387468Z [2024-03-29T00:30:05.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:30:05.506783684Z [2024-03-29T00:30:05.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:05.507078405Z [2024-03-29T00:30:05.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:05.507292540Z [2024-03-29T00:30:05.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:29:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:05.520109846Z [2024-03-29T00:30:05.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:25:00+00:00, map_index=-1, run_start_date=2024-03-29 00:30:04.135542+00:00, run_end_date=2024-03-29 00:30:04.496331+00:00, run_duration=0.360789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:01.184631+00:00, queued_by_job_id=2, pid=3997 2024-03-29T00:30:05.520580735Z [2024-03-29T00:30:05.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0364eb61-26e1-4120-a5b2-b8ee0446ae94 2024-03-29T00:30:05.520870671Z [2024-03-29T00:30:05.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:29:00+00:00, map_index=-1, run_start_date=2024-03-29 00:30:03.723437+00:00, run_end_date=2024-03-29 00:30:05.056074+00:00, run_duration=1.332637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:01.184631+00:00, queued_by_job_id=2, pid=3981 2024-03-29T00:30:06.717657912Z [2024-03-29T00:30:06.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:30:06.718022011Z [2024-03-29T00:30:06.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:29:00+00:00, run_id=scheduled__2024-03-29T00:29:00+00:00, run_start_date=2024-03-29 00:30:01.090647+00:00, run_end_date=2024-03-29 00:30:06.717563+00:00, run_duration=5.626916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:29:00+00:00, data_interval_end=2024-03-29 00:30:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:30:06.727428769Z [2024-03-29T00:30:06.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:31:00+00:00 2024-03-29T00:30:06.793406029Z [2024-03-29T00:30:06.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:29:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:06.799804465Z [2024-03-29T00:30:06.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:29:00+00:00, map_index=-1, run_start_date=2024-03-29 00:30:04.168204+00:00, run_end_date=2024-03-29 00:30:05.922678+00:00, run_duration=1.754474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:01.184631+00:00, queued_by_job_id=2, pid=3998 2024-03-29T00:30:08.186941712Z [2024-03-29T00:30:08.186+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:30:08.186981754Z 2024-03-29T00:30:08.187438889Z [2024-03-29T00:30:08.187+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:30:08.188635510Z [2024-03-29T00:30:08.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:30:08.188652175Z 2024-03-29T00:30:08.192531094Z [2024-03-29T00:30:08.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:30:08.192973752Z [2024-03-29T00:30:08.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:30:08.267522915Z [2024-03-29T00:30:08.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:08.267607469Z [2024-03-29T00:30:08.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:08.277818261Z [2024-03-29T00:30:08.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59e158b5-ae62-47d9-b4f7-30fc21676e37 2024-03-29T00:30:08.278125526Z [2024-03-29T00:30:08.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:25:00+00:00, map_index=-1, run_start_date=2024-03-29 00:30:07.558702+00:00, run_end_date=2024-03-29 00:30:07.899081+00:00, run_duration=0.340379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:05.415868+00:00, queued_by_job_id=2, pid=4016 2024-03-29T00:30:10.512049416Z [2024-03-29T00:30:10.511+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:30:10.512089102Z 2024-03-29T00:30:10.512376296Z [2024-03-29T00:30:10.512+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:30:10.513284126Z [2024-03-29T00:30:10.513+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:30:10.513293268Z 2024-03-29T00:30:10.516406592Z [2024-03-29T00:30:10.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:30:10.516752464Z [2024-03-29T00:30:10.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:30:10.566893286Z [2024-03-29T00:30:10.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status queued for try_number 1 2024-03-29T00:30:10.567162323Z [2024-03-29T00:30:10.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:10.573685252Z [2024-03-29T00:30:10.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea6c82f1-ea22-48ee-90a5-1cb3f7df58d3 2024-03-29T00:30:10.574117579Z [2024-03-29T00:30:10.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:25:00+00:00, map_index=0, run_start_date=2024-03-29 00:30:09.970523+00:00, run_end_date=2024-03-29 00:30:10.277568+00:00, run_duration=0.307045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:08.189417+00:00, queued_by_job_id=2, pid=4024 2024-03-29T00:30:13.264512413Z [2024-03-29T00:30:13.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:30:13.265091877Z [2024-03-29T00:30:13.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:25:00+00:00, run_id=scheduled__2024-03-29T00:25:00+00:00, run_start_date=2024-03-29 00:30:01.082528+00:00, run_end_date=2024-03-29 00:30:13.264424+00:00, run_duration=12.181896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:25:00+00:00, data_interval_end=2024-03-29 00:30:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:30:13.274489632Z [2024-03-29T00:30:13.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:30:00+00:00, run_after=2024-03-29T00:35:00+00:00 2024-03-29T00:30:13.308865772Z [2024-03-29T00:30:13.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:25:00+00:00 exited with status success for try_number 1 2024-03-29T00:30:13.315801084Z [2024-03-29T00:30:13.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:25:00+00:00, map_index=-1, run_start_date=2024-03-29 00:30:12.103982+00:00, run_end_date=2024-03-29 00:30:12.450930+00:00, run_duration=0.346948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:30:10.513870+00:00, queued_by_job_id=2, pid=4032 2024-03-29T00:31:00.920237809Z [2024-03-29T00:31:00.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:31:00+00:00, run_after=2024-03-29T00:32:00+00:00 2024-03-29T00:31:00.942957459Z [2024-03-29T00:31:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:31:00+00:00, run_after=2024-03-29T00:32:00+00:00 2024-03-29T00:31:00.950887842Z [2024-03-29T00:31:00.950+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:31:01.017243666Z [2024-03-29T00:31:01.016+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:31:01.017289435Z 2024-03-29T00:31:01.017310655Z 2024-03-29T00:31:01.017313987Z 2024-03-29T00:31:01.017317042Z [2024-03-29T00:31:01.016+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:31:01.017335508Z [2024-03-29T00:31:01.017+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:31:01.017465340Z [2024-03-29T00:31:01.017+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:31:01.018150375Z [2024-03-29T00:31:01.017+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:31:01.018164871Z 2024-03-29T00:31:01.018168461Z 2024-03-29T00:31:01.018171774Z 2024-03-29T00:31:01.022982694Z [2024-03-29T00:31:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:31:01.023591606Z [2024-03-29T00:31:01.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:31:01.024184824Z [2024-03-29T00:31:01.023+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:31:01.024406442Z [2024-03-29T00:31:01.024+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:31:01.024807502Z [2024-03-29T00:31:01.024+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:31:01.025011603Z [2024-03-29T00:31:01.024+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:31:01.279395767Z [2024-03-29T00:31:01.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:31:01.279663508Z [2024-03-29T00:31:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:31:01.280276432Z [2024-03-29T00:31:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:31:01.293316783Z [2024-03-29T00:31:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to e782a6b3-59b0-47b9-a26d-42ae5f772d24 2024-03-29T00:31:01.293707449Z [2024-03-29T00:31:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 011c3b91-b39c-455c-b754-23c33fcd9c4c 2024-03-29T00:31:01.294046679Z [2024-03-29T00:31:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43ac475e-ec45-43f4-80cf-f2a314be55be 2024-03-29T00:31:02.491336088Z [2024-03-29T00:31:02.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:31:02.491693043Z [2024-03-29T00:31:02.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:30:00+00:00, run_id=scheduled__2024-03-29T00:30:00+00:00, run_start_date=2024-03-29 00:31:00.963072+00:00, run_end_date=2024-03-29 00:31:02.491224+00:00, run_duration=1.528152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:30:00+00:00, data_interval_end=2024-03-29 00:31:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:31:02.503152075Z [2024-03-29T00:31:02.502+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:31:00+00:00, run_after=2024-03-29T00:32:00+00:00 2024-03-29T00:31:02.553879339Z [2024-03-29T00:31:02.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:31:02.560408394Z [2024-03-29T00:31:02.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=-1, run_start_date=2024-03-29 00:31:01.878391+00:00, run_end_date=2024-03-29 00:31:02.333805+00:00, run_duration=0.455414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:31:01.019019+00:00, queued_by_job_id=2, pid=4055 2024-03-29T00:31:05.735447188Z [2024-03-29T00:31:05.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:31:05.735868809Z [2024-03-29T00:31:05.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:30:00+00:00, run_id=scheduled__2024-03-29T00:30:00+00:00, run_start_date=2024-03-29 00:31:00.964350+00:00, run_end_date=2024-03-29 00:31:05.735372+00:00, run_duration=4.771022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:30:00+00:00, data_interval_end=2024-03-29 00:31:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:31:05.746115030Z [2024-03-29T00:31:05.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:31:00+00:00, run_after=2024-03-29T00:32:00+00:00 2024-03-29T00:31:05.755317437Z [2024-03-29T00:31:05.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:31:05.755741061Z [2024-03-29T00:31:05.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:30:00+00:00, run_id=scheduled__2024-03-29T00:30:00+00:00, run_start_date=2024-03-29 00:31:00.965425+00:00, run_end_date=2024-03-29 00:31:05.755241+00:00, run_duration=4.789816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:30:00+00:00, data_interval_end=2024-03-29 00:31:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:31:05.765660401Z [2024-03-29T00:31:05.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:31:00+00:00, run_after=2024-03-29T00:32:00+00:00 2024-03-29T00:31:05.809533063Z [2024-03-29T00:31:05.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:31:05.809631752Z [2024-03-29T00:31:05.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:31:05.838569663Z [2024-03-29T00:31:05.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=-1, run_start_date=2024-03-29 00:31:03.127787+00:00, run_end_date=2024-03-29 00:31:04.697139+00:00, run_duration=1.569352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:31:01.019019+00:00, queued_by_job_id=2, pid=4074 2024-03-29T00:31:05.838597979Z [2024-03-29T00:31:05.836+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=-1, run_start_date=2024-03-29 00:31:02.983815+00:00, run_end_date=2024-03-29 00:31:05.075139+00:00, run_duration=2.091324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:31:01.019019+00:00, queued_by_job_id=2, pid=4073 2024-03-29T00:32:00.527537383Z [2024-03-29T00:32:00.527+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:32:00.545911323Z [2024-03-29T00:32:00.545+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:32:00+00:00, run_after=2024-03-29T00:33:00+00:00 2024-03-29T00:32:00.562899079Z [2024-03-29T00:32:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:32:00+00:00, run_after=2024-03-29T00:33:00+00:00 2024-03-29T00:32:00.571708757Z [2024-03-29T00:32:00.571+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:32:00.656762734Z [2024-03-29T00:32:00.656+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:32:00.656784940Z 2024-03-29T00:32:00.656789355Z 2024-03-29T00:32:00.656792733Z 2024-03-29T00:32:00.656795972Z 2024-03-29T00:32:00.656975478Z [2024-03-29T00:32:00.656+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:32:00.657215208Z [2024-03-29T00:32:00.657+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:32:00.657432739Z [2024-03-29T00:32:00.657+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:32:00.657637589Z [2024-03-29T00:32:00.657+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:32:00.658422067Z [2024-03-29T00:32:00.658+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:32:00.658427361Z 2024-03-29T00:32:00.658430484Z 2024-03-29T00:32:00.658433729Z 2024-03-29T00:32:00.658436954Z 2024-03-29T00:32:00.663052266Z [2024-03-29T00:32:00.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:32:00.663277615Z [2024-03-29T00:32:00.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:32:00.663636641Z [2024-03-29T00:32:00.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:32:00.663877308Z [2024-03-29T00:32:00.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:32:00.664227061Z [2024-03-29T00:32:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:32:00.664446400Z [2024-03-29T00:32:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:32:00.664798720Z [2024-03-29T00:32:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:32:00.665020418Z [2024-03-29T00:32:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:32:01.071200785Z [2024-03-29T00:32:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:32:01.071247213Z [2024-03-29T00:32:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:31:00+00:00 exited with status queued for try_number 1 2024-03-29T00:32:01.071422599Z [2024-03-29T00:32:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:31:00+00:00 exited with status queued for try_number 1 2024-03-29T00:32:01.071508187Z [2024-03-29T00:32:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:31:00+00:00 exited with status queued for try_number 1 2024-03-29T00:32:01.080079044Z [2024-03-29T00:32:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21ba6371-503f-4984-9d7f-3d641d2e26e0 2024-03-29T00:32:01.080301767Z [2024-03-29T00:32:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3e42cfb-955b-47ea-8511-2f8428080059 2024-03-29T00:32:01.080529852Z [2024-03-29T00:32:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e5807c8-2b98-430d-a81d-84145e412056 2024-03-29T00:32:01.080879872Z [2024-03-29T00:32:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to cccffd22-e853-4c76-976d-c0709b1a77c7 2024-03-29T00:32:02.280797243Z [2024-03-29T00:32:02.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:32:02.281272128Z [2024-03-29T00:32:02.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:30:00+00:00, run_id=scheduled__2024-03-29T00:30:00+00:00, run_start_date=2024-03-29 00:32:00.584158+00:00, run_end_date=2024-03-29 00:32:02.280721+00:00, run_duration=1.696563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:30:00+00:00, data_interval_end=2024-03-29 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:32:02.296145338Z [2024-03-29T00:32:02.295+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:32:00+00:00, run_after=2024-03-29T00:34:00+00:00 2024-03-29T00:32:02.329617094Z [2024-03-29T00:32:02.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:32:02.329940476Z [2024-03-29T00:32:02.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:31:00+00:00, run_id=scheduled__2024-03-29T00:31:00+00:00, run_start_date=2024-03-29 00:32:00.585595+00:00, run_end_date=2024-03-29 00:32:02.329543+00:00, run_duration=1.743948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:31:00+00:00, data_interval_end=2024-03-29 00:32:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:32:02.352962415Z [2024-03-29T00:32:02.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:32:00+00:00, run_after=2024-03-29T00:33:00+00:00 2024-03-29T00:32:02.423516899Z [2024-03-29T00:32:02.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:32:02.423985744Z [2024-03-29T00:32:02.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:31:00+00:00 exited with status success for try_number 1 2024-03-29T00:32:02.435791839Z [2024-03-29T00:32:02.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=-1, run_start_date=2024-03-29 00:32:01.449910+00:00, run_end_date=2024-03-29 00:32:01.840562+00:00, run_duration=0.390652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:32:00.659590+00:00, queued_by_job_id=2, pid=4107 2024-03-29T00:32:02.436165788Z [2024-03-29T00:32:02.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:31:00+00:00, map_index=-1, run_start_date=2024-03-29 00:32:01.657009+00:00, run_end_date=2024-03-29 00:32:02.101367+00:00, run_duration=0.444358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:32:00.659590+00:00, queued_by_job_id=2, pid=4108 2024-03-29T00:32:04.636173414Z [2024-03-29T00:32:04.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:32:04.636586862Z [2024-03-29T00:32:04.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:31:00+00:00, run_id=scheduled__2024-03-29T00:31:00+00:00, run_start_date=2024-03-29 00:32:00.586920+00:00, run_end_date=2024-03-29 00:32:04.636052+00:00, run_duration=4.049132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:31:00+00:00, data_interval_end=2024-03-29 00:32:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:32:04.655864498Z [2024-03-29T00:32:04.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:32:00+00:00, run_after=2024-03-29T00:33:00+00:00 2024-03-29T00:32:04.666619012Z [2024-03-29T00:32:04.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:32:04.667144101Z [2024-03-29T00:32:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:31:00+00:00, run_id=scheduled__2024-03-29T00:31:00+00:00, run_start_date=2024-03-29 00:32:00.588216+00:00, run_end_date=2024-03-29 00:32:04.666579+00:00, run_duration=4.078363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:31:00+00:00, data_interval_end=2024-03-29 00:32:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:32:04.685281785Z [2024-03-29T00:32:04.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:32:00+00:00, run_after=2024-03-29T00:33:00+00:00 2024-03-29T00:32:04.747183341Z [2024-03-29T00:32:04.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:31:00+00:00 exited with status success for try_number 1 2024-03-29T00:32:04.758215731Z [2024-03-29T00:32:04.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:31:00+00:00, map_index=-1, run_start_date=2024-03-29 00:32:02.662567+00:00, run_end_date=2024-03-29 00:32:03.936366+00:00, run_duration=1.273799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:32:00.659590+00:00, queued_by_job_id=2, pid=4128 2024-03-29T00:32:05.048501801Z [2024-03-29T00:32:05.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:31:00+00:00 exited with status success for try_number 1 2024-03-29T00:32:05.054533143Z [2024-03-29T00:32:05.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:31:00+00:00, map_index=-1, run_start_date=2024-03-29 00:32:02.924304+00:00, run_end_date=2024-03-29 00:32:04.606627+00:00, run_duration=1.682323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:32:00.659590+00:00, queued_by_job_id=2, pid=4132 2024-03-29T00:33:00.324440572Z [2024-03-29T00:33:00.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:33:00+00:00, run_after=2024-03-29T00:34:00+00:00 2024-03-29T00:33:00.341750517Z [2024-03-29T00:33:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:33:00+00:00, run_after=2024-03-29T00:34:00+00:00 2024-03-29T00:33:00.351015134Z [2024-03-29T00:33:00.350+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:33:00.430303886Z [2024-03-29T00:33:00.429+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:33:00.430331073Z 2024-03-29T00:33:00.430335377Z 2024-03-29T00:33:00.430338863Z 2024-03-29T00:33:00.430426357Z [2024-03-29T00:33:00.430+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:33:00.430680462Z [2024-03-29T00:33:00.430+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:33:00.430774323Z [2024-03-29T00:33:00.430+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:33:00.431389972Z [2024-03-29T00:33:00.431+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:33:00.431397262Z 2024-03-29T00:33:00.431400784Z 2024-03-29T00:33:00.431403899Z 2024-03-29T00:33:00.435050983Z [2024-03-29T00:33:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:33:00.435095323Z [2024-03-29T00:33:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:33:00.435361441Z [2024-03-29T00:33:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:33:00.435475032Z [2024-03-29T00:33:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:33:00.435789855Z [2024-03-29T00:33:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:33:00.435948782Z [2024-03-29T00:33:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:33:00.691465807Z [2024-03-29T00:33:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status queued for try_number 1 2024-03-29T00:33:00.691520215Z [2024-03-29T00:33:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status queued for try_number 1 2024-03-29T00:33:00.691665357Z [2024-03-29T00:33:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status queued for try_number 1 2024-03-29T00:33:00.701242269Z [2024-03-29T00:33:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88f8657c-1325-4385-bfb3-61d895cd6410 2024-03-29T00:33:00.701384915Z [2024-03-29T00:33:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to d25f7164-620f-4aa6-80fc-53d52a6eee35 2024-03-29T00:33:00.701535448Z [2024-03-29T00:33:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7996725a-1339-4af2-b34a-7911508d80eb 2024-03-29T00:33:01.860383926Z [2024-03-29T00:33:01.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:33:01.861176158Z [2024-03-29T00:33:01.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:32:00+00:00, run_id=scheduled__2024-03-29T00:32:00+00:00, run_start_date=2024-03-29 00:33:00.364271+00:00, run_end_date=2024-03-29 00:33:01.860276+00:00, run_duration=1.496005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:32:00+00:00, data_interval_end=2024-03-29 00:33:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:33:01.884646810Z [2024-03-29T00:33:01.884+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:33:00+00:00, run_after=2024-03-29T00:34:00+00:00 2024-03-29T00:33:01.955743047Z [2024-03-29T00:33:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status success for try_number 1 2024-03-29T00:33:01.965834092Z [2024-03-29T00:33:01.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:32:00+00:00, map_index=-1, run_start_date=2024-03-29 00:33:01.229380+00:00, run_end_date=2024-03-29 00:33:01.696424+00:00, run_duration=0.467044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:33:00.432133+00:00, queued_by_job_id=2, pid=4164 2024-03-29T00:33:04.334179173Z [2024-03-29T00:33:04.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:33:04.334359385Z [2024-03-29T00:33:04.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:32:00+00:00, run_id=scheduled__2024-03-29T00:32:00+00:00, run_start_date=2024-03-29 00:33:00.365599+00:00, run_end_date=2024-03-29 00:33:04.333980+00:00, run_duration=3.968381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:32:00+00:00, data_interval_end=2024-03-29 00:33:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:33:04.349914853Z [2024-03-29T00:33:04.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:33:00+00:00, run_after=2024-03-29T00:34:00+00:00 2024-03-29T00:33:04.402594505Z [2024-03-29T00:33:04.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status success for try_number 1 2024-03-29T00:33:04.408079728Z [2024-03-29T00:33:04.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:32:00+00:00, map_index=-1, run_start_date=2024-03-29 00:33:02.433562+00:00, run_end_date=2024-03-29 00:33:03.745929+00:00, run_duration=1.312367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:33:00.432133+00:00, queued_by_job_id=2, pid=4182 2024-03-29T00:33:05.425766323Z [2024-03-29T00:33:05.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:33:05.426180520Z [2024-03-29T00:33:05.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:32:00+00:00, run_id=scheduled__2024-03-29T00:32:00+00:00, run_start_date=2024-03-29 00:33:00.367079+00:00, run_end_date=2024-03-29 00:33:05.425646+00:00, run_duration=5.058567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:32:00+00:00, data_interval_end=2024-03-29 00:33:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:33:05.444502334Z [2024-03-29T00:33:05.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:33:00+00:00, run_after=2024-03-29T00:34:00+00:00 2024-03-29T00:33:05.498259682Z [2024-03-29T00:33:05.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status success for try_number 1 2024-03-29T00:33:05.515202850Z [2024-03-29T00:33:05.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:32:00+00:00, map_index=-1, run_start_date=2024-03-29 00:33:02.477049+00:00, run_end_date=2024-03-29 00:33:04.466065+00:00, run_duration=1.989016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:33:00.432133+00:00, queued_by_job_id=2, pid=4183 2024-03-29T00:33:44.589543986Z [2024-03-29T00:33:44.589+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:34:00.085288702Z [2024-03-29T00:34:00.084+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:34:00.104216077Z [2024-03-29T00:34:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:34:00+00:00, run_after=2024-03-29T00:35:00+00:00 2024-03-29T00:34:00.127153818Z [2024-03-29T00:34:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:34:00+00:00, run_after=2024-03-29T00:35:00+00:00 2024-03-29T00:34:00.137530033Z [2024-03-29T00:34:00.137+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:34:00.207677422Z [2024-03-29T00:34:00.207+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:34:00.207717847Z 2024-03-29T00:34:00.207722492Z 2024-03-29T00:34:00.207725692Z 2024-03-29T00:34:00.207728995Z 2024-03-29T00:34:00.207958653Z [2024-03-29T00:34:00.207+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:34:00.208135524Z [2024-03-29T00:34:00.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:34:00.208396637Z [2024-03-29T00:34:00.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:34:00.208556805Z [2024-03-29T00:34:00.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:34:00.209257157Z [2024-03-29T00:34:00.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:34:00.209271036Z 2024-03-29T00:34:00.209275204Z 2024-03-29T00:34:00.209279037Z 2024-03-29T00:34:00.209282236Z 2024-03-29T00:34:00.212979248Z [2024-03-29T00:34:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:34:00.213174714Z [2024-03-29T00:34:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:34:00.213537065Z [2024-03-29T00:34:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:34:00.213743463Z [2024-03-29T00:34:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:34:00.213996216Z [2024-03-29T00:34:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:34:00.214168297Z [2024-03-29T00:34:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:34:00.214474212Z [2024-03-29T00:34:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:34:00.214675222Z [2024-03-29T00:34:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:34:00.650575916Z [2024-03-29T00:34:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status queued for try_number 1 2024-03-29T00:34:00.650817685Z [2024-03-29T00:34:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:33:00+00:00 exited with status queued for try_number 1 2024-03-29T00:34:00.651013085Z [2024-03-29T00:34:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:33:00+00:00 exited with status queued for try_number 1 2024-03-29T00:34:00.651178925Z [2024-03-29T00:34:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:33:00+00:00 exited with status queued for try_number 1 2024-03-29T00:34:00.661182253Z [2024-03-29T00:34:00.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3631b197-4c61-4304-bff5-a16075e24af2 2024-03-29T00:34:00.661528369Z [2024-03-29T00:34:00.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to b11b47d2-315d-43b1-8488-59375d4ade55 2024-03-29T00:34:00.661836993Z [2024-03-29T00:34:00.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 638b9be5-fe1e-43df-aed5-1e07fb240f05 2024-03-29T00:34:00.662030052Z [2024-03-29T00:34:00.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee00231a-f1da-4f05-b179-d0f64edcf860 2024-03-29T00:34:02.042063556Z [2024-03-29T00:34:02.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:34:02.042412182Z [2024-03-29T00:34:02.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:32:00+00:00, run_id=scheduled__2024-03-29T00:32:00+00:00, run_start_date=2024-03-29 00:34:00.150958+00:00, run_end_date=2024-03-29 00:34:02.042062+00:00, run_duration=1.891104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:32:00+00:00, data_interval_end=2024-03-29 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:34:02.052745568Z [2024-03-29T00:34:02.052+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:34:00+00:00, run_after=2024-03-29T00:36:00+00:00 2024-03-29T00:34:02.124944789Z [2024-03-29T00:34:02.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:32:00+00:00 exited with status success for try_number 1 2024-03-29T00:34:02.136646361Z [2024-03-29T00:34:02.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:32:00+00:00, map_index=-1, run_start_date=2024-03-29 00:34:01.165800+00:00, run_end_date=2024-03-29 00:34:01.734598+00:00, run_duration=0.568798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:34:00.210148+00:00, queued_by_job_id=2, pid=4212 2024-03-29T00:34:03.203524579Z [2024-03-29T00:34:03.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:34:03.203874981Z [2024-03-29T00:34:03.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:33:00+00:00, run_id=scheduled__2024-03-29T00:33:00+00:00, run_start_date=2024-03-29 00:34:00.152313+00:00, run_end_date=2024-03-29 00:34:03.203524+00:00, run_duration=3.051211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:33:00+00:00, data_interval_end=2024-03-29 00:34:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:34:03.220430709Z [2024-03-29T00:34:03.220+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:34:00+00:00, run_after=2024-03-29T00:35:00+00:00 2024-03-29T00:34:03.359458168Z [2024-03-29T00:34:03.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:33:00+00:00 exited with status success for try_number 1 2024-03-29T00:34:03.373503543Z [2024-03-29T00:34:03.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:33:00+00:00, map_index=-1, run_start_date=2024-03-29 00:34:01.799265+00:00, run_end_date=2024-03-29 00:34:02.520095+00:00, run_duration=0.72083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:34:00.210148+00:00, queued_by_job_id=2, pid=4224 2024-03-29T00:34:06.030394482Z [2024-03-29T00:34:06.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:34:06.030607530Z [2024-03-29T00:34:06.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:33:00+00:00, run_id=scheduled__2024-03-29T00:33:00+00:00, run_start_date=2024-03-29 00:34:00.153535+00:00, run_end_date=2024-03-29 00:34:06.030232+00:00, run_duration=5.876697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:33:00+00:00, data_interval_end=2024-03-29 00:34:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:34:06.040395813Z [2024-03-29T00:34:06.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:34:00+00:00, run_after=2024-03-29T00:35:00+00:00 2024-03-29T00:34:06.047887517Z [2024-03-29T00:34:06.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:34:06.048022721Z [2024-03-29T00:34:06.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:33:00+00:00, run_id=scheduled__2024-03-29T00:33:00+00:00, run_start_date=2024-03-29 00:34:00.154638+00:00, run_end_date=2024-03-29 00:34:06.047760+00:00, run_duration=5.893122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:33:00+00:00, data_interval_end=2024-03-29 00:34:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:34:06.057691869Z [2024-03-29T00:34:06.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:34:00+00:00, run_after=2024-03-29T00:35:00+00:00 2024-03-29T00:34:06.098181440Z [2024-03-29T00:34:06.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:33:00+00:00 exited with status success for try_number 1 2024-03-29T00:34:06.104491829Z [2024-03-29T00:34:06.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:33:00+00:00, map_index=-1, run_start_date=2024-03-29 00:34:02.891148+00:00, run_end_date=2024-03-29 00:34:04.806157+00:00, run_duration=1.915009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:34:00.210148+00:00, queued_by_job_id=2, pid=4236 2024-03-29T00:34:07.477478817Z [2024-03-29T00:34:07.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:33:00+00:00 exited with status success for try_number 1 2024-03-29T00:34:07.488693681Z [2024-03-29T00:34:07.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:33:00+00:00, map_index=-1, run_start_date=2024-03-29 00:34:03.367124+00:00, run_end_date=2024-03-29 00:34:05.576137+00:00, run_duration=2.209013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:34:00.210148+00:00, queued_by_job_id=2, pid=4247 2024-03-29T00:35:00.063561190Z [2024-03-29T00:35:00.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:35:00.078496564Z [2024-03-29T00:35:00.078+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:35:00+00:00, run_after=2024-03-29T00:36:00+00:00 2024-03-29T00:35:00.102744820Z [2024-03-29T00:35:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:35:00+00:00, run_after=2024-03-29T00:36:00+00:00 2024-03-29T00:35:00.120839071Z [2024-03-29T00:35:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:35:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:35:00.226270775Z [2024-03-29T00:35:00.225+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:35:00.226293827Z 2024-03-29T00:35:00.226299274Z 2024-03-29T00:35:00.226303957Z 2024-03-29T00:35:00.226308702Z 2024-03-29T00:35:00.226326523Z [2024-03-29T00:35:00.226+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:35:00.226556637Z [2024-03-29T00:35:00.226+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:35:00.226682490Z [2024-03-29T00:35:00.226+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:35:00.226816401Z [2024-03-29T00:35:00.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:35:00.227452781Z [2024-03-29T00:35:00.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:35:00.227463022Z 2024-03-29T00:35:00.227466890Z 2024-03-29T00:35:00.227470644Z 2024-03-29T00:35:00.227474067Z 2024-03-29T00:35:00.230891199Z [2024-03-29T00:35:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:35:00.231043618Z [2024-03-29T00:35:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:35:00.231403945Z [2024-03-29T00:35:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:35:00.231524339Z [2024-03-29T00:35:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:35:00.231763199Z [2024-03-29T00:35:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:35:00.231928512Z [2024-03-29T00:35:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:35:00.232192033Z [2024-03-29T00:35:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:35:00.232308092Z [2024-03-29T00:35:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:35:00.791037336Z [2024-03-29T00:35:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:35:00.791387048Z [2024-03-29T00:35:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status queued for try_number 1 2024-03-29T00:35:00.791754342Z [2024-03-29T00:35:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status queued for try_number 1 2024-03-29T00:35:00.792059699Z [2024-03-29T00:35:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status queued for try_number 1 2024-03-29T00:35:00.844767327Z [2024-03-29T00:35:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8012f6e-99b9-45bd-b50d-aaf8577ae6f8 2024-03-29T00:35:00.845217581Z [2024-03-29T00:35:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2b2e93f-4938-4332-bc7e-56ee463d900d 2024-03-29T00:35:00.845461106Z [2024-03-29T00:35:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79180d16-f703-4d52-b42a-14c8fe2c9cc3 2024-03-29T00:35:00.845679960Z [2024-03-29T00:35:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68f7159e-53ba-48b7-8d1c-c5a889a14bba 2024-03-29T00:35:03.305606055Z [2024-03-29T00:35:03.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:35:03.306305290Z [2024-03-29T00:35:03.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:34:00+00:00, run_id=scheduled__2024-03-29T00:34:00+00:00, run_start_date=2024-03-29 00:35:00.133585+00:00, run_end_date=2024-03-29 00:35:03.305686+00:00, run_duration=3.172101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:34:00+00:00, data_interval_end=2024-03-29 00:35:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:35:03.342409959Z [2024-03-29T00:35:03.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:35:00+00:00, run_after=2024-03-29T00:36:00+00:00 2024-03-29T00:35:03.597636763Z [2024-03-29T00:35:03.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status success for try_number 1 2024-03-29T00:35:03.624921203Z [2024-03-29T00:35:03.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:34:00+00:00, map_index=-1, run_start_date=2024-03-29 00:35:01.524726+00:00, run_end_date=2024-03-29 00:35:02.178205+00:00, run_duration=0.653479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:35:00.228299+00:00, queued_by_job_id=2, pid=4275 2024-03-29T00:35:05.572912990Z [2024-03-29T00:35:05.572+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:35:05.572928666Z 2024-03-29T00:35:05.575268683Z [2024-03-29T00:35:05.574+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:35:05.579697565Z [2024-03-29T00:35:05.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:35:05.579713772Z 2024-03-29T00:35:05.612170721Z [2024-03-29T00:35:05.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:35:05.612200929Z [2024-03-29T00:35:05.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:35:05.976961485Z [2024-03-29T00:35:05.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:35:05.977883185Z [2024-03-29T00:35:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:35:06.070929014Z [2024-03-29T00:35:06.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d2336d2-a124-45cf-b261-042db6babaf8 2024-03-29T00:35:06.100934119Z [2024-03-29T00:35:06.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=-1, run_start_date=2024-03-29 00:35:03.929621+00:00, run_end_date=2024-03-29 00:35:05.113497+00:00, run_duration=1.183876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:35:00.228299+00:00, queued_by_job_id=2, pid=4301 2024-03-29T00:35:06.237451660Z [2024-03-29T00:35:06.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:35:06.238152621Z [2024-03-29T00:35:06.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:34:00+00:00, run_id=scheduled__2024-03-29T00:34:00+00:00, run_start_date=2024-03-29 00:35:00.134644+00:00, run_end_date=2024-03-29 00:35:06.237768+00:00, run_duration=6.103124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:34:00+00:00, data_interval_end=2024-03-29 00:35:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:35:06.275997079Z [2024-03-29T00:35:06.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:35:00+00:00, run_after=2024-03-29T00:36:00+00:00 2024-03-29T00:35:06.311371261Z [2024-03-29T00:35:06.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:35:06.311792191Z [2024-03-29T00:35:06.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:34:00+00:00, run_id=scheduled__2024-03-29T00:34:00+00:00, run_start_date=2024-03-29 00:35:00.135778+00:00, run_end_date=2024-03-29 00:35:06.311432+00:00, run_duration=6.175654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:34:00+00:00, data_interval_end=2024-03-29 00:35:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:35:06.335844994Z [2024-03-29T00:35:06.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:35:00+00:00, run_after=2024-03-29T00:36:00+00:00 2024-03-29T00:35:06.404895435Z [2024-03-29T00:35:06.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status success for try_number 1 2024-03-29T00:35:06.421997649Z [2024-03-29T00:35:06.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:34:00+00:00, map_index=-1, run_start_date=2024-03-29 00:35:03.348405+00:00, run_end_date=2024-03-29 00:35:05.720232+00:00, run_duration=2.371827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:35:00.228299+00:00, queued_by_job_id=2, pid=4299 2024-03-29T00:35:06.759416738Z [2024-03-29T00:35:06.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status success for try_number 1 2024-03-29T00:35:06.769425529Z [2024-03-29T00:35:06.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:34:00+00:00, map_index=-1, run_start_date=2024-03-29 00:35:03.501241+00:00, run_end_date=2024-03-29 00:35:06.098282+00:00, run_duration=2.597041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:35:00.228299+00:00, queued_by_job_id=2, pid=4300 2024-03-29T00:35:11.123186735Z [2024-03-29T00:35:11.122+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:35:11.123218582Z 2024-03-29T00:35:11.123269332Z [2024-03-29T00:35:11.123+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:35:11.123755399Z [2024-03-29T00:35:11.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:35:11.123767157Z 2024-03-29T00:35:11.126800993Z [2024-03-29T00:35:11.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:35:11.126969523Z [2024-03-29T00:35:11.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:35:11.221297061Z [2024-03-29T00:35:11.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:35:11.221425903Z [2024-03-29T00:35:11.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:35:11.229962518Z [2024-03-29T00:35:11.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b085f0-b710-4932-8362-c302bc047b11 2024-03-29T00:35:11.230412215Z [2024-03-29T00:35:11.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=-1, run_start_date=2024-03-29 00:35:09.442859+00:00, run_end_date=2024-03-29 00:35:10.340230+00:00, run_duration=0.897371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:35:05.587307+00:00, queued_by_job_id=2, pid=4324 2024-03-29T00:35:14.893768040Z [2024-03-29T00:35:14.893+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:35:14.893811129Z 2024-03-29T00:35:14.893841592Z [2024-03-29T00:35:14.893+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:35:14.894409207Z [2024-03-29T00:35:14.894+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:35:14.894420094Z 2024-03-29T00:35:14.897377618Z [2024-03-29T00:35:14.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:35:14.897679878Z [2024-03-29T00:35:14.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:35:14.963560162Z [2024-03-29T00:35:14.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status queued for try_number 1 2024-03-29T00:35:14.963901889Z [2024-03-29T00:35:14.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:35:14.974204725Z [2024-03-29T00:35:14.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37e23f3e-3736-4d25-bd56-fe466c9f45fd 2024-03-29T00:35:14.974692593Z [2024-03-29T00:35:14.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=0, run_start_date=2024-03-29 00:35:13.868627+00:00, run_end_date=2024-03-29 00:35:14.216250+00:00, run_duration=0.347623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:35:11.124109+00:00, queued_by_job_id=2, pid=4332 2024-03-29T00:35:17.820258803Z [2024-03-29T00:35:17.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:35:17.820448071Z [2024-03-29T00:35:17.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:30:00+00:00, run_id=scheduled__2024-03-29T00:30:00+00:00, run_start_date=2024-03-29 00:35:00.132480+00:00, run_end_date=2024-03-29 00:35:17.820198+00:00, run_duration=17.687718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:30:00+00:00, data_interval_end=2024-03-29 00:35:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:35:17.832539249Z [2024-03-29T00:35:17.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:35:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:35:19.048855863Z [2024-03-29T00:35:19.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:30:00+00:00 exited with status success for try_number 1 2024-03-29T00:35:19.058799623Z [2024-03-29T00:35:19.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:30:00+00:00, map_index=-1, run_start_date=2024-03-29 00:35:17.263292+00:00, run_end_date=2024-03-29 00:35:17.787084+00:00, run_duration=0.523792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:35:14.894850+00:00, queued_by_job_id=2, pid=4340 2024-03-29T00:36:00.540177381Z [2024-03-29T00:36:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:36:00+00:00, run_after=2024-03-29T00:37:00+00:00 2024-03-29T00:36:00.556963279Z [2024-03-29T00:36:00.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:36:00+00:00, run_after=2024-03-29T00:37:00+00:00 2024-03-29T00:36:00.565658895Z [2024-03-29T00:36:00.564+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:36:00.573395795Z [2024-03-29T00:36:00.573+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:36:00.716789307Z [2024-03-29T00:36:00.716+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:36:00.716813640Z 2024-03-29T00:36:00.716818332Z 2024-03-29T00:36:00.716821914Z 2024-03-29T00:36:00.716825369Z 2024-03-29T00:36:00.717557412Z [2024-03-29T00:36:00.716+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:36:00.717802983Z [2024-03-29T00:36:00.717+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:36:00.721568479Z [2024-03-29T00:36:00.717+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:36:00.721583346Z [2024-03-29T00:36:00.718+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:36:00.721587527Z [2024-03-29T00:36:00.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:36:00.721591957Z 2024-03-29T00:36:00.721596440Z 2024-03-29T00:36:00.721601720Z 2024-03-29T00:36:00.721606688Z 2024-03-29T00:36:00.723525127Z [2024-03-29T00:36:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:36:00.723840573Z [2024-03-29T00:36:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:36:00.725256715Z [2024-03-29T00:36:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:36:00.725469581Z [2024-03-29T00:36:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:36:00.725836266Z [2024-03-29T00:36:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:36:00.726075916Z [2024-03-29T00:36:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:36:00.726416731Z [2024-03-29T00:36:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:36:00.726920580Z [2024-03-29T00:36:00.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:36:01.126676305Z [2024-03-29T00:36:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status queued for try_number 1 2024-03-29T00:36:01.128059610Z [2024-03-29T00:36:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status queued for try_number 1 2024-03-29T00:36:01.128325224Z [2024-03-29T00:36:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status queued for try_number 1 2024-03-29T00:36:01.128518030Z [2024-03-29T00:36:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status queued for try_number 1 2024-03-29T00:36:01.141900227Z [2024-03-29T00:36:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to f84e40ff-dc43-469b-b111-ec8a097dc5e7 2024-03-29T00:36:01.142343887Z [2024-03-29T00:36:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71969b21-d2a5-4733-a0f9-d49e5150fbe3 2024-03-29T00:36:01.143037916Z [2024-03-29T00:36:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16e460ab-6d6a-43e1-bfa4-f494196fec5a 2024-03-29T00:36:01.143405138Z [2024-03-29T00:36:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71ddd802-7037-4f15-bc4f-1a28f24ee2ea 2024-03-29T00:36:02.594278743Z [2024-03-29T00:36:02.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:34:00+00:00 exited with status success for try_number 1 2024-03-29T00:36:02.616103535Z [2024-03-29T00:36:02.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:34:00+00:00, map_index=-1, run_start_date=2024-03-29 00:36:01.827909+00:00, run_end_date=2024-03-29 00:36:02.392392+00:00, run_duration=0.564483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:36:00.720231+00:00, queued_by_job_id=2, pid=4363 2024-03-29T00:36:03.493338153Z [2024-03-29T00:36:03.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:36:03.494185295Z [2024-03-29T00:36:03.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:34:00+00:00, run_id=scheduled__2024-03-29T00:34:00+00:00, run_start_date=2024-03-29 00:36:00.587880+00:00, run_end_date=2024-03-29 00:36:03.493603+00:00, run_duration=2.905723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:34:00+00:00, data_interval_end=2024-03-29 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:36:03.519285629Z [2024-03-29T00:36:03.518+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:36:00+00:00, run_after=2024-03-29T00:38:00+00:00 2024-03-29T00:36:03.542956181Z [2024-03-29T00:36:03.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:36:03.543328018Z [2024-03-29T00:36:03.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:35:00+00:00, run_id=scheduled__2024-03-29T00:35:00+00:00, run_start_date=2024-03-29 00:36:00.589309+00:00, run_end_date=2024-03-29 00:36:03.542888+00:00, run_duration=2.953579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:35:00+00:00, data_interval_end=2024-03-29 00:36:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:36:03.599272817Z [2024-03-29T00:36:03.598+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:36:00+00:00, run_after=2024-03-29T00:37:00+00:00 2024-03-29T00:36:03.701415102Z [2024-03-29T00:36:03.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status success for try_number 1 2024-03-29T00:36:03.707707094Z [2024-03-29T00:36:03.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:35:00+00:00, map_index=-1, run_start_date=2024-03-29 00:36:01.934793+00:00, run_end_date=2024-03-29 00:36:02.526980+00:00, run_duration=0.592187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:36:00.720231+00:00, queued_by_job_id=2, pid=4364 2024-03-29T00:36:05.378936637Z [2024-03-29T00:36:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:36:05.379343263Z [2024-03-29T00:36:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:35:00+00:00, run_id=scheduled__2024-03-29T00:35:00+00:00, run_start_date=2024-03-29 00:36:00.590572+00:00, run_end_date=2024-03-29 00:36:05.378926+00:00, run_duration=4.788354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:35:00+00:00, data_interval_end=2024-03-29 00:36:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:36:05.398174557Z [2024-03-29T00:36:05.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:36:00+00:00, run_after=2024-03-29T00:37:00+00:00 2024-03-29T00:36:05.413149351Z [2024-03-29T00:36:05.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:36:05.413512370Z [2024-03-29T00:36:05.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:35:00+00:00, run_id=scheduled__2024-03-29T00:35:00+00:00, run_start_date=2024-03-29 00:36:00.591634+00:00, run_end_date=2024-03-29 00:36:05.413025+00:00, run_duration=4.821391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:35:00+00:00, data_interval_end=2024-03-29 00:36:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:36:05.430841338Z [2024-03-29T00:36:05.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:36:00+00:00, run_after=2024-03-29T00:37:00+00:00 2024-03-29T00:36:05.475217624Z [2024-03-29T00:36:05.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status success for try_number 1 2024-03-29T00:36:05.475259075Z [2024-03-29T00:36:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status success for try_number 1 2024-03-29T00:36:05.482568576Z [2024-03-29T00:36:05.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:35:00+00:00, map_index=-1, run_start_date=2024-03-29 00:36:03.141379+00:00, run_end_date=2024-03-29 00:36:04.913230+00:00, run_duration=1.771851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:36:00.720231+00:00, queued_by_job_id=2, pid=4382 2024-03-29T00:36:05.482725226Z [2024-03-29T00:36:05.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:35:00+00:00, map_index=-1, run_start_date=2024-03-29 00:36:03.460866+00:00, run_end_date=2024-03-29 00:36:05.266895+00:00, run_duration=1.806029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:36:00.720231+00:00, queued_by_job_id=2, pid=4388 2024-03-29T00:37:00.482825967Z [2024-03-29T00:37:00.482+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:37:00.498961633Z [2024-03-29T00:37:00.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:37:00+00:00, run_after=2024-03-29T00:38:00+00:00 2024-03-29T00:37:00.513138725Z [2024-03-29T00:37:00.512+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:37:00+00:00, run_after=2024-03-29T00:38:00+00:00 2024-03-29T00:37:00.589406997Z [2024-03-29T00:37:00.589+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:37:00.589436858Z 2024-03-29T00:37:00.589441028Z 2024-03-29T00:37:00.589444459Z 2024-03-29T00:37:00.589589166Z [2024-03-29T00:37:00.589+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:37:00.589868370Z [2024-03-29T00:37:00.589+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:37:00.589991749Z [2024-03-29T00:37:00.589+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:37:00.590622391Z [2024-03-29T00:37:00.590+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:37:00.590647922Z 2024-03-29T00:37:00.590651286Z 2024-03-29T00:37:00.590654348Z 2024-03-29T00:37:00.595138319Z [2024-03-29T00:37:00.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:37:00.595210250Z [2024-03-29T00:37:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:37:00.595524490Z [2024-03-29T00:37:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:37:00.595546251Z [2024-03-29T00:37:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:37:00.595817892Z [2024-03-29T00:37:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:37:00.596105656Z [2024-03-29T00:37:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:37:00.847727851Z [2024-03-29T00:37:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status queued for try_number 1 2024-03-29T00:37:00.847844755Z [2024-03-29T00:37:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status queued for try_number 1 2024-03-29T00:37:00.847973370Z [2024-03-29T00:37:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status queued for try_number 1 2024-03-29T00:37:00.858456385Z [2024-03-29T00:37:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed14b2e3-5a74-459c-a63f-efe705f164e9 2024-03-29T00:37:00.858621990Z [2024-03-29T00:37:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 935e0cde-3007-4a2b-b163-b7e99c6bed85 2024-03-29T00:37:00.858784906Z [2024-03-29T00:37:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 255004f2-ade0-43d5-838a-ac844c671a9a 2024-03-29T00:37:02.033346178Z [2024-03-29T00:37:02.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:37:02.033618729Z [2024-03-29T00:37:02.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:36:00+00:00, run_id=scheduled__2024-03-29T00:36:00+00:00, run_start_date=2024-03-29 00:37:00.525224+00:00, run_end_date=2024-03-29 00:37:02.033203+00:00, run_duration=1.507979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:36:00+00:00, data_interval_end=2024-03-29 00:37:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:37:02.048562971Z [2024-03-29T00:37:02.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:37:00+00:00, run_after=2024-03-29T00:38:00+00:00 2024-03-29T00:37:03.220185071Z [2024-03-29T00:37:03.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status success for try_number 1 2024-03-29T00:37:03.229470418Z [2024-03-29T00:37:03.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:36:00+00:00, map_index=-1, run_start_date=2024-03-29 00:37:01.424188+00:00, run_end_date=2024-03-29 00:37:01.955638+00:00, run_duration=0.53145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:37:00.591613+00:00, queued_by_job_id=2, pid=4420 2024-03-29T00:37:04.504235665Z [2024-03-29T00:37:04.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:37:04.504726694Z [2024-03-29T00:37:04.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:36:00+00:00, run_id=scheduled__2024-03-29T00:36:00+00:00, run_start_date=2024-03-29 00:37:00.528269+00:00, run_end_date=2024-03-29 00:37:04.504113+00:00, run_duration=3.975844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:36:00+00:00, data_interval_end=2024-03-29 00:37:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:37:04.515664016Z [2024-03-29T00:37:04.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:37:00+00:00, run_after=2024-03-29T00:38:00+00:00 2024-03-29T00:37:05.683458830Z [2024-03-29T00:37:05.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:37:05.683790202Z [2024-03-29T00:37:05.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:36:00+00:00, run_id=scheduled__2024-03-29T00:36:00+00:00, run_start_date=2024-03-29 00:37:00.527091+00:00, run_end_date=2024-03-29 00:37:05.683453+00:00, run_duration=5.156362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:36:00+00:00, data_interval_end=2024-03-29 00:37:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:37:05.692975644Z [2024-03-29T00:37:05.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:37:00+00:00, run_after=2024-03-29T00:38:00+00:00 2024-03-29T00:37:05.723165288Z [2024-03-29T00:37:05.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status success for try_number 1 2024-03-29T00:37:05.723324260Z [2024-03-29T00:37:05.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status success for try_number 1 2024-03-29T00:37:05.730134060Z [2024-03-29T00:37:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:36:00+00:00, map_index=-1, run_start_date=2024-03-29 00:37:02.762096+00:00, run_end_date=2024-03-29 00:37:04.450198+00:00, run_duration=1.688102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:37:00.591613+00:00, queued_by_job_id=2, pid=4439 2024-03-29T00:37:05.730515484Z [2024-03-29T00:37:05.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:36:00+00:00, map_index=-1, run_start_date=2024-03-29 00:37:02.749923+00:00, run_end_date=2024-03-29 00:37:04.720453+00:00, run_duration=1.97053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:37:00.591613+00:00, queued_by_job_id=2, pid=4438 2024-03-29T00:38:00.295941647Z [2024-03-29T00:38:00.295+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:38:00.307830718Z [2024-03-29T00:38:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:38:00+00:00, run_after=2024-03-29T00:39:00+00:00 2024-03-29T00:38:00.320306575Z [2024-03-29T00:38:00.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:38:00+00:00, run_after=2024-03-29T00:39:00+00:00 2024-03-29T00:38:00.327257126Z [2024-03-29T00:38:00.326+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:38:00.397400833Z [2024-03-29T00:38:00.396+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:38:00.397433406Z 2024-03-29T00:38:00.397438948Z 2024-03-29T00:38:00.397442589Z 2024-03-29T00:38:00.397468003Z 2024-03-29T00:38:00.397723990Z [2024-03-29T00:38:00.397+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:38:00.397772510Z [2024-03-29T00:38:00.397+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:38:00.397946995Z [2024-03-29T00:38:00.397+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:38:00.398130881Z [2024-03-29T00:38:00.397+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:38:00.398806708Z [2024-03-29T00:38:00.398+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:38:00.398820219Z 2024-03-29T00:38:00.398824224Z 2024-03-29T00:38:00.398827523Z 2024-03-29T00:38:00.398830899Z 2024-03-29T00:38:00.403000076Z [2024-03-29T00:38:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:38:00.403124577Z [2024-03-29T00:38:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:38:00.403413903Z [2024-03-29T00:38:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:38:00.403546308Z [2024-03-29T00:38:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:38:00.403791163Z [2024-03-29T00:38:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:38:00.403948156Z [2024-03-29T00:38:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:38:00.404175611Z [2024-03-29T00:38:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:38:00.404352208Z [2024-03-29T00:38:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:38:00.941612512Z [2024-03-29T00:38:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status queued for try_number 1 2024-03-29T00:38:00.941640078Z [2024-03-29T00:38:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:37:00+00:00 exited with status queued for try_number 1 2024-03-29T00:38:00.941680896Z [2024-03-29T00:38:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:37:00+00:00 exited with status queued for try_number 1 2024-03-29T00:38:00.941764471Z [2024-03-29T00:38:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:37:00+00:00 exited with status queued for try_number 1 2024-03-29T00:38:00.982117731Z [2024-03-29T00:38:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64948baa-c490-4ed5-a3d7-f1e98a30185d 2024-03-29T00:38:00.982593529Z [2024-03-29T00:38:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe3b796d-0095-4254-87c5-a1578f718adb 2024-03-29T00:38:00.982768097Z [2024-03-29T00:38:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d3a1537-6b49-443b-8e35-aa5816eab85b 2024-03-29T00:38:00.982947184Z [2024-03-29T00:38:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43172367-3318-4b12-b1ec-7163929fce4e 2024-03-29T00:38:02.180482965Z [2024-03-29T00:38:02.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:38:02.181310897Z [2024-03-29T00:38:02.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:36:00+00:00, run_id=scheduled__2024-03-29T00:36:00+00:00, run_start_date=2024-03-29 00:38:00.335970+00:00, run_end_date=2024-03-29 00:38:02.180850+00:00, run_duration=1.84488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:36:00+00:00, data_interval_end=2024-03-29 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:38:02.197752993Z [2024-03-29T00:38:02.197+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:38:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:38:02.248371811Z [2024-03-29T00:38:02.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:38:02.248774447Z [2024-03-29T00:38:02.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:37:00+00:00, run_id=scheduled__2024-03-29T00:37:00+00:00, run_start_date=2024-03-29 00:38:00.337233+00:00, run_end_date=2024-03-29 00:38:02.248265+00:00, run_duration=1.911032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:37:00+00:00, data_interval_end=2024-03-29 00:38:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:38:02.273016388Z [2024-03-29T00:38:02.272+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:38:00+00:00, run_after=2024-03-29T00:39:00+00:00 2024-03-29T00:38:02.402317113Z [2024-03-29T00:38:02.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:36:00+00:00 exited with status success for try_number 1 2024-03-29T00:38:02.402602218Z [2024-03-29T00:38:02.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:37:00+00:00 exited with status success for try_number 1 2024-03-29T00:38:02.424488552Z [2024-03-29T00:38:02.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:36:00+00:00, map_index=-1, run_start_date=2024-03-29 00:38:01.426505+00:00, run_end_date=2024-03-29 00:38:01.951231+00:00, run_duration=0.524726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:38:00.400165+00:00, queued_by_job_id=2, pid=4472 2024-03-29T00:38:02.424894577Z [2024-03-29T00:38:02.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:37:00+00:00, map_index=-1, run_start_date=2024-03-29 00:38:01.596635+00:00, run_end_date=2024-03-29 00:38:02.139117+00:00, run_duration=0.542482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:38:00.400165+00:00, queued_by_job_id=2, pid=4473 2024-03-29T00:38:05.946656778Z [2024-03-29T00:38:05.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:38:05.947257126Z [2024-03-29T00:38:05.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:37:00+00:00, run_id=scheduled__2024-03-29T00:37:00+00:00, run_start_date=2024-03-29 00:38:00.339408+00:00, run_end_date=2024-03-29 00:38:05.946472+00:00, run_duration=5.607064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:37:00+00:00, data_interval_end=2024-03-29 00:38:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:38:05.961058548Z [2024-03-29T00:38:05.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:38:00+00:00, run_after=2024-03-29T00:39:00+00:00 2024-03-29T00:38:05.974698600Z [2024-03-29T00:38:05.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:38:05.975049160Z [2024-03-29T00:38:05.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:37:00+00:00, run_id=scheduled__2024-03-29T00:37:00+00:00, run_start_date=2024-03-29 00:38:00.338314+00:00, run_end_date=2024-03-29 00:38:05.974575+00:00, run_duration=5.636261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:37:00+00:00, data_interval_end=2024-03-29 00:38:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:38:05.987516880Z [2024-03-29T00:38:05.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:38:00+00:00, run_after=2024-03-29T00:39:00+00:00 2024-03-29T00:38:06.079214477Z [2024-03-29T00:38:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:37:00+00:00 exited with status success for try_number 1 2024-03-29T00:38:06.079387303Z [2024-03-29T00:38:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:37:00+00:00 exited with status success for try_number 1 2024-03-29T00:38:06.101820107Z [2024-03-29T00:38:06.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:37:00+00:00, map_index=-1, run_start_date=2024-03-29 00:38:03.483147+00:00, run_end_date=2024-03-29 00:38:04.886123+00:00, run_duration=1.402976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:38:00.400165+00:00, queued_by_job_id=2, pid=4502 2024-03-29T00:38:06.102403380Z [2024-03-29T00:38:06.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:37:00+00:00, map_index=-1, run_start_date=2024-03-29 00:38:03.025467+00:00, run_end_date=2024-03-29 00:38:05.087606+00:00, run_duration=2.062139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:38:00.400165+00:00, queued_by_job_id=2, pid=4491 2024-03-29T00:38:44.640595856Z [2024-03-29T00:38:44.640+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:39:00.274263418Z [2024-03-29T00:39:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:39:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:39:00.281814616Z [2024-03-29T00:39:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:39:00.294881930Z [2024-03-29T00:39:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:39:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:39:00.353388585Z [2024-03-29T00:39:00.353+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:39:00.353411878Z 2024-03-29T00:39:00.353415477Z 2024-03-29T00:39:00.353433763Z 2024-03-29T00:39:00.353668649Z [2024-03-29T00:39:00.353+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:39:00.353907239Z [2024-03-29T00:39:00.353+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:39:00.354117572Z [2024-03-29T00:39:00.353+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:39:00.354821942Z [2024-03-29T00:39:00.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:39:00.354835223Z 2024-03-29T00:39:00.354838723Z 2024-03-29T00:39:00.354841921Z 2024-03-29T00:39:00.357998911Z [2024-03-29T00:39:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:39:00.358213177Z [2024-03-29T00:39:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:39:00.358599942Z [2024-03-29T00:39:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:39:00.358862665Z [2024-03-29T00:39:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:39:00.359205748Z [2024-03-29T00:39:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:39:00.359494100Z [2024-03-29T00:39:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:39:00.720426633Z [2024-03-29T00:39:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status queued for try_number 1 2024-03-29T00:39:00.720650125Z [2024-03-29T00:39:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status queued for try_number 1 2024-03-29T00:39:00.720800038Z [2024-03-29T00:39:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status queued for try_number 1 2024-03-29T00:39:00.738601180Z [2024-03-29T00:39:00.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4daa6ab-6b40-4fb2-8879-4e93d47346b6 2024-03-29T00:39:00.738906585Z [2024-03-29T00:39:00.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80bcab96-b6ac-44cf-934f-f9f421b98db9 2024-03-29T00:39:00.739124285Z [2024-03-29T00:39:00.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6528def-7afe-4ee2-91b1-9d35b5385002 2024-03-29T00:39:03.043815239Z [2024-03-29T00:39:03.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:39:03.045481232Z [2024-03-29T00:39:03.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:38:00+00:00, run_id=scheduled__2024-03-29T00:38:00+00:00, run_start_date=2024-03-29 00:39:00.303977+00:00, run_end_date=2024-03-29 00:39:03.044884+00:00, run_duration=2.740907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:38:00+00:00, data_interval_end=2024-03-29 00:39:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:39:03.056984818Z [2024-03-29T00:39:03.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:39:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:39:03.121932237Z [2024-03-29T00:39:03.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status success for try_number 1 2024-03-29T00:39:03.131650732Z [2024-03-29T00:39:03.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:38:00+00:00, map_index=-1, run_start_date=2024-03-29 00:39:01.429158+00:00, run_end_date=2024-03-29 00:39:01.979285+00:00, run_duration=0.550127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:39:00.355603+00:00, queued_by_job_id=2, pid=4530 2024-03-29T00:39:04.186655425Z [2024-03-29T00:39:04.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:39:04.186812748Z [2024-03-29T00:39:04.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:38:00+00:00, run_id=scheduled__2024-03-29T00:38:00+00:00, run_start_date=2024-03-29 00:39:00.305133+00:00, run_end_date=2024-03-29 00:39:04.186287+00:00, run_duration=3.881154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:38:00+00:00, data_interval_end=2024-03-29 00:39:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:39:04.200972556Z [2024-03-29T00:39:04.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:39:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:39:04.209288236Z [2024-03-29T00:39:04.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:39:04.209669803Z [2024-03-29T00:39:04.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:38:00+00:00, run_id=scheduled__2024-03-29T00:38:00+00:00, run_start_date=2024-03-29 00:39:00.306134+00:00, run_end_date=2024-03-29 00:39:04.209174+00:00, run_duration=3.90304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:38:00+00:00, data_interval_end=2024-03-29 00:39:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:39:04.220379142Z [2024-03-29T00:39:04.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:39:00+00:00, run_after=2024-03-29T00:40:00+00:00 2024-03-29T00:39:04.259193904Z [2024-03-29T00:39:04.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status success for try_number 1 2024-03-29T00:39:04.267803707Z [2024-03-29T00:39:04.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:38:00+00:00, map_index=-1, run_start_date=2024-03-29 00:39:02.523364+00:00, run_end_date=2024-03-29 00:39:03.815624+00:00, run_duration=1.29226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:39:00.355603+00:00, queued_by_job_id=2, pid=4549 2024-03-29T00:39:05.121223218Z [2024-03-29T00:39:05.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status success for try_number 1 2024-03-29T00:39:05.126260580Z [2024-03-29T00:39:05.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:38:00+00:00, map_index=-1, run_start_date=2024-03-29 00:39:02.501652+00:00, run_end_date=2024-03-29 00:39:04.140575+00:00, run_duration=1.638923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:39:00.355603+00:00, queued_by_job_id=2, pid=4548 2024-03-29T00:40:00.600558095Z [2024-03-29T00:40:00.599+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:40:00.619864274Z [2024-03-29T00:40:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:41:00+00:00 2024-03-29T00:40:00.635595834Z [2024-03-29T00:40:00.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:45:00+00:00 2024-03-29T00:40:00.644197132Z [2024-03-29T00:40:00.643+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:40:00.672690130Z [2024-03-29T00:40:00.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:41:00+00:00 2024-03-29T00:40:00.801128974Z [2024-03-29T00:40:00.799+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T00:40:00.801154128Z 2024-03-29T00:40:00.801159952Z 2024-03-29T00:40:00.801165499Z 2024-03-29T00:40:00.801171117Z 2024-03-29T00:40:00.801175691Z 2024-03-29T00:40:00.802092959Z [2024-03-29T00:40:00.801+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:40:00.802592513Z [2024-03-29T00:40:00.802+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:40:00.803163707Z [2024-03-29T00:40:00.802+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:40:00.803594173Z [2024-03-29T00:40:00.803+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:40:00.804038444Z [2024-03-29T00:40:00.803+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:40:00.806029807Z [2024-03-29T00:40:00.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:40:00.806042279Z 2024-03-29T00:40:00.806046581Z 2024-03-29T00:40:00.806051610Z 2024-03-29T00:40:00.806056427Z 2024-03-29T00:40:00.806062479Z 2024-03-29T00:40:00.812189565Z [2024-03-29T00:40:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:40:00.812414778Z [2024-03-29T00:40:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:40:00.812708998Z [2024-03-29T00:40:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:40:00.812854271Z [2024-03-29T00:40:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:40:00.813135073Z [2024-03-29T00:40:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:40:00.813268238Z [2024-03-29T00:40:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:40:00.813558312Z [2024-03-29T00:40:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:40:00.813693638Z [2024-03-29T00:40:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:40:00.813958823Z [2024-03-29T00:40:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:40:00.814108442Z [2024-03-29T00:40:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:40:01.355689661Z [2024-03-29T00:40:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:01.355719390Z [2024-03-29T00:40:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:01.355767217Z [2024-03-29T00:40:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:39:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:01.355828400Z [2024-03-29T00:40:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:39:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:01.355914605Z [2024-03-29T00:40:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:39:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:01.376179095Z [2024-03-29T00:40:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94e2668e-4221-43f8-8822-5efbf38ae2f7 2024-03-29T00:40:01.376235279Z [2024-03-29T00:40:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9b061eb-12ba-4b0d-8c9d-b72057c0d66e 2024-03-29T00:40:01.376340994Z [2024-03-29T00:40:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74b69b0a-c5c5-437f-abef-621c960ff83d 2024-03-29T00:40:01.376449117Z [2024-03-29T00:40:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce2c2791-792b-4182-991e-9331513d39b8 2024-03-29T00:40:01.376554899Z [2024-03-29T00:40:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2980cda5-360c-4ded-997c-f1c467618677 2024-03-29T00:40:02.721809965Z [2024-03-29T00:40:02.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:40:02.722460273Z [2024-03-29T00:40:02.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:38:00+00:00, run_id=scheduled__2024-03-29T00:38:00+00:00, run_start_date=2024-03-29 00:40:00.689145+00:00, run_end_date=2024-03-29 00:40:02.721769+00:00, run_duration=2.032624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:38:00+00:00, data_interval_end=2024-03-29 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:40:02.750650488Z [2024-03-29T00:40:02.750+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:42:00+00:00 2024-03-29T00:40:04.010646869Z [2024-03-29T00:40:04.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:40:04.012875892Z [2024-03-29T00:40:04.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:39:00+00:00, run_id=scheduled__2024-03-29T00:39:00+00:00, run_start_date=2024-03-29 00:40:00.690558+00:00, run_end_date=2024-03-29 00:40:04.012231+00:00, run_duration=3.321673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:39:00+00:00, data_interval_end=2024-03-29 00:40:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:40:04.039945924Z [2024-03-29T00:40:04.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:41:00+00:00 2024-03-29T00:40:04.180675353Z [2024-03-29T00:40:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:38:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:04.182554423Z [2024-03-29T00:40:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:39:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:04.197941837Z [2024-03-29T00:40:04.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:38:00+00:00, map_index=-1, run_start_date=2024-03-29 00:40:01.941307+00:00, run_end_date=2024-03-29 00:40:02.495146+00:00, run_duration=0.553839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:00.808028+00:00, queued_by_job_id=2, pid=4584 2024-03-29T00:40:04.198202711Z [2024-03-29T00:40:04.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:39:00+00:00, map_index=-1, run_start_date=2024-03-29 00:40:02.293715+00:00, run_end_date=2024-03-29 00:40:03.111174+00:00, run_duration=0.817459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:00.808028+00:00, queued_by_job_id=2, pid=4585 2024-03-29T00:40:05.279438910Z [2024-03-29T00:40:05.278+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:40:05.279464824Z 2024-03-29T00:40:05.279470149Z [2024-03-29T00:40:05.279+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:40:05.280905784Z [2024-03-29T00:40:05.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:40:05.280921543Z 2024-03-29T00:40:05.283263418Z [2024-03-29T00:40:05.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:40:05.283456124Z [2024-03-29T00:40:05.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:40:05.341642207Z [2024-03-29T00:40:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:05.341667276Z [2024-03-29T00:40:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:05.350766963Z [2024-03-29T00:40:05.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6647031-af07-48bf-990f-4682c2d4150b 2024-03-29T00:40:05.350916289Z [2024-03-29T00:40:05.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:35:00+00:00, map_index=-1, run_start_date=2024-03-29 00:40:03.736450+00:00, run_end_date=2024-03-29 00:40:04.252782+00:00, run_duration=0.516332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:00.808028+00:00, queued_by_job_id=2, pid=4610 2024-03-29T00:40:05.408951190Z [2024-03-29T00:40:05.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:40:05.409258457Z [2024-03-29T00:40:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:39:00+00:00, run_id=scheduled__2024-03-29T00:39:00+00:00, run_start_date=2024-03-29 00:40:00.692116+00:00, run_end_date=2024-03-29 00:40:05.408876+00:00, run_duration=4.71676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:39:00+00:00, data_interval_end=2024-03-29 00:40:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:40:05.440347287Z [2024-03-29T00:40:05.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:41:00+00:00 2024-03-29T00:40:06.698120795Z [2024-03-29T00:40:06.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:40:06.698314851Z [2024-03-29T00:40:06.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:39:00+00:00, run_id=scheduled__2024-03-29T00:39:00+00:00, run_start_date=2024-03-29 00:40:00.693253+00:00, run_end_date=2024-03-29 00:40:06.698049+00:00, run_duration=6.004796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:39:00+00:00, data_interval_end=2024-03-29 00:40:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:40:06.712431689Z [2024-03-29T00:40:06.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:41:00+00:00 2024-03-29T00:40:06.767382627Z [2024-03-29T00:40:06.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:39:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:06.767583909Z [2024-03-29T00:40:06.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:39:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:06.775170367Z [2024-03-29T00:40:06.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:39:00+00:00, map_index=-1, run_start_date=2024-03-29 00:40:04.033883+00:00, run_end_date=2024-03-29 00:40:05.314224+00:00, run_duration=1.280341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:00.808028+00:00, queued_by_job_id=2, pid=4616 2024-03-29T00:40:06.775569029Z [2024-03-29T00:40:06.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:39:00+00:00, map_index=-1, run_start_date=2024-03-29 00:40:03.540367+00:00, run_end_date=2024-03-29 00:40:05.452166+00:00, run_duration=1.911799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:00.808028+00:00, queued_by_job_id=2, pid=4609 2024-03-29T00:40:08.587529252Z [2024-03-29T00:40:08.587+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:40:08.587579063Z 2024-03-29T00:40:08.587585392Z [2024-03-29T00:40:08.587+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:40:08.588290568Z [2024-03-29T00:40:08.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:40:08.588304167Z 2024-03-29T00:40:08.590630613Z [2024-03-29T00:40:08.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:40:08.590804010Z [2024-03-29T00:40:08.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:40:08.648921319Z [2024-03-29T00:40:08.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:08.648956039Z [2024-03-29T00:40:08.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:08.654616992Z [2024-03-29T00:40:08.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8510494-8585-4947-b950-33e7eb7bd696 2024-03-29T00:40:08.654899822Z [2024-03-29T00:40:08.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:35:00+00:00, map_index=-1, run_start_date=2024-03-29 00:40:07.430847+00:00, run_end_date=2024-03-29 00:40:07.842954+00:00, run_duration=0.412107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:05.280834+00:00, queued_by_job_id=2, pid=4639 2024-03-29T00:40:12.088905278Z [2024-03-29T00:40:12.088+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:40:12.088937466Z 2024-03-29T00:40:12.089038103Z [2024-03-29T00:40:12.088+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:40:12.089596371Z [2024-03-29T00:40:12.089+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:40:12.089617796Z 2024-03-29T00:40:12.092085414Z [2024-03-29T00:40:12.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:40:12.092246650Z [2024-03-29T00:40:12.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:40:12.156805683Z [2024-03-29T00:40:12.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status queued for try_number 1 2024-03-29T00:40:12.157510775Z [2024-03-29T00:40:12.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:12.164150613Z [2024-03-29T00:40:12.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebd7c556-b155-467f-8d90-196e6af190c6 2024-03-29T00:40:12.164383306Z [2024-03-29T00:40:12.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:35:00+00:00, map_index=0, run_start_date=2024-03-29 00:40:10.701658+00:00, run_end_date=2024-03-29 00:40:11.175465+00:00, run_duration=0.473807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:08.588555+00:00, queued_by_job_id=2, pid=4647 2024-03-29T00:40:15.429649167Z [2024-03-29T00:40:15.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:40:15.430320893Z [2024-03-29T00:40:15.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:35:00+00:00, run_id=scheduled__2024-03-29T00:35:00+00:00, run_start_date=2024-03-29 00:40:00.686874+00:00, run_end_date=2024-03-29 00:40:15.430000+00:00, run_duration=14.743126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:35:00+00:00, data_interval_end=2024-03-29 00:40:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:40:15.436667974Z [2024-03-29T00:40:15.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:40:00+00:00, run_after=2024-03-29T00:45:00+00:00 2024-03-29T00:40:15.507400401Z [2024-03-29T00:40:15.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:35:00+00:00 exited with status success for try_number 1 2024-03-29T00:40:15.513152173Z [2024-03-29T00:40:15.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:35:00+00:00, map_index=-1, run_start_date=2024-03-29 00:40:14.435936+00:00, run_end_date=2024-03-29 00:40:14.906424+00:00, run_duration=0.470488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:40:12.089958+00:00, queued_by_job_id=2, pid=4655 2024-03-29T00:41:00.984519633Z [2024-03-29T00:41:00.984+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:41:00.997444853Z [2024-03-29T00:41:00.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:41:00+00:00, run_after=2024-03-29T00:42:00+00:00 2024-03-29T00:41:01.022227879Z [2024-03-29T00:41:01.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:41:00+00:00, run_after=2024-03-29T00:42:00+00:00 2024-03-29T00:41:01.088784765Z [2024-03-29T00:41:01.088+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:41:01.088820535Z 2024-03-29T00:41:01.088886832Z 2024-03-29T00:41:01.088893506Z 2024-03-29T00:41:01.088942004Z [2024-03-29T00:41:01.088+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:41:01.089098180Z [2024-03-29T00:41:01.088+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:41:01.089262858Z [2024-03-29T00:41:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:41:01.090510004Z [2024-03-29T00:41:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:41:01.090530382Z 2024-03-29T00:41:01.090534078Z 2024-03-29T00:41:01.090537424Z 2024-03-29T00:41:01.095498665Z [2024-03-29T00:41:01.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:41:01.095616483Z [2024-03-29T00:41:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:41:01.096057009Z [2024-03-29T00:41:01.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:41:01.096251632Z [2024-03-29T00:41:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:41:01.096514604Z [2024-03-29T00:41:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:41:01.096662497Z [2024-03-29T00:41:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:41:01.422593734Z [2024-03-29T00:41:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:41:01.422977699Z [2024-03-29T00:41:01.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:41:01.423250264Z [2024-03-29T00:41:01.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:41:01.444291623Z [2024-03-29T00:41:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to d88cf48f-f6a1-444c-8b4b-c2e8047434d9 2024-03-29T00:41:01.444528338Z [2024-03-29T00:41:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11e76e18-8885-4467-9f6a-a39187a5e49f 2024-03-29T00:41:01.444739268Z [2024-03-29T00:41:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9581af18-b52c-449c-9003-f432211363b8 2024-03-29T00:41:03.859696999Z [2024-03-29T00:41:03.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:41:03.859906178Z [2024-03-29T00:41:03.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:40:00+00:00, run_id=scheduled__2024-03-29T00:40:00+00:00, run_start_date=2024-03-29 00:41:01.032817+00:00, run_end_date=2024-03-29 00:41:03.859609+00:00, run_duration=2.826792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:40:00+00:00, data_interval_end=2024-03-29 00:41:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:41:03.871214440Z [2024-03-29T00:41:03.870+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:41:00+00:00, run_after=2024-03-29T00:42:00+00:00 2024-03-29T00:41:03.935533350Z [2024-03-29T00:41:03.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:41:03.943786235Z [2024-03-29T00:41:03.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=-1, run_start_date=2024-03-29 00:41:02.286001+00:00, run_end_date=2024-03-29 00:41:02.871107+00:00, run_duration=0.585106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:41:01.091588+00:00, queued_by_job_id=2, pid=4676 2024-03-29T00:41:05.564701137Z [2024-03-29T00:41:05.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:41:05.564726738Z [2024-03-29T00:41:05.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:40:00+00:00, run_id=scheduled__2024-03-29T00:40:00+00:00, run_start_date=2024-03-29 00:41:01.034055+00:00, run_end_date=2024-03-29 00:41:05.563791+00:00, run_duration=4.529736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:40:00+00:00, data_interval_end=2024-03-29 00:41:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:41:05.574362876Z [2024-03-29T00:41:05.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:41:00+00:00, run_after=2024-03-29T00:42:00+00:00 2024-03-29T00:41:05.614563778Z [2024-03-29T00:41:05.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:41:05.630570044Z [2024-03-29T00:41:05.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=-1, run_start_date=2024-03-29 00:41:03.275490+00:00, run_end_date=2024-03-29 00:41:05.053458+00:00, run_duration=1.777968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:41:01.091588+00:00, queued_by_job_id=2, pid=4689 2024-03-29T00:41:06.691214405Z [2024-03-29T00:41:06.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:41:06.692144914Z [2024-03-29T00:41:06.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:40:00+00:00, run_id=scheduled__2024-03-29T00:40:00+00:00, run_start_date=2024-03-29 00:41:01.035220+00:00, run_end_date=2024-03-29 00:41:06.691106+00:00, run_duration=5.655886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:40:00+00:00, data_interval_end=2024-03-29 00:41:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:41:06.702644344Z [2024-03-29T00:41:06.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:41:00+00:00, run_after=2024-03-29T00:42:00+00:00 2024-03-29T00:41:06.754953904Z [2024-03-29T00:41:06.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:41:06.762464165Z [2024-03-29T00:41:06.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=-1, run_start_date=2024-03-29 00:41:03.556290+00:00, run_end_date=2024-03-29 00:41:06.235265+00:00, run_duration=2.678975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:41:01.091588+00:00, queued_by_job_id=2, pid=4695 2024-03-29T00:42:00.731528921Z [2024-03-29T00:42:00.731+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:42:00.744479980Z [2024-03-29T00:42:00.744+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:42:00+00:00, run_after=2024-03-29T00:43:00+00:00 2024-03-29T00:42:00.757364143Z [2024-03-29T00:42:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:42:00+00:00, run_after=2024-03-29T00:43:00+00:00 2024-03-29T00:42:00.764748577Z [2024-03-29T00:42:00.764+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:42:00.857931789Z [2024-03-29T00:42:00.857+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:42:00.857962490Z 2024-03-29T00:42:00.857970993Z 2024-03-29T00:42:00.857975855Z 2024-03-29T00:42:00.857980263Z 2024-03-29T00:42:00.858401154Z [2024-03-29T00:42:00.858+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:42:00.859535415Z [2024-03-29T00:42:00.859+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:42:00.860724402Z [2024-03-29T00:42:00.860+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:42:00.861851886Z [2024-03-29T00:42:00.861+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:42:00.863074279Z [2024-03-29T00:42:00.862+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:42:00.863090047Z 2024-03-29T00:42:00.863096295Z 2024-03-29T00:42:00.863101063Z 2024-03-29T00:42:00.863106661Z 2024-03-29T00:42:00.871821430Z [2024-03-29T00:42:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:42:00.872127560Z [2024-03-29T00:42:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:42:00.872551634Z [2024-03-29T00:42:00.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:42:00.872837656Z [2024-03-29T00:42:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:42:00.873262739Z [2024-03-29T00:42:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:42:00.873530193Z [2024-03-29T00:42:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:42:00.874089592Z [2024-03-29T00:42:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:42:00.874357493Z [2024-03-29T00:42:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:42:01.307813329Z [2024-03-29T00:42:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:42:01.307845415Z [2024-03-29T00:42:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:41:00+00:00 exited with status queued for try_number 1 2024-03-29T00:42:01.308305286Z [2024-03-29T00:42:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:41:00+00:00 exited with status queued for try_number 1 2024-03-29T00:42:01.308456439Z [2024-03-29T00:42:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:41:00+00:00 exited with status queued for try_number 1 2024-03-29T00:42:01.324181852Z [2024-03-29T00:42:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to a61d411c-33dc-4d72-b9c8-ea1c23e0c45d 2024-03-29T00:42:01.324271610Z [2024-03-29T00:42:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13dbe575-882e-47e4-8ba8-54aa63a25f1a 2024-03-29T00:42:01.324467429Z [2024-03-29T00:42:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 965425d3-3bf5-4e03-8dfb-23e287f82c2f 2024-03-29T00:42:01.324609669Z [2024-03-29T00:42:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c1aa29d-61bd-405a-80eb-590320494722 2024-03-29T00:42:03.791436897Z [2024-03-29T00:42:03.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:42:03.792063027Z [2024-03-29T00:42:03.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:40:00+00:00, run_id=scheduled__2024-03-29T00:40:00+00:00, run_start_date=2024-03-29 00:42:00.776871+00:00, run_end_date=2024-03-29 00:42:03.791356+00:00, run_duration=3.014485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:40:00+00:00, data_interval_end=2024-03-29 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:42:03.806405206Z [2024-03-29T00:42:03.805+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:42:00+00:00, run_after=2024-03-29T00:44:00+00:00 2024-03-29T00:42:03.816852738Z [2024-03-29T00:42:03.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:42:03.817274533Z [2024-03-29T00:42:03.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:41:00+00:00, run_id=scheduled__2024-03-29T00:41:00+00:00, run_start_date=2024-03-29 00:42:00.778063+00:00, run_end_date=2024-03-29 00:42:03.816755+00:00, run_duration=3.038692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:41:00+00:00, data_interval_end=2024-03-29 00:42:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:42:03.830136893Z [2024-03-29T00:42:03.829+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:42:00+00:00, run_after=2024-03-29T00:43:00+00:00 2024-03-29T00:42:03.888562738Z [2024-03-29T00:42:03.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:42:03.888600255Z [2024-03-29T00:42:03.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:41:00+00:00 exited with status success for try_number 1 2024-03-29T00:42:03.901375660Z [2024-03-29T00:42:03.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:41:00+00:00, map_index=-1, run_start_date=2024-03-29 00:42:02.676824+00:00, run_end_date=2024-03-29 00:42:03.381343+00:00, run_duration=0.704519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:42:00.865067+00:00, queued_by_job_id=2, pid=4730 2024-03-29T00:42:03.901987751Z [2024-03-29T00:42:03.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=-1, run_start_date=2024-03-29 00:42:02.804138+00:00, run_end_date=2024-03-29 00:42:03.471648+00:00, run_duration=0.66751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:42:00.865067+00:00, queued_by_job_id=2, pid=4731 2024-03-29T00:42:05.882572965Z [2024-03-29T00:42:05.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:42:05.883165092Z [2024-03-29T00:42:05.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:41:00+00:00, run_id=scheduled__2024-03-29T00:41:00+00:00, run_start_date=2024-03-29 00:42:00.779293+00:00, run_end_date=2024-03-29 00:42:05.882420+00:00, run_duration=5.103127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:41:00+00:00, data_interval_end=2024-03-29 00:42:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:42:05.901086328Z [2024-03-29T00:42:05.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:42:00+00:00, run_after=2024-03-29T00:43:00+00:00 2024-03-29T00:42:05.987447002Z [2024-03-29T00:42:05.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:41:00+00:00 exited with status success for try_number 1 2024-03-29T00:42:05.999597793Z [2024-03-29T00:42:05.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:41:00+00:00, map_index=-1, run_start_date=2024-03-29 00:42:03.773819+00:00, run_end_date=2024-03-29 00:42:05.427416+00:00, run_duration=1.653597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:42:00.865067+00:00, queued_by_job_id=2, pid=4752 2024-03-29T00:42:07.044138941Z [2024-03-29T00:42:07.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:42:07.044484296Z [2024-03-29T00:42:07.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:41:00+00:00, run_id=scheduled__2024-03-29T00:41:00+00:00, run_start_date=2024-03-29 00:42:00.780297+00:00, run_end_date=2024-03-29 00:42:07.044045+00:00, run_duration=6.263748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:41:00+00:00, data_interval_end=2024-03-29 00:42:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:42:07.056582254Z [2024-03-29T00:42:07.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:42:00+00:00, run_after=2024-03-29T00:43:00+00:00 2024-03-29T00:42:07.087953899Z [2024-03-29T00:42:07.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:41:00+00:00 exited with status success for try_number 1 2024-03-29T00:42:07.095376161Z [2024-03-29T00:42:07.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:41:00+00:00, map_index=-1, run_start_date=2024-03-29 00:42:03.875450+00:00, run_end_date=2024-03-29 00:42:05.979729+00:00, run_duration=2.104279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:42:00.865067+00:00, queued_by_job_id=2, pid=4753 2024-03-29T00:43:00.507455706Z [2024-03-29T00:43:00.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:43:00+00:00, run_after=2024-03-29T00:44:00+00:00 2024-03-29T00:43:00.529362875Z [2024-03-29T00:43:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:43:00+00:00, run_after=2024-03-29T00:44:00+00:00 2024-03-29T00:43:00.539766170Z [2024-03-29T00:43:00.539+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:43:00.605416015Z [2024-03-29T00:43:00.605+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:43:00.605437342Z 2024-03-29T00:43:00.605441309Z 2024-03-29T00:43:00.605448130Z 2024-03-29T00:43:00.605733347Z [2024-03-29T00:43:00.605+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:43:00.605963202Z [2024-03-29T00:43:00.605+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:43:00.606150397Z [2024-03-29T00:43:00.606+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:43:00.606884775Z [2024-03-29T00:43:00.606+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:43:00.606898230Z 2024-03-29T00:43:00.606901954Z 2024-03-29T00:43:00.606905365Z 2024-03-29T00:43:00.610323479Z [2024-03-29T00:43:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:43:00.610708079Z [2024-03-29T00:43:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:43:00.611097859Z [2024-03-29T00:43:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:43:00.611326775Z [2024-03-29T00:43:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:43:00.611645010Z [2024-03-29T00:43:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:43:00.611863692Z [2024-03-29T00:43:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:43:00.915229348Z [2024-03-29T00:43:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status queued for try_number 1 2024-03-29T00:43:00.915622068Z [2024-03-29T00:43:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status queued for try_number 1 2024-03-29T00:43:00.915918163Z [2024-03-29T00:43:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status queued for try_number 1 2024-03-29T00:43:00.937992899Z [2024-03-29T00:43:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d73da41-1fd6-4510-903a-18bbbc16e499 2024-03-29T00:43:00.943012530Z [2024-03-29T00:43:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to 176a6a15-bfcc-4f1c-aba3-059df0e08b6b 2024-03-29T00:43:00.947093252Z [2024-03-29T00:43:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0290fcbc-3381-4886-9d60-f2687e972a86 2024-03-29T00:43:02.147235577Z [2024-03-29T00:43:02.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:43:02.147663305Z [2024-03-29T00:43:02.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:42:00+00:00, run_id=scheduled__2024-03-29T00:42:00+00:00, run_start_date=2024-03-29 00:43:00.553198+00:00, run_end_date=2024-03-29 00:43:02.147163+00:00, run_duration=1.593965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:42:00+00:00, data_interval_end=2024-03-29 00:43:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:43:02.168190607Z [2024-03-29T00:43:02.167+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:43:00+00:00, run_after=2024-03-29T00:44:00+00:00 2024-03-29T00:43:02.239963681Z [2024-03-29T00:43:02.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status success for try_number 1 2024-03-29T00:43:02.257270141Z [2024-03-29T00:43:02.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:42:00+00:00, map_index=-1, run_start_date=2024-03-29 00:43:01.521919+00:00, run_end_date=2024-03-29 00:43:01.978255+00:00, run_duration=0.456336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:43:00.607676+00:00, queued_by_job_id=2, pid=4785 2024-03-29T00:43:04.422369634Z [2024-03-29T00:43:04.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:43:04.422694411Z [2024-03-29T00:43:04.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:42:00+00:00, run_id=scheduled__2024-03-29T00:42:00+00:00, run_start_date=2024-03-29 00:43:00.554508+00:00, run_end_date=2024-03-29 00:43:04.422349+00:00, run_duration=3.867841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:42:00+00:00, data_interval_end=2024-03-29 00:43:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:43:04.432159458Z [2024-03-29T00:43:04.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:43:00+00:00, run_after=2024-03-29T00:44:00+00:00 2024-03-29T00:43:04.478919198Z [2024-03-29T00:43:04.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status success for try_number 1 2024-03-29T00:43:04.484467014Z [2024-03-29T00:43:04.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:42:00+00:00, map_index=-1, run_start_date=2024-03-29 00:43:02.564816+00:00, run_end_date=2024-03-29 00:43:03.932338+00:00, run_duration=1.367522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:43:00.607676+00:00, queued_by_job_id=2, pid=4798 2024-03-29T00:43:05.527700993Z [2024-03-29T00:43:05.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:43:05.528016052Z [2024-03-29T00:43:05.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:42:00+00:00, run_id=scheduled__2024-03-29T00:42:00+00:00, run_start_date=2024-03-29 00:43:00.555634+00:00, run_end_date=2024-03-29 00:43:05.527684+00:00, run_duration=4.97205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:42:00+00:00, data_interval_end=2024-03-29 00:43:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:43:05.541002016Z [2024-03-29T00:43:05.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:43:00+00:00, run_after=2024-03-29T00:44:00+00:00 2024-03-29T00:43:05.578937312Z [2024-03-29T00:43:05.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status success for try_number 1 2024-03-29T00:43:05.584237882Z [2024-03-29T00:43:05.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:42:00+00:00, map_index=-1, run_start_date=2024-03-29 00:43:02.809406+00:00, run_end_date=2024-03-29 00:43:04.566551+00:00, run_duration=1.757145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:43:00.607676+00:00, queued_by_job_id=2, pid=4804 2024-03-29T00:43:44.715933040Z [2024-03-29T00:43:44.714+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:44:00.053706831Z [2024-03-29T00:44:00.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:44:00.060580344Z [2024-03-29T00:44:00.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:44:00.071973216Z [2024-03-29T00:44:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:44:00+00:00, run_after=2024-03-29T00:45:00+00:00 2024-03-29T00:44:00.083348942Z [2024-03-29T00:44:00.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:44:00+00:00, run_after=2024-03-29T00:45:00+00:00 2024-03-29T00:44:00.154156892Z [2024-03-29T00:44:00.153+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:44:00.154180470Z 2024-03-29T00:44:00.154185006Z 2024-03-29T00:44:00.154188303Z 2024-03-29T00:44:00.154231222Z 2024-03-29T00:44:00.154402049Z [2024-03-29T00:44:00.154+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:44:00.154664848Z [2024-03-29T00:44:00.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:44:00.154815143Z [2024-03-29T00:44:00.154+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:44:00.154980972Z [2024-03-29T00:44:00.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:44:00.155965296Z [2024-03-29T00:44:00.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:44:00.155972655Z 2024-03-29T00:44:00.155976136Z 2024-03-29T00:44:00.155979259Z 2024-03-29T00:44:00.155982281Z 2024-03-29T00:44:00.161814303Z [2024-03-29T00:44:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:44:00.161921290Z [2024-03-29T00:44:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:44:00.162187884Z [2024-03-29T00:44:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:44:00.162369790Z [2024-03-29T00:44:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:44:00.162664040Z [2024-03-29T00:44:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:44:00.162793318Z [2024-03-29T00:44:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:44:00.163005108Z [2024-03-29T00:44:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:44:00.163136720Z [2024-03-29T00:44:00.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:44:00.436335227Z [2024-03-29T00:44:00.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status queued for try_number 1 2024-03-29T00:44:00.436561149Z [2024-03-29T00:44:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:43:00+00:00 exited with status queued for try_number 1 2024-03-29T00:44:00.436755858Z [2024-03-29T00:44:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:43:00+00:00 exited with status queued for try_number 1 2024-03-29T00:44:00.436938536Z [2024-03-29T00:44:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:43:00+00:00 exited with status queued for try_number 1 2024-03-29T00:44:00.444950266Z [2024-03-29T00:44:00.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to d13b471e-8ccc-431e-b6a3-09e6e2372796 2024-03-29T00:44:00.445230338Z [2024-03-29T00:44:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to e002cdb3-2ce0-4e70-96bc-490810ad46b2 2024-03-29T00:44:00.445459073Z [2024-03-29T00:44:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72384505-60fb-4c2a-8424-5bd08668d49e 2024-03-29T00:44:00.445691781Z [2024-03-29T00:44:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to a417275d-4f3e-4d0c-b01e-8af5b43fea52 2024-03-29T00:44:02.841787338Z [2024-03-29T00:44:02.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:44:02.842170751Z [2024-03-29T00:44:02.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:42:00+00:00, run_id=scheduled__2024-03-29T00:42:00+00:00, run_start_date=2024-03-29 00:44:00.093046+00:00, run_end_date=2024-03-29 00:44:02.841709+00:00, run_duration=2.748663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:42:00+00:00, data_interval_end=2024-03-29 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:44:02.854063901Z [2024-03-29T00:44:02.853+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:44:00+00:00, run_after=2024-03-29T00:46:00+00:00 2024-03-29T00:44:02.867927754Z [2024-03-29T00:44:02.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:44:02.868240979Z [2024-03-29T00:44:02.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:43:00+00:00, run_id=scheduled__2024-03-29T00:43:00+00:00, run_start_date=2024-03-29 00:44:00.094169+00:00, run_end_date=2024-03-29 00:44:02.867801+00:00, run_duration=2.773632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:43:00+00:00, data_interval_end=2024-03-29 00:44:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:44:02.888976505Z [2024-03-29T00:44:02.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:44:00+00:00, run_after=2024-03-29T00:45:00+00:00 2024-03-29T00:44:02.944957273Z [2024-03-29T00:44:02.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:42:00+00:00 exited with status success for try_number 1 2024-03-29T00:44:02.945012412Z [2024-03-29T00:44:02.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:43:00+00:00 exited with status success for try_number 1 2024-03-29T00:44:02.961875555Z [2024-03-29T00:44:02.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:43:00+00:00, map_index=-1, run_start_date=2024-03-29 00:44:01.208368+00:00, run_end_date=2024-03-29 00:44:01.737461+00:00, run_duration=0.529093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:44:00.156961+00:00, queued_by_job_id=2, pid=4838 2024-03-29T00:44:02.962076484Z [2024-03-29T00:44:02.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:42:00+00:00, map_index=-1, run_start_date=2024-03-29 00:44:01.167929+00:00, run_end_date=2024-03-29 00:44:01.752830+00:00, run_duration=0.584901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:44:00.156961+00:00, queued_by_job_id=2, pid=4837 2024-03-29T00:44:05.136293505Z [2024-03-29T00:44:05.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:44:05.136327795Z [2024-03-29T00:44:05.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:43:00+00:00, run_id=scheduled__2024-03-29T00:43:00+00:00, run_start_date=2024-03-29 00:44:00.096087+00:00, run_end_date=2024-03-29 00:44:05.135545+00:00, run_duration=5.039458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:43:00+00:00, data_interval_end=2024-03-29 00:44:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:44:05.152351799Z [2024-03-29T00:44:05.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:44:00+00:00, run_after=2024-03-29T00:45:00+00:00 2024-03-29T00:44:05.165111105Z [2024-03-29T00:44:05.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:44:05.165581915Z [2024-03-29T00:44:05.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:43:00+00:00, run_id=scheduled__2024-03-29T00:43:00+00:00, run_start_date=2024-03-29 00:44:00.095153+00:00, run_end_date=2024-03-29 00:44:05.165027+00:00, run_duration=5.069874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:43:00+00:00, data_interval_end=2024-03-29 00:44:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:44:05.187239539Z [2024-03-29T00:44:05.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:44:00+00:00, run_after=2024-03-29T00:45:00+00:00 2024-03-29T00:44:05.244568361Z [2024-03-29T00:44:05.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:43:00+00:00 exited with status success for try_number 1 2024-03-29T00:44:05.244664601Z [2024-03-29T00:44:05.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:43:00+00:00 exited with status success for try_number 1 2024-03-29T00:44:05.250625605Z [2024-03-29T00:44:05.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:43:00+00:00, map_index=-1, run_start_date=2024-03-29 00:44:02.536482+00:00, run_end_date=2024-03-29 00:44:03.994972+00:00, run_duration=1.45849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:44:00.156961+00:00, queued_by_job_id=2, pid=4862 2024-03-29T00:44:05.250742914Z [2024-03-29T00:44:05.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:43:00+00:00, map_index=-1, run_start_date=2024-03-29 00:44:02.431502+00:00, run_end_date=2024-03-29 00:44:04.299091+00:00, run_duration=1.867589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:44:00.156961+00:00, queued_by_job_id=2, pid=4861 2024-03-29T00:45:00.738362253Z [2024-03-29T00:45:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:45:00+00:00, run_after=2024-03-29T00:46:00+00:00 2024-03-29T00:45:00.755871759Z [2024-03-29T00:45:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:45:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:45:00.770784987Z [2024-03-29T00:45:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:45:00+00:00, run_after=2024-03-29T00:46:00+00:00 2024-03-29T00:45:00.778338906Z [2024-03-29T00:45:00.777+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:45:00.922708759Z [2024-03-29T00:45:00.922+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:45:00.922737262Z 2024-03-29T00:45:00.922742618Z 2024-03-29T00:45:00.922746196Z 2024-03-29T00:45:00.922749438Z 2024-03-29T00:45:00.923004423Z [2024-03-29T00:45:00.922+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:45:00.923335951Z [2024-03-29T00:45:00.923+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:45:00.923582827Z [2024-03-29T00:45:00.923+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:45:00.923928061Z [2024-03-29T00:45:00.923+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:45:00.925173054Z [2024-03-29T00:45:00.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:45:00.925188991Z 2024-03-29T00:45:00.925193376Z 2024-03-29T00:45:00.925196884Z 2024-03-29T00:45:00.925200026Z 2024-03-29T00:45:00.932010754Z [2024-03-29T00:45:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:45:00.932436144Z [2024-03-29T00:45:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:45:00.932917297Z [2024-03-29T00:45:00.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:45:00.933205233Z [2024-03-29T00:45:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:45:00.933678285Z [2024-03-29T00:45:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:45:00.933961068Z [2024-03-29T00:45:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:45:00.934387569Z [2024-03-29T00:45:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:45:00.934733219Z [2024-03-29T00:45:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:45:01.514859250Z [2024-03-29T00:45:01.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:45:01.515079280Z [2024-03-29T00:45:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status queued for try_number 1 2024-03-29T00:45:01.515256326Z [2024-03-29T00:45:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status queued for try_number 1 2024-03-29T00:45:01.515353575Z [2024-03-29T00:45:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status queued for try_number 1 2024-03-29T00:45:01.530933265Z [2024-03-29T00:45:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to c54eef87-20fb-4290-ba06-535dccfef2df 2024-03-29T00:45:01.531048772Z [2024-03-29T00:45:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a2fc0a4-9a2e-47a1-964a-e1eac51b47ec 2024-03-29T00:45:01.531403631Z [2024-03-29T00:45:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1df6ec08-4c9e-48bf-9956-cd6529fe942c 2024-03-29T00:45:01.531670936Z [2024-03-29T00:45:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to b37cc22f-eae9-492c-939f-80a9355ec251 2024-03-29T00:45:06.940200943Z [2024-03-29T00:45:06.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:45:06.947170612Z [2024-03-29T00:45:06.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:44:00+00:00, run_id=scheduled__2024-03-29T00:44:00+00:00, run_start_date=2024-03-29 00:45:00.795140+00:00, run_end_date=2024-03-29 00:45:06.946538+00:00, run_duration=6.151398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:44:00+00:00, data_interval_end=2024-03-29 00:45:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:45:06.988663169Z [2024-03-29T00:45:06.988+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:45:00+00:00, run_after=2024-03-29T00:46:00+00:00 2024-03-29T00:45:07.386532621Z [2024-03-29T00:45:07.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status success for try_number 1 2024-03-29T00:45:07.395570497Z [2024-03-29T00:45:07.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:44:00+00:00, map_index=-1, run_start_date=2024-03-29 00:45:03.426799+00:00, run_end_date=2024-03-29 00:45:05.436132+00:00, run_duration=2.009333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:45:00.927688+00:00, queued_by_job_id=2, pid=4895 2024-03-29T00:45:10.584632713Z [2024-03-29T00:45:10.584+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:45:10.584703497Z 2024-03-29T00:45:10.587483875Z [2024-03-29T00:45:10.587+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:45:10.588210821Z [2024-03-29T00:45:10.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:45:10.588223616Z 2024-03-29T00:45:10.594700327Z [2024-03-29T00:45:10.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:45:10.598842659Z [2024-03-29T00:45:10.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:45:10.748886058Z [2024-03-29T00:45:10.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:45:10.752679643Z [2024-03-29T00:45:10.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:45:10.772653285Z [2024-03-29T00:45:10.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to a863348e-6861-4af7-8b56-8faafb6c32a0 2024-03-29T00:45:10.773825454Z [2024-03-29T00:45:10.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=-1, run_start_date=2024-03-29 00:45:07.308754+00:00, run_end_date=2024-03-29 00:45:09.450323+00:00, run_duration=2.141569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:45:00.927688+00:00, queued_by_job_id=2, pid=4909 2024-03-29T00:45:12.931480665Z [2024-03-29T00:45:12.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:45:12.931626030Z [2024-03-29T00:45:12.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:44:00+00:00, run_id=scheduled__2024-03-29T00:44:00+00:00, run_start_date=2024-03-29 00:45:00.796662+00:00, run_end_date=2024-03-29 00:45:12.931344+00:00, run_duration=12.134682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:44:00+00:00, data_interval_end=2024-03-29 00:45:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:45:12.941392320Z [2024-03-29T00:45:12.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:45:00+00:00, run_after=2024-03-29T00:46:00+00:00 2024-03-29T00:45:13.035901107Z [2024-03-29T00:45:13.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status success for try_number 1 2024-03-29T00:45:13.041775044Z [2024-03-29T00:45:13.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:44:00+00:00, map_index=-1, run_start_date=2024-03-29 00:45:09.940605+00:00, run_end_date=2024-03-29 00:45:12.589191+00:00, run_duration=2.648586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:45:00.927688+00:00, queued_by_job_id=2, pid=4920 2024-03-29T00:45:14.121133540Z [2024-03-29T00:45:14.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:45:14.121481746Z [2024-03-29T00:45:14.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:44:00+00:00, run_id=scheduled__2024-03-29T00:44:00+00:00, run_start_date=2024-03-29 00:45:00.798539+00:00, run_end_date=2024-03-29 00:45:14.121037+00:00, run_duration=13.322498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:44:00+00:00, data_interval_end=2024-03-29 00:45:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:45:14.141114692Z [2024-03-29T00:45:14.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:45:00+00:00, run_after=2024-03-29T00:46:00+00:00 2024-03-29T00:45:14.269005367Z [2024-03-29T00:45:14.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status success for try_number 1 2024-03-29T00:45:14.296876142Z [2024-03-29T00:45:14.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:44:00+00:00, map_index=-1, run_start_date=2024-03-29 00:45:10.848165+00:00, run_end_date=2024-03-29 00:45:13.570918+00:00, run_duration=2.722753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:45:00.927688+00:00, queued_by_job_id=2, pid=4932 2024-03-29T00:45:15.379660191Z [2024-03-29T00:45:15.378+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:45:15.379690758Z 2024-03-29T00:45:15.380063932Z [2024-03-29T00:45:15.379+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:45:15.380982351Z [2024-03-29T00:45:15.380+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:45:15.380995418Z 2024-03-29T00:45:15.384140651Z [2024-03-29T00:45:15.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:45:15.384596636Z [2024-03-29T00:45:15.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:45:15.457497588Z [2024-03-29T00:45:15.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:45:15.457576616Z [2024-03-29T00:45:15.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:45:15.464331685Z [2024-03-29T00:45:15.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24ffd7ad-efff-4047-96af-7a6e3489ddd4 2024-03-29T00:45:15.464493721Z [2024-03-29T00:45:15.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=-1, run_start_date=2024-03-29 00:45:14.406814+00:00, run_end_date=2024-03-29 00:45:14.866688+00:00, run_duration=0.459874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:45:10.588784+00:00, queued_by_job_id=2, pid=4944 2024-03-29T00:45:19.350698780Z [2024-03-29T00:45:19.350+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:45:19.350726628Z 2024-03-29T00:45:19.350740779Z [2024-03-29T00:45:19.350+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:45:19.351225879Z [2024-03-29T00:45:19.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:45:19.351236870Z 2024-03-29T00:45:19.358474863Z [2024-03-29T00:45:19.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:45:19.362935151Z [2024-03-29T00:45:19.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:45:19.544259265Z [2024-03-29T00:45:19.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status queued for try_number 1 2024-03-29T00:45:19.544288682Z [2024-03-29T00:45:19.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:45:19.552510383Z [2024-03-29T00:45:19.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 494d780d-3591-419e-8d76-c181ca9de656 2024-03-29T00:45:19.552617110Z [2024-03-29T00:45:19.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=0, run_start_date=2024-03-29 00:45:17.629885+00:00, run_end_date=2024-03-29 00:45:18.127858+00:00, run_duration=0.497973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:45:15.381647+00:00, queued_by_job_id=2, pid=4962 2024-03-29T00:45:22.486858000Z [2024-03-29T00:45:22.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:45:22.487225110Z [2024-03-29T00:45:22.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:40:00+00:00, run_id=scheduled__2024-03-29T00:40:00+00:00, run_start_date=2024-03-29 00:45:00.793276+00:00, run_end_date=2024-03-29 00:45:22.486769+00:00, run_duration=21.693493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:40:00+00:00, data_interval_end=2024-03-29 00:45:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:45:22.501891744Z [2024-03-29T00:45:22.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:45:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:45:22.559597395Z [2024-03-29T00:45:22.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:40:00+00:00 exited with status success for try_number 1 2024-03-29T00:45:22.563666576Z [2024-03-29T00:45:22.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:40:00+00:00, map_index=-1, run_start_date=2024-03-29 00:45:21.633000+00:00, run_end_date=2024-03-29 00:45:22.075698+00:00, run_duration=0.442698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:45:19.351540+00:00, queued_by_job_id=2, pid=4973 2024-03-29T00:46:00.881993261Z [2024-03-29T00:46:00.881+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:46:00.900332283Z [2024-03-29T00:46:00.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:46:00+00:00, run_after=2024-03-29T00:47:00+00:00 2024-03-29T00:46:00.908726885Z [2024-03-29T00:46:00.908+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:46:00.923307519Z [2024-03-29T00:46:00.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:46:00+00:00, run_after=2024-03-29T00:47:00+00:00 2024-03-29T00:46:01.019107011Z [2024-03-29T00:46:01.018+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:46:01.019185091Z 2024-03-29T00:46:01.019192160Z 2024-03-29T00:46:01.019197303Z 2024-03-29T00:46:01.019201713Z 2024-03-29T00:46:01.019552467Z [2024-03-29T00:46:01.019+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:46:01.020139679Z [2024-03-29T00:46:01.019+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:46:01.020615209Z [2024-03-29T00:46:01.020+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:46:01.020844538Z [2024-03-29T00:46:01.020+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:46:01.021829696Z [2024-03-29T00:46:01.021+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:46:01.021841799Z 2024-03-29T00:46:01.021845969Z 2024-03-29T00:46:01.021849467Z 2024-03-29T00:46:01.021852713Z 2024-03-29T00:46:01.027436475Z [2024-03-29T00:46:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:46:01.027564350Z [2024-03-29T00:46:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:46:01.027894526Z [2024-03-29T00:46:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:46:01.028062523Z [2024-03-29T00:46:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:46:01.028362766Z [2024-03-29T00:46:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:46:01.028663014Z [2024-03-29T00:46:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:46:01.028937317Z [2024-03-29T00:46:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:46:01.029107744Z [2024-03-29T00:46:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:46:01.507063722Z [2024-03-29T00:46:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status queued for try_number 1 2024-03-29T00:46:01.507477463Z [2024-03-29T00:46:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status queued for try_number 1 2024-03-29T00:46:01.507687499Z [2024-03-29T00:46:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status queued for try_number 1 2024-03-29T00:46:01.507960441Z [2024-03-29T00:46:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status queued for try_number 1 2024-03-29T00:46:01.530827584Z [2024-03-29T00:46:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c1059be-c36b-4b57-abc7-01f6602ad8ce 2024-03-29T00:46:01.535591983Z [2024-03-29T00:46:01.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1906120a-d256-4647-8a82-efbbb027ae2e 2024-03-29T00:46:01.535973399Z [2024-03-29T00:46:01.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44faf442-b942-4fe8-a28a-35d857e45929 2024-03-29T00:46:01.536334989Z [2024-03-29T00:46:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to e39876c1-91e3-4b12-94f6-501a0a4ecba6 2024-03-29T00:46:03.370324035Z [2024-03-29T00:46:03.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:46:03.371092805Z [2024-03-29T00:46:03.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:44:00+00:00, run_id=scheduled__2024-03-29T00:44:00+00:00, run_start_date=2024-03-29 00:46:00.935344+00:00, run_end_date=2024-03-29 00:46:03.370488+00:00, run_duration=2.435144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:44:00+00:00, data_interval_end=2024-03-29 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:46:03.387093095Z [2024-03-29T00:46:03.386+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:46:00+00:00, run_after=2024-03-29T00:48:00+00:00 2024-03-29T00:46:03.399423225Z [2024-03-29T00:46:03.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:46:03.400742226Z [2024-03-29T00:46:03.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:45:00+00:00, run_id=scheduled__2024-03-29T00:45:00+00:00, run_start_date=2024-03-29 00:46:00.937334+00:00, run_end_date=2024-03-29 00:46:03.400196+00:00, run_duration=2.462862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:45:00+00:00, data_interval_end=2024-03-29 00:46:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:46:03.420649527Z [2024-03-29T00:46:03.420+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:46:00+00:00, run_after=2024-03-29T00:47:00+00:00 2024-03-29T00:46:03.492366326Z [2024-03-29T00:46:03.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:44:00+00:00 exited with status success for try_number 1 2024-03-29T00:46:03.492739199Z [2024-03-29T00:46:03.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status success for try_number 1 2024-03-29T00:46:03.501697564Z [2024-03-29T00:46:03.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:45:00+00:00, map_index=-1, run_start_date=2024-03-29 00:46:01.944689+00:00, run_end_date=2024-03-29 00:46:02.569052+00:00, run_duration=0.624363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:46:01.023240+00:00, queued_by_job_id=2, pid=4983 2024-03-29T00:46:03.502047835Z [2024-03-29T00:46:03.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:44:00+00:00, map_index=-1, run_start_date=2024-03-29 00:46:02.166409+00:00, run_end_date=2024-03-29 00:46:02.719212+00:00, run_duration=0.552803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:46:01.023240+00:00, queued_by_job_id=2, pid=4984 2024-03-29T00:46:04.956655468Z [2024-03-29T00:46:04.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:46:04.957071487Z [2024-03-29T00:46:04.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:45:00+00:00, run_id=scheduled__2024-03-29T00:45:00+00:00, run_start_date=2024-03-29 00:46:00.939378+00:00, run_end_date=2024-03-29 00:46:04.956733+00:00, run_duration=4.017355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:45:00+00:00, data_interval_end=2024-03-29 00:46:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:46:04.967119729Z [2024-03-29T00:46:04.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:46:00+00:00, run_after=2024-03-29T00:47:00+00:00 2024-03-29T00:46:05.026753749Z [2024-03-29T00:46:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status success for try_number 1 2024-03-29T00:46:05.037324159Z [2024-03-29T00:46:05.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:45:00+00:00, map_index=-1, run_start_date=2024-03-29 00:46:03.441032+00:00, run_end_date=2024-03-29 00:46:04.814875+00:00, run_duration=1.373843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:46:01.023240+00:00, queued_by_job_id=2, pid=5002 2024-03-29T00:46:06.073224637Z [2024-03-29T00:46:06.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:46:06.073464021Z [2024-03-29T00:46:06.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:45:00+00:00, run_id=scheduled__2024-03-29T00:45:00+00:00, run_start_date=2024-03-29 00:46:00.941351+00:00, run_end_date=2024-03-29 00:46:06.073109+00:00, run_duration=5.131758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:45:00+00:00, data_interval_end=2024-03-29 00:46:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:46:06.082397787Z [2024-03-29T00:46:06.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:46:00+00:00, run_after=2024-03-29T00:47:00+00:00 2024-03-29T00:46:06.110496360Z [2024-03-29T00:46:06.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status success for try_number 1 2024-03-29T00:46:06.115489948Z [2024-03-29T00:46:06.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:45:00+00:00, map_index=-1, run_start_date=2024-03-29 00:46:03.740081+00:00, run_end_date=2024-03-29 00:46:05.585449+00:00, run_duration=1.845368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:46:01.023240+00:00, queued_by_job_id=2, pid=5008 2024-03-29T00:47:00.638979069Z [2024-03-29T00:47:00.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:47:00+00:00, run_after=2024-03-29T00:48:00+00:00 2024-03-29T00:47:00.654219800Z [2024-03-29T00:47:00.653+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:47:00+00:00, run_after=2024-03-29T00:48:00+00:00 2024-03-29T00:47:00.662725613Z [2024-03-29T00:47:00.662+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:47:00.728429290Z [2024-03-29T00:47:00.727+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:47:00.728485239Z 2024-03-29T00:47:00.728527366Z 2024-03-29T00:47:00.728533148Z 2024-03-29T00:47:00.728956235Z [2024-03-29T00:47:00.728+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:47:00.729387122Z [2024-03-29T00:47:00.729+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:47:00.729720267Z [2024-03-29T00:47:00.729+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:47:00.730949451Z [2024-03-29T00:47:00.730+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:47:00.730969935Z 2024-03-29T00:47:00.730976047Z 2024-03-29T00:47:00.730981194Z 2024-03-29T00:47:00.736483004Z [2024-03-29T00:47:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:47:00.736819793Z [2024-03-29T00:47:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:47:00.737351223Z [2024-03-29T00:47:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:47:00.737579434Z [2024-03-29T00:47:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:47:00.737807011Z [2024-03-29T00:47:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:47:00.738060333Z [2024-03-29T00:47:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:47:01.055598862Z [2024-03-29T00:47:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status queued for try_number 1 2024-03-29T00:47:01.056199299Z [2024-03-29T00:47:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status queued for try_number 1 2024-03-29T00:47:01.056596402Z [2024-03-29T00:47:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status queued for try_number 1 2024-03-29T00:47:01.080873053Z [2024-03-29T00:47:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4567d443-c021-41aa-9aa0-c168e06cd7a6 2024-03-29T00:47:01.081332340Z [2024-03-29T00:47:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to d532ec43-f5ef-43e6-bc1d-55c63d373d3e 2024-03-29T00:47:01.081823477Z [2024-03-29T00:47:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff6805d5-8bd6-4e86-ba43-0879cc9b5347 2024-03-29T00:47:02.303956730Z [2024-03-29T00:47:02.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:47:02.304736137Z [2024-03-29T00:47:02.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:46:00+00:00, run_id=scheduled__2024-03-29T00:46:00+00:00, run_start_date=2024-03-29 00:47:00.673597+00:00, run_end_date=2024-03-29 00:47:02.303874+00:00, run_duration=1.630277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:46:00+00:00, data_interval_end=2024-03-29 00:47:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:47:02.318505989Z [2024-03-29T00:47:02.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:47:00+00:00, run_after=2024-03-29T00:48:00+00:00 2024-03-29T00:47:02.656836832Z [2024-03-29T00:47:02.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status success for try_number 1 2024-03-29T00:47:02.662594297Z [2024-03-29T00:47:02.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:46:00+00:00, map_index=-1, run_start_date=2024-03-29 00:47:01.727826+00:00, run_end_date=2024-03-29 00:47:02.234236+00:00, run_duration=0.50641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:47:00.732521+00:00, queued_by_job_id=2, pid=5040 2024-03-29T00:47:05.811161293Z [2024-03-29T00:47:05.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:47:05.811353484Z [2024-03-29T00:47:05.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:46:00+00:00, run_id=scheduled__2024-03-29T00:46:00+00:00, run_start_date=2024-03-29 00:47:00.674934+00:00, run_end_date=2024-03-29 00:47:05.805257+00:00, run_duration=5.130323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:46:00+00:00, data_interval_end=2024-03-29 00:47:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:47:05.834229662Z [2024-03-29T00:47:05.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:47:00+00:00, run_after=2024-03-29T00:48:00+00:00 2024-03-29T00:47:05.842325169Z [2024-03-29T00:47:05.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:47:05.842814606Z [2024-03-29T00:47:05.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:46:00+00:00, run_id=scheduled__2024-03-29T00:46:00+00:00, run_start_date=2024-03-29 00:47:00.676259+00:00, run_end_date=2024-03-29 00:47:05.842239+00:00, run_duration=5.16598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:46:00+00:00, data_interval_end=2024-03-29 00:47:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:47:05.852753973Z [2024-03-29T00:47:05.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:47:00+00:00, run_after=2024-03-29T00:48:00+00:00 2024-03-29T00:47:05.908554585Z [2024-03-29T00:47:05.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status success for try_number 1 2024-03-29T00:47:05.908706480Z [2024-03-29T00:47:05.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status success for try_number 1 2024-03-29T00:47:05.915151837Z [2024-03-29T00:47:05.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:46:00+00:00, map_index=-1, run_start_date=2024-03-29 00:47:03.103315+00:00, run_end_date=2024-03-29 00:47:04.669662+00:00, run_duration=1.566347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:47:00.732521+00:00, queued_by_job_id=2, pid=5059 2024-03-29T00:47:05.915374608Z [2024-03-29T00:47:05.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:46:00+00:00, map_index=-1, run_start_date=2024-03-29 00:47:02.954198+00:00, run_end_date=2024-03-29 00:47:04.848223+00:00, run_duration=1.894025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:47:00.732521+00:00, queued_by_job_id=2, pid=5058 2024-03-29T00:48:00.430648233Z [2024-03-29T00:48:00.429+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:48:00.469411814Z [2024-03-29T00:48:00.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:48:00+00:00, run_after=2024-03-29T00:49:00+00:00 2024-03-29T00:48:00.479046747Z [2024-03-29T00:48:00.478+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:48:00.493831070Z [2024-03-29T00:48:00.493+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:48:00+00:00, run_after=2024-03-29T00:49:00+00:00 2024-03-29T00:48:00.580957703Z [2024-03-29T00:48:00.580+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:48:00.580984115Z 2024-03-29T00:48:00.580988361Z 2024-03-29T00:48:00.581004306Z 2024-03-29T00:48:00.581007416Z 2024-03-29T00:48:00.581135729Z [2024-03-29T00:48:00.580+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:48:00.581345267Z [2024-03-29T00:48:00.581+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:48:00.581623347Z [2024-03-29T00:48:00.581+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:48:00.581884542Z [2024-03-29T00:48:00.581+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:48:00.582895552Z [2024-03-29T00:48:00.582+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:48:00.582908862Z 2024-03-29T00:48:00.582917775Z 2024-03-29T00:48:00.582921197Z 2024-03-29T00:48:00.582924408Z 2024-03-29T00:48:00.588154797Z [2024-03-29T00:48:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:48:00.588469096Z [2024-03-29T00:48:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:48:00.588853128Z [2024-03-29T00:48:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:48:00.589023382Z [2024-03-29T00:48:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:48:00.589424546Z [2024-03-29T00:48:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:48:00.589675265Z [2024-03-29T00:48:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:48:00.590092082Z [2024-03-29T00:48:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:48:00.590315193Z [2024-03-29T00:48:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:48:01.008968794Z [2024-03-29T00:48:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status queued for try_number 1 2024-03-29T00:48:01.009155006Z [2024-03-29T00:48:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:47:00+00:00 exited with status queued for try_number 1 2024-03-29T00:48:01.009383947Z [2024-03-29T00:48:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:47:00+00:00 exited with status queued for try_number 1 2024-03-29T00:48:01.009614829Z [2024-03-29T00:48:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:47:00+00:00 exited with status queued for try_number 1 2024-03-29T00:48:01.030926024Z [2024-03-29T00:48:01.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0960113-c404-4d18-bc3a-fd65fac19e4d 2024-03-29T00:48:01.031452970Z [2024-03-29T00:48:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbe8d596-b655-4c17-909c-9549869b7518 2024-03-29T00:48:01.033577589Z [2024-03-29T00:48:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4066ec6b-3743-46ce-997c-b13ef3a87b96 2024-03-29T00:48:01.036474650Z [2024-03-29T00:48:01.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9ae04d9-44e7-4f1b-bbbe-1d56e89ed5a6 2024-03-29T00:48:02.438104166Z [2024-03-29T00:48:02.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:48:02.438366845Z [2024-03-29T00:48:02.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:46:00+00:00, run_id=scheduled__2024-03-29T00:46:00+00:00, run_start_date=2024-03-29 00:48:00.510197+00:00, run_end_date=2024-03-29 00:48:02.437995+00:00, run_duration=1.927798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:46:00+00:00, data_interval_end=2024-03-29 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:48:02.453250492Z [2024-03-29T00:48:02.452+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:48:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:48:02.621346896Z [2024-03-29T00:48:02.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:46:00+00:00 exited with status success for try_number 1 2024-03-29T00:48:02.635689739Z [2024-03-29T00:48:02.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:46:00+00:00, map_index=-1, run_start_date=2024-03-29 00:48:01.746323+00:00, run_end_date=2024-03-29 00:48:02.239744+00:00, run_duration=0.493421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:48:00.584359+00:00, queued_by_job_id=2, pid=5087 2024-03-29T00:48:04.176168556Z [2024-03-29T00:48:04.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:48:04.178005465Z [2024-03-29T00:48:04.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:47:00+00:00, run_id=scheduled__2024-03-29T00:47:00+00:00, run_start_date=2024-03-29 00:48:00.511502+00:00, run_end_date=2024-03-29 00:48:04.176057+00:00, run_duration=3.664555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:47:00+00:00, data_interval_end=2024-03-29 00:48:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:48:04.197039320Z [2024-03-29T00:48:04.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:48:00+00:00, run_after=2024-03-29T00:49:00+00:00 2024-03-29T00:48:04.276371899Z [2024-03-29T00:48:04.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:47:00+00:00 exited with status success for try_number 1 2024-03-29T00:48:04.284440370Z [2024-03-29T00:48:04.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:47:00+00:00, map_index=-1, run_start_date=2024-03-29 00:48:02.496815+00:00, run_end_date=2024-03-29 00:48:03.078616+00:00, run_duration=0.581801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:48:00.584359+00:00, queued_by_job_id=2, pid=5100 2024-03-29T00:48:05.327183458Z [2024-03-29T00:48:05.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:48:05.327555537Z [2024-03-29T00:48:05.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:47:00+00:00, run_id=scheduled__2024-03-29T00:47:00+00:00, run_start_date=2024-03-29 00:48:00.513084+00:00, run_end_date=2024-03-29 00:48:05.327133+00:00, run_duration=4.814049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:47:00+00:00, data_interval_end=2024-03-29 00:48:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:48:05.338551633Z [2024-03-29T00:48:05.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:48:00+00:00, run_after=2024-03-29T00:49:00+00:00 2024-03-29T00:48:05.381127267Z [2024-03-29T00:48:05.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:47:00+00:00 exited with status success for try_number 1 2024-03-29T00:48:05.388032886Z [2024-03-29T00:48:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:47:00+00:00, map_index=-1, run_start_date=2024-03-29 00:48:03.518352+00:00, run_end_date=2024-03-29 00:48:05.048861+00:00, run_duration=1.530509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:48:00.584359+00:00, queued_by_job_id=2, pid=5116 2024-03-29T00:48:06.146884749Z [2024-03-29T00:48:06.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:48:06.147214829Z [2024-03-29T00:48:06.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:47:00+00:00, run_id=scheduled__2024-03-29T00:47:00+00:00, run_start_date=2024-03-29 00:48:00.514255+00:00, run_end_date=2024-03-29 00:48:06.146841+00:00, run_duration=5.632586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:47:00+00:00, data_interval_end=2024-03-29 00:48:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:48:06.156645645Z [2024-03-29T00:48:06.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:48:00+00:00, run_after=2024-03-29T00:49:00+00:00 2024-03-29T00:48:06.195071690Z [2024-03-29T00:48:06.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:47:00+00:00 exited with status success for try_number 1 2024-03-29T00:48:06.201133615Z [2024-03-29T00:48:06.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:47:00+00:00, map_index=-1, run_start_date=2024-03-29 00:48:03.639506+00:00, run_end_date=2024-03-29 00:48:05.587498+00:00, run_duration=1.947992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:48:00.584359+00:00, queued_by_job_id=2, pid=5117 2024-03-29T00:48:44.786807044Z [2024-03-29T00:48:44.786+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:49:01.031791649Z [2024-03-29T00:49:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:49:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:49:01.053221961Z [2024-03-29T00:49:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:49:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:49:01.064149625Z [2024-03-29T00:49:01.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:49:01.149878768Z [2024-03-29T00:49:01.149+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:49:01.149909222Z 2024-03-29T00:49:01.149914202Z 2024-03-29T00:49:01.149918726Z 2024-03-29T00:49:01.150224038Z [2024-03-29T00:49:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:49:01.150560155Z [2024-03-29T00:49:01.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:49:01.150905391Z [2024-03-29T00:49:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:49:01.151753765Z [2024-03-29T00:49:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:49:01.151774903Z 2024-03-29T00:49:01.151780607Z 2024-03-29T00:49:01.151785560Z 2024-03-29T00:49:01.156185027Z [2024-03-29T00:49:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:49:01.156510584Z [2024-03-29T00:49:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:49:01.156920396Z [2024-03-29T00:49:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:49:01.157112340Z [2024-03-29T00:49:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:49:01.157489679Z [2024-03-29T00:49:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:49:01.157749180Z [2024-03-29T00:49:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:49:01.452129714Z [2024-03-29T00:49:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status queued for try_number 1 2024-03-29T00:49:01.452164292Z [2024-03-29T00:49:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status queued for try_number 1 2024-03-29T00:49:01.452412288Z [2024-03-29T00:49:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status queued for try_number 1 2024-03-29T00:49:01.461984413Z [2024-03-29T00:49:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 910e17f8-2111-4458-80e7-ce0bfc301434 2024-03-29T00:49:01.462154740Z [2024-03-29T00:49:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa27a82f-f4f7-4649-9a66-a803a6b8d813 2024-03-29T00:49:01.462338345Z [2024-03-29T00:49:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 452e2253-4ec5-47c8-b695-3781d434f2f7 2024-03-29T00:49:03.073463650Z [2024-03-29T00:49:03.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:49:03.073968554Z [2024-03-29T00:49:03.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:48:00+00:00, run_id=scheduled__2024-03-29T00:48:00+00:00, run_start_date=2024-03-29 00:49:01.079093+00:00, run_end_date=2024-03-29 00:49:03.073372+00:00, run_duration=1.994279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:48:00+00:00, data_interval_end=2024-03-29 00:49:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:49:03.084902773Z [2024-03-29T00:49:03.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:49:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:49:03.156709963Z [2024-03-29T00:49:03.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status success for try_number 1 2024-03-29T00:49:03.166341799Z [2024-03-29T00:49:03.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:48:00+00:00, map_index=-1, run_start_date=2024-03-29 00:49:01.945668+00:00, run_end_date=2024-03-29 00:49:02.349860+00:00, run_duration=0.404192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:49:01.152759+00:00, queued_by_job_id=2, pid=5150 2024-03-29T00:49:05.735431574Z [2024-03-29T00:49:05.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:49:05.735603835Z [2024-03-29T00:49:05.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:48:00+00:00, run_id=scheduled__2024-03-29T00:48:00+00:00, run_start_date=2024-03-29 00:49:01.082772+00:00, run_end_date=2024-03-29 00:49:05.735360+00:00, run_duration=4.652588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:48:00+00:00, data_interval_end=2024-03-29 00:49:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:49:05.748757501Z [2024-03-29T00:49:05.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:49:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:49:05.765844642Z [2024-03-29T00:49:05.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:49:05.768575732Z [2024-03-29T00:49:05.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:48:00+00:00, run_id=scheduled__2024-03-29T00:48:00+00:00, run_start_date=2024-03-29 00:49:01.081006+00:00, run_end_date=2024-03-29 00:49:05.768045+00:00, run_duration=4.687039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:48:00+00:00, data_interval_end=2024-03-29 00:49:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:49:05.787352215Z [2024-03-29T00:49:05.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:49:00+00:00, run_after=2024-03-29T00:50:00+00:00 2024-03-29T00:49:05.856928917Z [2024-03-29T00:49:05.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status success for try_number 1 2024-03-29T00:49:05.861625440Z [2024-03-29T00:49:05.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:48:00+00:00, map_index=-1, run_start_date=2024-03-29 00:49:03.392177+00:00, run_end_date=2024-03-29 00:49:05.323413+00:00, run_duration=1.931236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:49:01.152759+00:00, queued_by_job_id=2, pid=5169 2024-03-29T00:49:06.919268699Z [2024-03-29T00:49:06.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status success for try_number 1 2024-03-29T00:49:06.923820460Z [2024-03-29T00:49:06.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:48:00+00:00, map_index=-1, run_start_date=2024-03-29 00:49:03.132414+00:00, run_end_date=2024-03-29 00:49:05.687065+00:00, run_duration=2.554651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:49:01.152759+00:00, queued_by_job_id=2, pid=5168 2024-03-29T00:50:00.821249822Z [2024-03-29T00:50:00.820+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:50:00.833204677Z [2024-03-29T00:50:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:55:00+00:00 2024-03-29T00:50:00.841232168Z [2024-03-29T00:50:00.840+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:50:00.852913920Z [2024-03-29T00:50:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:51:00+00:00 2024-03-29T00:50:00.867251412Z [2024-03-29T00:50:00.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:51:00+00:00 2024-03-29T00:50:00.963623776Z [2024-03-29T00:50:00.962+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T00:50:00.963675699Z 2024-03-29T00:50:00.963681738Z 2024-03-29T00:50:00.963687596Z 2024-03-29T00:50:00.963692254Z 2024-03-29T00:50:00.963696901Z 2024-03-29T00:50:00.963847962Z [2024-03-29T00:50:00.963+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:50:00.964246941Z [2024-03-29T00:50:00.963+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:50:00.964507059Z [2024-03-29T00:50:00.964+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:50:00.964732193Z [2024-03-29T00:50:00.964+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:50:00.964941118Z [2024-03-29T00:50:00.964+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:50:00.966004601Z [2024-03-29T00:50:00.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:50:00.966021525Z 2024-03-29T00:50:00.966028712Z 2024-03-29T00:50:00.966041546Z 2024-03-29T00:50:00.966087312Z 2024-03-29T00:50:00.966092800Z 2024-03-29T00:50:00.972589596Z [2024-03-29T00:50:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:50:00.972814676Z [2024-03-29T00:50:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:50:00.973255513Z [2024-03-29T00:50:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:50:00.973446686Z [2024-03-29T00:50:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:50:00.973900132Z [2024-03-29T00:50:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:50:00.974116461Z [2024-03-29T00:50:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:50:00.974550706Z [2024-03-29T00:50:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:50:00.975004386Z [2024-03-29T00:50:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:50:00.975925419Z [2024-03-29T00:50:00.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:50:00.976309004Z [2024-03-29T00:50:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:50:01.748108199Z [2024-03-29T00:50:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:01.750939816Z [2024-03-29T00:50:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:01.751225570Z [2024-03-29T00:50:01.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:49:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:01.751421882Z [2024-03-29T00:50:01.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:49:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:01.751610654Z [2024-03-29T00:50:01.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:49:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:01.780292952Z [2024-03-29T00:50:01.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87ae39aa-42d1-42da-abfe-3e19df09038b 2024-03-29T00:50:01.785192187Z [2024-03-29T00:50:01.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79f21693-c20b-41b1-824c-961a92c6b005 2024-03-29T00:50:01.785555176Z [2024-03-29T00:50:01.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56b17f83-a374-40a2-925e-80c3daedf165 2024-03-29T00:50:01.785894034Z [2024-03-29T00:50:01.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11a483f6-3104-4a9d-8961-17ce5bc375ba 2024-03-29T00:50:01.786170820Z [2024-03-29T00:50:01.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9777a40a-0052-4794-a54c-7654161522be 2024-03-29T00:50:02.793007000Z [2024-03-29T00:50:02.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:50:02.793242083Z [2024-03-29T00:50:02.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:48:00+00:00, run_id=scheduled__2024-03-29T00:48:00+00:00, run_start_date=2024-03-29 00:50:00.880643+00:00, run_end_date=2024-03-29 00:50:02.792925+00:00, run_duration=1.912282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:48:00+00:00, data_interval_end=2024-03-29 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:50:02.802849728Z [2024-03-29T00:50:02.802+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:52:00+00:00 2024-03-29T00:50:02.907819259Z [2024-03-29T00:50:02.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:48:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:02.917078737Z [2024-03-29T00:50:02.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:48:00+00:00, map_index=-1, run_start_date=2024-03-29 00:50:02.035745+00:00, run_end_date=2024-03-29 00:50:02.610991+00:00, run_duration=0.575246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:00.968216+00:00, queued_by_job_id=2, pid=5198 2024-03-29T00:50:03.948289601Z [2024-03-29T00:50:03.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:50:03.948419624Z [2024-03-29T00:50:03.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:49:00+00:00, run_id=scheduled__2024-03-29T00:49:00+00:00, run_start_date=2024-03-29 00:50:00.881824+00:00, run_end_date=2024-03-29 00:50:03.948167+00:00, run_duration=3.066343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:49:00+00:00, data_interval_end=2024-03-29 00:50:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:50:03.966364701Z [2024-03-29T00:50:03.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:51:00+00:00 2024-03-29T00:50:04.077944942Z [2024-03-29T00:50:04.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:49:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:04.085622626Z [2024-03-29T00:50:04.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:49:00+00:00, map_index=-1, run_start_date=2024-03-29 00:50:02.932719+00:00, run_end_date=2024-03-29 00:50:03.498395+00:00, run_duration=0.565676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:00.968216+00:00, queued_by_job_id=2, pid=5209 2024-03-29T00:50:06.727950566Z [2024-03-29T00:50:06.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:50:06.728870454Z [2024-03-29T00:50:06.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:49:00+00:00, run_id=scheduled__2024-03-29T00:49:00+00:00, run_start_date=2024-03-29 00:50:00.883026+00:00, run_end_date=2024-03-29 00:50:06.727940+00:00, run_duration=5.844914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:49:00+00:00, data_interval_end=2024-03-29 00:50:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:50:06.741017639Z [2024-03-29T00:50:06.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:51:00+00:00 2024-03-29T00:50:06.771897878Z [2024-03-29T00:50:06.771+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:50:06.771925862Z 2024-03-29T00:50:06.771938880Z [2024-03-29T00:50:06.771+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:50:06.772467275Z [2024-03-29T00:50:06.772+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:50:06.772479545Z 2024-03-29T00:50:06.775197730Z [2024-03-29T00:50:06.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:50:06.775283423Z [2024-03-29T00:50:06.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:50:06.880164778Z [2024-03-29T00:50:06.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:06.880581743Z [2024-03-29T00:50:06.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:06.880936377Z [2024-03-29T00:50:06.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:49:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:06.896913304Z [2024-03-29T00:50:06.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:45:00+00:00, map_index=-1, run_start_date=2024-03-29 00:50:04.928633+00:00, run_end_date=2024-03-29 00:50:05.718586+00:00, run_duration=0.789953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:00.968216+00:00, queued_by_job_id=2, pid=5235 2024-03-29T00:50:06.897399351Z [2024-03-29T00:50:06.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d9bef7a-6834-4b7c-aca8-7da4bd9a1e66 2024-03-29T00:50:06.897933683Z [2024-03-29T00:50:06.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:49:00+00:00, map_index=-1, run_start_date=2024-03-29 00:50:04.614035+00:00, run_end_date=2024-03-29 00:50:06.506481+00:00, run_duration=1.892446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:00.968216+00:00, queued_by_job_id=2, pid=5228 2024-03-29T00:50:07.006025814Z [2024-03-29T00:50:07.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:50:07.006362062Z [2024-03-29T00:50:07.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:49:00+00:00, run_id=scheduled__2024-03-29T00:49:00+00:00, run_start_date=2024-03-29 00:50:00.884054+00:00, run_end_date=2024-03-29 00:50:07.005597+00:00, run_duration=6.121543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:49:00+00:00, data_interval_end=2024-03-29 00:50:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:50:07.021406697Z [2024-03-29T00:50:07.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:51:00+00:00 2024-03-29T00:50:07.152759775Z [2024-03-29T00:50:07.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:49:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:07.159288613Z [2024-03-29T00:50:07.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:49:00+00:00, map_index=-1, run_start_date=2024-03-29 00:50:04.697443+00:00, run_end_date=2024-03-29 00:50:06.949562+00:00, run_duration=2.252119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:00.968216+00:00, queued_by_job_id=2, pid=5233 2024-03-29T00:50:09.714485604Z [2024-03-29T00:50:09.713+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:50:09.714519141Z 2024-03-29T00:50:09.714783269Z [2024-03-29T00:50:09.714+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:50:09.715800179Z [2024-03-29T00:50:09.715+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:50:09.715816241Z 2024-03-29T00:50:09.719467033Z [2024-03-29T00:50:09.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:50:09.719809928Z [2024-03-29T00:50:09.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:50:09.765467606Z [2024-03-29T00:50:09.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:09.765659342Z [2024-03-29T00:50:09.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:09.771984990Z [2024-03-29T00:50:09.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3efda2b1-b057-41a2-866d-58701ce2527e 2024-03-29T00:50:09.772343614Z [2024-03-29T00:50:09.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:45:00+00:00, map_index=-1, run_start_date=2024-03-29 00:50:08.671015+00:00, run_end_date=2024-03-29 00:50:08.996230+00:00, run_duration=0.325215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:06.772805+00:00, queued_by_job_id=2, pid=5258 2024-03-29T00:50:12.035994036Z [2024-03-29T00:50:12.035+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:50:12.036040421Z 2024-03-29T00:50:12.036078945Z [2024-03-29T00:50:12.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:50:12.036770082Z [2024-03-29T00:50:12.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:50:12.036794647Z 2024-03-29T00:50:12.040115250Z [2024-03-29T00:50:12.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:50:12.040284982Z [2024-03-29T00:50:12.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:50:12.083805278Z [2024-03-29T00:50:12.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status queued for try_number 1 2024-03-29T00:50:12.083839376Z [2024-03-29T00:50:12.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:12.089040716Z [2024-03-29T00:50:12.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ccabd50-b1af-44c7-9d06-5908849acdf0 2024-03-29T00:50:12.089377344Z [2024-03-29T00:50:12.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:45:00+00:00, map_index=0, run_start_date=2024-03-29 00:50:11.459726+00:00, run_end_date=2024-03-29 00:50:11.777196+00:00, run_duration=0.31747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:09.716490+00:00, queued_by_job_id=2, pid=5266 2024-03-29T00:50:14.141120975Z [2024-03-29T00:50:14.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:50:14.141386418Z [2024-03-29T00:50:14.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:45:00+00:00, run_id=scheduled__2024-03-29T00:45:00+00:00, run_start_date=2024-03-29 00:50:00.879256+00:00, run_end_date=2024-03-29 00:50:14.140963+00:00, run_duration=13.261707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:45:00+00:00, data_interval_end=2024-03-29 00:50:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:50:14.148299790Z [2024-03-29T00:50:14.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:50:00+00:00, run_after=2024-03-29T00:55:00+00:00 2024-03-29T00:50:14.176699323Z [2024-03-29T00:50:14.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:45:00+00:00 exited with status success for try_number 1 2024-03-29T00:50:14.181833026Z [2024-03-29T00:50:14.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:45:00+00:00, map_index=-1, run_start_date=2024-03-29 00:50:13.681864+00:00, run_end_date=2024-03-29 00:50:14.026761+00:00, run_duration=0.344897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:50:12.037053+00:00, queued_by_job_id=2, pid=5274 2024-03-29T00:51:00.791512357Z [2024-03-29T00:51:00.791+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:51:00.815411743Z [2024-03-29T00:51:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:51:00+00:00, run_after=2024-03-29T00:52:00+00:00 2024-03-29T00:51:00.835407580Z [2024-03-29T00:51:00.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:51:00+00:00, run_after=2024-03-29T00:52:00+00:00 2024-03-29T00:51:00.910229970Z [2024-03-29T00:51:00.909+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:51:00.910260291Z 2024-03-29T00:51:00.910265563Z 2024-03-29T00:51:00.910270168Z 2024-03-29T00:51:00.910567542Z [2024-03-29T00:51:00.910+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:51:00.910891578Z [2024-03-29T00:51:00.910+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:51:00.911077558Z [2024-03-29T00:51:00.910+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:51:00.911891256Z [2024-03-29T00:51:00.911+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:51:00.911904678Z 2024-03-29T00:51:00.911913824Z 2024-03-29T00:51:00.911918711Z 2024-03-29T00:51:00.915961986Z [2024-03-29T00:51:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:51:00.916117952Z [2024-03-29T00:51:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:51:00.916433316Z [2024-03-29T00:51:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:51:00.916703854Z [2024-03-29T00:51:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:51:00.917155524Z [2024-03-29T00:51:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:51:00.917283043Z [2024-03-29T00:51:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:51:01.151917080Z [2024-03-29T00:51:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:51:01.152153493Z [2024-03-29T00:51:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:51:01.152326333Z [2024-03-29T00:51:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:51:01.178615215Z [2024-03-29T00:51:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3639cb83-1a6a-4439-a451-95f6fe300ba5 2024-03-29T00:51:01.178638000Z [2024-03-29T00:51:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c92f2ea-84fc-49d8-8cd5-ef6f052eff2d 2024-03-29T00:51:01.178641922Z [2024-03-29T00:51:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85e42933-b539-41d6-9e60-2a840682a69a 2024-03-29T00:51:02.325330905Z [2024-03-29T00:51:02.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:51:02.325639385Z [2024-03-29T00:51:02.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:50:00+00:00, run_id=scheduled__2024-03-29T00:50:00+00:00, run_start_date=2024-03-29 00:51:00.847679+00:00, run_end_date=2024-03-29 00:51:02.325279+00:00, run_duration=1.4776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:50:00+00:00, data_interval_end=2024-03-29 00:51:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:51:02.350260733Z [2024-03-29T00:51:02.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:51:00+00:00, run_after=2024-03-29T00:52:00+00:00 2024-03-29T00:51:03.521971195Z [2024-03-29T00:51:03.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:51:03.527306195Z [2024-03-29T00:51:03.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=-1, run_start_date=2024-03-29 00:51:01.762184+00:00, run_end_date=2024-03-29 00:51:02.261842+00:00, run_duration=0.499658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:51:00.912803+00:00, queued_by_job_id=2, pid=5296 2024-03-29T00:51:04.440980531Z [2024-03-29T00:51:04.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:51:04.441241237Z [2024-03-29T00:51:04.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:50:00+00:00, run_id=scheduled__2024-03-29T00:50:00+00:00, run_start_date=2024-03-29 00:51:00.849038+00:00, run_end_date=2024-03-29 00:51:04.440874+00:00, run_duration=3.591836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:50:00+00:00, data_interval_end=2024-03-29 00:51:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:51:04.450324953Z [2024-03-29T00:51:04.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:51:00+00:00, run_after=2024-03-29T00:52:00+00:00 2024-03-29T00:51:04.484934038Z [2024-03-29T00:51:04.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:51:04.491848339Z [2024-03-29T00:51:04.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=-1, run_start_date=2024-03-29 00:51:02.984309+00:00, run_end_date=2024-03-29 00:51:04.258049+00:00, run_duration=1.27374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:51:00.912803+00:00, queued_by_job_id=2, pid=5315 2024-03-29T00:51:05.642524663Z [2024-03-29T00:51:05.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:51:05.645729476Z [2024-03-29T00:51:05.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:50:00+00:00, run_id=scheduled__2024-03-29T00:50:00+00:00, run_start_date=2024-03-29 00:51:00.850151+00:00, run_end_date=2024-03-29 00:51:05.642184+00:00, run_duration=4.792033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:50:00+00:00, data_interval_end=2024-03-29 00:51:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:51:05.663449660Z [2024-03-29T00:51:05.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:51:00+00:00, run_after=2024-03-29T00:52:00+00:00 2024-03-29T00:51:05.718935679Z [2024-03-29T00:51:05.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:51:05.726721316Z [2024-03-29T00:51:05.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=-1, run_start_date=2024-03-29 00:51:02.848098+00:00, run_end_date=2024-03-29 00:51:04.513994+00:00, run_duration=1.665896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:51:00.912803+00:00, queued_by_job_id=2, pid=5314 2024-03-29T00:52:00.543586460Z [2024-03-29T00:52:00.543+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:52:00.552877142Z [2024-03-29T00:52:00.552+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:52:00.575575484Z [2024-03-29T00:52:00.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:52:00+00:00, run_after=2024-03-29T00:53:00+00:00 2024-03-29T00:52:00.591089120Z [2024-03-29T00:52:00.590+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:52:00+00:00, run_after=2024-03-29T00:53:00+00:00 2024-03-29T00:52:00.706979618Z [2024-03-29T00:52:00.706+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:52:00.707008624Z 2024-03-29T00:52:00.707015092Z 2024-03-29T00:52:00.707020521Z 2024-03-29T00:52:00.707026258Z 2024-03-29T00:52:00.707295028Z [2024-03-29T00:52:00.707+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:52:00.707610932Z [2024-03-29T00:52:00.707+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:52:00.707877690Z [2024-03-29T00:52:00.707+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:52:00.708174634Z [2024-03-29T00:52:00.708+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:52:00.709160328Z [2024-03-29T00:52:00.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:52:00.709177019Z 2024-03-29T00:52:00.709180873Z 2024-03-29T00:52:00.709200885Z 2024-03-29T00:52:00.709205312Z 2024-03-29T00:52:00.714698214Z [2024-03-29T00:52:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:52:00.715019035Z [2024-03-29T00:52:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:52:00.715459294Z [2024-03-29T00:52:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:52:00.715736319Z [2024-03-29T00:52:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:52:00.716140158Z [2024-03-29T00:52:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:52:00.716394475Z [2024-03-29T00:52:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:52:00.716809817Z [2024-03-29T00:52:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:52:00.717085430Z [2024-03-29T00:52:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:52:01.260110054Z [2024-03-29T00:52:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:52:01.260457062Z [2024-03-29T00:52:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:51:00+00:00 exited with status queued for try_number 1 2024-03-29T00:52:01.260662758Z [2024-03-29T00:52:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:51:00+00:00 exited with status queued for try_number 1 2024-03-29T00:52:01.260849119Z [2024-03-29T00:52:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:51:00+00:00 exited with status queued for try_number 1 2024-03-29T00:52:01.304767560Z [2024-03-29T00:52:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 702e8c9d-b909-4acd-be03-be972484cc7b 2024-03-29T00:52:01.305663116Z [2024-03-29T00:52:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1ab9f2f-29ac-46a4-9be0-46ca14f1c71f 2024-03-29T00:52:01.310111765Z [2024-03-29T00:52:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to e964e2f5-f1c3-4e7e-88e6-713b2801fdc1 2024-03-29T00:52:01.310858359Z [2024-03-29T00:52:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to de3fb1dc-f05a-4b87-8485-fbbf1f7dede5 2024-03-29T00:52:02.661669014Z [2024-03-29T00:52:02.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:52:02.662254700Z [2024-03-29T00:52:02.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:50:00+00:00, run_id=scheduled__2024-03-29T00:50:00+00:00, run_start_date=2024-03-29 00:52:00.604714+00:00, run_end_date=2024-03-29 00:52:02.661551+00:00, run_duration=2.056837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:50:00+00:00, data_interval_end=2024-03-29 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:52:02.676036903Z [2024-03-29T00:52:02.675+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:52:00+00:00, run_after=2024-03-29T00:54:00+00:00 2024-03-29T00:52:02.707392315Z [2024-03-29T00:52:02.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:52:02.707795998Z [2024-03-29T00:52:02.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:51:00+00:00, run_id=scheduled__2024-03-29T00:51:00+00:00, run_start_date=2024-03-29 00:52:00.606037+00:00, run_end_date=2024-03-29 00:52:02.707282+00:00, run_duration=2.101245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:51:00+00:00, data_interval_end=2024-03-29 00:52:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:52:02.724498010Z [2024-03-29T00:52:02.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:52:00+00:00, run_after=2024-03-29T00:53:00+00:00 2024-03-29T00:52:02.790898956Z [2024-03-29T00:52:02.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:51:00+00:00 exited with status success for try_number 1 2024-03-29T00:52:02.800899124Z [2024-03-29T00:52:02.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:51:00+00:00, map_index=-1, run_start_date=2024-03-29 00:52:01.877281+00:00, run_end_date=2024-03-29 00:52:02.367647+00:00, run_duration=0.490366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:52:00.710525+00:00, queued_by_job_id=2, pid=5348 2024-03-29T00:52:03.896513987Z [2024-03-29T00:52:03.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:52:03.903841931Z [2024-03-29T00:52:03.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=-1, run_start_date=2024-03-29 00:52:02.167556+00:00, run_end_date=2024-03-29 00:52:02.605458+00:00, run_duration=0.437902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:52:00.710525+00:00, queued_by_job_id=2, pid=5349 2024-03-29T00:52:04.865816331Z [2024-03-29T00:52:04.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:52:04.866456611Z [2024-03-29T00:52:04.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:51:00+00:00, run_id=scheduled__2024-03-29T00:51:00+00:00, run_start_date=2024-03-29 00:52:00.607167+00:00, run_end_date=2024-03-29 00:52:04.865953+00:00, run_duration=4.258786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:51:00+00:00, data_interval_end=2024-03-29 00:52:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:52:04.877554683Z [2024-03-29T00:52:04.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:52:00+00:00, run_after=2024-03-29T00:53:00+00:00 2024-03-29T00:52:04.924304574Z [2024-03-29T00:52:04.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:51:00+00:00 exited with status success for try_number 1 2024-03-29T00:52:04.929330353Z [2024-03-29T00:52:04.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:51:00+00:00, map_index=-1, run_start_date=2024-03-29 00:52:03.267156+00:00, run_end_date=2024-03-29 00:52:04.653278+00:00, run_duration=1.386122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:52:00.710525+00:00, queued_by_job_id=2, pid=5372 2024-03-29T00:52:05.988375782Z [2024-03-29T00:52:05.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:52:05.989214552Z [2024-03-29T00:52:05.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:51:00+00:00, run_id=scheduled__2024-03-29T00:51:00+00:00, run_start_date=2024-03-29 00:52:00.608191+00:00, run_end_date=2024-03-29 00:52:05.988737+00:00, run_duration=5.380546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:51:00+00:00, data_interval_end=2024-03-29 00:52:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:52:06.007291095Z [2024-03-29T00:52:06.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:52:00+00:00, run_after=2024-03-29T00:53:00+00:00 2024-03-29T00:52:06.064749401Z [2024-03-29T00:52:06.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:51:00+00:00 exited with status success for try_number 1 2024-03-29T00:52:06.073692903Z [2024-03-29T00:52:06.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:51:00+00:00, map_index=-1, run_start_date=2024-03-29 00:52:03.277499+00:00, run_end_date=2024-03-29 00:52:04.862237+00:00, run_duration=1.584738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:52:00.710525+00:00, queued_by_job_id=2, pid=5373 2024-03-29T00:53:00.286336956Z [2024-03-29T00:53:00.285+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:53:00+00:00, run_after=2024-03-29T00:54:00+00:00 2024-03-29T00:53:00.294289995Z [2024-03-29T00:53:00.293+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:53:00.307491897Z [2024-03-29T00:53:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:53:00+00:00, run_after=2024-03-29T00:54:00+00:00 2024-03-29T00:53:00.372585089Z [2024-03-29T00:53:00.372+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:53:00.372636198Z 2024-03-29T00:53:00.372641648Z 2024-03-29T00:53:00.372646405Z 2024-03-29T00:53:00.372840029Z [2024-03-29T00:53:00.372+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:53:00.373061772Z [2024-03-29T00:53:00.372+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:53:00.373223263Z [2024-03-29T00:53:00.373+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:53:00.373878800Z [2024-03-29T00:53:00.373+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:53:00.373936873Z 2024-03-29T00:53:00.373943886Z 2024-03-29T00:53:00.373949893Z 2024-03-29T00:53:00.377060619Z [2024-03-29T00:53:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:53:00.377295367Z [2024-03-29T00:53:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:53:00.377587690Z [2024-03-29T00:53:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:53:00.377785207Z [2024-03-29T00:53:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:53:00.378064219Z [2024-03-29T00:53:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:53:00.378253720Z [2024-03-29T00:53:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:53:00.579639724Z [2024-03-29T00:53:00.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status queued for try_number 1 2024-03-29T00:53:00.579682839Z [2024-03-29T00:53:00.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status queued for try_number 1 2024-03-29T00:53:00.579818527Z [2024-03-29T00:53:00.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status queued for try_number 1 2024-03-29T00:53:00.588641749Z [2024-03-29T00:53:00.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dc87813-4de1-4dfd-b4db-2c532135ff4b 2024-03-29T00:53:00.588797687Z [2024-03-29T00:53:00.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8606a378-01ac-408f-a7d0-0b2986d906e5 2024-03-29T00:53:00.588972755Z [2024-03-29T00:53:00.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe1daada-f3bb-4cc3-8f6a-a0090df10f03 2024-03-29T00:53:01.759921799Z [2024-03-29T00:53:01.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:53:01.760511312Z [2024-03-29T00:53:01.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:52:00+00:00, run_id=scheduled__2024-03-29T00:52:00+00:00, run_start_date=2024-03-29 00:53:00.321832+00:00, run_end_date=2024-03-29 00:53:01.759911+00:00, run_duration=1.438079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:52:00+00:00, data_interval_end=2024-03-29 00:53:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:53:01.780156260Z [2024-03-29T00:53:01.779+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:53:00+00:00, run_after=2024-03-29T00:54:00+00:00 2024-03-29T00:53:01.865609595Z [2024-03-29T00:53:01.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status success for try_number 1 2024-03-29T00:53:01.875490865Z [2024-03-29T00:53:01.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:52:00+00:00, map_index=-1, run_start_date=2024-03-29 00:53:01.101307+00:00, run_end_date=2024-03-29 00:53:01.462867+00:00, run_duration=0.36156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:53:00.374787+00:00, queued_by_job_id=2, pid=5405 2024-03-29T00:53:04.014806304Z [2024-03-29T00:53:04.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:53:04.015083886Z [2024-03-29T00:53:04.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:52:00+00:00, run_id=scheduled__2024-03-29T00:52:00+00:00, run_start_date=2024-03-29 00:53:00.323383+00:00, run_end_date=2024-03-29 00:53:04.014736+00:00, run_duration=3.691353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:52:00+00:00, data_interval_end=2024-03-29 00:53:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:53:04.025194321Z [2024-03-29T00:53:04.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:53:00+00:00, run_after=2024-03-29T00:54:00+00:00 2024-03-29T00:53:04.070142254Z [2024-03-29T00:53:04.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status success for try_number 1 2024-03-29T00:53:04.079446771Z [2024-03-29T00:53:04.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:52:00+00:00, map_index=-1, run_start_date=2024-03-29 00:53:02.332135+00:00, run_end_date=2024-03-29 00:53:03.682684+00:00, run_duration=1.350549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:53:00.374787+00:00, queued_by_job_id=2, pid=5424 2024-03-29T00:53:05.146575290Z [2024-03-29T00:53:05.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:53:05.146602569Z [2024-03-29T00:53:05.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:52:00+00:00, run_id=scheduled__2024-03-29T00:52:00+00:00, run_start_date=2024-03-29 00:53:00.324651+00:00, run_end_date=2024-03-29 00:53:05.144768+00:00, run_duration=4.820117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:52:00+00:00, data_interval_end=2024-03-29 00:53:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:53:05.182906498Z [2024-03-29T00:53:05.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:53:00+00:00, run_after=2024-03-29T00:54:00+00:00 2024-03-29T00:53:05.221560301Z [2024-03-29T00:53:05.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status success for try_number 1 2024-03-29T00:53:05.231124866Z [2024-03-29T00:53:05.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:52:00+00:00, map_index=-1, run_start_date=2024-03-29 00:53:02.166184+00:00, run_end_date=2024-03-29 00:53:04.066084+00:00, run_duration=1.8999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:53:00.374787+00:00, queued_by_job_id=2, pid=5423 2024-03-29T00:53:44.847293541Z [2024-03-29T00:53:44.846+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:54:00.517519417Z [2024-03-29T00:54:00.517+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:54:00.530096370Z [2024-03-29T00:54:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:54:00+00:00, run_after=2024-03-29T00:55:00+00:00 2024-03-29T00:54:00.537227634Z [2024-03-29T00:54:00.536+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:54:00.550114236Z [2024-03-29T00:54:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:54:00+00:00, run_after=2024-03-29T00:55:00+00:00 2024-03-29T00:54:00.623353326Z [2024-03-29T00:54:00.622+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:54:00.623393704Z 2024-03-29T00:54:00.623398075Z 2024-03-29T00:54:00.623454534Z 2024-03-29T00:54:00.623458164Z 2024-03-29T00:54:00.623475873Z [2024-03-29T00:54:00.623+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:54:00.623482739Z [2024-03-29T00:54:00.623+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:54:00.623633027Z [2024-03-29T00:54:00.623+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:54:00.623744039Z [2024-03-29T00:54:00.623+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:54:00.624395789Z [2024-03-29T00:54:00.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:54:00.624407189Z 2024-03-29T00:54:00.624411614Z 2024-03-29T00:54:00.624415767Z 2024-03-29T00:54:00.624419909Z 2024-03-29T00:54:00.628395379Z [2024-03-29T00:54:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:54:00.628434126Z [2024-03-29T00:54:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:54:00.628729182Z [2024-03-29T00:54:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:54:00.629024729Z [2024-03-29T00:54:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:54:00.629339419Z [2024-03-29T00:54:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:54:00.629506617Z [2024-03-29T00:54:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:54:00.629769983Z [2024-03-29T00:54:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:54:00.629984893Z [2024-03-29T00:54:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:54:00.964491286Z [2024-03-29T00:54:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status queued for try_number 1 2024-03-29T00:54:00.964524045Z [2024-03-29T00:54:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:53:00+00:00 exited with status queued for try_number 1 2024-03-29T00:54:00.964677213Z [2024-03-29T00:54:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:53:00+00:00 exited with status queued for try_number 1 2024-03-29T00:54:00.964814235Z [2024-03-29T00:54:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:53:00+00:00 exited with status queued for try_number 1 2024-03-29T00:54:00.976581600Z [2024-03-29T00:54:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 864e9aaf-8596-46b7-8c2a-2ba972301e0f 2024-03-29T00:54:00.976622275Z [2024-03-29T00:54:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8da8a6a2-8cb4-492c-8dd6-7a20fe271102 2024-03-29T00:54:00.978927050Z [2024-03-29T00:54:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36faf5d7-6f66-4ea3-894f-8b10961d3a2c 2024-03-29T00:54:00.979278737Z [2024-03-29T00:54:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d62d33-8ffa-456b-875e-425178e74441 2024-03-29T00:54:02.597914703Z [2024-03-29T00:54:02.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:54:02.599510277Z [2024-03-29T00:54:02.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:52:00+00:00, run_id=scheduled__2024-03-29T00:52:00+00:00, run_start_date=2024-03-29 00:54:00.562564+00:00, run_end_date=2024-03-29 00:54:02.598058+00:00, run_duration=2.035494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:52:00+00:00, data_interval_end=2024-03-29 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:54:02.613348089Z [2024-03-29T00:54:02.612+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:54:00+00:00, run_after=2024-03-29T00:56:00+00:00 2024-03-29T00:54:02.628785519Z [2024-03-29T00:54:02.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:54:02.629358343Z [2024-03-29T00:54:02.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:53:00+00:00, run_id=scheduled__2024-03-29T00:53:00+00:00, run_start_date=2024-03-29 00:54:00.564098+00:00, run_end_date=2024-03-29 00:54:02.628646+00:00, run_duration=2.064548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:53:00+00:00, data_interval_end=2024-03-29 00:54:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:54:02.661186658Z [2024-03-29T00:54:02.660+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:54:00+00:00, run_after=2024-03-29T00:55:00+00:00 2024-03-29T00:54:02.752179279Z [2024-03-29T00:54:02.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:52:00+00:00 exited with status success for try_number 1 2024-03-29T00:54:02.752211190Z [2024-03-29T00:54:02.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:53:00+00:00 exited with status success for try_number 1 2024-03-29T00:54:02.765605367Z [2024-03-29T00:54:02.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:52:00+00:00, map_index=-1, run_start_date=2024-03-29 00:54:01.537527+00:00, run_end_date=2024-03-29 00:54:02.060134+00:00, run_duration=0.522607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:54:00.625222+00:00, queued_by_job_id=2, pid=5458 2024-03-29T00:54:02.767279501Z [2024-03-29T00:54:02.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:53:00+00:00, map_index=-1, run_start_date=2024-03-29 00:54:01.687141+00:00, run_end_date=2024-03-29 00:54:02.174569+00:00, run_duration=0.487428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:54:00.625222+00:00, queued_by_job_id=2, pid=5459 2024-03-29T00:54:04.925725061Z [2024-03-29T00:54:04.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:54:04.926156038Z [2024-03-29T00:54:04.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:53:00+00:00, run_id=scheduled__2024-03-29T00:53:00+00:00, run_start_date=2024-03-29 00:54:00.566340+00:00, run_end_date=2024-03-29 00:54:04.925680+00:00, run_duration=4.35934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:53:00+00:00, data_interval_end=2024-03-29 00:54:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:54:04.940513863Z [2024-03-29T00:54:04.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:54:00+00:00, run_after=2024-03-29T00:55:00+00:00 2024-03-29T00:54:04.951491232Z [2024-03-29T00:54:04.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:54:04.952003794Z [2024-03-29T00:54:04.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:53:00+00:00, run_id=scheduled__2024-03-29T00:53:00+00:00, run_start_date=2024-03-29 00:54:00.565260+00:00, run_end_date=2024-03-29 00:54:04.951538+00:00, run_duration=4.386278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:53:00+00:00, data_interval_end=2024-03-29 00:54:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:54:04.974495581Z [2024-03-29T00:54:04.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:54:00+00:00, run_after=2024-03-29T00:55:00+00:00 2024-03-29T00:54:05.024212073Z [2024-03-29T00:54:05.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:53:00+00:00 exited with status success for try_number 1 2024-03-29T00:54:05.024306240Z [2024-03-29T00:54:05.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:53:00+00:00 exited with status success for try_number 1 2024-03-29T00:54:05.032699610Z [2024-03-29T00:54:05.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:53:00+00:00, map_index=-1, run_start_date=2024-03-29 00:54:02.897094+00:00, run_end_date=2024-03-29 00:54:04.594819+00:00, run_duration=1.697725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:54:00.625222+00:00, queued_by_job_id=2, pid=5482 2024-03-29T00:54:05.032940734Z [2024-03-29T00:54:05.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:53:00+00:00, map_index=-1, run_start_date=2024-03-29 00:54:02.950830+00:00, run_end_date=2024-03-29 00:54:04.325444+00:00, run_duration=1.374614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:54:00.625222+00:00, queued_by_job_id=2, pid=5483 2024-03-29T00:55:00.533504020Z [2024-03-29T00:55:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:55:00+00:00, run_after=2024-03-29T00:56:00+00:00 2024-03-29T00:55:00.546203788Z [2024-03-29T00:55:00.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:55:00+00:00, run_after=2024-03-29T00:56:00+00:00 2024-03-29T00:55:00.558549939Z [2024-03-29T00:55:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:55:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:55:00.565647501Z [2024-03-29T00:55:00.565+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:55:00.685130504Z [2024-03-29T00:55:00.683+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:55:00.685165442Z 2024-03-29T00:55:00.685189097Z 2024-03-29T00:55:00.685193452Z 2024-03-29T00:55:00.685197557Z 2024-03-29T00:55:00.685500834Z [2024-03-29T00:55:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:55:00.685734764Z [2024-03-29T00:55:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:55:00.685866594Z [2024-03-29T00:55:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:55:00.685969784Z [2024-03-29T00:55:00.685+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:55:00.686755421Z [2024-03-29T00:55:00.686+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:55:00.686772889Z 2024-03-29T00:55:00.686776998Z 2024-03-29T00:55:00.686780393Z 2024-03-29T00:55:00.686783619Z 2024-03-29T00:55:00.692068200Z [2024-03-29T00:55:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T00:55:00.692247220Z [2024-03-29T00:55:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:55:00.692548514Z [2024-03-29T00:55:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:55:00.692635592Z [2024-03-29T00:55:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:55:00.692841643Z [2024-03-29T00:55:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:55:00.692902248Z [2024-03-29T00:55:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:55:00.693132935Z [2024-03-29T00:55:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:55:00.693185830Z [2024-03-29T00:55:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:55:01.047335340Z [2024-03-29T00:55:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:55:01.047396749Z [2024-03-29T00:55:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status queued for try_number 1 2024-03-29T00:55:01.047489799Z [2024-03-29T00:55:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status queued for try_number 1 2024-03-29T00:55:01.047615071Z [2024-03-29T00:55:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status queued for try_number 1 2024-03-29T00:55:01.071206789Z [2024-03-29T00:55:01.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 542b6a4b-c326-41dd-b469-8cbe398a5305 2024-03-29T00:55:01.071387192Z [2024-03-29T00:55:01.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20689fdb-e380-48d9-9ff0-c8ef6b034b61 2024-03-29T00:55:01.071570585Z [2024-03-29T00:55:01.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56935533-282d-4568-9789-1f70e1574a96 2024-03-29T00:55:01.071739787Z [2024-03-29T00:55:01.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63a62060-ccad-4dff-bac3-84838f7e4d23 2024-03-29T00:55:02.341009807Z [2024-03-29T00:55:02.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:55:02.341325481Z [2024-03-29T00:55:02.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:54:00+00:00, run_id=scheduled__2024-03-29T00:54:00+00:00, run_start_date=2024-03-29 00:55:00.583092+00:00, run_end_date=2024-03-29 00:55:02.340900+00:00, run_duration=1.757808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:54:00+00:00, data_interval_end=2024-03-29 00:55:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:55:02.354867979Z [2024-03-29T00:55:02.354+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:55:00+00:00, run_after=2024-03-29T00:56:00+00:00 2024-03-29T00:55:02.413242779Z [2024-03-29T00:55:02.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status success for try_number 1 2024-03-29T00:55:02.431214025Z [2024-03-29T00:55:02.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:54:00+00:00, map_index=-1, run_start_date=2024-03-29 00:55:01.644782+00:00, run_end_date=2024-03-29 00:55:02.155050+00:00, run_duration=0.510268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:55:00.687882+00:00, queued_by_job_id=2, pid=5516 2024-03-29T00:55:04.671344720Z [2024-03-29T00:55:04.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:55:04.671701440Z [2024-03-29T00:55:04.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:54:00+00:00, run_id=scheduled__2024-03-29T00:54:00+00:00, run_start_date=2024-03-29 00:55:00.584568+00:00, run_end_date=2024-03-29 00:55:04.671178+00:00, run_duration=4.08661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:54:00+00:00, data_interval_end=2024-03-29 00:55:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:55:04.690786161Z [2024-03-29T00:55:04.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:55:00+00:00, run_after=2024-03-29T00:56:00+00:00 2024-03-29T00:55:04.734747262Z [2024-03-29T00:55:04.732+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:55:04.734785618Z 2024-03-29T00:55:04.734791054Z [2024-03-29T00:55:04.732+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:55:04.734795542Z [2024-03-29T00:55:04.733+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:55:04.734799095Z 2024-03-29T00:55:04.738259021Z [2024-03-29T00:55:04.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T00:55:04.738289459Z [2024-03-29T00:55:04.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:55:04.866990591Z [2024-03-29T00:55:04.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:55:04.867371876Z [2024-03-29T00:55:04.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:55:04.867767524Z [2024-03-29T00:55:04.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status success for try_number 1 2024-03-29T00:55:04.887176043Z [2024-03-29T00:55:04.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56a75fe0-641f-4737-832d-20f560b8710a 2024-03-29T00:55:04.887482046Z [2024-03-29T00:55:04.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:54:00+00:00, map_index=-1, run_start_date=2024-03-29 00:55:02.902020+00:00, run_end_date=2024-03-29 00:55:04.415963+00:00, run_duration=1.513943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:55:00.687882+00:00, queued_by_job_id=2, pid=5538 2024-03-29T00:55:04.887994471Z [2024-03-29T00:55:04.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=-1, run_start_date=2024-03-29 00:55:03.168482+00:00, run_end_date=2024-03-29 00:55:03.666543+00:00, run_duration=0.498061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:55:00.687882+00:00, queued_by_job_id=2, pid=5542 2024-03-29T00:55:04.941809927Z [2024-03-29T00:55:04.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:55:04.942748844Z [2024-03-29T00:55:04.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:54:00+00:00, run_id=scheduled__2024-03-29T00:54:00+00:00, run_start_date=2024-03-29 00:55:00.585812+00:00, run_end_date=2024-03-29 00:55:04.942235+00:00, run_duration=4.356423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:54:00+00:00, data_interval_end=2024-03-29 00:55:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:55:04.959219079Z [2024-03-29T00:55:04.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:55:00+00:00, run_after=2024-03-29T00:56:00+00:00 2024-03-29T00:55:05.080027124Z [2024-03-29T00:55:05.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status success for try_number 1 2024-03-29T00:55:05.086713626Z [2024-03-29T00:55:05.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:54:00+00:00, map_index=-1, run_start_date=2024-03-29 00:55:03.054822+00:00, run_end_date=2024-03-29 00:55:04.813568+00:00, run_duration=1.758746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:55:00.687882+00:00, queued_by_job_id=2, pid=5541 2024-03-29T00:55:07.568800505Z [2024-03-29T00:55:07.568+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:55:07.568828146Z 2024-03-29T00:55:07.569771577Z [2024-03-29T00:55:07.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:55:07.570745625Z [2024-03-29T00:55:07.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:55:07.570761156Z 2024-03-29T00:55:07.574131556Z [2024-03-29T00:55:07.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T00:55:07.574376582Z [2024-03-29T00:55:07.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T00:55:07.657094168Z [2024-03-29T00:55:07.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:55:07.657148612Z [2024-03-29T00:55:07.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:55:07.663752774Z [2024-03-29T00:55:07.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 938157cf-3300-456c-b214-81ea254bb106 2024-03-29T00:55:07.664163311Z [2024-03-29T00:55:07.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=-1, run_start_date=2024-03-29 00:55:06.796569+00:00, run_end_date=2024-03-29 00:55:07.128121+00:00, run_duration=0.331552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:55:04.734240+00:00, queued_by_job_id=2, pid=5565 2024-03-29T00:55:09.708791692Z [2024-03-29T00:55:09.708+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T00:55:09.708840664Z 2024-03-29T00:55:09.708847172Z [2024-03-29T00:55:09.708+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:55:09.709343461Z [2024-03-29T00:55:09.709+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:55:09.709356205Z 2024-03-29T00:55:09.711679264Z [2024-03-29T00:55:09.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:55:09.711756981Z [2024-03-29T00:55:09.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T00:55:09.782558465Z [2024-03-29T00:55:09.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status queued for try_number 1 2024-03-29T00:55:09.782656289Z [2024-03-29T00:55:09.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:55:09.790392749Z [2024-03-29T00:55:09.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88d7e0bf-1b7a-4a9a-925a-3bcc4c427550 2024-03-29T00:55:09.790986094Z [2024-03-29T00:55:09.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=0, run_start_date=2024-03-29 00:55:09.296419+00:00, run_end_date=2024-03-29 00:55:09.610948+00:00, run_duration=0.314529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:55:07.571318+00:00, queued_by_job_id=2, pid=5573 2024-03-29T00:55:11.995561703Z [2024-03-29T00:55:11.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:55:11.996162735Z [2024-03-29T00:55:11.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:50:00+00:00, run_id=scheduled__2024-03-29T00:50:00+00:00, run_start_date=2024-03-29 00:55:00.581481+00:00, run_end_date=2024-03-29 00:55:11.995755+00:00, run_duration=11.414274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:50:00+00:00, data_interval_end=2024-03-29 00:55:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T00:55:12.003157049Z [2024-03-29T00:55:12.002+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:55:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:55:12.033716585Z [2024-03-29T00:55:12.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:50:00+00:00 exited with status success for try_number 1 2024-03-29T00:55:12.039667043Z [2024-03-29T00:55:12.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:50:00+00:00, map_index=-1, run_start_date=2024-03-29 00:55:11.308578+00:00, run_end_date=2024-03-29 00:55:11.630968+00:00, run_duration=0.32239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:55:09.709620+00:00, queued_by_job_id=2, pid=5581 2024-03-29T00:56:00.451407502Z [2024-03-29T00:56:00.450+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:56:00.457771213Z [2024-03-29T00:56:00.457+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:56:00.468664574Z [2024-03-29T00:56:00.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:56:00+00:00, run_after=2024-03-29T00:57:00+00:00 2024-03-29T00:56:00.479996755Z [2024-03-29T00:56:00.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:56:00+00:00, run_after=2024-03-29T00:57:00+00:00 2024-03-29T00:56:00.583364432Z [2024-03-29T00:56:00.582+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:56:00.583396624Z 2024-03-29T00:56:00.583403675Z 2024-03-29T00:56:00.583409722Z 2024-03-29T00:56:00.583415903Z 2024-03-29T00:56:00.583722525Z [2024-03-29T00:56:00.583+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:56:00.584139669Z [2024-03-29T00:56:00.583+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:56:00.584406931Z [2024-03-29T00:56:00.584+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:56:00.584628128Z [2024-03-29T00:56:00.584+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:56:00.585290685Z [2024-03-29T00:56:00.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:56:00.585313574Z 2024-03-29T00:56:00.585317503Z 2024-03-29T00:56:00.585321193Z 2024-03-29T00:56:00.585324649Z 2024-03-29T00:56:00.590356908Z [2024-03-29T00:56:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:56:00.590696246Z [2024-03-29T00:56:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:56:00.591213738Z [2024-03-29T00:56:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:56:00.591615978Z [2024-03-29T00:56:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:56:00.592183986Z [2024-03-29T00:56:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:56:00.592521546Z [2024-03-29T00:56:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:56:00.593005740Z [2024-03-29T00:56:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:56:00.593308226Z [2024-03-29T00:56:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:56:01.084693652Z [2024-03-29T00:56:01.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status queued for try_number 1 2024-03-29T00:56:01.084941779Z [2024-03-29T00:56:01.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status queued for try_number 1 2024-03-29T00:56:01.085075201Z [2024-03-29T00:56:01.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status queued for try_number 1 2024-03-29T00:56:01.085220405Z [2024-03-29T00:56:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status queued for try_number 1 2024-03-29T00:56:01.094780043Z [2024-03-29T00:56:01.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73aae440-b9fe-436a-8dd0-f210f47d44c2 2024-03-29T00:56:01.095082017Z [2024-03-29T00:56:01.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67a1d287-8962-49af-aba6-56faefbab7f0 2024-03-29T00:56:01.095274629Z [2024-03-29T00:56:01.095+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7834315-a327-48e3-8ecd-aa4c81331e96 2024-03-29T00:56:01.095467207Z [2024-03-29T00:56:01.095+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f6f395c-756f-43ce-8f8a-632448659173 2024-03-29T00:56:02.336682689Z [2024-03-29T00:56:02.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:56:02.337131262Z [2024-03-29T00:56:02.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:54:00+00:00, run_id=scheduled__2024-03-29T00:54:00+00:00, run_start_date=2024-03-29 00:56:00.490858+00:00, run_end_date=2024-03-29 00:56:02.336622+00:00, run_duration=1.845764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:54:00+00:00, data_interval_end=2024-03-29 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:56:02.347907732Z [2024-03-29T00:56:02.347+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:56:00+00:00, run_after=2024-03-29T00:58:00+00:00 2024-03-29T00:56:02.419903377Z [2024-03-29T00:56:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:54:00+00:00 exited with status success for try_number 1 2024-03-29T00:56:02.426952259Z [2024-03-29T00:56:02.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:54:00+00:00, map_index=-1, run_start_date=2024-03-29 00:56:01.661884+00:00, run_end_date=2024-03-29 00:56:02.187107+00:00, run_duration=0.525223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:56:00.586290+00:00, queued_by_job_id=2, pid=5605 2024-03-29T00:56:03.415489755Z [2024-03-29T00:56:03.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:56:03.416020055Z [2024-03-29T00:56:03.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:55:00+00:00, run_id=scheduled__2024-03-29T00:55:00+00:00, run_start_date=2024-03-29 00:56:00.492496+00:00, run_end_date=2024-03-29 00:56:03.415558+00:00, run_duration=2.923062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:55:00+00:00, data_interval_end=2024-03-29 00:56:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:56:03.434808927Z [2024-03-29T00:56:03.434+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:56:00+00:00, run_after=2024-03-29T00:57:00+00:00 2024-03-29T00:56:03.505623896Z [2024-03-29T00:56:03.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status success for try_number 1 2024-03-29T00:56:03.511670153Z [2024-03-29T00:56:03.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:55:00+00:00, map_index=-1, run_start_date=2024-03-29 00:56:01.776827+00:00, run_end_date=2024-03-29 00:56:02.412472+00:00, run_duration=0.635645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:56:00.586290+00:00, queued_by_job_id=2, pid=5607 2024-03-29T00:56:04.584948490Z [2024-03-29T00:56:04.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:56:04.585642717Z [2024-03-29T00:56:04.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:55:00+00:00, run_id=scheduled__2024-03-29T00:55:00+00:00, run_start_date=2024-03-29 00:56:00.494056+00:00, run_end_date=2024-03-29 00:56:04.584751+00:00, run_duration=4.090695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:55:00+00:00, data_interval_end=2024-03-29 00:56:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:56:04.596484315Z [2024-03-29T00:56:04.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:56:00+00:00, run_after=2024-03-29T00:57:00+00:00 2024-03-29T00:56:05.695376191Z [2024-03-29T00:56:05.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:56:05.699060949Z [2024-03-29T00:56:05.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:55:00+00:00, run_id=scheduled__2024-03-29T00:55:00+00:00, run_start_date=2024-03-29 00:56:00.499093+00:00, run_end_date=2024-03-29 00:56:05.698503+00:00, run_duration=5.19941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:55:00+00:00, data_interval_end=2024-03-29 00:56:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:56:05.714697118Z [2024-03-29T00:56:05.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:56:00+00:00, run_after=2024-03-29T00:57:00+00:00 2024-03-29T00:56:05.774668839Z [2024-03-29T00:56:05.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status success for try_number 1 2024-03-29T00:56:05.774706935Z [2024-03-29T00:56:05.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status success for try_number 1 2024-03-29T00:56:05.784482977Z [2024-03-29T00:56:05.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:55:00+00:00, map_index=-1, run_start_date=2024-03-29 00:56:03.054449+00:00, run_end_date=2024-03-29 00:56:04.501667+00:00, run_duration=1.447218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:56:00.586290+00:00, queued_by_job_id=2, pid=5630 2024-03-29T00:56:05.784509498Z [2024-03-29T00:56:05.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:55:00+00:00, map_index=-1, run_start_date=2024-03-29 00:56:02.954521+00:00, run_end_date=2024-03-29 00:56:04.705822+00:00, run_duration=1.751301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:56:00.586290+00:00, queued_by_job_id=2, pid=5629 2024-03-29T00:57:00.237171409Z [2024-03-29T00:57:00.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:57:00+00:00, run_after=2024-03-29T00:58:00+00:00 2024-03-29T00:57:00.267507463Z [2024-03-29T00:57:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:57:00+00:00, run_after=2024-03-29T00:58:00+00:00 2024-03-29T00:57:00.275659578Z [2024-03-29T00:57:00.275+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:57:00.371134216Z [2024-03-29T00:57:00.370+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:57:00.371190151Z 2024-03-29T00:57:00.371196667Z 2024-03-29T00:57:00.371202172Z 2024-03-29T00:57:00.371552368Z [2024-03-29T00:57:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:57:00.371887097Z [2024-03-29T00:57:00.371+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:57:00.372213306Z [2024-03-29T00:57:00.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:57:00.373162146Z [2024-03-29T00:57:00.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:57:00.373178415Z 2024-03-29T00:57:00.373183964Z 2024-03-29T00:57:00.373189339Z 2024-03-29T00:57:00.378054945Z [2024-03-29T00:57:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:57:00.378347778Z [2024-03-29T00:57:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:57:00.378773230Z [2024-03-29T00:57:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:57:00.379016341Z [2024-03-29T00:57:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:57:00.379380499Z [2024-03-29T00:57:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:57:00.379610720Z [2024-03-29T00:57:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:57:00.551432561Z [2024-03-29T00:57:00.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status queued for try_number 1 2024-03-29T00:57:00.551520905Z [2024-03-29T00:57:00.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status queued for try_number 1 2024-03-29T00:57:00.551653638Z [2024-03-29T00:57:00.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status queued for try_number 1 2024-03-29T00:57:00.558728118Z [2024-03-29T00:57:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 982107fe-fb17-4941-ab4e-12c73146e049 2024-03-29T00:57:00.558878617Z [2024-03-29T00:57:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fb3f246-fd69-4f51-81c4-d242159bfe21 2024-03-29T00:57:00.559037389Z [2024-03-29T00:57:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to e97ead38-4ec9-4617-a774-84ed3c336300 2024-03-29T00:57:01.731207623Z [2024-03-29T00:57:01.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:57:01.732077502Z [2024-03-29T00:57:01.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:56:00+00:00, run_id=scheduled__2024-03-29T00:56:00+00:00, run_start_date=2024-03-29 00:57:00.287688+00:00, run_end_date=2024-03-29 00:57:01.731294+00:00, run_duration=1.443606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:56:00+00:00, data_interval_end=2024-03-29 00:57:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:57:01.758160715Z [2024-03-29T00:57:01.757+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:57:00+00:00, run_after=2024-03-29T00:58:00+00:00 2024-03-29T00:57:02.978034356Z [2024-03-29T00:57:02.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status success for try_number 1 2024-03-29T00:57:02.984956100Z [2024-03-29T00:57:02.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:56:00+00:00, map_index=-1, run_start_date=2024-03-29 00:57:01.268728+00:00, run_end_date=2024-03-29 00:57:01.703574+00:00, run_duration=0.434846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:57:00.374264+00:00, queued_by_job_id=2, pid=5662 2024-03-29T00:57:04.030796960Z [2024-03-29T00:57:04.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:57:04.031197936Z [2024-03-29T00:57:04.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:56:00+00:00, run_id=scheduled__2024-03-29T00:56:00+00:00, run_start_date=2024-03-29 00:57:00.290011+00:00, run_end_date=2024-03-29 00:57:04.030874+00:00, run_duration=3.740863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:56:00+00:00, data_interval_end=2024-03-29 00:57:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:57:04.040343284Z [2024-03-29T00:57:04.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:57:00+00:00, run_after=2024-03-29T00:58:00+00:00 2024-03-29T00:57:04.077049751Z [2024-03-29T00:57:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status success for try_number 1 2024-03-29T00:57:04.081935193Z [2024-03-29T00:57:04.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:56:00+00:00, map_index=-1, run_start_date=2024-03-29 00:57:02.227411+00:00, run_end_date=2024-03-29 00:57:03.859960+00:00, run_duration=1.632549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:57:00.374264+00:00, queued_by_job_id=2, pid=5680 2024-03-29T00:57:05.348281053Z [2024-03-29T00:57:05.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:57:05.348661799Z [2024-03-29T00:57:05.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:56:00+00:00, run_id=scheduled__2024-03-29T00:56:00+00:00, run_start_date=2024-03-29 00:57:00.288927+00:00, run_end_date=2024-03-29 00:57:05.348206+00:00, run_duration=5.059279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:56:00+00:00, data_interval_end=2024-03-29 00:57:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:57:05.364985290Z [2024-03-29T00:57:05.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:57:00+00:00, run_after=2024-03-29T00:58:00+00:00 2024-03-29T00:57:05.402009127Z [2024-03-29T00:57:05.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status success for try_number 1 2024-03-29T00:57:05.412722034Z [2024-03-29T00:57:05.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:56:00+00:00, map_index=-1, run_start_date=2024-03-29 00:57:02.374040+00:00, run_end_date=2024-03-29 00:57:04.281112+00:00, run_duration=1.907072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:57:00.374264+00:00, queued_by_job_id=2, pid=5681 2024-03-29T00:58:00.116561075Z [2024-03-29T00:58:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:58:00+00:00, run_after=2024-03-29T00:59:00+00:00 2024-03-29T00:58:00.130107869Z [2024-03-29T00:58:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:58:00+00:00, run_after=2024-03-29T00:59:00+00:00 2024-03-29T00:58:00.136805610Z [2024-03-29T00:58:00.136+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:58:00.142428347Z [2024-03-29T00:58:00.142+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:58:00.209956394Z [2024-03-29T00:58:00.209+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T00:58:00.209981096Z 2024-03-29T00:58:00.209988105Z 2024-03-29T00:58:00.209993185Z 2024-03-29T00:58:00.209998975Z 2024-03-29T00:58:00.210305575Z [2024-03-29T00:58:00.210+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T00:58:00.210417468Z [2024-03-29T00:58:00.210+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:58:00.210541122Z [2024-03-29T00:58:00.210+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:58:00.210676932Z [2024-03-29T00:58:00.210+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:58:00.211215384Z [2024-03-29T00:58:00.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:58:00.211227663Z 2024-03-29T00:58:00.211232869Z 2024-03-29T00:58:00.211237516Z 2024-03-29T00:58:00.211242186Z 2024-03-29T00:58:00.214584032Z [2024-03-29T00:58:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:58:00.214633115Z [2024-03-29T00:58:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T00:58:00.214804117Z [2024-03-29T00:58:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:58:00.214883579Z [2024-03-29T00:58:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:58:00.215066819Z [2024-03-29T00:58:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:58:00.215131582Z [2024-03-29T00:58:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:58:00.215340442Z [2024-03-29T00:58:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:58:00.215375529Z [2024-03-29T00:58:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:58:00.624889715Z [2024-03-29T00:58:00.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status queued for try_number 1 2024-03-29T00:58:00.625123801Z [2024-03-29T00:58:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:57:00+00:00 exited with status queued for try_number 1 2024-03-29T00:58:00.625342080Z [2024-03-29T00:58:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:57:00+00:00 exited with status queued for try_number 1 2024-03-29T00:58:00.625718876Z [2024-03-29T00:58:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:57:00+00:00 exited with status queued for try_number 1 2024-03-29T00:58:00.644344268Z [2024-03-29T00:58:00.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18828e81-b83e-4529-a99f-2de78d6499c1 2024-03-29T00:58:00.647531168Z [2024-03-29T00:58:00.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffe81389-91a7-41bc-b605-80f89594677c 2024-03-29T00:58:00.647863473Z [2024-03-29T00:58:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 129143cd-600d-415b-9561-206020c0391f 2024-03-29T00:58:00.648143242Z [2024-03-29T00:58:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f32c8d5-5261-4b9d-b5a4-0ac77066aa82 2024-03-29T00:58:02.019496064Z [2024-03-29T00:58:02.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:58:02.022507669Z [2024-03-29T00:58:02.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:56:00+00:00, run_id=scheduled__2024-03-29T00:56:00+00:00, run_start_date=2024-03-29 00:58:00.151765+00:00, run_end_date=2024-03-29 00:58:02.019433+00:00, run_duration=1.867668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:56:00+00:00, data_interval_end=2024-03-29 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T00:58:02.043660383Z [2024-03-29T00:58:02.042+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T00:58:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:58:02.302187758Z [2024-03-29T00:58:02.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:56:00+00:00 exited with status success for try_number 1 2024-03-29T00:58:02.319652997Z [2024-03-29T00:58:02.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:56:00+00:00, map_index=-1, run_start_date=2024-03-29 00:58:01.244260+00:00, run_end_date=2024-03-29 00:58:01.823770+00:00, run_duration=0.57951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:58:00.212032+00:00, queued_by_job_id=2, pid=5714 2024-03-29T00:58:03.418412692Z [2024-03-29T00:58:03.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:58:03.423303250Z [2024-03-29T00:58:03.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:57:00+00:00, run_id=scheduled__2024-03-29T00:57:00+00:00, run_start_date=2024-03-29 00:58:00.152872+00:00, run_end_date=2024-03-29 00:58:03.418314+00:00, run_duration=3.265442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:57:00+00:00, data_interval_end=2024-03-29 00:58:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:58:03.451794268Z [2024-03-29T00:58:03.451+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:58:00+00:00, run_after=2024-03-29T00:59:00+00:00 2024-03-29T00:58:03.547543998Z [2024-03-29T00:58:03.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:57:00+00:00 exited with status success for try_number 1 2024-03-29T00:58:03.553848402Z [2024-03-29T00:58:03.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:57:00+00:00, map_index=-1, run_start_date=2024-03-29 00:58:01.577830+00:00, run_end_date=2024-03-29 00:58:02.414314+00:00, run_duration=0.836484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:58:00.212032+00:00, queued_by_job_id=2, pid=5715 2024-03-29T00:58:05.698571523Z [2024-03-29T00:58:05.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:58:05.698599006Z [2024-03-29T00:58:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:57:00+00:00, run_id=scheduled__2024-03-29T00:57:00+00:00, run_start_date=2024-03-29 00:58:00.153893+00:00, run_end_date=2024-03-29 00:58:05.697471+00:00, run_duration=5.543578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:57:00+00:00, data_interval_end=2024-03-29 00:58:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:58:05.710583869Z [2024-03-29T00:58:05.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:58:00+00:00, run_after=2024-03-29T00:59:00+00:00 2024-03-29T00:58:05.718557799Z [2024-03-29T00:58:05.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:58:05.718586506Z [2024-03-29T00:58:05.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:57:00+00:00, run_id=scheduled__2024-03-29T00:57:00+00:00, run_start_date=2024-03-29 00:58:00.155460+00:00, run_end_date=2024-03-29 00:58:05.715746+00:00, run_duration=5.560286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:57:00+00:00, data_interval_end=2024-03-29 00:58:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:58:05.727085369Z [2024-03-29T00:58:05.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:58:00+00:00, run_after=2024-03-29T00:59:00+00:00 2024-03-29T00:58:05.759756518Z [2024-03-29T00:58:05.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:57:00+00:00 exited with status success for try_number 1 2024-03-29T00:58:05.760011567Z [2024-03-29T00:58:05.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:57:00+00:00 exited with status success for try_number 1 2024-03-29T00:58:05.766275495Z [2024-03-29T00:58:05.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:57:00+00:00, map_index=-1, run_start_date=2024-03-29 00:58:03.272357+00:00, run_end_date=2024-03-29 00:58:04.843233+00:00, run_duration=1.570876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:58:00.212032+00:00, queued_by_job_id=2, pid=5733 2024-03-29T00:58:05.766696425Z [2024-03-29T00:58:05.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:57:00+00:00, map_index=-1, run_start_date=2024-03-29 00:58:03.644609+00:00, run_end_date=2024-03-29 00:58:05.237574+00:00, run_duration=1.592965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:58:00.212032+00:00, queued_by_job_id=2, pid=5744 2024-03-29T00:58:44.944149218Z [2024-03-29T00:58:44.943+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T00:59:00.750402850Z [2024-03-29T00:59:00.749+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T00:59:00.768350183Z [2024-03-29T00:59:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:59:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:59:00.783721606Z [2024-03-29T00:59:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:59:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:59:00.874298711Z [2024-03-29T00:59:00.873+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T00:59:00.874389754Z 2024-03-29T00:59:00.874396156Z 2024-03-29T00:59:00.874418829Z 2024-03-29T00:59:00.874480579Z [2024-03-29T00:59:00.874+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T00:59:00.874582895Z [2024-03-29T00:59:00.874+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:59:00.874777985Z [2024-03-29T00:59:00.874+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T00:59:00.875726222Z [2024-03-29T00:59:00.875+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T00:59:00.875742377Z 2024-03-29T00:59:00.875748336Z 2024-03-29T00:59:00.875753298Z 2024-03-29T00:59:00.882204150Z [2024-03-29T00:59:00.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:59:00.882386962Z [2024-03-29T00:59:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T00:59:00.882971143Z [2024-03-29T00:59:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:59:00.883195595Z [2024-03-29T00:59:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T00:59:00.883555484Z [2024-03-29T00:59:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T00:59:00.883791587Z [2024-03-29T00:59:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T00:59:01.187958673Z [2024-03-29T00:59:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status queued for try_number 1 2024-03-29T00:59:01.188111226Z [2024-03-29T00:59:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status queued for try_number 1 2024-03-29T00:59:01.188278835Z [2024-03-29T00:59:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status queued for try_number 1 2024-03-29T00:59:01.198658982Z [2024-03-29T00:59:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to acbe78cd-d10f-4876-9d00-72326c90f7e9 2024-03-29T00:59:01.199097835Z [2024-03-29T00:59:01.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to a938decf-7ee4-4236-9f5e-f1eed001ac7b 2024-03-29T00:59:01.199513426Z [2024-03-29T00:59:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to a962bac4-7eea-4fa3-bea7-a4068134835d 2024-03-29T00:59:02.806978917Z [2024-03-29T00:59:02.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:59:02.807395652Z [2024-03-29T00:59:02.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:58:00+00:00, run_id=scheduled__2024-03-29T00:58:00+00:00, run_start_date=2024-03-29 00:59:00.796122+00:00, run_end_date=2024-03-29 00:59:02.806897+00:00, run_duration=2.010775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:58:00+00:00, data_interval_end=2024-03-29 00:59:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T00:59:02.827043489Z [2024-03-29T00:59:02.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T00:59:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:59:02.905638230Z [2024-03-29T00:59:02.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status success for try_number 1 2024-03-29T00:59:02.912080522Z [2024-03-29T00:59:02.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:58:00+00:00, map_index=-1, run_start_date=2024-03-29 00:59:01.773662+00:00, run_end_date=2024-03-29 00:59:02.199074+00:00, run_duration=0.425412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:59:00.877033+00:00, queued_by_job_id=2, pid=5771 2024-03-29T00:59:06.208238331Z [2024-03-29T00:59:06.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:59:06.208595031Z [2024-03-29T00:59:06.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:58:00+00:00, run_id=scheduled__2024-03-29T00:58:00+00:00, run_start_date=2024-03-29 00:59:00.798985+00:00, run_end_date=2024-03-29 00:59:06.208077+00:00, run_duration=5.409092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:58:00+00:00, data_interval_end=2024-03-29 00:59:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T00:59:06.218531151Z [2024-03-29T00:59:06.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:59:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:59:06.233038933Z [2024-03-29T00:59:06.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T00:59:06.233367099Z [2024-03-29T00:59:06.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:58:00+00:00, run_id=scheduled__2024-03-29T00:58:00+00:00, run_start_date=2024-03-29 00:59:00.797536+00:00, run_end_date=2024-03-29 00:59:06.232911+00:00, run_duration=5.435375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:58:00+00:00, data_interval_end=2024-03-29 00:59:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T00:59:06.264210876Z [2024-03-29T00:59:06.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T00:59:00+00:00, run_after=2024-03-29T01:00:00+00:00 2024-03-29T00:59:06.305555472Z [2024-03-29T00:59:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status success for try_number 1 2024-03-29T00:59:06.305950559Z [2024-03-29T00:59:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status success for try_number 1 2024-03-29T00:59:06.314279254Z [2024-03-29T00:59:06.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:58:00+00:00, map_index=-1, run_start_date=2024-03-29 00:59:02.683849+00:00, run_end_date=2024-03-29 00:59:05.589151+00:00, run_duration=2.905302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:59:00.877033+00:00, queued_by_job_id=2, pid=5784 2024-03-29T00:59:06.314428461Z [2024-03-29T00:59:06.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:58:00+00:00, map_index=-1, run_start_date=2024-03-29 00:59:03.284065+00:00, run_end_date=2024-03-29 00:59:05.371584+00:00, run_duration=2.087519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 00:59:00.877033+00:00, queued_by_job_id=2, pid=5795 2024-03-29T01:00:00.063881133Z [2024-03-29T01:00:00.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:00:00.076893525Z [2024-03-29T01:00:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:01:00+00:00 2024-03-29T01:00:00.091322943Z [2024-03-29T01:00:00.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:01:00+00:00 2024-03-29T01:00:00.106717703Z [2024-03-29T01:00:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:05:00+00:00 2024-03-29T01:00:00.113964489Z [2024-03-29T01:00:00.113+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:00:00.259059554Z [2024-03-29T01:00:00.258+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:00:00.259095541Z 2024-03-29T01:00:00.259102714Z 2024-03-29T01:00:00.259112898Z 2024-03-29T01:00:00.259119329Z 2024-03-29T01:00:00.259125859Z 2024-03-29T01:00:00.259422603Z [2024-03-29T01:00:00.258+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:00:00.260057636Z [2024-03-29T01:00:00.259+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:00:00.260562343Z [2024-03-29T01:00:00.260+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:00:00.260973957Z [2024-03-29T01:00:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:00:00.261370811Z [2024-03-29T01:00:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:00:00.262638470Z [2024-03-29T01:00:00.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:00:00.262659654Z 2024-03-29T01:00:00.262666740Z 2024-03-29T01:00:00.262673318Z 2024-03-29T01:00:00.262679573Z 2024-03-29T01:00:00.262685571Z 2024-03-29T01:00:00.268771015Z [2024-03-29T01:00:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:00:00.269130219Z [2024-03-29T01:00:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:00:00.269502268Z [2024-03-29T01:00:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:00:00.269777748Z [2024-03-29T01:00:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:00:00.270134060Z [2024-03-29T01:00:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:00:00.270356677Z [2024-03-29T01:00:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:00:00.270755320Z [2024-03-29T01:00:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:00:00.270990359Z [2024-03-29T01:00:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:00:00.271621971Z [2024-03-29T01:00:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:00:00.272065456Z [2024-03-29T01:00:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:00:00.997945844Z [2024-03-29T01:00:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:00.998065079Z [2024-03-29T01:00:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:00.998206912Z [2024-03-29T01:00:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:59:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:00.998425168Z [2024-03-29T01:00:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:59:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:00.998588511Z [2024-03-29T01:00:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:59:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:01.018579421Z [2024-03-29T01:00:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a404f7e-3470-42b4-bce2-160ba5e378a5 2024-03-29T01:00:01.018969459Z [2024-03-29T01:00:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 638e3784-2990-49f6-9e83-e9106e03fecc 2024-03-29T01:00:01.019338838Z [2024-03-29T01:00:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35f542d1-ab4b-4723-8520-afa0caeef751 2024-03-29T01:00:01.019653853Z [2024-03-29T01:00:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a913929-13a7-41e4-88cb-2290e309c479 2024-03-29T01:00:01.019975038Z [2024-03-29T01:00:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to c76d9d39-675d-475c-97ab-5aa3502f3d2f 2024-03-29T01:00:02.376052110Z [2024-03-29T01:00:02.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:00:02.376729988Z [2024-03-29T01:00:02.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 00:58:00+00:00, run_id=scheduled__2024-03-29T00:58:00+00:00, run_start_date=2024-03-29 01:00:00.124751+00:00, run_end_date=2024-03-29 01:00:02.376301+00:00, run_duration=2.25155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:58:00+00:00, data_interval_end=2024-03-29 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:00:02.392922339Z [2024-03-29T01:00:02.392+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:02:00+00:00 2024-03-29T01:00:02.431449581Z [2024-03-29T01:00:02.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:00:02.432022894Z [2024-03-29T01:00:02.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 00:59:00+00:00, run_id=scheduled__2024-03-29T00:59:00+00:00, run_start_date=2024-03-29 01:00:00.125743+00:00, run_end_date=2024-03-29 01:00:02.431628+00:00, run_duration=2.305885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:59:00+00:00, data_interval_end=2024-03-29 01:00:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:00:02.445291578Z [2024-03-29T01:00:02.444+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:01:00+00:00 2024-03-29T01:00:02.520337494Z [2024-03-29T01:00:02.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T00:58:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:02.520472702Z [2024-03-29T01:00:02.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:59:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:02.528494489Z [2024-03-29T01:00:02.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T00:58:00+00:00, map_index=-1, run_start_date=2024-03-29 01:00:01.158428+00:00, run_end_date=2024-03-29 01:00:01.700187+00:00, run_duration=0.541759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:00.264408+00:00, queued_by_job_id=2, pid=5819 2024-03-29T01:00:02.528874931Z [2024-03-29T01:00:02.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:59:00+00:00, map_index=-1, run_start_date=2024-03-29 01:00:01.813207+00:00, run_end_date=2024-03-29 01:00:02.369024+00:00, run_duration=0.555817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:00.264408+00:00, queued_by_job_id=2, pid=5831 2024-03-29T01:00:03.645929044Z [2024-03-29T01:00:03.645+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:00:03.645958677Z 2024-03-29T01:00:03.646357566Z [2024-03-29T01:00:03.646+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:00:03.647786561Z [2024-03-29T01:00:03.647+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:00:03.647803324Z 2024-03-29T01:00:03.660545847Z [2024-03-29T01:00:03.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:00:03.660909311Z [2024-03-29T01:00:03.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:00:03.732969990Z [2024-03-29T01:00:03.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:03.733150403Z [2024-03-29T01:00:03.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:03.745042742Z [2024-03-29T01:00:03.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9327570-b0f8-4ce0-a3a6-1c9337c5801d 2024-03-29T01:00:03.745334961Z [2024-03-29T01:00:03.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T00:55:00+00:00, map_index=-1, run_start_date=2024-03-29 01:00:02.823426+00:00, run_end_date=2024-03-29 01:00:03.320103+00:00, run_duration=0.496677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:00.264408+00:00, queued_by_job_id=2, pid=5849 2024-03-29T01:00:04.960187246Z [2024-03-29T01:00:04.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:00:04.961031495Z [2024-03-29T01:00:04.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:59:00+00:00, run_id=scheduled__2024-03-29T00:59:00+00:00, run_start_date=2024-03-29 01:00:00.127045+00:00, run_end_date=2024-03-29 01:00:04.960237+00:00, run_duration=4.833192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:59:00+00:00, data_interval_end=2024-03-29 01:00:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:00:04.981098164Z [2024-03-29T01:00:04.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:01:00+00:00 2024-03-29T01:00:05.066871984Z [2024-03-29T01:00:05.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:59:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:05.077549455Z [2024-03-29T01:00:05.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:59:00+00:00, map_index=-1, run_start_date=2024-03-29 01:00:02.967883+00:00, run_end_date=2024-03-29 01:00:04.307507+00:00, run_duration=1.339624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:00.264408+00:00, queued_by_job_id=2, pid=5850 2024-03-29T01:00:06.205702123Z [2024-03-29T01:00:06.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:00:06.208476649Z [2024-03-29T01:00:06.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:59:00+00:00, run_id=scheduled__2024-03-29T00:59:00+00:00, run_start_date=2024-03-29 01:00:00.129833+00:00, run_end_date=2024-03-29 01:00:06.205599+00:00, run_duration=6.075766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:59:00+00:00, data_interval_end=2024-03-29 01:00:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:00:06.237675269Z [2024-03-29T01:00:06.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:01:00+00:00 2024-03-29T01:00:06.327256199Z [2024-03-29T01:00:06.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T00:59:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:06.340415052Z [2024-03-29T01:00:06.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T00:59:00+00:00, map_index=-1, run_start_date=2024-03-29 01:00:03.442434+00:00, run_end_date=2024-03-29 01:00:05.252645+00:00, run_duration=1.810211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:00.264408+00:00, queued_by_job_id=2, pid=5866 2024-03-29T01:00:07.531904642Z [2024-03-29T01:00:07.531+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:00:07.531933537Z 2024-03-29T01:00:07.532118979Z [2024-03-29T01:00:07.531+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:00:07.532687577Z [2024-03-29T01:00:07.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:00:07.532699501Z 2024-03-29T01:00:07.535623805Z [2024-03-29T01:00:07.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:00:07.535762071Z [2024-03-29T01:00:07.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:00:07.595933069Z [2024-03-29T01:00:07.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:07.595976396Z [2024-03-29T01:00:07.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:07.605543230Z [2024-03-29T01:00:07.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ae8dca6-75b1-46f4-95f7-372915d982d1 2024-03-29T01:00:07.605732806Z [2024-03-29T01:00:07.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T00:55:00+00:00, map_index=-1, run_start_date=2024-03-29 01:00:06.155482+00:00, run_end_date=2024-03-29 01:00:06.827740+00:00, run_duration=0.672258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:03.656114+00:00, queued_by_job_id=2, pid=5879 2024-03-29T01:00:10.356193002Z [2024-03-29T01:00:10.355+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:00:10.356257123Z 2024-03-29T01:00:10.356589736Z [2024-03-29T01:00:10.356+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:00:10.357441936Z [2024-03-29T01:00:10.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:00:10.357459983Z 2024-03-29T01:00:10.360605530Z [2024-03-29T01:00:10.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:00:10.360961977Z [2024-03-29T01:00:10.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:00:10.405953133Z [2024-03-29T01:00:10.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status queued for try_number 1 2024-03-29T01:00:10.406217400Z [2024-03-29T01:00:10.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:10.413629837Z [2024-03-29T01:00:10.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa5795a6-4a37-400c-896e-76aa5cf62793 2024-03-29T01:00:10.414010287Z [2024-03-29T01:00:10.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T00:55:00+00:00, map_index=0, run_start_date=2024-03-29 01:00:09.727241+00:00, run_end_date=2024-03-29 01:00:10.143585+00:00, run_duration=0.416344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:07.533068+00:00, queued_by_job_id=2, pid=5887 2024-03-29T01:00:12.682523741Z [2024-03-29T01:00:12.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:00:12.683004797Z [2024-03-29T01:00:12.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 00:55:00+00:00, run_id=scheduled__2024-03-29T00:55:00+00:00, run_start_date=2024-03-29 01:00:00.123316+00:00, run_end_date=2024-03-29 01:00:12.682331+00:00, run_duration=12.559015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 00:55:00+00:00, data_interval_end=2024-03-29 01:00:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:00:12.693574225Z [2024-03-29T01:00:12.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:00:00+00:00, run_after=2024-03-29T01:05:00+00:00 2024-03-29T01:00:12.735188302Z [2024-03-29T01:00:12.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T00:55:00+00:00 exited with status success for try_number 1 2024-03-29T01:00:12.743712545Z [2024-03-29T01:00:12.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T00:55:00+00:00, map_index=-1, run_start_date=2024-03-29 01:00:12.173098+00:00, run_end_date=2024-03-29 01:00:12.560644+00:00, run_duration=0.387546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:00:10.357981+00:00, queued_by_job_id=2, pid=5895 2024-03-29T01:01:00.544050839Z [2024-03-29T01:01:00.543+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:01:00.559115582Z [2024-03-29T01:01:00.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:01:00+00:00, run_after=2024-03-29T01:02:00+00:00 2024-03-29T01:01:00.572446029Z [2024-03-29T01:01:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:01:00+00:00, run_after=2024-03-29T01:02:00+00:00 2024-03-29T01:01:00.638799857Z [2024-03-29T01:01:00.638+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:01:00.638843264Z 2024-03-29T01:01:00.638848167Z 2024-03-29T01:01:00.638851422Z 2024-03-29T01:01:00.639043646Z [2024-03-29T01:01:00.638+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:01:00.639193582Z [2024-03-29T01:01:00.639+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:01:00.639314290Z [2024-03-29T01:01:00.639+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:01:00.640265891Z [2024-03-29T01:01:00.639+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:01:00.640273583Z 2024-03-29T01:01:00.640276975Z 2024-03-29T01:01:00.640280044Z 2024-03-29T01:01:00.643775419Z [2024-03-29T01:01:00.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:01:00.643919633Z [2024-03-29T01:01:00.643+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:01:00.644155290Z [2024-03-29T01:01:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:01:00.644335696Z [2024-03-29T01:01:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:01:00.644564522Z [2024-03-29T01:01:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:01:00.644730311Z [2024-03-29T01:01:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:01:00.914868625Z [2024-03-29T01:01:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:01:00.914970548Z [2024-03-29T01:01:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:01:00.915136487Z [2024-03-29T01:01:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:01:00.922862223Z [2024-03-29T01:01:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to a486e0bf-e649-4789-b632-6d6737606a66 2024-03-29T01:01:00.922956405Z [2024-03-29T01:01:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71a864fd-40b3-4162-9f2c-a35bb14ae6da 2024-03-29T01:01:00.923153210Z [2024-03-29T01:01:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae322914-8b31-4017-9521-1b4bc3e17777 2024-03-29T01:01:02.132394220Z [2024-03-29T01:01:02.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:01:02.133362985Z [2024-03-29T01:01:02.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:00:00+00:00, run_id=scheduled__2024-03-29T01:00:00+00:00, run_start_date=2024-03-29 01:01:00.582054+00:00, run_end_date=2024-03-29 01:01:02.132332+00:00, run_duration=1.550278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:00:00+00:00, data_interval_end=2024-03-29 01:01:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:01:02.156431576Z [2024-03-29T01:01:02.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:01:00+00:00, run_after=2024-03-29T01:02:00+00:00 2024-03-29T01:01:03.360008342Z [2024-03-29T01:01:03.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:01:03.369076204Z [2024-03-29T01:01:03.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=-1, run_start_date=2024-03-29 01:01:01.593243+00:00, run_end_date=2024-03-29 01:01:02.104621+00:00, run_duration=0.511378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:01:00.641239+00:00, queued_by_job_id=2, pid=5917 2024-03-29T01:01:04.424027535Z [2024-03-29T01:01:04.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:01:04.424264615Z [2024-03-29T01:01:04.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:00:00+00:00, run_id=scheduled__2024-03-29T01:00:00+00:00, run_start_date=2024-03-29 01:01:00.583294+00:00, run_end_date=2024-03-29 01:01:04.423907+00:00, run_duration=3.840613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:00:00+00:00, data_interval_end=2024-03-29 01:01:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:01:04.438512958Z [2024-03-29T01:01:04.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:01:00+00:00, run_after=2024-03-29T01:02:00+00:00 2024-03-29T01:01:04.491124751Z [2024-03-29T01:01:04.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:01:04.498162464Z [2024-03-29T01:01:04.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=-1, run_start_date=2024-03-29 01:01:02.836686+00:00, run_end_date=2024-03-29 01:01:04.257494+00:00, run_duration=1.420808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:01:00.641239+00:00, queued_by_job_id=2, pid=5936 2024-03-29T01:01:05.550598315Z [2024-03-29T01:01:05.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:01:05.551215072Z [2024-03-29T01:01:05.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:00:00+00:00, run_id=scheduled__2024-03-29T01:00:00+00:00, run_start_date=2024-03-29 01:01:00.584446+00:00, run_end_date=2024-03-29 01:01:05.550404+00:00, run_duration=4.965958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:00:00+00:00, data_interval_end=2024-03-29 01:01:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:01:05.563524923Z [2024-03-29T01:01:05.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:01:00+00:00, run_after=2024-03-29T01:02:00+00:00 2024-03-29T01:01:05.601094551Z [2024-03-29T01:01:05.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:01:05.638043448Z [2024-03-29T01:01:05.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=-1, run_start_date=2024-03-29 01:01:02.815181+00:00, run_end_date=2024-03-29 01:01:04.526715+00:00, run_duration=1.711534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:01:00.641239+00:00, queued_by_job_id=2, pid=5935 2024-03-29T01:02:00.121328775Z [2024-03-29T01:02:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:02:00+00:00, run_after=2024-03-29T01:03:00+00:00 2024-03-29T01:02:00.127656262Z [2024-03-29T01:02:00.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:02:00.133545760Z [2024-03-29T01:02:00.133+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:02:00.145131994Z [2024-03-29T01:02:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:02:00+00:00, run_after=2024-03-29T01:03:00+00:00 2024-03-29T01:02:00.228230158Z [2024-03-29T01:02:00.227+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:02:00.228286296Z 2024-03-29T01:02:00.228293182Z 2024-03-29T01:02:00.228299048Z 2024-03-29T01:02:00.228303963Z 2024-03-29T01:02:00.228322371Z [2024-03-29T01:02:00.228+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:02:00.228421091Z [2024-03-29T01:02:00.228+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:02:00.228513107Z [2024-03-29T01:02:00.228+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:02:00.228622438Z [2024-03-29T01:02:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:02:00.229293782Z [2024-03-29T01:02:00.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:02:00.229305236Z 2024-03-29T01:02:00.229310958Z 2024-03-29T01:02:00.229316099Z 2024-03-29T01:02:00.229321374Z 2024-03-29T01:02:00.233793214Z [2024-03-29T01:02:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:02:00.233859620Z [2024-03-29T01:02:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:02:00.234214710Z [2024-03-29T01:02:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:02:00.234328491Z [2024-03-29T01:02:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:02:00.234704792Z [2024-03-29T01:02:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:02:00.234812341Z [2024-03-29T01:02:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:02:00.235023487Z [2024-03-29T01:02:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:02:00.235115710Z [2024-03-29T01:02:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:02:00.599534922Z [2024-03-29T01:02:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:02:00.601756032Z [2024-03-29T01:02:00.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:01:00+00:00 exited with status queued for try_number 1 2024-03-29T01:02:00.601975222Z [2024-03-29T01:02:00.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:01:00+00:00 exited with status queued for try_number 1 2024-03-29T01:02:00.602164452Z [2024-03-29T01:02:00.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:01:00+00:00 exited with status queued for try_number 1 2024-03-29T01:02:00.612763571Z [2024-03-29T01:02:00.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00c7478d-b40d-4360-b1f3-395de36eda39 2024-03-29T01:02:00.613014359Z [2024-03-29T01:02:00.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86d7ccb9-1be7-4e02-98ca-63b60f94e04e 2024-03-29T01:02:00.613224240Z [2024-03-29T01:02:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2654924-3463-4c50-91e3-8651682227e4 2024-03-29T01:02:00.613412660Z [2024-03-29T01:02:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5450791-ce17-4d39-a7c4-e1f4c76baa13 2024-03-29T01:02:01.836395574Z [2024-03-29T01:02:01.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:02:01.837054311Z [2024-03-29T01:02:01.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:00:00+00:00, run_id=scheduled__2024-03-29T01:00:00+00:00, run_start_date=2024-03-29 01:02:00.154395+00:00, run_end_date=2024-03-29 01:02:01.836590+00:00, run_duration=1.682195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:00:00+00:00, data_interval_end=2024-03-29 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:02:01.846350183Z [2024-03-29T01:02:01.845+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:02:00+00:00, run_after=2024-03-29T01:04:00+00:00 2024-03-29T01:02:01.863615197Z [2024-03-29T01:02:01.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:02:01.865159401Z [2024-03-29T01:02:01.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:01:00+00:00, run_id=scheduled__2024-03-29T01:01:00+00:00, run_start_date=2024-03-29 01:02:00.155961+00:00, run_end_date=2024-03-29 01:02:01.863489+00:00, run_duration=1.707528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:01:00+00:00, data_interval_end=2024-03-29 01:02:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:02:01.877662268Z [2024-03-29T01:02:01.877+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:02:00+00:00, run_after=2024-03-29T01:03:00+00:00 2024-03-29T01:02:01.937057326Z [2024-03-29T01:02:01.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:02:01.937089175Z [2024-03-29T01:02:01.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:01:00+00:00 exited with status success for try_number 1 2024-03-29T01:02:01.946024574Z [2024-03-29T01:02:01.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:01:00+00:00, map_index=-1, run_start_date=2024-03-29 01:02:01.100109+00:00, run_end_date=2024-03-29 01:02:01.556648+00:00, run_duration=0.456539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:02:00.230216+00:00, queued_by_job_id=2, pid=5969 2024-03-29T01:02:01.946103227Z [2024-03-29T01:02:01.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=-1, run_start_date=2024-03-29 01:02:01.267328+00:00, run_end_date=2024-03-29 01:02:01.682335+00:00, run_duration=0.415007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:02:00.230216+00:00, queued_by_job_id=2, pid=5970 2024-03-29T01:02:04.077510751Z [2024-03-29T01:02:04.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:02:04.077987924Z [2024-03-29T01:02:04.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:01:00+00:00, run_id=scheduled__2024-03-29T01:01:00+00:00, run_start_date=2024-03-29 01:02:00.157404+00:00, run_end_date=2024-03-29 01:02:04.077617+00:00, run_duration=3.920213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:01:00+00:00, data_interval_end=2024-03-29 01:02:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:02:04.087758686Z [2024-03-29T01:02:04.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:02:00+00:00, run_after=2024-03-29T01:03:00+00:00 2024-03-29T01:02:04.132520458Z [2024-03-29T01:02:04.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:01:00+00:00 exited with status success for try_number 1 2024-03-29T01:02:04.140130678Z [2024-03-29T01:02:04.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:01:00+00:00, map_index=-1, run_start_date=2024-03-29 01:02:02.466804+00:00, run_end_date=2024-03-29 01:02:03.792771+00:00, run_duration=1.325967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:02:00.230216+00:00, queued_by_job_id=2, pid=5994 2024-03-29T01:02:05.211600617Z [2024-03-29T01:02:05.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:02:05.211767322Z [2024-03-29T01:02:05.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:01:00+00:00, run_id=scheduled__2024-03-29T01:01:00+00:00, run_start_date=2024-03-29 01:02:00.159237+00:00, run_end_date=2024-03-29 01:02:05.211533+00:00, run_duration=5.052296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:01:00+00:00, data_interval_end=2024-03-29 01:02:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:02:05.221456872Z [2024-03-29T01:02:05.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:02:00+00:00, run_after=2024-03-29T01:03:00+00:00 2024-03-29T01:02:05.257058445Z [2024-03-29T01:02:05.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:01:00+00:00 exited with status success for try_number 1 2024-03-29T01:02:05.262768189Z [2024-03-29T01:02:05.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:01:00+00:00, map_index=-1, run_start_date=2024-03-29 01:02:02.360643+00:00, run_end_date=2024-03-29 01:02:04.503604+00:00, run_duration=2.142961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:02:00.230216+00:00, queued_by_job_id=2, pid=5993 2024-03-29T01:03:00.884352608Z [2024-03-29T01:03:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:03:00+00:00, run_after=2024-03-29T01:04:00+00:00 2024-03-29T01:03:00.897959711Z [2024-03-29T01:03:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:03:00+00:00, run_after=2024-03-29T01:04:00+00:00 2024-03-29T01:03:00.906524345Z [2024-03-29T01:03:00.906+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:03:00.993225888Z [2024-03-29T01:03:00.992+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:03:00.993257033Z 2024-03-29T01:03:00.993281181Z 2024-03-29T01:03:00.993285764Z 2024-03-29T01:03:00.993682455Z [2024-03-29T01:03:00.993+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:03:00.994355461Z [2024-03-29T01:03:00.993+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:03:00.994668483Z [2024-03-29T01:03:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:03:00.996007529Z [2024-03-29T01:03:00.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:03:00.996020754Z 2024-03-29T01:03:00.996024234Z 2024-03-29T01:03:00.996027518Z 2024-03-29T01:03:01.001340114Z [2024-03-29T01:03:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:03:01.001734019Z [2024-03-29T01:03:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:03:01.002224051Z [2024-03-29T01:03:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:03:01.002529494Z [2024-03-29T01:03:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:03:01.002920398Z [2024-03-29T01:03:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:03:01.003163746Z [2024-03-29T01:03:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:03:01.255885052Z [2024-03-29T01:03:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status queued for try_number 1 2024-03-29T01:03:01.256173135Z [2024-03-29T01:03:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status queued for try_number 1 2024-03-29T01:03:01.256369306Z [2024-03-29T01:03:01.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status queued for try_number 1 2024-03-29T01:03:01.264865793Z [2024-03-29T01:03:01.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9484e0be-3b39-49c1-9b79-a819a5850fe7 2024-03-29T01:03:01.265280979Z [2024-03-29T01:03:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bd1ba71-c621-49fd-a487-1c50065b1796 2024-03-29T01:03:01.265513237Z [2024-03-29T01:03:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb27b0ca-3e6f-4657-9f1d-08a87adc9d0e 2024-03-29T01:03:02.430539987Z [2024-03-29T01:03:02.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:03:02.431472880Z [2024-03-29T01:03:02.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:02:00+00:00, run_id=scheduled__2024-03-29T01:02:00+00:00, run_start_date=2024-03-29 01:03:00.919604+00:00, run_end_date=2024-03-29 01:03:02.430800+00:00, run_duration=1.511196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:02:00+00:00, data_interval_end=2024-03-29 01:03:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:03:02.450829109Z [2024-03-29T01:03:02.450+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:03:00+00:00, run_after=2024-03-29T01:04:00+00:00 2024-03-29T01:03:02.518399690Z [2024-03-29T01:03:02.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status success for try_number 1 2024-03-29T01:03:02.527901861Z [2024-03-29T01:03:02.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:02:00+00:00, map_index=-1, run_start_date=2024-03-29 01:03:01.791935+00:00, run_end_date=2024-03-29 01:03:02.172111+00:00, run_duration=0.380176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:03:00.997473+00:00, queued_by_job_id=2, pid=6026 2024-03-29T01:03:04.652616873Z [2024-03-29T01:03:04.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:03:04.652833392Z [2024-03-29T01:03:04.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:02:00+00:00, run_id=scheduled__2024-03-29T01:02:00+00:00, run_start_date=2024-03-29 01:03:00.921120+00:00, run_end_date=2024-03-29 01:03:04.652466+00:00, run_duration=3.731346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:02:00+00:00, data_interval_end=2024-03-29 01:03:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:03:04.666087175Z [2024-03-29T01:03:04.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:03:00+00:00, run_after=2024-03-29T01:04:00+00:00 2024-03-29T01:03:04.755865193Z [2024-03-29T01:03:04.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status success for try_number 1 2024-03-29T01:03:04.760995483Z [2024-03-29T01:03:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:02:00+00:00, map_index=-1, run_start_date=2024-03-29 01:03:02.846235+00:00, run_end_date=2024-03-29 01:03:04.201823+00:00, run_duration=1.355588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:03:00.997473+00:00, queued_by_job_id=2, pid=6044 2024-03-29T01:03:04.886737615Z [2024-03-29T01:03:04.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:03:04.887086458Z [2024-03-29T01:03:04.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:02:00+00:00, run_id=scheduled__2024-03-29T01:02:00+00:00, run_start_date=2024-03-29 01:03:00.922501+00:00, run_end_date=2024-03-29 01:03:04.886777+00:00, run_duration=3.964276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:02:00+00:00, data_interval_end=2024-03-29 01:03:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:03:04.896466626Z [2024-03-29T01:03:04.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:03:00+00:00, run_after=2024-03-29T01:04:00+00:00 2024-03-29T01:03:04.925569881Z [2024-03-29T01:03:04.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status success for try_number 1 2024-03-29T01:03:04.930998414Z [2024-03-29T01:03:04.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:02:00+00:00, map_index=-1, run_start_date=2024-03-29 01:03:02.980309+00:00, run_end_date=2024-03-29 01:03:04.644817+00:00, run_duration=1.664508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:03:00.997473+00:00, queued_by_job_id=2, pid=6045 2024-03-29T01:03:45.017878824Z [2024-03-29T01:03:45.017+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:04:00.445556619Z [2024-03-29T01:04:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:04:00+00:00, run_after=2024-03-29T01:05:00+00:00 2024-03-29T01:04:00.459098790Z [2024-03-29T01:04:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:04:00+00:00, run_after=2024-03-29T01:05:00+00:00 2024-03-29T01:04:00.466127588Z [2024-03-29T01:04:00.465+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:04:00.472116574Z [2024-03-29T01:04:00.471+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:04:00.551525140Z [2024-03-29T01:04:00.551+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:04:00.551554352Z 2024-03-29T01:04:00.551560630Z 2024-03-29T01:04:00.551565190Z 2024-03-29T01:04:00.551569861Z 2024-03-29T01:04:00.551933862Z [2024-03-29T01:04:00.551+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:04:00.552125790Z [2024-03-29T01:04:00.551+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:04:00.552370546Z [2024-03-29T01:04:00.552+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:04:00.552606542Z [2024-03-29T01:04:00.552+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:04:00.553403578Z [2024-03-29T01:04:00.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:04:00.553418460Z 2024-03-29T01:04:00.553423387Z 2024-03-29T01:04:00.553427947Z 2024-03-29T01:04:00.553432667Z 2024-03-29T01:04:00.558805097Z [2024-03-29T01:04:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:04:00.558971453Z [2024-03-29T01:04:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:04:00.559198116Z [2024-03-29T01:04:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:04:00.559247434Z [2024-03-29T01:04:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:04:00.559461099Z [2024-03-29T01:04:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:04:00.559642110Z [2024-03-29T01:04:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:04:00.560047353Z [2024-03-29T01:04:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:04:00.560168698Z [2024-03-29T01:04:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:04:00.920260645Z [2024-03-29T01:04:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status queued for try_number 1 2024-03-29T01:04:00.920300474Z [2024-03-29T01:04:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:03:00+00:00 exited with status queued for try_number 1 2024-03-29T01:04:00.922661283Z [2024-03-29T01:04:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:03:00+00:00 exited with status queued for try_number 1 2024-03-29T01:04:00.922718905Z [2024-03-29T01:04:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:03:00+00:00 exited with status queued for try_number 1 2024-03-29T01:04:00.931659944Z [2024-03-29T01:04:00.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb8407e4-82a0-485b-925b-21703e920d18 2024-03-29T01:04:00.931840453Z [2024-03-29T01:04:00.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63dffbc9-1380-48c4-b1f9-3409af96f7d1 2024-03-29T01:04:00.932011065Z [2024-03-29T01:04:00.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to a197ca47-f976-41fc-990c-4ac16aa0ea5a 2024-03-29T01:04:00.932097584Z [2024-03-29T01:04:00.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 998709f5-839a-4a59-a082-0cd2cb01a475 2024-03-29T01:04:02.110992130Z [2024-03-29T01:04:02.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:04:02.111310112Z [2024-03-29T01:04:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:02:00+00:00, run_id=scheduled__2024-03-29T01:02:00+00:00, run_start_date=2024-03-29 01:04:00.482695+00:00, run_end_date=2024-03-29 01:04:02.110881+00:00, run_duration=1.628186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:02:00+00:00, data_interval_end=2024-03-29 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:04:02.118989217Z [2024-03-29T01:04:02.118+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:04:00+00:00, run_after=2024-03-29T01:06:00+00:00 2024-03-29T01:04:02.126130543Z [2024-03-29T01:04:02.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:04:02.126375812Z [2024-03-29T01:04:02.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:03:00+00:00, run_id=scheduled__2024-03-29T01:03:00+00:00, run_start_date=2024-03-29 01:04:00.484302+00:00, run_end_date=2024-03-29 01:04:02.126009+00:00, run_duration=1.641707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:03:00+00:00, data_interval_end=2024-03-29 01:04:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:04:02.136476123Z [2024-03-29T01:04:02.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:04:00+00:00, run_after=2024-03-29T01:05:00+00:00 2024-03-29T01:04:02.184309936Z [2024-03-29T01:04:02.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:02:00+00:00 exited with status success for try_number 1 2024-03-29T01:04:02.184602289Z [2024-03-29T01:04:02.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:03:00+00:00 exited with status success for try_number 1 2024-03-29T01:04:02.192690530Z [2024-03-29T01:04:02.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:02:00+00:00, map_index=-1, run_start_date=2024-03-29 01:04:01.263124+00:00, run_end_date=2024-03-29 01:04:01.659337+00:00, run_duration=0.396213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:04:00.554698+00:00, queued_by_job_id=2, pid=6078 2024-03-29T01:04:02.193014642Z [2024-03-29T01:04:02.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:03:00+00:00, map_index=-1, run_start_date=2024-03-29 01:04:01.444987+00:00, run_end_date=2024-03-29 01:04:01.892141+00:00, run_duration=0.447154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:04:00.554698+00:00, queued_by_job_id=2, pid=6079 2024-03-29T01:04:04.326856945Z [2024-03-29T01:04:04.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:04:04.327086578Z [2024-03-29T01:04:04.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:03:00+00:00, run_id=scheduled__2024-03-29T01:03:00+00:00, run_start_date=2024-03-29 01:04:00.486198+00:00, run_end_date=2024-03-29 01:04:04.326762+00:00, run_duration=3.840564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:03:00+00:00, data_interval_end=2024-03-29 01:04:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:04:04.339120673Z [2024-03-29T01:04:04.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:04:00+00:00, run_after=2024-03-29T01:05:00+00:00 2024-03-29T01:04:04.350474073Z [2024-03-29T01:04:04.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:04:04.350953221Z [2024-03-29T01:04:04.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:03:00+00:00, run_id=scheduled__2024-03-29T01:03:00+00:00, run_start_date=2024-03-29 01:04:00.485276+00:00, run_end_date=2024-03-29 01:04:04.350303+00:00, run_duration=3.865027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:03:00+00:00, data_interval_end=2024-03-29 01:04:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:04:04.369789016Z [2024-03-29T01:04:04.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:04:00+00:00, run_after=2024-03-29T01:05:00+00:00 2024-03-29T01:04:04.401631638Z [2024-03-29T01:04:04.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:03:00+00:00 exited with status success for try_number 1 2024-03-29T01:04:04.411828556Z [2024-03-29T01:04:04.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:03:00+00:00, map_index=-1, run_start_date=2024-03-29 01:04:02.615110+00:00, run_end_date=2024-03-29 01:04:03.951802+00:00, run_duration=1.336692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:04:00.554698+00:00, queued_by_job_id=2, pid=6103 2024-03-29T01:04:05.481228775Z [2024-03-29T01:04:05.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:03:00+00:00 exited with status success for try_number 1 2024-03-29T01:04:05.488339304Z [2024-03-29T01:04:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:03:00+00:00, map_index=-1, run_start_date=2024-03-29 01:04:02.614500+00:00, run_end_date=2024-03-29 01:04:04.286857+00:00, run_duration=1.672357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:04:00.554698+00:00, queued_by_job_id=2, pid=6102 2024-03-29T01:05:00.755671746Z [2024-03-29T01:05:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:05:00+00:00, run_after=2024-03-29T01:06:00+00:00 2024-03-29T01:05:00.769675790Z [2024-03-29T01:05:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:05:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:05:00.788918481Z [2024-03-29T01:05:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:05:00+00:00, run_after=2024-03-29T01:06:00+00:00 2024-03-29T01:05:00.796406342Z [2024-03-29T01:05:00.796+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:05:00.898379986Z [2024-03-29T01:05:00.897+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:05:00.898420569Z 2024-03-29T01:05:00.898432610Z 2024-03-29T01:05:00.898437083Z 2024-03-29T01:05:00.898455889Z 2024-03-29T01:05:00.898765236Z [2024-03-29T01:05:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:05:00.899142362Z [2024-03-29T01:05:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:05:00.899449840Z [2024-03-29T01:05:00.899+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:05:00.899822558Z [2024-03-29T01:05:00.899+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:05:00.901058139Z [2024-03-29T01:05:00.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:05:00.901074804Z 2024-03-29T01:05:00.901113158Z 2024-03-29T01:05:00.901119065Z 2024-03-29T01:05:00.901124514Z 2024-03-29T01:05:00.906712681Z [2024-03-29T01:05:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:05:00.907115266Z [2024-03-29T01:05:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:05:00.907658880Z [2024-03-29T01:05:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:05:00.908024620Z [2024-03-29T01:05:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:05:00.908542343Z [2024-03-29T01:05:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:05:00.908850748Z [2024-03-29T01:05:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:05:00.909347271Z [2024-03-29T01:05:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:05:00.909668480Z [2024-03-29T01:05:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:05:01.401648980Z [2024-03-29T01:05:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:05:01.401682438Z [2024-03-29T01:05:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status queued for try_number 1 2024-03-29T01:05:01.401725071Z [2024-03-29T01:05:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status queued for try_number 1 2024-03-29T01:05:01.401818349Z [2024-03-29T01:05:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status queued for try_number 1 2024-03-29T01:05:01.420471145Z [2024-03-29T01:05:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5000021-ddbe-4d21-a0ce-0eae912f56b0 2024-03-29T01:05:01.420623509Z [2024-03-29T01:05:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59dec3a5-fcc5-4c54-9056-c1507425d27e 2024-03-29T01:05:01.420834109Z [2024-03-29T01:05:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0105e7b-afbc-41c1-93e5-cf11aabeffbc 2024-03-29T01:05:01.421142347Z [2024-03-29T01:05:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to b529d27a-38c5-4f0a-9ca7-d56454350547 2024-03-29T01:05:03.024636839Z [2024-03-29T01:05:03.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:05:03.025164034Z [2024-03-29T01:05:03.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:04:00+00:00, run_id=scheduled__2024-03-29T01:04:00+00:00, run_start_date=2024-03-29 01:05:00.810923+00:00, run_end_date=2024-03-29 01:05:03.024476+00:00, run_duration=2.213553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:04:00+00:00, data_interval_end=2024-03-29 01:05:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:05:03.035667947Z [2024-03-29T01:05:03.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:05:00+00:00, run_after=2024-03-29T01:06:00+00:00 2024-03-29T01:05:03.103956826Z [2024-03-29T01:05:03.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status success for try_number 1 2024-03-29T01:05:03.114711789Z [2024-03-29T01:05:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:04:00+00:00, map_index=-1, run_start_date=2024-03-29 01:05:01.938620+00:00, run_end_date=2024-03-29 01:05:02.499137+00:00, run_duration=0.560517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:05:00.902900+00:00, queued_by_job_id=2, pid=6137 2024-03-29T01:05:04.237478640Z [2024-03-29T01:05:04.236+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:05:04.237529757Z 2024-03-29T01:05:04.238020607Z [2024-03-29T01:05:04.237+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:05:04.239262082Z [2024-03-29T01:05:04.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:05:04.239282449Z 2024-03-29T01:05:04.252704736Z [2024-03-29T01:05:04.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:05:04.253014450Z [2024-03-29T01:05:04.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:05:04.328691714Z [2024-03-29T01:05:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:05:04.331939050Z [2024-03-29T01:05:04.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:05:04.340827573Z [2024-03-29T01:05:04.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22ce4c66-36aa-49b0-8192-1916394204c7 2024-03-29T01:05:04.341325743Z [2024-03-29T01:05:04.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=-1, run_start_date=2024-03-29 01:05:03.170943+00:00, run_end_date=2024-03-29 01:05:03.585934+00:00, run_duration=0.414991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:05:00.902900+00:00, queued_by_job_id=2, pid=6162 2024-03-29T01:05:05.533018994Z [2024-03-29T01:05:05.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:05:05.533350222Z [2024-03-29T01:05:05.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:04:00+00:00, run_id=scheduled__2024-03-29T01:04:00+00:00, run_start_date=2024-03-29 01:05:00.812193+00:00, run_end_date=2024-03-29 01:05:05.532895+00:00, run_duration=4.720702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:04:00+00:00, data_interval_end=2024-03-29 01:05:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:05:05.563791278Z [2024-03-29T01:05:05.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:05:00+00:00, run_after=2024-03-29T01:06:00+00:00 2024-03-29T01:05:05.571980611Z [2024-03-29T01:05:05.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:05:05.572302762Z [2024-03-29T01:05:05.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:04:00+00:00, run_id=scheduled__2024-03-29T01:04:00+00:00, run_start_date=2024-03-29 01:05:00.813421+00:00, run_end_date=2024-03-29 01:05:05.571884+00:00, run_duration=4.758463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:04:00+00:00, data_interval_end=2024-03-29 01:05:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:05:05.584508164Z [2024-03-29T01:05:05.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:05:00+00:00, run_after=2024-03-29T01:06:00+00:00 2024-03-29T01:05:05.639812556Z [2024-03-29T01:05:05.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status success for try_number 1 2024-03-29T01:05:05.639899287Z [2024-03-29T01:05:05.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status success for try_number 1 2024-03-29T01:05:05.660023352Z [2024-03-29T01:05:05.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:04:00+00:00, map_index=-1, run_start_date=2024-03-29 01:05:03.077010+00:00, run_end_date=2024-03-29 01:05:04.399841+00:00, run_duration=1.322831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:05:00.902900+00:00, queued_by_job_id=2, pid=6156 2024-03-29T01:05:05.660619775Z [2024-03-29T01:05:05.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:04:00+00:00, map_index=-1, run_start_date=2024-03-29 01:05:03.359857+00:00, run_end_date=2024-03-29 01:05:05.084671+00:00, run_duration=1.724814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:05:00.902900+00:00, queued_by_job_id=2, pid=6163 2024-03-29T01:05:07.010714635Z [2024-03-29T01:05:07.010+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:05:07.010752945Z 2024-03-29T01:05:07.011361980Z [2024-03-29T01:05:07.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:05:07.012781169Z [2024-03-29T01:05:07.012+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:05:07.012800984Z 2024-03-29T01:05:07.016406612Z [2024-03-29T01:05:07.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:05:07.016523893Z [2024-03-29T01:05:07.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:05:07.070727063Z [2024-03-29T01:05:07.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:05:07.071032977Z [2024-03-29T01:05:07.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:05:07.080955164Z [2024-03-29T01:05:07.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3793fdd-5b09-4547-91dd-6087e9ead790 2024-03-29T01:05:07.081818604Z [2024-03-29T01:05:07.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=-1, run_start_date=2024-03-29 01:05:06.138370+00:00, run_end_date=2024-03-29 01:05:06.560873+00:00, run_duration=0.422503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:05:04.239997+00:00, queued_by_job_id=2, pid=6186 2024-03-29T01:05:09.383512597Z [2024-03-29T01:05:09.383+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:05:09.383557843Z 2024-03-29T01:05:09.383881847Z [2024-03-29T01:05:09.383+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:05:09.384564854Z [2024-03-29T01:05:09.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:05:09.384576694Z 2024-03-29T01:05:09.386939479Z [2024-03-29T01:05:09.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:05:09.387225340Z [2024-03-29T01:05:09.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:05:09.429797289Z [2024-03-29T01:05:09.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status queued for try_number 1 2024-03-29T01:05:09.429822186Z [2024-03-29T01:05:09.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:05:09.436325678Z [2024-03-29T01:05:09.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47d366ce-a922-4ba0-b304-50684b7231a5 2024-03-29T01:05:09.436416130Z [2024-03-29T01:05:09.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=0, run_start_date=2024-03-29 01:05:08.859257+00:00, run_end_date=2024-03-29 01:05:09.163684+00:00, run_duration=0.304427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:05:07.013666+00:00, queued_by_job_id=2, pid=6194 2024-03-29T01:05:12.053246390Z [2024-03-29T01:05:12.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:05:12.053412581Z [2024-03-29T01:05:12.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:00:00+00:00, run_id=scheduled__2024-03-29T01:00:00+00:00, run_start_date=2024-03-29 01:05:00.809373+00:00, run_end_date=2024-03-29 01:05:12.053081+00:00, run_duration=11.243708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:00:00+00:00, data_interval_end=2024-03-29 01:05:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:05:12.060555674Z [2024-03-29T01:05:12.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:05:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:05:12.094856645Z [2024-03-29T01:05:12.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:00:00+00:00 exited with status success for try_number 1 2024-03-29T01:05:12.102079394Z [2024-03-29T01:05:12.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:00:00+00:00, map_index=-1, run_start_date=2024-03-29 01:05:11.062097+00:00, run_end_date=2024-03-29 01:05:11.393010+00:00, run_duration=0.330913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:05:09.385041+00:00, queued_by_job_id=2, pid=6202 2024-03-29T01:06:00.320356939Z [2024-03-29T01:06:00.319+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:06:00.337360163Z [2024-03-29T01:06:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:06:00+00:00, run_after=2024-03-29T01:07:00+00:00 2024-03-29T01:06:00.345491319Z [2024-03-29T01:06:00.345+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:06:00.358163962Z [2024-03-29T01:06:00.357+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:06:00+00:00, run_after=2024-03-29T01:07:00+00:00 2024-03-29T01:06:00.450095091Z [2024-03-29T01:06:00.449+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:06:00.450130308Z 2024-03-29T01:06:00.450137737Z 2024-03-29T01:06:00.450143814Z 2024-03-29T01:06:00.450149591Z 2024-03-29T01:06:00.450429416Z [2024-03-29T01:06:00.449+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:06:00.450729419Z [2024-03-29T01:06:00.450+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:06:00.450923771Z [2024-03-29T01:06:00.450+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:06:00.451060529Z [2024-03-29T01:06:00.450+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:06:00.452289770Z [2024-03-29T01:06:00.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:06:00.452302973Z 2024-03-29T01:06:00.452308427Z 2024-03-29T01:06:00.452335353Z 2024-03-29T01:06:00.452340027Z 2024-03-29T01:06:00.457841595Z [2024-03-29T01:06:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:06:00.458023523Z [2024-03-29T01:06:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:06:00.458587359Z [2024-03-29T01:06:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:06:00.458884524Z [2024-03-29T01:06:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:06:00.459460026Z [2024-03-29T01:06:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:06:00.459951144Z [2024-03-29T01:06:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:06:00.460239598Z [2024-03-29T01:06:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:06:00.460383809Z [2024-03-29T01:06:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:06:00.967467797Z [2024-03-29T01:06:00.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status queued for try_number 1 2024-03-29T01:06:00.967557673Z [2024-03-29T01:06:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status queued for try_number 1 2024-03-29T01:06:00.967627709Z [2024-03-29T01:06:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status queued for try_number 1 2024-03-29T01:06:00.968077553Z [2024-03-29T01:06:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status queued for try_number 1 2024-03-29T01:06:00.991335588Z [2024-03-29T01:06:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1803ac82-ed2b-413b-b470-2ea49804f46b 2024-03-29T01:06:00.991560669Z [2024-03-29T01:06:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1914b0e-7eea-4611-9964-8b52e867f596 2024-03-29T01:06:00.991796629Z [2024-03-29T01:06:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7396b16e-ba4a-4590-afcd-8de10d096eb0 2024-03-29T01:06:00.992017472Z [2024-03-29T01:06:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3110a0ab-fea7-44e9-b9ec-5740b2ae99bb 2024-03-29T01:06:02.300279887Z [2024-03-29T01:06:02.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:06:02.300590358Z [2024-03-29T01:06:02.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:04:00+00:00, run_id=scheduled__2024-03-29T01:04:00+00:00, run_start_date=2024-03-29 01:06:00.369573+00:00, run_end_date=2024-03-29 01:06:02.300170+00:00, run_duration=1.930597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:04:00+00:00, data_interval_end=2024-03-29 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:06:02.309188112Z [2024-03-29T01:06:02.308+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:06:00+00:00, run_after=2024-03-29T01:08:00+00:00 2024-03-29T01:06:02.331058791Z [2024-03-29T01:06:02.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:06:02.331288219Z [2024-03-29T01:06:02.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:05:00+00:00, run_id=scheduled__2024-03-29T01:05:00+00:00, run_start_date=2024-03-29 01:06:00.370928+00:00, run_end_date=2024-03-29 01:06:02.330951+00:00, run_duration=1.960023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:05:00+00:00, data_interval_end=2024-03-29 01:06:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:06:02.343089371Z [2024-03-29T01:06:02.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:06:00+00:00, run_after=2024-03-29T01:07:00+00:00 2024-03-29T01:06:02.388002678Z [2024-03-29T01:06:02.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:04:00+00:00 exited with status success for try_number 1 2024-03-29T01:06:02.388329769Z [2024-03-29T01:06:02.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status success for try_number 1 2024-03-29T01:06:02.398386987Z [2024-03-29T01:06:02.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:04:00+00:00, map_index=-1, run_start_date=2024-03-29 01:06:01.372237+00:00, run_end_date=2024-03-29 01:06:01.959959+00:00, run_duration=0.587722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:06:00.454149+00:00, queued_by_job_id=2, pid=6225 2024-03-29T01:06:02.398866447Z [2024-03-29T01:06:02.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:05:00+00:00, map_index=-1, run_start_date=2024-03-29 01:06:01.536708+00:00, run_end_date=2024-03-29 01:06:02.121544+00:00, run_duration=0.584836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:06:00.454149+00:00, queued_by_job_id=2, pid=6226 2024-03-29T01:06:05.004572303Z [2024-03-29T01:06:04.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:06:05.004608488Z [2024-03-29T01:06:05.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:05:00+00:00, run_id=scheduled__2024-03-29T01:05:00+00:00, run_start_date=2024-03-29 01:06:00.373098+00:00, run_end_date=2024-03-29 01:06:05.001360+00:00, run_duration=4.628262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:05:00+00:00, data_interval_end=2024-03-29 01:06:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:06:05.024263143Z [2024-03-29T01:06:05.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:06:00+00:00, run_after=2024-03-29T01:07:00+00:00 2024-03-29T01:06:05.035778068Z [2024-03-29T01:06:05.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:06:05.036332370Z [2024-03-29T01:06:05.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:05:00+00:00, run_id=scheduled__2024-03-29T01:05:00+00:00, run_start_date=2024-03-29 01:06:00.372025+00:00, run_end_date=2024-03-29 01:06:05.035876+00:00, run_duration=4.663851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:05:00+00:00, data_interval_end=2024-03-29 01:06:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:06:05.049583268Z [2024-03-29T01:06:05.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:06:00+00:00, run_after=2024-03-29T01:07:00+00:00 2024-03-29T01:06:05.082751000Z [2024-03-29T01:06:05.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status success for try_number 1 2024-03-29T01:06:05.082855400Z [2024-03-29T01:06:05.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status success for try_number 1 2024-03-29T01:06:05.089655457Z [2024-03-29T01:06:05.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:05:00+00:00, map_index=-1, run_start_date=2024-03-29 01:06:02.812581+00:00, run_end_date=2024-03-29 01:06:04.402467+00:00, run_duration=1.589886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:06:00.454149+00:00, queued_by_job_id=2, pid=6244 2024-03-29T01:06:05.090422555Z [2024-03-29T01:06:05.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:05:00+00:00, map_index=-1, run_start_date=2024-03-29 01:06:03.079081+00:00, run_end_date=2024-03-29 01:06:04.312789+00:00, run_duration=1.233708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:06:00.454149+00:00, queued_by_job_id=2, pid=6250 2024-03-29T01:07:00.596770746Z [2024-03-29T01:07:00.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:07:00+00:00, run_after=2024-03-29T01:08:00+00:00 2024-03-29T01:07:00.621006488Z [2024-03-29T01:07:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:07:00+00:00, run_after=2024-03-29T01:08:00+00:00 2024-03-29T01:07:00.632896021Z [2024-03-29T01:07:00.632+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:07:00.737884667Z [2024-03-29T01:07:00.737+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:07:00.737932851Z 2024-03-29T01:07:00.737938531Z 2024-03-29T01:07:00.737942792Z 2024-03-29T01:07:00.737955563Z [2024-03-29T01:07:00.737+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:07:00.738135983Z [2024-03-29T01:07:00.737+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:07:00.738283363Z [2024-03-29T01:07:00.738+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:07:00.738899622Z [2024-03-29T01:07:00.738+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:07:00.738910053Z 2024-03-29T01:07:00.738917543Z 2024-03-29T01:07:00.738922409Z 2024-03-29T01:07:00.742207892Z [2024-03-29T01:07:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:07:00.742286943Z [2024-03-29T01:07:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:07:00.742625967Z [2024-03-29T01:07:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:07:00.742796938Z [2024-03-29T01:07:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:07:00.743020599Z [2024-03-29T01:07:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:07:00.743131672Z [2024-03-29T01:07:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:07:01.168819904Z [2024-03-29T01:07:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status queued for try_number 1 2024-03-29T01:07:01.168873022Z [2024-03-29T01:07:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status queued for try_number 1 2024-03-29T01:07:01.168889081Z [2024-03-29T01:07:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status queued for try_number 1 2024-03-29T01:07:01.180718478Z [2024-03-29T01:07:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to d36be98e-12ce-460d-97a9-b4de2d3af000 2024-03-29T01:07:01.180781129Z [2024-03-29T01:07:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 335e28db-13f6-414c-ac66-f616ca9ff455 2024-03-29T01:07:01.180908474Z [2024-03-29T01:07:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee72843c-887c-4d35-805e-62c3a03c1ac1 2024-03-29T01:07:02.389194863Z [2024-03-29T01:07:02.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:07:02.389681188Z [2024-03-29T01:07:02.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:06:00+00:00, run_id=scheduled__2024-03-29T01:06:00+00:00, run_start_date=2024-03-29 01:07:00.648165+00:00, run_end_date=2024-03-29 01:07:02.389087+00:00, run_duration=1.740922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:06:00+00:00, data_interval_end=2024-03-29 01:07:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:07:02.401447755Z [2024-03-29T01:07:02.401+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:07:00+00:00, run_after=2024-03-29T01:08:00+00:00 2024-03-29T01:07:03.564223100Z [2024-03-29T01:07:03.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status success for try_number 1 2024-03-29T01:07:03.569458497Z [2024-03-29T01:07:03.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:06:00+00:00, map_index=-1, run_start_date=2024-03-29 01:07:01.869568+00:00, run_end_date=2024-03-29 01:07:02.343722+00:00, run_duration=0.474154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:07:00.739622+00:00, queued_by_job_id=2, pid=6281 2024-03-29T01:07:05.704399527Z [2024-03-29T01:07:05.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:07:05.704647265Z [2024-03-29T01:07:05.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:06:00+00:00, run_id=scheduled__2024-03-29T01:06:00+00:00, run_start_date=2024-03-29 01:07:00.649493+00:00, run_end_date=2024-03-29 01:07:05.704327+00:00, run_duration=5.054834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:06:00+00:00, data_interval_end=2024-03-29 01:07:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:07:05.739924723Z [2024-03-29T01:07:05.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:07:00+00:00, run_after=2024-03-29T01:08:00+00:00 2024-03-29T01:07:05.748927491Z [2024-03-29T01:07:05.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:07:05.749091860Z [2024-03-29T01:07:05.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:06:00+00:00, run_id=scheduled__2024-03-29T01:06:00+00:00, run_start_date=2024-03-29 01:07:00.650666+00:00, run_end_date=2024-03-29 01:07:05.748805+00:00, run_duration=5.098139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:06:00+00:00, data_interval_end=2024-03-29 01:07:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:07:05.762725203Z [2024-03-29T01:07:05.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:07:00+00:00, run_after=2024-03-29T01:08:00+00:00 2024-03-29T01:07:05.807392259Z [2024-03-29T01:07:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status success for try_number 1 2024-03-29T01:07:05.807415801Z [2024-03-29T01:07:05.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status success for try_number 1 2024-03-29T01:07:05.812523631Z [2024-03-29T01:07:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:06:00+00:00, map_index=-1, run_start_date=2024-03-29 01:07:03.260956+00:00, run_end_date=2024-03-29 01:07:05.230643+00:00, run_duration=1.969687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:07:00.739622+00:00, queued_by_job_id=2, pid=6300 2024-03-29T01:07:05.812654751Z [2024-03-29T01:07:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:06:00+00:00, map_index=-1, run_start_date=2024-03-29 01:07:03.135404+00:00, run_end_date=2024-03-29 01:07:05.077111+00:00, run_duration=1.941707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:07:00.739622+00:00, queued_by_job_id=2, pid=6299 2024-03-29T01:08:00.297822141Z [2024-03-29T01:08:00.297+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:08:00.314344334Z [2024-03-29T01:08:00.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:08:00+00:00, run_after=2024-03-29T01:09:00+00:00 2024-03-29T01:08:00.321446827Z [2024-03-29T01:08:00.321+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:08:00.333764972Z [2024-03-29T01:08:00.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:08:00+00:00, run_after=2024-03-29T01:09:00+00:00 2024-03-29T01:08:00.429207331Z [2024-03-29T01:08:00.428+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:08:00.429233576Z 2024-03-29T01:08:00.429238141Z 2024-03-29T01:08:00.429241411Z 2024-03-29T01:08:00.429244743Z 2024-03-29T01:08:00.429424112Z [2024-03-29T01:08:00.429+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:08:00.429648920Z [2024-03-29T01:08:00.429+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:08:00.429848559Z [2024-03-29T01:08:00.429+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:08:00.430040834Z [2024-03-29T01:08:00.429+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:08:00.430913889Z [2024-03-29T01:08:00.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:08:00.430927217Z 2024-03-29T01:08:00.430930561Z 2024-03-29T01:08:00.430933569Z 2024-03-29T01:08:00.430937053Z 2024-03-29T01:08:00.434779398Z [2024-03-29T01:08:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:08:00.434928310Z [2024-03-29T01:08:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:08:00.435204248Z [2024-03-29T01:08:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:08:00.435312616Z [2024-03-29T01:08:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:08:00.435552841Z [2024-03-29T01:08:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:08:00.435662166Z [2024-03-29T01:08:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:08:00.435937047Z [2024-03-29T01:08:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:08:00.436041530Z [2024-03-29T01:08:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:08:00.851551559Z [2024-03-29T01:08:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status queued for try_number 1 2024-03-29T01:08:00.851628724Z [2024-03-29T01:08:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:07:00+00:00 exited with status queued for try_number 1 2024-03-29T01:08:00.851796121Z [2024-03-29T01:08:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:07:00+00:00 exited with status queued for try_number 1 2024-03-29T01:08:00.851922456Z [2024-03-29T01:08:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:07:00+00:00 exited with status queued for try_number 1 2024-03-29T01:08:00.868527248Z [2024-03-29T01:08:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73995aff-7b0a-48a4-b573-a570fa73a293 2024-03-29T01:08:00.868742224Z [2024-03-29T01:08:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f0b4631-2a7f-4c01-8d43-863b42bf10bc 2024-03-29T01:08:00.869143343Z [2024-03-29T01:08:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f6d0fa0-1268-4226-9b77-11b187304796 2024-03-29T01:08:00.869314948Z [2024-03-29T01:08:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 225c14f0-b2a1-4355-9519-2b8320f34caa 2024-03-29T01:08:02.804199370Z [2024-03-29T01:08:02.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:08:02.804385110Z [2024-03-29T01:08:02.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:06:00+00:00, run_id=scheduled__2024-03-29T01:06:00+00:00, run_start_date=2024-03-29 01:08:00.345251+00:00, run_end_date=2024-03-29 01:08:02.804054+00:00, run_duration=2.458803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:06:00+00:00, data_interval_end=2024-03-29 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:08:02.816219284Z [2024-03-29T01:08:02.815+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:08:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:08:02.833313876Z [2024-03-29T01:08:02.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:08:02.834269187Z [2024-03-29T01:08:02.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:07:00+00:00, run_id=scheduled__2024-03-29T01:07:00+00:00, run_start_date=2024-03-29 01:08:00.346502+00:00, run_end_date=2024-03-29 01:08:02.833860+00:00, run_duration=2.487358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:07:00+00:00, data_interval_end=2024-03-29 01:08:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:08:02.855388298Z [2024-03-29T01:08:02.854+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:08:00+00:00, run_after=2024-03-29T01:09:00+00:00 2024-03-29T01:08:03.012185284Z [2024-03-29T01:08:03.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:06:00+00:00 exited with status success for try_number 1 2024-03-29T01:08:03.016282375Z [2024-03-29T01:08:03.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:07:00+00:00 exited with status success for try_number 1 2024-03-29T01:08:03.031983674Z [2024-03-29T01:08:03.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:06:00+00:00, map_index=-1, run_start_date=2024-03-29 01:08:01.475967+00:00, run_end_date=2024-03-29 01:08:01.976719+00:00, run_duration=0.500752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:08:00.432120+00:00, queued_by_job_id=2, pid=6333 2024-03-29T01:08:03.032643965Z [2024-03-29T01:08:03.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:07:00+00:00, map_index=-1, run_start_date=2024-03-29 01:08:01.643933+00:00, run_end_date=2024-03-29 01:08:02.192055+00:00, run_duration=0.548122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:08:00.432120+00:00, queued_by_job_id=2, pid=6334 2024-03-29T01:08:04.333648394Z [2024-03-29T01:08:04.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:08:04.334355772Z [2024-03-29T01:08:04.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:07:00+00:00, run_id=scheduled__2024-03-29T01:07:00+00:00, run_start_date=2024-03-29 01:08:00.347828+00:00, run_end_date=2024-03-29 01:08:04.333851+00:00, run_duration=3.986023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:07:00+00:00, data_interval_end=2024-03-29 01:08:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:08:04.346243163Z [2024-03-29T01:08:04.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:08:00+00:00, run_after=2024-03-29T01:09:00+00:00 2024-03-29T01:08:04.397834109Z [2024-03-29T01:08:04.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:07:00+00:00 exited with status success for try_number 1 2024-03-29T01:08:04.410793216Z [2024-03-29T01:08:04.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:07:00+00:00, map_index=-1, run_start_date=2024-03-29 01:08:02.721654+00:00, run_end_date=2024-03-29 01:08:04.160384+00:00, run_duration=1.43873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:08:00.432120+00:00, queued_by_job_id=2, pid=6357 2024-03-29T01:08:05.465091835Z [2024-03-29T01:08:05.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:08:05.465450830Z [2024-03-29T01:08:05.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:07:00+00:00, run_id=scheduled__2024-03-29T01:07:00+00:00, run_start_date=2024-03-29 01:08:00.349182+00:00, run_end_date=2024-03-29 01:08:05.465031+00:00, run_duration=5.115849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:07:00+00:00, data_interval_end=2024-03-29 01:08:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:08:05.475584539Z [2024-03-29T01:08:05.475+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:08:00+00:00, run_after=2024-03-29T01:09:00+00:00 2024-03-29T01:08:05.520886062Z [2024-03-29T01:08:05.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:07:00+00:00 exited with status success for try_number 1 2024-03-29T01:08:05.527525862Z [2024-03-29T01:08:05.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:07:00+00:00, map_index=-1, run_start_date=2024-03-29 01:08:02.893643+00:00, run_end_date=2024-03-29 01:08:04.799413+00:00, run_duration=1.90577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:08:00.432120+00:00, queued_by_job_id=2, pid=6358 2024-03-29T01:08:45.085764392Z [2024-03-29T01:08:45.085+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:09:00.106211520Z [2024-03-29T01:09:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:09:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:09:00.120134633Z [2024-03-29T01:09:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:09:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:09:00.126602890Z [2024-03-29T01:09:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:09:00.214326285Z [2024-03-29T01:09:00.213+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:09:00.214372543Z 2024-03-29T01:09:00.214378430Z 2024-03-29T01:09:00.214383404Z 2024-03-29T01:09:00.214586933Z [2024-03-29T01:09:00.214+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:09:00.214878047Z [2024-03-29T01:09:00.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:09:00.215098846Z [2024-03-29T01:09:00.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:09:00.216108680Z [2024-03-29T01:09:00.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:09:00.216123815Z 2024-03-29T01:09:00.216128979Z 2024-03-29T01:09:00.216138094Z 2024-03-29T01:09:00.220313405Z [2024-03-29T01:09:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:09:00.220517354Z [2024-03-29T01:09:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:09:00.220796303Z [2024-03-29T01:09:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:09:00.220890985Z [2024-03-29T01:09:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:09:00.221171557Z [2024-03-29T01:09:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:09:00.221335492Z [2024-03-29T01:09:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:09:00.406376132Z [2024-03-29T01:09:00.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status queued for try_number 1 2024-03-29T01:09:00.406625313Z [2024-03-29T01:09:00.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status queued for try_number 1 2024-03-29T01:09:00.406792757Z [2024-03-29T01:09:00.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status queued for try_number 1 2024-03-29T01:09:00.417243515Z [2024-03-29T01:09:00.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73d8364b-acc4-4712-864b-66014b7450df 2024-03-29T01:09:00.417550464Z [2024-03-29T01:09:00.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 931e4053-1d0c-49b6-97a0-83f7a35ee562 2024-03-29T01:09:00.417779281Z [2024-03-29T01:09:00.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb638af4-309f-4467-9b65-9fca5b7b4ba0 2024-03-29T01:09:01.566088489Z [2024-03-29T01:09:01.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:09:01.566605620Z [2024-03-29T01:09:01.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:08:00+00:00, run_id=scheduled__2024-03-29T01:08:00+00:00, run_start_date=2024-03-29 01:09:00.150024+00:00, run_end_date=2024-03-29 01:09:01.566201+00:00, run_duration=1.416177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:08:00+00:00, data_interval_end=2024-03-29 01:09:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:09:01.578767824Z [2024-03-29T01:09:01.578+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:09:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:09:01.637385180Z [2024-03-29T01:09:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status success for try_number 1 2024-03-29T01:09:01.644510799Z [2024-03-29T01:09:01.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:08:00+00:00, map_index=-1, run_start_date=2024-03-29 01:09:01.026129+00:00, run_end_date=2024-03-29 01:09:01.385943+00:00, run_duration=0.359814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:09:00.217502+00:00, queued_by_job_id=2, pid=6390 2024-03-29T01:09:04.355416199Z [2024-03-29T01:09:04.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:09:04.356420371Z [2024-03-29T01:09:04.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:08:00+00:00, run_id=scheduled__2024-03-29T01:08:00+00:00, run_start_date=2024-03-29 01:09:00.153166+00:00, run_end_date=2024-03-29 01:09:04.355968+00:00, run_duration=4.202802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:08:00+00:00, data_interval_end=2024-03-29 01:09:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:09:04.368015520Z [2024-03-29T01:09:04.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:09:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:09:04.380923301Z [2024-03-29T01:09:04.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:09:04.381675997Z [2024-03-29T01:09:04.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:08:00+00:00, run_id=scheduled__2024-03-29T01:08:00+00:00, run_start_date=2024-03-29 01:09:00.151757+00:00, run_end_date=2024-03-29 01:09:04.380861+00:00, run_duration=4.229104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:08:00+00:00, data_interval_end=2024-03-29 01:09:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:09:04.410133840Z [2024-03-29T01:09:04.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:09:00+00:00, run_after=2024-03-29T01:10:00+00:00 2024-03-29T01:09:04.454419209Z [2024-03-29T01:09:04.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status success for try_number 1 2024-03-29T01:09:04.454500094Z [2024-03-29T01:09:04.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status success for try_number 1 2024-03-29T01:09:04.465552507Z [2024-03-29T01:09:04.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:08:00+00:00, map_index=-1, run_start_date=2024-03-29 01:09:01.921589+00:00, run_end_date=2024-03-29 01:09:04.007574+00:00, run_duration=2.085985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:09:00.217502+00:00, queued_by_job_id=2, pid=6408 2024-03-29T01:09:04.465617878Z [2024-03-29T01:09:04.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:08:00+00:00, map_index=-1, run_start_date=2024-03-29 01:09:02.051512+00:00, run_end_date=2024-03-29 01:09:03.415850+00:00, run_duration=1.364338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:09:00.217502+00:00, queued_by_job_id=2, pid=6409 2024-03-29T01:10:00.292205726Z [2024-03-29T01:10:00.291+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:10:00.303942694Z [2024-03-29T01:10:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:11:00+00:00 2024-03-29T01:10:00.315134445Z [2024-03-29T01:10:00.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:10:00.321087886Z [2024-03-29T01:10:00.320+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:10:00.332284147Z [2024-03-29T01:10:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:11:00+00:00 2024-03-29T01:10:00.448496613Z [2024-03-29T01:10:00.448+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:10:00.448533897Z 2024-03-29T01:10:00.448562446Z 2024-03-29T01:10:00.448569282Z 2024-03-29T01:10:00.448575309Z 2024-03-29T01:10:00.448580857Z 2024-03-29T01:10:00.448612596Z [2024-03-29T01:10:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:10:00.448857441Z [2024-03-29T01:10:00.448+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:10:00.448988791Z [2024-03-29T01:10:00.448+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:10:00.449230907Z [2024-03-29T01:10:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:10:00.449431060Z [2024-03-29T01:10:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:10:00.450213541Z [2024-03-29T01:10:00.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:10:00.450227354Z 2024-03-29T01:10:00.450232943Z 2024-03-29T01:10:00.450237731Z 2024-03-29T01:10:00.450242030Z 2024-03-29T01:10:00.450245689Z 2024-03-29T01:10:00.456078878Z [2024-03-29T01:10:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:10:00.456406866Z [2024-03-29T01:10:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:10:00.456818241Z [2024-03-29T01:10:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:10:00.457129905Z [2024-03-29T01:10:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:10:00.457501282Z [2024-03-29T01:10:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:10:00.457746500Z [2024-03-29T01:10:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:10:00.458015549Z [2024-03-29T01:10:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:10:00.458117315Z [2024-03-29T01:10:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:10:00.458409845Z [2024-03-29T01:10:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:10:00.458681201Z [2024-03-29T01:10:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:10:00.752500552Z [2024-03-29T01:10:00.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:00.752550511Z [2024-03-29T01:10:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:00.752829197Z [2024-03-29T01:10:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:09:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:00.752839813Z [2024-03-29T01:10:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:09:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:00.752869683Z [2024-03-29T01:10:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:09:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:00.772222393Z [2024-03-29T01:10:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9bb13f3-fc5e-49c9-b082-40f9d859f733 2024-03-29T01:10:00.772256785Z [2024-03-29T01:10:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8530f0f-333a-43bc-b170-20644412745f 2024-03-29T01:10:00.772373817Z [2024-03-29T01:10:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to e49232ab-cb03-4c85-91e0-c7d864ee57e8 2024-03-29T01:10:00.772471511Z [2024-03-29T01:10:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ed95440-11f8-483b-ae11-13f071cdbb39 2024-03-29T01:10:00.772588231Z [2024-03-29T01:10:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e8de585-bfc8-484a-8575-a67427cc1515 2024-03-29T01:10:02.588274809Z [2024-03-29T01:10:02.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:10:02.589120550Z [2024-03-29T01:10:02.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:08:00+00:00, run_id=scheduled__2024-03-29T01:08:00+00:00, run_start_date=2024-03-29 01:10:00.343996+00:00, run_end_date=2024-03-29 01:10:02.588130+00:00, run_duration=2.244134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:08:00+00:00, data_interval_end=2024-03-29 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:10:02.608089152Z [2024-03-29T01:10:02.607+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:12:00+00:00 2024-03-29T01:10:02.695358746Z [2024-03-29T01:10:02.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:10:02.695816894Z [2024-03-29T01:10:02.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:09:00+00:00, run_id=scheduled__2024-03-29T01:09:00+00:00, run_start_date=2024-03-29 01:10:00.345359+00:00, run_end_date=2024-03-29 01:10:02.695235+00:00, run_duration=2.349876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:09:00+00:00, data_interval_end=2024-03-29 01:10:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:10:02.718645585Z [2024-03-29T01:10:02.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:11:00+00:00 2024-03-29T01:10:02.800865001Z [2024-03-29T01:10:02.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:08:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:02.812268291Z [2024-03-29T01:10:02.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:08:00+00:00, map_index=-1, run_start_date=2024-03-29 01:10:01.306492+00:00, run_end_date=2024-03-29 01:10:01.844067+00:00, run_duration=0.537575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:00.451488+00:00, queued_by_job_id=2, pid=6444 2024-03-29T01:10:03.936029787Z [2024-03-29T01:10:03.935+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:10:03.936058782Z 2024-03-29T01:10:03.936260152Z [2024-03-29T01:10:03.935+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:10:03.936885605Z [2024-03-29T01:10:03.936+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:10:03.936902875Z 2024-03-29T01:10:03.939271187Z [2024-03-29T01:10:03.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:10:03.939466040Z [2024-03-29T01:10:03.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:10:04.031547340Z [2024-03-29T01:10:04.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:04.033283422Z [2024-03-29T01:10:04.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:04.033561304Z [2024-03-29T01:10:04.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:09:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:04.044202837Z [2024-03-29T01:10:04.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:05:00+00:00, map_index=-1, run_start_date=2024-03-29 01:10:03.370908+00:00, run_end_date=2024-03-29 01:10:03.799471+00:00, run_duration=0.428563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:00.451488+00:00, queued_by_job_id=2, pid=6474 2024-03-29T01:10:04.044497574Z [2024-03-29T01:10:04.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to e86a3051-d649-4c2f-8cfc-cb43c518b33e 2024-03-29T01:10:04.044921125Z [2024-03-29T01:10:04.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:09:00+00:00, map_index=-1, run_start_date=2024-03-29 01:10:01.831963+00:00, run_end_date=2024-03-29 01:10:02.637427+00:00, run_duration=0.805464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:00.451488+00:00, queued_by_job_id=2, pid=6450 2024-03-29T01:10:05.250713498Z [2024-03-29T01:10:05.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:10:05.251470132Z [2024-03-29T01:10:05.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:09:00+00:00, run_id=scheduled__2024-03-29T01:09:00+00:00, run_start_date=2024-03-29 01:10:00.346315+00:00, run_end_date=2024-03-29 01:10:05.250647+00:00, run_duration=4.904332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:09:00+00:00, data_interval_end=2024-03-29 01:10:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:10:05.267208571Z [2024-03-29T01:10:05.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:11:00+00:00 2024-03-29T01:10:05.349408037Z [2024-03-29T01:10:05.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:09:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:05.363901099Z [2024-03-29T01:10:05.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:09:00+00:00, map_index=-1, run_start_date=2024-03-29 01:10:03.378168+00:00, run_end_date=2024-03-29 01:10:04.651713+00:00, run_duration=1.273545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:00.451488+00:00, queued_by_job_id=2, pid=6475 2024-03-29T01:10:06.453785209Z [2024-03-29T01:10:06.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:10:06.456022124Z [2024-03-29T01:10:06.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:09:00+00:00, run_id=scheduled__2024-03-29T01:09:00+00:00, run_start_date=2024-03-29 01:10:00.347626+00:00, run_end_date=2024-03-29 01:10:06.453671+00:00, run_duration=6.106045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:09:00+00:00, data_interval_end=2024-03-29 01:10:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:10:06.489812739Z [2024-03-29T01:10:06.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:11:00+00:00 2024-03-29T01:10:06.610212153Z [2024-03-29T01:10:06.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:09:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:06.651004400Z [2024-03-29T01:10:06.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:09:00+00:00, map_index=-1, run_start_date=2024-03-29 01:10:03.498009+00:00, run_end_date=2024-03-29 01:10:05.221450+00:00, run_duration=1.723441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:00.451488+00:00, queued_by_job_id=2, pid=6476 2024-03-29T01:10:07.812410889Z [2024-03-29T01:10:07.811+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:10:07.812450796Z 2024-03-29T01:10:07.813023362Z [2024-03-29T01:10:07.812+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:10:07.814101587Z [2024-03-29T01:10:07.813+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:10:07.814118025Z 2024-03-29T01:10:07.819485748Z [2024-03-29T01:10:07.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:10:07.820138686Z [2024-03-29T01:10:07.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:10:07.900656884Z [2024-03-29T01:10:07.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:07.901832250Z [2024-03-29T01:10:07.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:07.911643594Z [2024-03-29T01:10:07.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ae6691a-7383-4573-9f37-7877db20f1ad 2024-03-29T01:10:07.911823361Z [2024-03-29T01:10:07.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:05:00+00:00, map_index=-1, run_start_date=2024-03-29 01:10:06.142955+00:00, run_end_date=2024-03-29 01:10:06.499393+00:00, run_duration=0.356438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:03.937221+00:00, queued_by_job_id=2, pid=6499 2024-03-29T01:10:10.128940507Z [2024-03-29T01:10:10.128+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:10:10.128965905Z 2024-03-29T01:10:10.129085469Z [2024-03-29T01:10:10.128+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:10:10.129702227Z [2024-03-29T01:10:10.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:10:10.129712509Z 2024-03-29T01:10:10.132047431Z [2024-03-29T01:10:10.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:10:10.132447697Z [2024-03-29T01:10:10.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:10:10.186770976Z [2024-03-29T01:10:10.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status queued for try_number 1 2024-03-29T01:10:10.187770847Z [2024-03-29T01:10:10.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:10.193878555Z [2024-03-29T01:10:10.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc2dabb0-ebcd-4369-ba33-9d1f8bfd3406 2024-03-29T01:10:10.194190419Z [2024-03-29T01:10:10.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:05:00+00:00, map_index=0, run_start_date=2024-03-29 01:10:09.657802+00:00, run_end_date=2024-03-29 01:10:09.964965+00:00, run_duration=0.307163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:07.815265+00:00, queued_by_job_id=2, pid=6507 2024-03-29T01:10:12.847755167Z [2024-03-29T01:10:12.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:10:12.848338382Z [2024-03-29T01:10:12.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:05:00+00:00, run_id=scheduled__2024-03-29T01:05:00+00:00, run_start_date=2024-03-29 01:10:00.342828+00:00, run_end_date=2024-03-29 01:10:12.847868+00:00, run_duration=12.50504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:05:00+00:00, data_interval_end=2024-03-29 01:10:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:10:12.856174578Z [2024-03-29T01:10:12.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:10:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:10:12.889805578Z [2024-03-29T01:10:12.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:05:00+00:00 exited with status success for try_number 1 2024-03-29T01:10:12.898271207Z [2024-03-29T01:10:12.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:05:00+00:00, map_index=-1, run_start_date=2024-03-29 01:10:11.902851+00:00, run_end_date=2024-03-29 01:10:12.258642+00:00, run_duration=0.355791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:10:10.130123+00:00, queued_by_job_id=2, pid=6515 2024-03-29T01:11:00.524431719Z [2024-03-29T01:11:00.523+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:11:00.547315790Z [2024-03-29T01:11:00.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:11:00+00:00, run_after=2024-03-29T01:12:00+00:00 2024-03-29T01:11:00.562946669Z [2024-03-29T01:11:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:11:00+00:00, run_after=2024-03-29T01:12:00+00:00 2024-03-29T01:11:00.628127849Z [2024-03-29T01:11:00.627+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:11:00.628154499Z 2024-03-29T01:11:00.628158643Z 2024-03-29T01:11:00.628162222Z 2024-03-29T01:11:00.628416666Z [2024-03-29T01:11:00.628+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:11:00.628722837Z [2024-03-29T01:11:00.628+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:11:00.628853986Z [2024-03-29T01:11:00.628+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:11:00.629450664Z [2024-03-29T01:11:00.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:11:00.629465397Z 2024-03-29T01:11:00.629468961Z 2024-03-29T01:11:00.629472437Z 2024-03-29T01:11:00.633457475Z [2024-03-29T01:11:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:11:00.633665820Z [2024-03-29T01:11:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:11:00.633954350Z [2024-03-29T01:11:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:11:00.634141101Z [2024-03-29T01:11:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:11:00.634411495Z [2024-03-29T01:11:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:11:00.634611357Z [2024-03-29T01:11:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:11:01.003687105Z [2024-03-29T01:11:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:11:01.003717673Z [2024-03-29T01:11:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:11:01.003833174Z [2024-03-29T01:11:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:11:01.019155146Z [2024-03-29T01:11:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a68083f-a1b8-4722-b130-53de1c842c13 2024-03-29T01:11:01.019268875Z [2024-03-29T01:11:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45f45246-c14b-4371-8ad3-7d3d2c9850c7 2024-03-29T01:11:01.019380853Z [2024-03-29T01:11:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ad2bda6-a8f0-4ca0-b492-d5c57a9ccf14 2024-03-29T01:11:02.217882186Z [2024-03-29T01:11:02.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:11:02.219413260Z [2024-03-29T01:11:02.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:10:00+00:00, run_id=scheduled__2024-03-29T01:10:00+00:00, run_start_date=2024-03-29 01:11:00.576737+00:00, run_end_date=2024-03-29 01:11:02.218136+00:00, run_duration=1.641399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:10:00+00:00, data_interval_end=2024-03-29 01:11:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:11:02.264912570Z [2024-03-29T01:11:02.264+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:11:00+00:00, run_after=2024-03-29T01:12:00+00:00 2024-03-29T01:11:02.308977648Z [2024-03-29T01:11:02.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:11:02.323289930Z [2024-03-29T01:11:02.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=-1, run_start_date=2024-03-29 01:11:01.525765+00:00, run_end_date=2024-03-29 01:11:02.034183+00:00, run_duration=0.508418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:11:00.630327+00:00, queued_by_job_id=2, pid=6537 2024-03-29T01:11:05.432043530Z [2024-03-29T01:11:05.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:11:05.432307342Z [2024-03-29T01:11:05.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:10:00+00:00, run_id=scheduled__2024-03-29T01:10:00+00:00, run_start_date=2024-03-29 01:11:00.578071+00:00, run_end_date=2024-03-29 01:11:05.432006+00:00, run_duration=4.853935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:10:00+00:00, data_interval_end=2024-03-29 01:11:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:11:05.446804910Z [2024-03-29T01:11:05.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:11:00+00:00, run_after=2024-03-29T01:12:00+00:00 2024-03-29T01:11:05.544627482Z [2024-03-29T01:11:05.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:11:05.568565027Z [2024-03-29T01:11:05.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=-1, run_start_date=2024-03-29 01:11:02.706154+00:00, run_end_date=2024-03-29 01:11:04.628694+00:00, run_duration=1.92254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:11:00.630327+00:00, queued_by_job_id=2, pid=6556 2024-03-29T01:11:06.666607014Z [2024-03-29T01:11:06.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:11:06.666641074Z [2024-03-29T01:11:06.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:10:00+00:00, run_id=scheduled__2024-03-29T01:10:00+00:00, run_start_date=2024-03-29 01:11:00.579289+00:00, run_end_date=2024-03-29 01:11:06.665974+00:00, run_duration=6.086685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:10:00+00:00, data_interval_end=2024-03-29 01:11:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:11:06.703895024Z [2024-03-29T01:11:06.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:11:00+00:00, run_after=2024-03-29T01:12:00+00:00 2024-03-29T01:11:06.755860082Z [2024-03-29T01:11:06.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:11:06.761941962Z [2024-03-29T01:11:06.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=-1, run_start_date=2024-03-29 01:11:02.701451+00:00, run_end_date=2024-03-29 01:11:05.292333+00:00, run_duration=2.590882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:11:00.630327+00:00, queued_by_job_id=2, pid=6555 2024-03-29T01:12:00.751646941Z [2024-03-29T01:12:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:12:00+00:00, run_after=2024-03-29T01:13:00+00:00 2024-03-29T01:12:00.759518886Z [2024-03-29T01:12:00.759+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:12:00.773004278Z [2024-03-29T01:12:00.772+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:12:00.793119454Z [2024-03-29T01:12:00.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:12:00+00:00, run_after=2024-03-29T01:13:00+00:00 2024-03-29T01:12:00.889887226Z [2024-03-29T01:12:00.889+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:12:00.889904059Z 2024-03-29T01:12:00.889909641Z 2024-03-29T01:12:00.889914566Z 2024-03-29T01:12:00.889919092Z 2024-03-29T01:12:00.889931750Z [2024-03-29T01:12:00.889+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:12:00.890084257Z [2024-03-29T01:12:00.889+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:12:00.890146968Z [2024-03-29T01:12:00.890+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:12:00.890229342Z [2024-03-29T01:12:00.890+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:12:00.890863222Z [2024-03-29T01:12:00.890+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:12:00.890902481Z 2024-03-29T01:12:00.890907326Z 2024-03-29T01:12:00.890911181Z 2024-03-29T01:12:00.890914684Z 2024-03-29T01:12:00.894889563Z [2024-03-29T01:12:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:12:00.894909347Z [2024-03-29T01:12:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:12:00.895125370Z [2024-03-29T01:12:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:12:00.895171712Z [2024-03-29T01:12:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:12:00.895337954Z [2024-03-29T01:12:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:12:00.895449085Z [2024-03-29T01:12:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:12:00.895626530Z [2024-03-29T01:12:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:12:00.895704877Z [2024-03-29T01:12:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:12:01.280495568Z [2024-03-29T01:12:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:12:01.280615722Z [2024-03-29T01:12:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:11:00+00:00 exited with status queued for try_number 1 2024-03-29T01:12:01.280707486Z [2024-03-29T01:12:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:11:00+00:00 exited with status queued for try_number 1 2024-03-29T01:12:01.280816978Z [2024-03-29T01:12:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:11:00+00:00 exited with status queued for try_number 1 2024-03-29T01:12:01.306562618Z [2024-03-29T01:12:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 732cf6b5-e46c-458b-ac52-7aad3940e3d2 2024-03-29T01:12:01.306764260Z [2024-03-29T01:12:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to df3f62d6-3dff-4589-8c36-341f6298394b 2024-03-29T01:12:01.307014199Z [2024-03-29T01:12:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7da3727f-5b05-497b-9513-367e7449547f 2024-03-29T01:12:01.307264160Z [2024-03-29T01:12:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to c527d98d-1975-4096-b250-c99cc493d39e 2024-03-29T01:12:02.578937929Z [2024-03-29T01:12:02.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:12:02.579405607Z [2024-03-29T01:12:02.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:10:00+00:00, run_id=scheduled__2024-03-29T01:10:00+00:00, run_start_date=2024-03-29 01:12:00.807623+00:00, run_end_date=2024-03-29 01:12:02.578827+00:00, run_duration=1.771204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:10:00+00:00, data_interval_end=2024-03-29 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:12:02.595839923Z [2024-03-29T01:12:02.595+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:12:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:12:02.666894804Z [2024-03-29T01:12:02.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:12:02.667190265Z [2024-03-29T01:12:02.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:11:00+00:00 exited with status success for try_number 1 2024-03-29T01:12:02.677064843Z [2024-03-29T01:12:02.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:11:00+00:00, map_index=-1, run_start_date=2024-03-29 01:12:01.870752+00:00, run_end_date=2024-03-29 01:12:02.434515+00:00, run_duration=0.563763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:12:00.891811+00:00, queued_by_job_id=2, pid=6590 2024-03-29T01:12:02.677635696Z [2024-03-29T01:12:02.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=-1, run_start_date=2024-03-29 01:12:01.773841+00:00, run_end_date=2024-03-29 01:12:02.350891+00:00, run_duration=0.57705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:12:00.891811+00:00, queued_by_job_id=2, pid=6589 2024-03-29T01:12:03.304285693Z [2024-03-29T01:12:03.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:12:03.304462629Z [2024-03-29T01:12:03.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:11:00+00:00, run_id=scheduled__2024-03-29T01:11:00+00:00, run_start_date=2024-03-29 01:12:00.808967+00:00, run_end_date=2024-03-29 01:12:03.304119+00:00, run_duration=2.495152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:11:00+00:00, data_interval_end=2024-03-29 01:12:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:12:03.317529859Z [2024-03-29T01:12:03.317+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:12:00+00:00, run_after=2024-03-29T01:13:00+00:00 2024-03-29T01:12:05.880084618Z [2024-03-29T01:12:05.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:12:05.880554835Z [2024-03-29T01:12:05.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:11:00+00:00, run_id=scheduled__2024-03-29T01:11:00+00:00, run_start_date=2024-03-29 01:12:00.812212+00:00, run_end_date=2024-03-29 01:12:05.879986+00:00, run_duration=5.067774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:11:00+00:00, data_interval_end=2024-03-29 01:12:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:12:05.892789999Z [2024-03-29T01:12:05.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:12:00+00:00, run_after=2024-03-29T01:13:00+00:00 2024-03-29T01:12:05.901746418Z [2024-03-29T01:12:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:12:05.902023877Z [2024-03-29T01:12:05.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:11:00+00:00, run_id=scheduled__2024-03-29T01:11:00+00:00, run_start_date=2024-03-29 01:12:00.813743+00:00, run_end_date=2024-03-29 01:12:05.901667+00:00, run_duration=5.087924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:11:00+00:00, data_interval_end=2024-03-29 01:12:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:12:05.915127883Z [2024-03-29T01:12:05.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:12:00+00:00, run_after=2024-03-29T01:13:00+00:00 2024-03-29T01:12:05.949125537Z [2024-03-29T01:12:05.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:11:00+00:00 exited with status success for try_number 1 2024-03-29T01:12:05.949155684Z [2024-03-29T01:12:05.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:11:00+00:00 exited with status success for try_number 1 2024-03-29T01:12:05.956470637Z [2024-03-29T01:12:05.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:11:00+00:00, map_index=-1, run_start_date=2024-03-29 01:12:03.403181+00:00, run_end_date=2024-03-29 01:12:04.791861+00:00, run_duration=1.38868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:12:00.891811+00:00, queued_by_job_id=2, pid=6614 2024-03-29T01:12:05.956622613Z [2024-03-29T01:12:05.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:11:00+00:00, map_index=-1, run_start_date=2024-03-29 01:12:03.067347+00:00, run_end_date=2024-03-29 01:12:05.040672+00:00, run_duration=1.973325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:12:00.891811+00:00, queued_by_job_id=2, pid=6608 2024-03-29T01:13:00.248939229Z [2024-03-29T01:13:00.248+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:13:00.267406479Z [2024-03-29T01:13:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:13:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:13:00.285848394Z [2024-03-29T01:13:00.285+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:13:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:13:00.409531967Z [2024-03-29T01:13:00.408+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:13:00.409568560Z 2024-03-29T01:13:00.409575468Z 2024-03-29T01:13:00.409581960Z 2024-03-29T01:13:00.409588123Z [2024-03-29T01:13:00.409+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:13:00.409694835Z [2024-03-29T01:13:00.409+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:13:00.409884731Z [2024-03-29T01:13:00.409+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:13:00.410816705Z [2024-03-29T01:13:00.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:13:00.410829619Z 2024-03-29T01:13:00.410835914Z 2024-03-29T01:13:00.410842045Z 2024-03-29T01:13:00.417332230Z [2024-03-29T01:13:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:13:00.417517279Z [2024-03-29T01:13:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:13:00.417782573Z [2024-03-29T01:13:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:13:00.417935016Z [2024-03-29T01:13:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:13:00.418610704Z [2024-03-29T01:13:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:13:00.418838308Z [2024-03-29T01:13:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:13:00.693130174Z [2024-03-29T01:13:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status queued for try_number 1 2024-03-29T01:13:00.693296240Z [2024-03-29T01:13:00.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status queued for try_number 1 2024-03-29T01:13:00.693829995Z [2024-03-29T01:13:00.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status queued for try_number 1 2024-03-29T01:13:00.703911248Z [2024-03-29T01:13:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a39facb-1b7f-40ca-90d7-89afecad9cd5 2024-03-29T01:13:00.704280821Z [2024-03-29T01:13:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to be9ddcd0-66d3-4299-924f-9c202d5ce7ea 2024-03-29T01:13:00.704495541Z [2024-03-29T01:13:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ccefebf-2a55-494f-b715-230b7fab371a 2024-03-29T01:13:01.925046912Z [2024-03-29T01:13:01.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:13:01.925723137Z [2024-03-29T01:13:01.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:12:00+00:00, run_id=scheduled__2024-03-29T01:12:00+00:00, run_start_date=2024-03-29 01:13:00.299776+00:00, run_end_date=2024-03-29 01:13:01.925135+00:00, run_duration=1.625359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:12:00+00:00, data_interval_end=2024-03-29 01:13:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:13:01.941632331Z [2024-03-29T01:13:01.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:13:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:13:01.985925688Z [2024-03-29T01:13:01.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status success for try_number 1 2024-03-29T01:13:01.992805077Z [2024-03-29T01:13:01.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:12:00+00:00, map_index=-1, run_start_date=2024-03-29 01:13:01.125422+00:00, run_end_date=2024-03-29 01:13:01.438738+00:00, run_duration=0.313316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:13:00.412644+00:00, queued_by_job_id=2, pid=6646 2024-03-29T01:13:05.384849303Z [2024-03-29T01:13:05.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:13:05.385573666Z [2024-03-29T01:13:05.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:12:00+00:00, run_id=scheduled__2024-03-29T01:12:00+00:00, run_start_date=2024-03-29 01:13:00.303502+00:00, run_end_date=2024-03-29 01:13:05.384777+00:00, run_duration=5.081275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:12:00+00:00, data_interval_end=2024-03-29 01:13:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:13:05.406341904Z [2024-03-29T01:13:05.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:13:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:13:05.420918454Z [2024-03-29T01:13:05.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:13:05.421572525Z [2024-03-29T01:13:05.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:12:00+00:00, run_id=scheduled__2024-03-29T01:12:00+00:00, run_start_date=2024-03-29 01:13:00.301608+00:00, run_end_date=2024-03-29 01:13:05.420810+00:00, run_duration=5.119202, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:12:00+00:00, data_interval_end=2024-03-29 01:13:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:13:05.441897068Z [2024-03-29T01:13:05.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:13:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:13:05.515892801Z [2024-03-29T01:13:05.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status success for try_number 1 2024-03-29T01:13:05.516349559Z [2024-03-29T01:13:05.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status success for try_number 1 2024-03-29T01:13:05.531308118Z [2024-03-29T01:13:05.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:12:00+00:00, map_index=-1, run_start_date=2024-03-29 01:13:02.349797+00:00, run_end_date=2024-03-29 01:13:04.823656+00:00, run_duration=2.473859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:13:00.412644+00:00, queued_by_job_id=2, pid=6665 2024-03-29T01:13:05.531888240Z [2024-03-29T01:13:05.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:12:00+00:00, map_index=-1, run_start_date=2024-03-29 01:13:02.201177+00:00, run_end_date=2024-03-29 01:13:04.837853+00:00, run_duration=2.636676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:13:00.412644+00:00, queued_by_job_id=2, pid=6664 2024-03-29T01:13:25.685344436Z [2024-03-29T01:13:25.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 to 2024-03-29T01:13:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:13:25.741479628Z [2024-03-29T01:13:25.741+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:13:25.742311020Z 2024-03-29T01:13:25.742331623Z [2024-03-29T01:13:25.741+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 has 0/16 running and queued tasks 2024-03-29T01:13:25.742340835Z [2024-03-29T01:13:25.742+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:13:25.742344175Z 2024-03-29T01:13:25.744418416Z [2024-03-29T01:13:25.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:13:25.744613780Z [2024-03-29T01:13:25.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:13:25.821187168Z [2024-03-29T01:13:25.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status queued for try_number 1 2024-03-29T01:13:25.834635626Z [2024-03-29T01:13:25.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82d257ce-08ee-417c-981c-82174b483158 2024-03-29T01:13:28.034405252Z [2024-03-29T01:13:28.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:13:28.034773848Z [2024-03-29T01:13:28.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, execution_date=2024-03-29 01:12:00+00:00, run_id=scheduled__2024-03-29T01:12:00+00:00, run_start_date=2024-03-29 01:13:25.700603+00:00, run_end_date=2024-03-29 01:13:28.034268+00:00, run_duration=2.333665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:12:00+00:00, data_interval_end=2024-03-29 01:13:00+00:00, dag_hash=e4cefa996e2943d7dd6ce1b8328128e3 2024-03-29T01:13:28.043170777Z [2024-03-29T01:13:28.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 to 2024-03-29T01:13:00+00:00, run_after=2024-03-29T01:14:00+00:00 2024-03-29T01:13:28.074162683Z [2024-03-29T01:13:28.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status success for try_number 1 2024-03-29T01:13:28.079843523Z [2024-03-29T01:13:28.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:12:00+00:00, map_index=-1, run_start_date=2024-03-29 01:13:26.471409+00:00, run_end_date=2024-03-29 01:13:26.855674+00:00, run_duration=0.384265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:13:25.742614+00:00, queued_by_job_id=2, pid=6695 2024-03-29T01:13:45.180665939Z [2024-03-29T01:13:45.175+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:14:00.132828614Z [2024-03-29T01:14:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:14:00.140660059Z [2024-03-29T01:14:00.140+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:14:00.153117410Z [2024-03-29T01:14:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:14:00.165058090Z [2024-03-29T01:14:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:14:00.171415811Z [2024-03-29T01:14:00.171+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:14:00.276703663Z [2024-03-29T01:14:00.276+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:14:00.276732960Z 2024-03-29T01:14:00.276738833Z 2024-03-29T01:14:00.276744487Z 2024-03-29T01:14:00.276750517Z 2024-03-29T01:14:00.276757963Z 2024-03-29T01:14:00.276815283Z [2024-03-29T01:14:00.276+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:14:00.277132337Z [2024-03-29T01:14:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:14:00.277390619Z [2024-03-29T01:14:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:14:00.277527492Z [2024-03-29T01:14:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:14:00.277683749Z [2024-03-29T01:14:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 has 0/16 running and queued tasks 2024-03-29T01:14:00.278355916Z [2024-03-29T01:14:00.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:14:00.278367632Z 2024-03-29T01:14:00.278372549Z 2024-03-29T01:14:00.278376884Z 2024-03-29T01:14:00.278381222Z 2024-03-29T01:14:00.278406559Z 2024-03-29T01:14:00.283043214Z [2024-03-29T01:14:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:14:00.283079636Z [2024-03-29T01:14:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:14:00.283330023Z [2024-03-29T01:14:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:14:00.283397103Z [2024-03-29T01:14:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:14:00.283825032Z [2024-03-29T01:14:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:14:00.283888532Z [2024-03-29T01:14:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:14:00.284413912Z [2024-03-29T01:14:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:14:00.284445345Z [2024-03-29T01:14:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:14:00.284588729Z [2024-03-29T01:14:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:14:00.284740619Z [2024-03-29T01:14:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:14:00.875723117Z [2024-03-29T01:14:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status queued for try_number 1 2024-03-29T01:14:00.875942840Z [2024-03-29T01:14:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status queued for try_number 1 2024-03-29T01:14:00.876137335Z [2024-03-29T01:14:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status queued for try_number 1 2024-03-29T01:14:00.876304778Z [2024-03-29T01:14:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status queued for try_number 1 2024-03-29T01:14:00.876485655Z [2024-03-29T01:14:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status queued for try_number 1 2024-03-29T01:14:00.901084612Z [2024-03-29T01:14:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to c716b496-46e6-427e-865d-f9fe3e1763cf 2024-03-29T01:14:00.901489047Z [2024-03-29T01:14:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0185a1f3-91a7-40ab-b455-bd56d08b98fd 2024-03-29T01:14:00.901746277Z [2024-03-29T01:14:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 369a7779-e3d1-463b-a653-1dfb427c7548 2024-03-29T01:14:00.901977083Z [2024-03-29T01:14:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to a848ffb0-9d82-43c6-9e5f-38250f180f0d 2024-03-29T01:14:00.902229555Z [2024-03-29T01:14:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b43c1a9-d395-405e-8e95-5df86e5182cd 2024-03-29T01:14:02.165924153Z [2024-03-29T01:14:02.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:14:02.166709088Z [2024-03-29T01:14:02.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:12:00+00:00, run_id=scheduled__2024-03-29T01:12:00+00:00, run_start_date=2024-03-29 01:14:00.180890+00:00, run_end_date=2024-03-29 01:14:02.166060+00:00, run_duration=1.98517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:12:00+00:00, data_interval_end=2024-03-29 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:14:02.182739281Z [2024-03-29T01:14:02.181+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:14:02.197460011Z [2024-03-29T01:14:02.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:14:02.198117367Z [2024-03-29T01:14:02.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, execution_date=2024-03-29 01:13:00+00:00, run_id=scheduled__2024-03-29T01:13:00+00:00, run_start_date=2024-03-29 01:14:00.181960+00:00, run_end_date=2024-03-29 01:14:02.197524+00:00, run_duration=2.015564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:13:00+00:00, data_interval_end=2024-03-29 01:14:00+00:00, dag_hash=e4cefa996e2943d7dd6ce1b8328128e3 2024-03-29T01:14:02.223017708Z [2024-03-29T01:14:02.222+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:14:02.329285127Z [2024-03-29T01:14:02.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:12:00+00:00 exited with status success for try_number 1 2024-03-29T01:14:02.330509631Z [2024-03-29T01:14:02.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status success for try_number 1 2024-03-29T01:14:02.344334628Z [2024-03-29T01:14:02.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:13:00+00:00, map_index=-1, run_start_date=2024-03-29 01:14:01.328724+00:00, run_end_date=2024-03-29 01:14:01.988181+00:00, run_duration=0.659457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:14:00.279452+00:00, queued_by_job_id=2, pid=6717 2024-03-29T01:14:02.344386782Z [2024-03-29T01:14:02.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:12:00+00:00, map_index=-1, run_start_date=2024-03-29 01:14:01.224254+00:00, run_end_date=2024-03-29 01:14:01.894252+00:00, run_duration=0.669998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:14:00.279452+00:00, queued_by_job_id=2, pid=6711 2024-03-29T01:14:03.398759261Z [2024-03-29T01:14:03.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:14:03.399162258Z [2024-03-29T01:14:03.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:13:00+00:00, run_id=scheduled__2024-03-29T01:13:00+00:00, run_start_date=2024-03-29 01:14:00.183526+00:00, run_end_date=2024-03-29 01:14:03.398588+00:00, run_duration=3.215062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:13:00+00:00, data_interval_end=2024-03-29 01:14:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:14:03.416240533Z [2024-03-29T01:14:03.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:14:03.482016143Z [2024-03-29T01:14:03.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status success for try_number 1 2024-03-29T01:14:03.488438195Z [2024-03-29T01:14:03.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:13:00+00:00, map_index=-1, run_start_date=2024-03-29 01:14:01.640066+00:00, run_end_date=2024-03-29 01:14:02.193815+00:00, run_duration=0.553749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:14:00.279452+00:00, queued_by_job_id=2, pid=6719 2024-03-29T01:14:04.456862908Z [2024-03-29T01:14:04.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:14:04.457202483Z [2024-03-29T01:14:04.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:13:00+00:00, run_id=scheduled__2024-03-29T01:13:00+00:00, run_start_date=2024-03-29 01:14:00.184619+00:00, run_end_date=2024-03-29 01:14:04.456849+00:00, run_duration=4.27223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:13:00+00:00, data_interval_end=2024-03-29 01:14:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:14:04.468186797Z [2024-03-29T01:14:04.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:14:04.516972090Z [2024-03-29T01:14:04.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status success for try_number 1 2024-03-29T01:14:04.523045621Z [2024-03-29T01:14:04.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:13:00+00:00, map_index=-1, run_start_date=2024-03-29 01:14:02.863528+00:00, run_end_date=2024-03-29 01:14:04.159792+00:00, run_duration=1.296264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:14:00.279452+00:00, queued_by_job_id=2, pid=6752 2024-03-29T01:14:05.590369231Z [2024-03-29T01:14:05.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:14:05.590916031Z [2024-03-29T01:14:05.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:13:00+00:00, run_id=scheduled__2024-03-29T01:13:00+00:00, run_start_date=2024-03-29 01:14:00.185661+00:00, run_end_date=2024-03-29 01:14:05.590582+00:00, run_duration=5.404921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:13:00+00:00, data_interval_end=2024-03-29 01:14:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:14:05.600166057Z [2024-03-29T01:14:05.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:14:00+00:00, run_after=2024-03-29T01:15:00+00:00 2024-03-29T01:14:05.684467958Z [2024-03-29T01:14:05.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:13:00+00:00 exited with status success for try_number 1 2024-03-29T01:14:05.689261229Z [2024-03-29T01:14:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:13:00+00:00, map_index=-1, run_start_date=2024-03-29 01:14:02.563056+00:00, run_end_date=2024-03-29 01:14:04.602536+00:00, run_duration=2.03948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:14:00.279452+00:00, queued_by_job_id=2, pid=6741 2024-03-29T01:15:00.493197386Z [2024-03-29T01:15:00.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:15:00.502885727Z [2024-03-29T01:15:00.502+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:15:00.523837236Z [2024-03-29T01:15:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:15:00.539064587Z [2024-03-29T01:15:00.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:15:00.553115367Z [2024-03-29T01:15:00.552+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:15:00.673648598Z [2024-03-29T01:15:00.673+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:15:00.673684012Z 2024-03-29T01:15:00.673689416Z 2024-03-29T01:15:00.673693687Z 2024-03-29T01:15:00.673697936Z 2024-03-29T01:15:00.673701855Z 2024-03-29T01:15:00.673705964Z [2024-03-29T01:15:00.673+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:15:00.673835418Z [2024-03-29T01:15:00.673+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 has 0/16 running and queued tasks 2024-03-29T01:15:00.674107325Z [2024-03-29T01:15:00.673+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:15:00.674287236Z [2024-03-29T01:15:00.674+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:15:00.674523276Z [2024-03-29T01:15:00.674+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:15:00.675758485Z [2024-03-29T01:15:00.675+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:15:00.675782800Z 2024-03-29T01:15:00.675788172Z 2024-03-29T01:15:00.675793569Z 2024-03-29T01:15:00.675797917Z 2024-03-29T01:15:00.675802198Z 2024-03-29T01:15:00.679630390Z [2024-03-29T01:15:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:15:00.679838516Z [2024-03-29T01:15:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:15:00.680158430Z [2024-03-29T01:15:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:15:00.680342591Z [2024-03-29T01:15:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:15:00.680560592Z [2024-03-29T01:15:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:15:00.680672688Z [2024-03-29T01:15:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:15:00.680871852Z [2024-03-29T01:15:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:15:00.681042430Z [2024-03-29T01:15:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:15:00.681265623Z [2024-03-29T01:15:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:15:00.681391389Z [2024-03-29T01:15:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:15:01.047845011Z [2024-03-29T01:15:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:01.048027960Z [2024-03-29T01:15:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:01.048234381Z [2024-03-29T01:15:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:01.048379039Z [2024-03-29T01:15:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:01.048541849Z [2024-03-29T01:15:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:01.062767683Z [2024-03-29T01:15:01.062+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdfe6126-3495-481a-93b8-9a1ea8e18d5f 2024-03-29T01:15:01.062953910Z [2024-03-29T01:15:01.062+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a2329eb-7baa-4fcb-9c6e-b25a85af19c5 2024-03-29T01:15:01.063150476Z [2024-03-29T01:15:01.062+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33d65a2f-b884-4f44-9912-583b9e3d657c 2024-03-29T01:15:01.063307105Z [2024-03-29T01:15:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5db1701d-c794-4eba-a2df-20a502089cd2 2024-03-29T01:15:01.063533024Z [2024-03-29T01:15:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f4f1e53-266f-4365-9f73-590855533e70 2024-03-29T01:15:01.989702605Z [2024-03-29T01:15:01.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status failed for try_number 1 2024-03-29T01:15:02.001273090Z [2024-03-29T01:15:02.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:00.676769+00:00, queued_by_job_id=2, pid=None 2024-03-29T01:15:02.002306430Z [2024-03-29T01:15:02.001+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T01:15:02.005455024Z [2024-03-29T01:15:02.005+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T01:15:02.043357697Z [2024-03-29T01:15:02.042+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240329T011400, start_date=, end_date=20240329T011502 2024-03-29T01:15:03.160800902Z [2024-03-29T01:15:03.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:15:03.162351863Z [2024-03-29T01:15:03.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:14:00+00:00, run_id=scheduled__2024-03-29T01:14:00+00:00, run_start_date=2024-03-29 01:15:00.574232+00:00, run_end_date=2024-03-29 01:15:03.161779+00:00, run_duration=2.587547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:14:00+00:00, data_interval_end=2024-03-29 01:15:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:15:03.176889851Z [2024-03-29T01:15:03.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:15:03.295391884Z [2024-03-29T01:15:03.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status success for try_number 1 2024-03-29T01:15:03.305433021Z [2024-03-29T01:15:03.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:14:00+00:00, map_index=-1, run_start_date=2024-03-29 01:15:01.601756+00:00, run_end_date=2024-03-29 01:15:02.193257+00:00, run_duration=0.591501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:00.676769+00:00, queued_by_job_id=2, pid=6791 2024-03-29T01:15:04.421189674Z [2024-03-29T01:15:04.420+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:15:04.421243300Z 2024-03-29T01:15:04.421489742Z [2024-03-29T01:15:04.421+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:15:04.422266337Z [2024-03-29T01:15:04.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:15:04.422272268Z 2024-03-29T01:15:04.425902906Z [2024-03-29T01:15:04.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:15:04.426262175Z [2024-03-29T01:15:04.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:15:04.482030896Z [2024-03-29T01:15:04.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:04.482056813Z [2024-03-29T01:15:04.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:15:04.487766189Z [2024-03-29T01:15:04.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d2ce4e5-c0bb-4e9e-a2a7-105abaa388a7 2024-03-29T01:15:04.487851297Z [2024-03-29T01:15:04.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=-1, run_start_date=2024-03-29 01:15:03.388290+00:00, run_end_date=2024-03-29 01:15:03.853686+00:00, run_duration=0.465396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:00.676769+00:00, queued_by_job_id=2, pid=6816 2024-03-29T01:15:04.914142821Z [2024-03-29T01:15:04.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:15:04.914389649Z [2024-03-29T01:15:04.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:14:00+00:00, run_id=scheduled__2024-03-29T01:14:00+00:00, run_start_date=2024-03-29 01:15:00.575553+00:00, run_end_date=2024-03-29 01:15:04.914009+00:00, run_duration=4.338456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:14:00+00:00, data_interval_end=2024-03-29 01:15:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:15:04.925299407Z [2024-03-29T01:15:04.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:15:05.095479413Z [2024-03-29T01:15:05.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status success for try_number 1 2024-03-29T01:15:05.110361623Z [2024-03-29T01:15:05.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:14:00+00:00, map_index=-1, run_start_date=2024-03-29 01:15:03.392480+00:00, run_end_date=2024-03-29 01:15:04.726834+00:00, run_duration=1.334354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:00.676769+00:00, queued_by_job_id=2, pid=6817 2024-03-29T01:15:06.171730334Z [2024-03-29T01:15:06.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:15:06.171834226Z [2024-03-29T01:15:06.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:14:00+00:00, run_id=scheduled__2024-03-29T01:14:00+00:00, run_start_date=2024-03-29 01:15:00.578956+00:00, run_end_date=2024-03-29 01:15:06.171581+00:00, run_duration=5.592625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:14:00+00:00, data_interval_end=2024-03-29 01:15:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:15:06.184785756Z [2024-03-29T01:15:06.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:15:06.282072741Z [2024-03-29T01:15:06.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status success for try_number 1 2024-03-29T01:15:06.288344422Z [2024-03-29T01:15:06.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:14:00+00:00, map_index=-1, run_start_date=2024-03-29 01:15:03.177385+00:00, run_end_date=2024-03-29 01:15:05.130059+00:00, run_duration=1.952674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:00.676769+00:00, queued_by_job_id=2, pid=6815 2024-03-29T01:15:07.204854422Z [2024-03-29T01:15:07.204+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:15:07.204880849Z 2024-03-29T01:15:07.205725289Z [2024-03-29T01:15:07.204+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:15:07.207153371Z [2024-03-29T01:15:07.206+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:15:07.207179570Z 2024-03-29T01:15:07.212779074Z [2024-03-29T01:15:07.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:15:07.212822701Z [2024-03-29T01:15:07.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:15:07.437894392Z [2024-03-29T01:15:07.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:07.437961336Z [2024-03-29T01:15:07.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:15:07.451536721Z [2024-03-29T01:15:07.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 731681fd-8587-48b4-a824-ebff6e04e6fb 2024-03-29T01:15:07.451979524Z [2024-03-29T01:15:07.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=-1, run_start_date=2024-03-29 01:15:06.538251+00:00, run_end_date=2024-03-29 01:15:06.897305+00:00, run_duration=0.359054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:04.422946+00:00, queued_by_job_id=2, pid=6840 2024-03-29T01:15:09.812509114Z [2024-03-29T01:15:09.810+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:15:09.812565385Z 2024-03-29T01:15:09.812578844Z [2024-03-29T01:15:09.812+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:15:09.813301965Z [2024-03-29T01:15:09.812+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:15:09.813323410Z 2024-03-29T01:15:09.817512846Z [2024-03-29T01:15:09.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:15:09.817544008Z [2024-03-29T01:15:09.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:15:09.892459722Z [2024-03-29T01:15:09.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status queued for try_number 1 2024-03-29T01:15:09.893992773Z [2024-03-29T01:15:09.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:15:09.905794832Z [2024-03-29T01:15:09.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc1b6d37-4ce0-465e-9142-fc4c316aba62 2024-03-29T01:15:09.906233179Z [2024-03-29T01:15:09.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=0, run_start_date=2024-03-29 01:15:09.230809+00:00, run_end_date=2024-03-29 01:15:09.641754+00:00, run_duration=0.410945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:07.208085+00:00, queued_by_job_id=2, pid=6848 2024-03-29T01:15:12.208932078Z [2024-03-29T01:15:12.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:15:12.209325388Z [2024-03-29T01:15:12.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:10:00+00:00, run_id=scheduled__2024-03-29T01:10:00+00:00, run_start_date=2024-03-29 01:15:00.571243+00:00, run_end_date=2024-03-29 01:15:12.208819+00:00, run_duration=11.637576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:10:00+00:00, data_interval_end=2024-03-29 01:15:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:15:12.215951883Z [2024-03-29T01:15:12.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:15:12.269070112Z [2024-03-29T01:15:12.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:15:12.269096556Z 2024-03-29T01:15:12.269328302Z [2024-03-29T01:15:12.269+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 has 0/16 running and queued tasks 2024-03-29T01:15:12.270228145Z [2024-03-29T01:15:12.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:15:12.270239557Z 2024-03-29T01:15:12.272928815Z [2024-03-29T01:15:12.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:14:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:15:12.273175232Z [2024-03-29T01:15:12.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:15:12.332947406Z [2024-03-29T01:15:12.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status queued for try_number 2 2024-03-29T01:15:12.333125033Z [2024-03-29T01:15:12.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:10:00+00:00 exited with status success for try_number 1 2024-03-29T01:15:12.341606921Z [2024-03-29T01:15:12.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:10:00+00:00, map_index=-1, run_start_date=2024-03-29 01:15:11.772801+00:00, run_end_date=2024-03-29 01:15:12.152636+00:00, run_duration=0.379835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:09.813835+00:00, queued_by_job_id=2, pid=6856 2024-03-29T01:15:12.342177885Z [2024-03-29T01:15:12.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 131564b0-90b5-4619-b5b9-409d38422d92 2024-03-29T01:15:13.664970980Z [2024-03-29T01:15:13.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status failed for try_number 2 2024-03-29T01:15:13.671903154Z [2024-03-29T01:15:13.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-29 01:15:02.010210+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:15:12.270730+00:00, queued_by_job_id=2, pid=None 2024-03-29T01:15:13.672581095Z [2024-03-29T01:15:13.672+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T01:15:13.675459679Z [2024-03-29T01:15:13.675+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T01:15:13.694152695Z [2024-03-29T01:15:13.693+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240329T011400, start_date=, end_date=20240329T011513 2024-03-29T01:15:14.498048245Z [2024-03-29T01:15:14.497+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-29T01:15:14.498236716Z [2024-03-29T01:15:14.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8, execution_date=2024-03-29 01:14:00+00:00, run_id=scheduled__2024-03-29T01:14:00+00:00, run_start_date=2024-03-29 01:15:00.572911+00:00, run_end_date=2024-03-29 01:15:14.497855+00:00, run_duration=13.924944, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:14:00+00:00, data_interval_end=2024-03-29 01:15:00+00:00, dag_hash=e4cefa996e2943d7dd6ce1b8328128e3 2024-03-29T01:15:14.507449768Z [2024-03-29T01:15:14.507+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_0c55f103-1888-4383-bae8-2e05f81656c8 to 2024-03-29T01:15:00+00:00, run_after=2024-03-29T01:16:00+00:00 2024-03-29T01:16:00.768928802Z [2024-03-29T01:16:00.768+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:16:00.796535863Z [2024-03-29T01:16:00.796+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:16:00+00:00, run_after=2024-03-29T01:17:00+00:00 2024-03-29T01:16:00.814719351Z [2024-03-29T01:16:00.814+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:16:00.837379768Z [2024-03-29T01:16:00.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:16:00+00:00, run_after=2024-03-29T01:17:00+00:00 2024-03-29T01:16:00.942880149Z [2024-03-29T01:16:00.942+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:16:00.942909020Z 2024-03-29T01:16:00.942913813Z 2024-03-29T01:16:00.942917459Z 2024-03-29T01:16:00.942935278Z 2024-03-29T01:16:00.943184852Z [2024-03-29T01:16:00.942+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:16:00.943416334Z [2024-03-29T01:16:00.943+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:16:00.943695540Z [2024-03-29T01:16:00.943+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:16:00.943963229Z [2024-03-29T01:16:00.943+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:16:00.944691846Z [2024-03-29T01:16:00.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:16:00.944707668Z 2024-03-29T01:16:00.944714041Z 2024-03-29T01:16:00.944719392Z 2024-03-29T01:16:00.944724501Z 2024-03-29T01:16:00.949413584Z [2024-03-29T01:16:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:16:00.949904022Z [2024-03-29T01:16:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:16:00.950524438Z [2024-03-29T01:16:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:16:00.950769736Z [2024-03-29T01:16:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:16:00.951243012Z [2024-03-29T01:16:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:16:00.951663298Z [2024-03-29T01:16:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:16:00.952115827Z [2024-03-29T01:16:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:16:00.952397618Z [2024-03-29T01:16:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:16:01.333721189Z [2024-03-29T01:16:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status queued for try_number 1 2024-03-29T01:16:01.336447978Z [2024-03-29T01:16:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status queued for try_number 1 2024-03-29T01:16:01.336839480Z [2024-03-29T01:16:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status queued for try_number 1 2024-03-29T01:16:01.337171395Z [2024-03-29T01:16:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status queued for try_number 1 2024-03-29T01:16:01.348088864Z [2024-03-29T01:16:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea0a19cc-8d2e-46a6-a59e-9c5ad353f222 2024-03-29T01:16:01.348890500Z [2024-03-29T01:16:01.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9dbbbea-4f67-417f-8d42-b961cd90a631 2024-03-29T01:16:01.349335431Z [2024-03-29T01:16:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 410a08d4-9c36-4dcf-9bd1-4a39f4f95dec 2024-03-29T01:16:01.349672157Z [2024-03-29T01:16:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2393294b-90e9-4f67-a78b-cf93fb99e761 2024-03-29T01:16:03.191512472Z [2024-03-29T01:16:03.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:16:03.193537690Z [2024-03-29T01:16:03.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:14:00+00:00, run_id=scheduled__2024-03-29T01:14:00+00:00, run_start_date=2024-03-29 01:16:00.860118+00:00, run_end_date=2024-03-29 01:16:03.192459+00:00, run_duration=2.332341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:14:00+00:00, data_interval_end=2024-03-29 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:16:03.221821980Z [2024-03-29T01:16:03.221+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:16:00+00:00, run_after=2024-03-29T01:18:00+00:00 2024-03-29T01:16:03.234682939Z [2024-03-29T01:16:03.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:16:03.235110826Z [2024-03-29T01:16:03.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:15:00+00:00, run_id=scheduled__2024-03-29T01:15:00+00:00, run_start_date=2024-03-29 01:16:00.862084+00:00, run_end_date=2024-03-29 01:16:03.234649+00:00, run_duration=2.372565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:15:00+00:00, data_interval_end=2024-03-29 01:16:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:16:03.263063606Z [2024-03-29T01:16:03.262+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:16:00+00:00, run_after=2024-03-29T01:17:00+00:00 2024-03-29T01:16:03.321639432Z [2024-03-29T01:16:03.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:14:00+00:00 exited with status success for try_number 1 2024-03-29T01:16:03.321840360Z [2024-03-29T01:16:03.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status success for try_number 1 2024-03-29T01:16:03.330426122Z [2024-03-29T01:16:03.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:14:00+00:00, map_index=-1, run_start_date=2024-03-29 01:16:02.076173+00:00, run_end_date=2024-03-29 01:16:02.595448+00:00, run_duration=0.519275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:16:00.945883+00:00, queued_by_job_id=2, pid=6891 2024-03-29T01:16:03.330870718Z [2024-03-29T01:16:03.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:15:00+00:00, map_index=-1, run_start_date=2024-03-29 01:16:02.313372+00:00, run_end_date=2024-03-29 01:16:02.789624+00:00, run_duration=0.476252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:16:00.945883+00:00, queued_by_job_id=2, pid=6893 2024-03-29T01:16:05.480513534Z [2024-03-29T01:16:05.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:16:05.480819144Z [2024-03-29T01:16:05.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:15:00+00:00, run_id=scheduled__2024-03-29T01:15:00+00:00, run_start_date=2024-03-29 01:16:00.866055+00:00, run_end_date=2024-03-29 01:16:05.480448+00:00, run_duration=4.614393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:15:00+00:00, data_interval_end=2024-03-29 01:16:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:16:05.490834775Z [2024-03-29T01:16:05.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:16:00+00:00, run_after=2024-03-29T01:17:00+00:00 2024-03-29T01:16:05.501931619Z [2024-03-29T01:16:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:16:05.502343452Z [2024-03-29T01:16:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:15:00+00:00, run_id=scheduled__2024-03-29T01:15:00+00:00, run_start_date=2024-03-29 01:16:00.864211+00:00, run_end_date=2024-03-29 01:16:05.502028+00:00, run_duration=4.637817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:15:00+00:00, data_interval_end=2024-03-29 01:16:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:16:05.514299811Z [2024-03-29T01:16:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:16:00+00:00, run_after=2024-03-29T01:17:00+00:00 2024-03-29T01:16:05.548005056Z [2024-03-29T01:16:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status success for try_number 1 2024-03-29T01:16:05.548213585Z [2024-03-29T01:16:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status success for try_number 1 2024-03-29T01:16:05.556267922Z [2024-03-29T01:16:05.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:15:00+00:00, map_index=-1, run_start_date=2024-03-29 01:16:03.123544+00:00, run_end_date=2024-03-29 01:16:04.491637+00:00, run_duration=1.368093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:16:00.945883+00:00, queued_by_job_id=2, pid=6910 2024-03-29T01:16:05.556521142Z [2024-03-29T01:16:05.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:15:00+00:00, map_index=-1, run_start_date=2024-03-29 01:16:03.400091+00:00, run_end_date=2024-03-29 01:16:05.201160+00:00, run_duration=1.801069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:16:00.945883+00:00, queued_by_job_id=2, pid=6916 2024-03-29T01:17:01.028896484Z [2024-03-29T01:17:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:17:00+00:00, run_after=2024-03-29T01:18:00+00:00 2024-03-29T01:17:01.048983902Z [2024-03-29T01:17:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:17:00+00:00, run_after=2024-03-29T01:18:00+00:00 2024-03-29T01:17:01.057296801Z [2024-03-29T01:17:01.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:17:01.124876382Z [2024-03-29T01:17:01.124+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:17:01.124903864Z 2024-03-29T01:17:01.124907734Z 2024-03-29T01:17:01.124910911Z 2024-03-29T01:17:01.124922301Z [2024-03-29T01:17:01.124+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:17:01.124985461Z [2024-03-29T01:17:01.124+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:17:01.125061351Z [2024-03-29T01:17:01.124+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:17:01.125633643Z [2024-03-29T01:17:01.125+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:17:01.125646918Z 2024-03-29T01:17:01.125650479Z 2024-03-29T01:17:01.125653847Z 2024-03-29T01:17:01.129207691Z [2024-03-29T01:17:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:17:01.129255031Z [2024-03-29T01:17:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:17:01.129480746Z [2024-03-29T01:17:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:17:01.129553863Z [2024-03-29T01:17:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:17:01.129782525Z [2024-03-29T01:17:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:17:01.129802220Z [2024-03-29T01:17:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:17:01.428025191Z [2024-03-29T01:17:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status queued for try_number 1 2024-03-29T01:17:01.428810132Z [2024-03-29T01:17:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status queued for try_number 1 2024-03-29T01:17:01.428997221Z [2024-03-29T01:17:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status queued for try_number 1 2024-03-29T01:17:01.444772283Z [2024-03-29T01:17:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf7bfc74-ff67-4ef2-b4de-3871333ae06d 2024-03-29T01:17:01.445177063Z [2024-03-29T01:17:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to f38af210-a180-4c5e-8bb6-0ec47be46af2 2024-03-29T01:17:01.446176126Z [2024-03-29T01:17:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6316cc67-c93c-4fd4-8110-0582ba16f84b 2024-03-29T01:17:02.659986222Z [2024-03-29T01:17:02.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:17:02.660595946Z [2024-03-29T01:17:02.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:16:00+00:00, run_id=scheduled__2024-03-29T01:16:00+00:00, run_start_date=2024-03-29 01:17:01.067914+00:00, run_end_date=2024-03-29 01:17:02.659862+00:00, run_duration=1.591948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:16:00+00:00, data_interval_end=2024-03-29 01:17:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:17:02.680059551Z [2024-03-29T01:17:02.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:17:00+00:00, run_after=2024-03-29T01:18:00+00:00 2024-03-29T01:17:03.970423783Z [2024-03-29T01:17:03.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status success for try_number 1 2024-03-29T01:17:03.992787296Z [2024-03-29T01:17:03.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:16:00+00:00, map_index=-1, run_start_date=2024-03-29 01:17:02.053472+00:00, run_end_date=2024-03-29 01:17:02.533656+00:00, run_duration=0.480184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:17:01.126349+00:00, queued_by_job_id=2, pid=6948 2024-03-29T01:17:07.066575147Z [2024-03-29T01:17:07.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:17:07.067034048Z [2024-03-29T01:17:07.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:16:00+00:00, run_id=scheduled__2024-03-29T01:16:00+00:00, run_start_date=2024-03-29 01:17:01.069224+00:00, run_end_date=2024-03-29 01:17:07.066685+00:00, run_duration=5.997461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:16:00+00:00, data_interval_end=2024-03-29 01:17:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:17:07.076294879Z [2024-03-29T01:17:07.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:17:00+00:00, run_after=2024-03-29T01:18:00+00:00 2024-03-29T01:17:07.117007832Z [2024-03-29T01:17:07.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status success for try_number 1 2024-03-29T01:17:07.130563123Z [2024-03-29T01:17:07.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:16:00+00:00, map_index=-1, run_start_date=2024-03-29 01:17:03.892193+00:00, run_end_date=2024-03-29 01:17:06.469438+00:00, run_duration=2.577245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:17:01.126349+00:00, queued_by_job_id=2, pid=6967 2024-03-29T01:17:08.166284218Z [2024-03-29T01:17:08.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:17:08.166600516Z [2024-03-29T01:17:08.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:16:00+00:00, run_id=scheduled__2024-03-29T01:16:00+00:00, run_start_date=2024-03-29 01:17:01.070330+00:00, run_end_date=2024-03-29 01:17:08.166182+00:00, run_duration=7.095852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:16:00+00:00, data_interval_end=2024-03-29 01:17:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:17:08.175373150Z [2024-03-29T01:17:08.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:17:00+00:00, run_after=2024-03-29T01:18:00+00:00 2024-03-29T01:17:08.203875852Z [2024-03-29T01:17:08.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status success for try_number 1 2024-03-29T01:17:08.208948388Z [2024-03-29T01:17:08.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:16:00+00:00, map_index=-1, run_start_date=2024-03-29 01:17:03.806315+00:00, run_end_date=2024-03-29 01:17:07.956471+00:00, run_duration=4.150156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:17:01.126349+00:00, queued_by_job_id=2, pid=6966 2024-03-29T01:18:00.206204572Z [2024-03-29T01:18:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:18:00+00:00, run_after=2024-03-29T01:19:00+00:00 2024-03-29T01:18:00.214207054Z [2024-03-29T01:18:00.213+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:18:00.224814226Z [2024-03-29T01:18:00.224+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:18:00.240086670Z [2024-03-29T01:18:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:18:00+00:00, run_after=2024-03-29T01:19:00+00:00 2024-03-29T01:18:00.364935216Z [2024-03-29T01:18:00.364+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:18:00.364961886Z 2024-03-29T01:18:00.364968698Z 2024-03-29T01:18:00.364971854Z 2024-03-29T01:18:00.365014643Z 2024-03-29T01:18:00.366822407Z [2024-03-29T01:18:00.364+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:18:00.366852452Z [2024-03-29T01:18:00.365+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:18:00.366856222Z [2024-03-29T01:18:00.365+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:18:00.366859397Z [2024-03-29T01:18:00.365+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:18:00.366862534Z [2024-03-29T01:18:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:18:00.366883332Z 2024-03-29T01:18:00.366887389Z 2024-03-29T01:18:00.366890495Z 2024-03-29T01:18:00.366893742Z 2024-03-29T01:18:00.371849220Z [2024-03-29T01:18:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:18:00.371905053Z [2024-03-29T01:18:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:18:00.371910375Z [2024-03-29T01:18:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:18:00.371913857Z [2024-03-29T01:18:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:18:00.371916963Z [2024-03-29T01:18:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:18:00.371920030Z [2024-03-29T01:18:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:18:00.371923234Z [2024-03-29T01:18:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:18:00.372034382Z [2024-03-29T01:18:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:18:00.667876799Z [2024-03-29T01:18:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status queued for try_number 1 2024-03-29T01:18:00.668261359Z [2024-03-29T01:18:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:17:00+00:00 exited with status queued for try_number 1 2024-03-29T01:18:00.668655352Z [2024-03-29T01:18:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:17:00+00:00 exited with status queued for try_number 1 2024-03-29T01:18:00.668908538Z [2024-03-29T01:18:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:17:00+00:00 exited with status queued for try_number 1 2024-03-29T01:18:00.682028135Z [2024-03-29T01:18:00.681+0000] {scheduler_job.py:635} INFO - Setting external_id for to a53a1408-d932-4c1c-a7ba-cd6b75268b8d 2024-03-29T01:18:00.682358100Z [2024-03-29T01:18:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65c4bc4e-a2a1-4adf-b761-7db8c7e6fd3e 2024-03-29T01:18:00.682773254Z [2024-03-29T01:18:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to b412ac48-437e-4482-a78b-bf7aea461ad1 2024-03-29T01:18:00.683075376Z [2024-03-29T01:18:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to e07d4bee-d2ad-458f-9056-5c4ec23919cd 2024-03-29T01:18:01.907781133Z [2024-03-29T01:18:01.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:18:01.908165915Z [2024-03-29T01:18:01.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:16:00+00:00, run_id=scheduled__2024-03-29T01:16:00+00:00, run_start_date=2024-03-29 01:18:00.261830+00:00, run_end_date=2024-03-29 01:18:01.907795+00:00, run_duration=1.645965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:16:00+00:00, data_interval_end=2024-03-29 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:18:01.919275071Z [2024-03-29T01:18:01.918+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:18:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:18:01.996269877Z [2024-03-29T01:18:01.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:16:00+00:00 exited with status success for try_number 1 2024-03-29T01:18:02.006781376Z [2024-03-29T01:18:02.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:16:00+00:00, map_index=-1, run_start_date=2024-03-29 01:18:01.179914+00:00, run_end_date=2024-03-29 01:18:01.656770+00:00, run_duration=0.476856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:18:00.366670+00:00, queued_by_job_id=2, pid=7000 2024-03-29T01:18:03.064093370Z [2024-03-29T01:18:03.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:18:03.064652852Z [2024-03-29T01:18:03.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:17:00+00:00, run_id=scheduled__2024-03-29T01:17:00+00:00, run_start_date=2024-03-29 01:18:00.263070+00:00, run_end_date=2024-03-29 01:18:03.064178+00:00, run_duration=2.801108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:17:00+00:00, data_interval_end=2024-03-29 01:18:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:18:03.084791520Z [2024-03-29T01:18:03.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:18:00+00:00, run_after=2024-03-29T01:19:00+00:00 2024-03-29T01:18:03.161913533Z [2024-03-29T01:18:03.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:17:00+00:00 exited with status success for try_number 1 2024-03-29T01:18:03.168116586Z [2024-03-29T01:18:03.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:17:00+00:00, map_index=-1, run_start_date=2024-03-29 01:18:01.354924+00:00, run_end_date=2024-03-29 01:18:01.950038+00:00, run_duration=0.595114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:18:00.366670+00:00, queued_by_job_id=2, pid=7001 2024-03-29T01:18:04.217312626Z [2024-03-29T01:18:04.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:18:04.217923381Z [2024-03-29T01:18:04.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:17:00+00:00, run_id=scheduled__2024-03-29T01:17:00+00:00, run_start_date=2024-03-29 01:18:00.264248+00:00, run_end_date=2024-03-29 01:18:04.217221+00:00, run_duration=3.952973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:17:00+00:00, data_interval_end=2024-03-29 01:18:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:18:04.234571213Z [2024-03-29T01:18:04.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:18:00+00:00, run_after=2024-03-29T01:19:00+00:00 2024-03-29T01:18:04.281098272Z [2024-03-29T01:18:04.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:17:00+00:00 exited with status success for try_number 1 2024-03-29T01:18:04.287076674Z [2024-03-29T01:18:04.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:17:00+00:00, map_index=-1, run_start_date=2024-03-29 01:18:02.702935+00:00, run_end_date=2024-03-29 01:18:03.925584+00:00, run_duration=1.222649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:18:00.366670+00:00, queued_by_job_id=2, pid=7024 2024-03-29T01:18:05.013855779Z [2024-03-29T01:18:05.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:18:05.013893236Z [2024-03-29T01:18:05.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:17:00+00:00, run_id=scheduled__2024-03-29T01:17:00+00:00, run_start_date=2024-03-29 01:18:00.265335+00:00, run_end_date=2024-03-29 01:18:05.011987+00:00, run_duration=4.746652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:17:00+00:00, data_interval_end=2024-03-29 01:18:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:18:05.030646629Z [2024-03-29T01:18:05.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:18:00+00:00, run_after=2024-03-29T01:19:00+00:00 2024-03-29T01:18:05.068902389Z [2024-03-29T01:18:05.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:17:00+00:00 exited with status success for try_number 1 2024-03-29T01:18:05.076587049Z [2024-03-29T01:18:05.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:17:00+00:00, map_index=-1, run_start_date=2024-03-29 01:18:02.882795+00:00, run_end_date=2024-03-29 01:18:04.499182+00:00, run_duration=1.616387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:18:00.366670+00:00, queued_by_job_id=2, pid=7025 2024-03-29T01:18:45.249676578Z [2024-03-29T01:18:45.249+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:19:00.767789135Z [2024-03-29T01:19:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:19:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:19:00.777976225Z [2024-03-29T01:19:00.777+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:19:00.792154099Z [2024-03-29T01:19:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:19:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:19:00.866114071Z [2024-03-29T01:19:00.865+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:19:00.866140849Z 2024-03-29T01:19:00.866144549Z 2024-03-29T01:19:00.866148079Z 2024-03-29T01:19:00.866429145Z [2024-03-29T01:19:00.866+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:19:00.866808968Z [2024-03-29T01:19:00.866+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:19:00.866988457Z [2024-03-29T01:19:00.866+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:19:00.868099544Z [2024-03-29T01:19:00.867+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:19:00.868111572Z 2024-03-29T01:19:00.868115249Z 2024-03-29T01:19:00.868118487Z 2024-03-29T01:19:00.874387027Z [2024-03-29T01:19:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:19:00.874791144Z [2024-03-29T01:19:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:19:00.875394033Z [2024-03-29T01:19:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:19:00.875877339Z [2024-03-29T01:19:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:19:00.876431252Z [2024-03-29T01:19:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:19:00.877035791Z [2024-03-29T01:19:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:19:01.348161382Z [2024-03-29T01:19:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status queued for try_number 1 2024-03-29T01:19:01.351209382Z [2024-03-29T01:19:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status queued for try_number 1 2024-03-29T01:19:01.351406936Z [2024-03-29T01:19:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status queued for try_number 1 2024-03-29T01:19:01.361280201Z [2024-03-29T01:19:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20aadbf7-27ea-44b9-ae21-74ced35a64aa 2024-03-29T01:19:01.362038339Z [2024-03-29T01:19:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b255f25-176c-4317-b6b8-5874ef2e74d7 2024-03-29T01:19:01.362264577Z [2024-03-29T01:19:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 320df1b0-26de-4723-83df-21d79f50e338 2024-03-29T01:19:02.590332470Z [2024-03-29T01:19:02.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:19:02.590972734Z [2024-03-29T01:19:02.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:18:00+00:00, run_id=scheduled__2024-03-29T01:18:00+00:00, run_start_date=2024-03-29 01:19:00.805846+00:00, run_end_date=2024-03-29 01:19:02.590218+00:00, run_duration=1.784372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:18:00+00:00, data_interval_end=2024-03-29 01:19:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:19:02.612494157Z [2024-03-29T01:19:02.612+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:19:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:19:02.680569893Z [2024-03-29T01:19:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status success for try_number 1 2024-03-29T01:19:02.689192765Z [2024-03-29T01:19:02.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:18:00+00:00, map_index=-1, run_start_date=2024-03-29 01:19:01.685500+00:00, run_end_date=2024-03-29 01:19:02.200044+00:00, run_duration=0.514544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:19:00.869775+00:00, queued_by_job_id=2, pid=7058 2024-03-29T01:19:04.827195626Z [2024-03-29T01:19:04.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:19:04.827427034Z [2024-03-29T01:19:04.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:18:00+00:00, run_id=scheduled__2024-03-29T01:18:00+00:00, run_start_date=2024-03-29 01:19:00.808352+00:00, run_end_date=2024-03-29 01:19:04.827080+00:00, run_duration=4.018728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:18:00+00:00, data_interval_end=2024-03-29 01:19:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:19:04.837956204Z [2024-03-29T01:19:04.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:19:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:19:04.844828395Z [2024-03-29T01:19:04.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:19:04.844953513Z [2024-03-29T01:19:04.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:18:00+00:00, run_id=scheduled__2024-03-29T01:18:00+00:00, run_start_date=2024-03-29 01:19:00.807234+00:00, run_end_date=2024-03-29 01:19:04.844722+00:00, run_duration=4.037488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:18:00+00:00, data_interval_end=2024-03-29 01:19:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:19:04.855663183Z [2024-03-29T01:19:04.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:19:00+00:00, run_after=2024-03-29T01:20:00+00:00 2024-03-29T01:19:04.898464810Z [2024-03-29T01:19:04.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status success for try_number 1 2024-03-29T01:19:04.898837304Z [2024-03-29T01:19:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status success for try_number 1 2024-03-29T01:19:04.908814373Z [2024-03-29T01:19:04.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:18:00+00:00, map_index=-1, run_start_date=2024-03-29 01:19:03.048410+00:00, run_end_date=2024-03-29 01:19:04.393477+00:00, run_duration=1.345067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:19:00.869775+00:00, queued_by_job_id=2, pid=7077 2024-03-29T01:19:04.909651245Z [2024-03-29T01:19:04.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:18:00+00:00, map_index=-1, run_start_date=2024-03-29 01:19:02.924596+00:00, run_end_date=2024-03-29 01:19:04.691185+00:00, run_duration=1.766589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:19:00.869775+00:00, queued_by_job_id=2, pid=7076 2024-03-29T01:20:00.231511219Z [2024-03-29T01:20:00.231+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:21:00+00:00 2024-03-29T01:20:00.238793486Z [2024-03-29T01:20:00.238+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:20:00.256171947Z [2024-03-29T01:20:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:25:00+00:00 2024-03-29T01:20:00.268707493Z [2024-03-29T01:20:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:21:00+00:00 2024-03-29T01:20:00.275618043Z [2024-03-29T01:20:00.275+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:20:00.374584806Z [2024-03-29T01:20:00.374+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:20:00.374617645Z 2024-03-29T01:20:00.374623742Z 2024-03-29T01:20:00.374629546Z 2024-03-29T01:20:00.374634441Z 2024-03-29T01:20:00.374639829Z 2024-03-29T01:20:00.375019162Z [2024-03-29T01:20:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:20:00.375339099Z [2024-03-29T01:20:00.375+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:20:00.375588565Z [2024-03-29T01:20:00.375+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:20:00.375776418Z [2024-03-29T01:20:00.375+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:20:00.376016364Z [2024-03-29T01:20:00.375+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:20:00.376943876Z [2024-03-29T01:20:00.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:20:00.376954402Z 2024-03-29T01:20:00.376961172Z 2024-03-29T01:20:00.376964638Z 2024-03-29T01:20:00.376967911Z 2024-03-29T01:20:00.376971020Z 2024-03-29T01:20:00.385751746Z [2024-03-29T01:20:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:20:00.385897368Z [2024-03-29T01:20:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:20:00.386176001Z [2024-03-29T01:20:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:20:00.386327861Z [2024-03-29T01:20:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:20:00.387981531Z [2024-03-29T01:20:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:20:00.388081520Z [2024-03-29T01:20:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:20:00.388365742Z [2024-03-29T01:20:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:20:00.388459059Z [2024-03-29T01:20:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:20:00.388763067Z [2024-03-29T01:20:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:20:00.388868867Z [2024-03-29T01:20:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:20:00.890328264Z [2024-03-29T01:20:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:00.890380850Z [2024-03-29T01:20:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:00.890534115Z [2024-03-29T01:20:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:19:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:00.890634676Z [2024-03-29T01:20:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:19:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:00.890772292Z [2024-03-29T01:20:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:19:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:00.902393166Z [2024-03-29T01:20:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bbf29ca-6c81-4a90-8f22-59567d4ca343 2024-03-29T01:20:00.902432410Z [2024-03-29T01:20:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e37e515-0256-4158-b353-0b6c60f24cc5 2024-03-29T01:20:00.902711526Z [2024-03-29T01:20:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0a9e836-7695-425e-b916-7f783178edae 2024-03-29T01:20:00.902824198Z [2024-03-29T01:20:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9422e4f1-108d-4879-8aff-c987b871ac66 2024-03-29T01:20:00.902927689Z [2024-03-29T01:20:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54ac65c8-4034-4038-9c0d-89082bd23eae 2024-03-29T01:20:02.210237398Z [2024-03-29T01:20:02.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:20:02.211739057Z [2024-03-29T01:20:02.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:19:00+00:00, run_id=scheduled__2024-03-29T01:19:00+00:00, run_start_date=2024-03-29 01:20:00.293881+00:00, run_end_date=2024-03-29 01:20:02.210205+00:00, run_duration=1.916324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:19:00+00:00, data_interval_end=2024-03-29 01:20:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:20:02.224221159Z [2024-03-29T01:20:02.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:21:00+00:00 2024-03-29T01:20:02.343585218Z [2024-03-29T01:20:02.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:19:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:02.367990767Z [2024-03-29T01:20:02.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:19:00+00:00, map_index=-1, run_start_date=2024-03-29 01:20:01.409315+00:00, run_end_date=2024-03-29 01:20:02.027402+00:00, run_duration=0.618087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:00.379024+00:00, queued_by_job_id=2, pid=7111 2024-03-29T01:20:03.463298071Z [2024-03-29T01:20:03.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:20:03.463488734Z [2024-03-29T01:20:03.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:18:00+00:00, run_id=scheduled__2024-03-29T01:18:00+00:00, run_start_date=2024-03-29 01:20:00.292866+00:00, run_end_date=2024-03-29 01:20:03.463178+00:00, run_duration=3.170312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:18:00+00:00, data_interval_end=2024-03-29 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:20:03.487491239Z [2024-03-29T01:20:03.486+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:22:00+00:00 2024-03-29T01:20:03.610329185Z [2024-03-29T01:20:03.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:18:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:03.627388482Z [2024-03-29T01:20:03.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:18:00+00:00, map_index=-1, run_start_date=2024-03-29 01:20:01.702712+00:00, run_end_date=2024-03-29 01:20:02.331436+00:00, run_duration=0.628724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:00.379024+00:00, queued_by_job_id=2, pid=7113 2024-03-29T01:20:04.694684051Z [2024-03-29T01:20:04.692+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:20:04.694718081Z [2024-03-29T01:20:04.693+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:19:00+00:00, run_id=scheduled__2024-03-29T01:19:00+00:00, run_start_date=2024-03-29 01:20:00.294826+00:00, run_end_date=2024-03-29 01:20:04.692907+00:00, run_duration=4.398081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:19:00+00:00, data_interval_end=2024-03-29 01:20:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:20:04.718640954Z [2024-03-29T01:20:04.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:21:00+00:00 2024-03-29T01:20:04.778947208Z [2024-03-29T01:20:04.778+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:20:04.778973899Z 2024-03-29T01:20:04.778978731Z [2024-03-29T01:20:04.778+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:20:04.780078321Z [2024-03-29T01:20:04.779+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:20:04.780094534Z 2024-03-29T01:20:04.785558383Z [2024-03-29T01:20:04.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:20:04.785591674Z [2024-03-29T01:20:04.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:20:04.850767339Z [2024-03-29T01:20:04.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:04.850992403Z [2024-03-29T01:20:04.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:04.851112436Z [2024-03-29T01:20:04.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:19:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:04.861063219Z [2024-03-29T01:20:04.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:15:00+00:00, map_index=-1, run_start_date=2024-03-29 01:20:03.240240+00:00, run_end_date=2024-03-29 01:20:03.674048+00:00, run_duration=0.433808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:00.379024+00:00, queued_by_job_id=2, pid=7148 2024-03-29T01:20:04.861413197Z [2024-03-29T01:20:04.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:19:00+00:00, map_index=-1, run_start_date=2024-03-29 01:20:03.201581+00:00, run_end_date=2024-03-29 01:20:04.484371+00:00, run_duration=1.28279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:00.379024+00:00, queued_by_job_id=2, pid=7147 2024-03-29T01:20:04.861732309Z [2024-03-29T01:20:04.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4df136c6-441a-48a1-8bf0-3d2832f7c8af 2024-03-29T01:20:06.027630614Z [2024-03-29T01:20:06.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:20:06.028131485Z [2024-03-29T01:20:06.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:19:00+00:00, run_id=scheduled__2024-03-29T01:19:00+00:00, run_start_date=2024-03-29 01:20:00.295779+00:00, run_end_date=2024-03-29 01:20:06.027737+00:00, run_duration=5.731958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:19:00+00:00, data_interval_end=2024-03-29 01:20:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:20:06.037717727Z [2024-03-29T01:20:06.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:21:00+00:00 2024-03-29T01:20:06.084294131Z [2024-03-29T01:20:06.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:19:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:06.090945607Z [2024-03-29T01:20:06.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:19:00+00:00, map_index=-1, run_start_date=2024-03-29 01:20:02.742381+00:00, run_end_date=2024-03-29 01:20:05.165834+00:00, run_duration=2.423453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:00.379024+00:00, queued_by_job_id=2, pid=7131 2024-03-29T01:20:08.652989479Z [2024-03-29T01:20:08.652+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:20:08.653060946Z 2024-03-29T01:20:08.653274383Z [2024-03-29T01:20:08.652+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:20:08.654055127Z [2024-03-29T01:20:08.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:20:08.654075127Z 2024-03-29T01:20:08.657692194Z [2024-03-29T01:20:08.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:20:08.658000311Z [2024-03-29T01:20:08.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:20:08.734067833Z [2024-03-29T01:20:08.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:08.734147555Z [2024-03-29T01:20:08.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:08.741793556Z [2024-03-29T01:20:08.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4f83a03-b9aa-404d-9c87-3e777f3e1825 2024-03-29T01:20:08.742115865Z [2024-03-29T01:20:08.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:15:00+00:00, map_index=-1, run_start_date=2024-03-29 01:20:07.239457+00:00, run_end_date=2024-03-29 01:20:07.760643+00:00, run_duration=0.521186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:04.780624+00:00, queued_by_job_id=2, pid=7166 2024-03-29T01:20:10.993745604Z [2024-03-29T01:20:10.993+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:20:10.993796522Z 2024-03-29T01:20:10.993809325Z [2024-03-29T01:20:10.993+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:20:10.994572116Z [2024-03-29T01:20:10.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:20:10.994587472Z 2024-03-29T01:20:10.997438697Z [2024-03-29T01:20:10.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:20:10.997587749Z [2024-03-29T01:20:10.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:20:11.057670306Z [2024-03-29T01:20:11.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status queued for try_number 1 2024-03-29T01:20:11.058002501Z [2024-03-29T01:20:11.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:11.070336244Z [2024-03-29T01:20:11.069+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4548b535-d06a-4e09-9793-0d14e6abc317 2024-03-29T01:20:11.070864114Z [2024-03-29T01:20:11.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:15:00+00:00, map_index=0, run_start_date=2024-03-29 01:20:10.366141+00:00, run_end_date=2024-03-29 01:20:10.688936+00:00, run_duration=0.322795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:08.654653+00:00, queued_by_job_id=2, pid=7174 2024-03-29T01:20:13.749534360Z [2024-03-29T01:20:13.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:20:13.749855251Z [2024-03-29T01:20:13.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:15:00+00:00, run_id=scheduled__2024-03-29T01:15:00+00:00, run_start_date=2024-03-29 01:20:00.291669+00:00, run_end_date=2024-03-29 01:20:13.749365+00:00, run_duration=13.457696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:15:00+00:00, data_interval_end=2024-03-29 01:20:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:20:13.759068792Z [2024-03-29T01:20:13.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:20:00+00:00, run_after=2024-03-29T01:25:00+00:00 2024-03-29T01:20:13.793472468Z [2024-03-29T01:20:13.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:15:00+00:00 exited with status success for try_number 1 2024-03-29T01:20:13.798865519Z [2024-03-29T01:20:13.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:15:00+00:00, map_index=-1, run_start_date=2024-03-29 01:20:12.899122+00:00, run_end_date=2024-03-29 01:20:13.297609+00:00, run_duration=0.398487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:20:10.994954+00:00, queued_by_job_id=2, pid=7182 2024-03-29T01:21:00.383748371Z [2024-03-29T01:21:00.383+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:21:00+00:00, run_after=2024-03-29T01:22:00+00:00 2024-03-29T01:21:00.401031136Z [2024-03-29T01:21:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:21:00+00:00, run_after=2024-03-29T01:22:00+00:00 2024-03-29T01:21:00.411845520Z [2024-03-29T01:21:00.411+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:21:00.505076544Z [2024-03-29T01:21:00.504+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:21:00.505108682Z 2024-03-29T01:21:00.505114305Z 2024-03-29T01:21:00.505119773Z 2024-03-29T01:21:00.505502483Z [2024-03-29T01:21:00.504+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:21:00.505807223Z [2024-03-29T01:21:00.505+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:21:00.506153930Z [2024-03-29T01:21:00.505+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:21:00.507248021Z [2024-03-29T01:21:00.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:21:00.507264619Z 2024-03-29T01:21:00.507268279Z 2024-03-29T01:21:00.507271484Z 2024-03-29T01:21:00.512637298Z [2024-03-29T01:21:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:21:00.512899934Z [2024-03-29T01:21:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:21:00.513267225Z [2024-03-29T01:21:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:21:00.513446715Z [2024-03-29T01:21:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:21:00.513830767Z [2024-03-29T01:21:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:21:00.513972887Z [2024-03-29T01:21:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:21:00.764751556Z [2024-03-29T01:21:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:21:00.764782435Z [2024-03-29T01:21:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:21:00.766912702Z [2024-03-29T01:21:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:21:00.774164677Z [2024-03-29T01:21:00.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae933a62-3d05-41e2-91d8-38f07572a5ad 2024-03-29T01:21:00.774243831Z [2024-03-29T01:21:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36b5221d-b087-46aa-b54b-e30a4fd8c6e9 2024-03-29T01:21:00.774416704Z [2024-03-29T01:21:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to d510dbc1-9b23-4f63-831e-5dccfb55fdb3 2024-03-29T01:21:02.085691100Z [2024-03-29T01:21:02.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:21:02.086261441Z [2024-03-29T01:21:02.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:20:00+00:00, run_id=scheduled__2024-03-29T01:20:00+00:00, run_start_date=2024-03-29 01:21:00.426202+00:00, run_end_date=2024-03-29 01:21:02.085583+00:00, run_duration=1.659381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:20:00+00:00, data_interval_end=2024-03-29 01:21:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:21:02.097044113Z [2024-03-29T01:21:02.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:21:00+00:00, run_after=2024-03-29T01:22:00+00:00 2024-03-29T01:21:02.159351182Z [2024-03-29T01:21:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:21:02.167722160Z [2024-03-29T01:21:02.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=-1, run_start_date=2024-03-29 01:21:01.451994+00:00, run_end_date=2024-03-29 01:21:01.960350+00:00, run_duration=0.508356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:21:00.508489+00:00, queued_by_job_id=2, pid=7205 2024-03-29T01:21:04.349520447Z [2024-03-29T01:21:04.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:21:04.349907578Z [2024-03-29T01:21:04.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:20:00+00:00, run_id=scheduled__2024-03-29T01:20:00+00:00, run_start_date=2024-03-29 01:21:00.427764+00:00, run_end_date=2024-03-29 01:21:04.349507+00:00, run_duration=3.921743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:20:00+00:00, data_interval_end=2024-03-29 01:21:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:21:04.360556764Z [2024-03-29T01:21:04.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:21:00+00:00, run_after=2024-03-29T01:22:00+00:00 2024-03-29T01:21:04.368518404Z [2024-03-29T01:21:04.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:21:04.368880584Z [2024-03-29T01:21:04.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:20:00+00:00, run_id=scheduled__2024-03-29T01:20:00+00:00, run_start_date=2024-03-29 01:21:00.429627+00:00, run_end_date=2024-03-29 01:21:04.368523+00:00, run_duration=3.938896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:20:00+00:00, data_interval_end=2024-03-29 01:21:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:21:04.384034008Z [2024-03-29T01:21:04.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:21:00+00:00, run_after=2024-03-29T01:22:00+00:00 2024-03-29T01:21:04.422386410Z [2024-03-29T01:21:04.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:21:04.430947628Z [2024-03-29T01:21:04.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=-1, run_start_date=2024-03-29 01:21:02.524898+00:00, run_end_date=2024-03-29 01:21:04.122814+00:00, run_duration=1.597916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:21:00.508489+00:00, queued_by_job_id=2, pid=7218 2024-03-29T01:21:05.496810517Z [2024-03-29T01:21:05.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:21:05.504235337Z [2024-03-29T01:21:05.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=-1, run_start_date=2024-03-29 01:21:02.798154+00:00, run_end_date=2024-03-29 01:21:04.290153+00:00, run_duration=1.491999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:21:00.508489+00:00, queued_by_job_id=2, pid=7224 2024-03-29T01:22:00.051471690Z [2024-03-29T01:22:00.051+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:22:00.062692683Z [2024-03-29T01:22:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:22:00+00:00, run_after=2024-03-29T01:23:00+00:00 2024-03-29T01:22:00.068809352Z [2024-03-29T01:22:00.068+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:22:00.079765002Z [2024-03-29T01:22:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:22:00+00:00, run_after=2024-03-29T01:23:00+00:00 2024-03-29T01:22:00.150885740Z [2024-03-29T01:22:00.149+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:22:00.150920712Z 2024-03-29T01:22:00.150954382Z 2024-03-29T01:22:00.150961388Z 2024-03-29T01:22:00.150967393Z 2024-03-29T01:22:00.151643210Z [2024-03-29T01:22:00.151+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:22:00.152095489Z [2024-03-29T01:22:00.151+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:22:00.152471577Z [2024-03-29T01:22:00.152+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:22:00.152917745Z [2024-03-29T01:22:00.152+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:22:00.154630367Z [2024-03-29T01:22:00.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:22:00.154652682Z 2024-03-29T01:22:00.154695541Z 2024-03-29T01:22:00.154704673Z 2024-03-29T01:22:00.154713213Z 2024-03-29T01:22:00.161429016Z [2024-03-29T01:22:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:22:00.161869767Z [2024-03-29T01:22:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:22:00.162354845Z [2024-03-29T01:22:00.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:22:00.162808616Z [2024-03-29T01:22:00.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:22:00.163410315Z [2024-03-29T01:22:00.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:22:00.163819012Z [2024-03-29T01:22:00.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:22:00.164389415Z [2024-03-29T01:22:00.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:22:00.164760654Z [2024-03-29T01:22:00.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:22:00.634144575Z [2024-03-29T01:22:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:22:00.634413044Z [2024-03-29T01:22:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:21:00+00:00 exited with status queued for try_number 1 2024-03-29T01:22:00.634699915Z [2024-03-29T01:22:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:21:00+00:00 exited with status queued for try_number 1 2024-03-29T01:22:00.635017018Z [2024-03-29T01:22:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:21:00+00:00 exited with status queued for try_number 1 2024-03-29T01:22:00.646601767Z [2024-03-29T01:22:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to d08b80c2-e3d0-4c43-8bac-3203608c382f 2024-03-29T01:22:00.646983705Z [2024-03-29T01:22:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75f54a8b-9142-44c1-9981-e620d196517b 2024-03-29T01:22:00.647240543Z [2024-03-29T01:22:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 689f2bf3-0c3e-4312-80ab-3677143ea1ea 2024-03-29T01:22:00.647493991Z [2024-03-29T01:22:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to b247115d-56c9-45d4-96ff-cc397abb8a4d 2024-03-29T01:22:01.967485537Z [2024-03-29T01:22:01.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:22:01.968039577Z [2024-03-29T01:22:01.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:20:00+00:00, run_id=scheduled__2024-03-29T01:20:00+00:00, run_start_date=2024-03-29 01:22:00.088394+00:00, run_end_date=2024-03-29 01:22:01.967425+00:00, run_duration=1.879031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:20:00+00:00, data_interval_end=2024-03-29 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:22:02.006156521Z [2024-03-29T01:22:02.005+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:22:00+00:00, run_after=2024-03-29T01:24:00+00:00 2024-03-29T01:22:02.054537924Z [2024-03-29T01:22:02.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:22:02.055910435Z [2024-03-29T01:22:02.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:21:00+00:00, run_id=scheduled__2024-03-29T01:21:00+00:00, run_start_date=2024-03-29 01:22:00.089505+00:00, run_end_date=2024-03-29 01:22:02.054510+00:00, run_duration=1.965005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:21:00+00:00, data_interval_end=2024-03-29 01:22:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:22:02.085739309Z [2024-03-29T01:22:02.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:22:00+00:00, run_after=2024-03-29T01:23:00+00:00 2024-03-29T01:22:02.143916869Z [2024-03-29T01:22:02.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:22:02.144275810Z [2024-03-29T01:22:02.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:21:00+00:00 exited with status success for try_number 1 2024-03-29T01:22:02.156942770Z [2024-03-29T01:22:02.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=-1, run_start_date=2024-03-29 01:22:00.923798+00:00, run_end_date=2024-03-29 01:22:01.268211+00:00, run_duration=0.344413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:22:00.156883+00:00, queued_by_job_id=2, pid=7257 2024-03-29T01:22:02.157287571Z [2024-03-29T01:22:02.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:21:00+00:00, map_index=-1, run_start_date=2024-03-29 01:22:01.121093+00:00, run_end_date=2024-03-29 01:22:01.598672+00:00, run_duration=0.477579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:22:00.156883+00:00, queued_by_job_id=2, pid=7258 2024-03-29T01:22:04.092851177Z [2024-03-29T01:22:04.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:22:04.094534725Z [2024-03-29T01:22:04.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:21:00+00:00, run_id=scheduled__2024-03-29T01:21:00+00:00, run_start_date=2024-03-29 01:22:00.090508+00:00, run_end_date=2024-03-29 01:22:04.093383+00:00, run_duration=4.002875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:21:00+00:00, data_interval_end=2024-03-29 01:22:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:22:04.129917939Z [2024-03-29T01:22:04.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:22:00+00:00, run_after=2024-03-29T01:23:00+00:00 2024-03-29T01:22:04.210726952Z [2024-03-29T01:22:04.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:21:00+00:00 exited with status success for try_number 1 2024-03-29T01:22:04.224072035Z [2024-03-29T01:22:04.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:21:00+00:00, map_index=-1, run_start_date=2024-03-29 01:22:02.271447+00:00, run_end_date=2024-03-29 01:22:03.733521+00:00, run_duration=1.462074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:22:00.156883+00:00, queued_by_job_id=2, pid=7282 2024-03-29T01:22:05.295299875Z [2024-03-29T01:22:05.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:22:05.295999949Z [2024-03-29T01:22:05.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:21:00+00:00, run_id=scheduled__2024-03-29T01:21:00+00:00, run_start_date=2024-03-29 01:22:00.091460+00:00, run_end_date=2024-03-29 01:22:05.295188+00:00, run_duration=5.203728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:21:00+00:00, data_interval_end=2024-03-29 01:22:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:22:05.312732027Z [2024-03-29T01:22:05.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:22:00+00:00, run_after=2024-03-29T01:23:00+00:00 2024-03-29T01:22:05.361296606Z [2024-03-29T01:22:05.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:21:00+00:00 exited with status success for try_number 1 2024-03-29T01:22:05.368906879Z [2024-03-29T01:22:05.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:21:00+00:00, map_index=-1, run_start_date=2024-03-29 01:22:02.201939+00:00, run_end_date=2024-03-29 01:22:04.808930+00:00, run_duration=2.606991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:22:00.156883+00:00, queued_by_job_id=2, pid=7281 2024-03-29T01:23:00.938883156Z [2024-03-29T01:23:00.938+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:23:00.952061974Z [2024-03-29T01:23:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:23:00+00:00, run_after=2024-03-29T01:24:00+00:00 2024-03-29T01:23:00.965592451Z [2024-03-29T01:23:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:23:00+00:00, run_after=2024-03-29T01:24:00+00:00 2024-03-29T01:23:01.049728703Z [2024-03-29T01:23:01.048+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:23:01.049768336Z 2024-03-29T01:23:01.049829326Z 2024-03-29T01:23:01.049838072Z 2024-03-29T01:23:01.050374923Z [2024-03-29T01:23:01.049+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:23:01.050992138Z [2024-03-29T01:23:01.050+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:23:01.051526524Z [2024-03-29T01:23:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:23:01.053075232Z [2024-03-29T01:23:01.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:23:01.053096774Z 2024-03-29T01:23:01.053103782Z 2024-03-29T01:23:01.053109595Z 2024-03-29T01:23:01.061816342Z [2024-03-29T01:23:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:23:01.062098719Z [2024-03-29T01:23:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:23:01.062519918Z [2024-03-29T01:23:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:23:01.062830774Z [2024-03-29T01:23:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:23:01.063235157Z [2024-03-29T01:23:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:23:01.063441777Z [2024-03-29T01:23:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:23:01.340533856Z [2024-03-29T01:23:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status queued for try_number 1 2024-03-29T01:23:01.340655721Z [2024-03-29T01:23:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status queued for try_number 1 2024-03-29T01:23:01.340787175Z [2024-03-29T01:23:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status queued for try_number 1 2024-03-29T01:23:01.350173758Z [2024-03-29T01:23:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb9cceac-26fa-4c52-85c4-7f3cfd32daad 2024-03-29T01:23:01.350573249Z [2024-03-29T01:23:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67758b5d-aa1d-430e-af5c-fc276f43ca01 2024-03-29T01:23:01.350791277Z [2024-03-29T01:23:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7db55e13-91df-4f77-8b8b-e18b0a0444a2 2024-03-29T01:23:02.571701616Z [2024-03-29T01:23:02.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:23:02.572378555Z [2024-03-29T01:23:02.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:22:00+00:00, run_id=scheduled__2024-03-29T01:22:00+00:00, run_start_date=2024-03-29 01:23:00.980478+00:00, run_end_date=2024-03-29 01:23:02.571596+00:00, run_duration=1.591118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:22:00+00:00, data_interval_end=2024-03-29 01:23:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:23:02.594312812Z [2024-03-29T01:23:02.593+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:23:00+00:00, run_after=2024-03-29T01:24:00+00:00 2024-03-29T01:23:02.655366068Z [2024-03-29T01:23:02.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status success for try_number 1 2024-03-29T01:23:02.661981656Z [2024-03-29T01:23:02.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:22:00+00:00, map_index=-1, run_start_date=2024-03-29 01:23:01.891071+00:00, run_end_date=2024-03-29 01:23:02.399285+00:00, run_duration=0.508214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:23:01.057001+00:00, queued_by_job_id=2, pid=7314 2024-03-29T01:23:04.829556173Z [2024-03-29T01:23:04.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:23:04.830046642Z [2024-03-29T01:23:04.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:22:00+00:00, run_id=scheduled__2024-03-29T01:22:00+00:00, run_start_date=2024-03-29 01:23:00.981802+00:00, run_end_date=2024-03-29 01:23:04.829471+00:00, run_duration=3.847669, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:22:00+00:00, data_interval_end=2024-03-29 01:23:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:23:04.842575877Z [2024-03-29T01:23:04.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:23:00+00:00, run_after=2024-03-29T01:24:00+00:00 2024-03-29T01:23:05.988041803Z [2024-03-29T01:23:05.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:23:05.988076703Z [2024-03-29T01:23:05.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:22:00+00:00, run_id=scheduled__2024-03-29T01:22:00+00:00, run_start_date=2024-03-29 01:23:00.983037+00:00, run_end_date=2024-03-29 01:23:05.987069+00:00, run_duration=5.004032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:22:00+00:00, data_interval_end=2024-03-29 01:23:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:23:06.000311287Z [2024-03-29T01:23:05.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:23:00+00:00, run_after=2024-03-29T01:24:00+00:00 2024-03-29T01:23:06.052163401Z [2024-03-29T01:23:06.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status success for try_number 1 2024-03-29T01:23:06.052189177Z [2024-03-29T01:23:06.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status success for try_number 1 2024-03-29T01:23:06.061121600Z [2024-03-29T01:23:06.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:22:00+00:00, map_index=-1, run_start_date=2024-03-29 01:23:03.222724+00:00, run_end_date=2024-03-29 01:23:04.746569+00:00, run_duration=1.523845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:23:01.057001+00:00, queued_by_job_id=2, pid=7333 2024-03-29T01:23:06.061209493Z [2024-03-29T01:23:06.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:22:00+00:00, map_index=-1, run_start_date=2024-03-29 01:23:03.184630+00:00, run_end_date=2024-03-29 01:23:04.979711+00:00, run_duration=1.795081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:23:01.057001+00:00, queued_by_job_id=2, pid=7332 2024-03-29T01:23:45.321256391Z [2024-03-29T01:23:45.320+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:24:00.465399390Z [2024-03-29T01:24:00.465+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:24:00.478274442Z [2024-03-29T01:24:00.477+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:24:00+00:00, run_after=2024-03-29T01:25:00+00:00 2024-03-29T01:24:00.491248163Z [2024-03-29T01:24:00.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:24:00+00:00, run_after=2024-03-29T01:25:00+00:00 2024-03-29T01:24:00.498322284Z [2024-03-29T01:24:00.498+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:24:00.579254497Z [2024-03-29T01:24:00.578+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:24:00.579284204Z 2024-03-29T01:24:00.579288858Z 2024-03-29T01:24:00.579292303Z 2024-03-29T01:24:00.579295653Z 2024-03-29T01:24:00.579682835Z [2024-03-29T01:24:00.579+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:24:00.580011345Z [2024-03-29T01:24:00.579+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:24:00.580297562Z [2024-03-29T01:24:00.580+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:24:00.580561101Z [2024-03-29T01:24:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:24:00.581579443Z [2024-03-29T01:24:00.581+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:24:00.581597046Z 2024-03-29T01:24:00.581603056Z 2024-03-29T01:24:00.581608381Z 2024-03-29T01:24:00.581613622Z 2024-03-29T01:24:00.586259469Z [2024-03-29T01:24:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:24:00.586522761Z [2024-03-29T01:24:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:24:00.586861106Z [2024-03-29T01:24:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:24:00.587072606Z [2024-03-29T01:24:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:24:00.587567064Z [2024-03-29T01:24:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:24:00.587815935Z [2024-03-29T01:24:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:24:00.588168410Z [2024-03-29T01:24:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:24:00.588398866Z [2024-03-29T01:24:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:24:00.857184307Z [2024-03-29T01:24:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status queued for try_number 1 2024-03-29T01:24:00.857409441Z [2024-03-29T01:24:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:23:00+00:00 exited with status queued for try_number 1 2024-03-29T01:24:00.857578956Z [2024-03-29T01:24:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:23:00+00:00 exited with status queued for try_number 1 2024-03-29T01:24:00.857741503Z [2024-03-29T01:24:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:23:00+00:00 exited with status queued for try_number 1 2024-03-29T01:24:00.868553986Z [2024-03-29T01:24:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e6d0f5e-c208-45b7-8ec1-83ee192689a3 2024-03-29T01:24:00.868593213Z [2024-03-29T01:24:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86f0368e-2372-4e70-bcef-7d000716e977 2024-03-29T01:24:00.868837726Z [2024-03-29T01:24:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to d55ba727-8701-471b-bdf9-78cac7888952 2024-03-29T01:24:00.868937632Z [2024-03-29T01:24:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to db8afa0e-e277-40df-bfe7-169aebe03897 2024-03-29T01:24:02.273157856Z [2024-03-29T01:24:02.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:24:02.273669027Z [2024-03-29T01:24:02.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:22:00+00:00, run_id=scheduled__2024-03-29T01:22:00+00:00, run_start_date=2024-03-29 01:24:00.511242+00:00, run_end_date=2024-03-29 01:24:02.273074+00:00, run_duration=1.761832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:22:00+00:00, data_interval_end=2024-03-29 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:24:02.292886866Z [2024-03-29T01:24:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:24:00+00:00, run_after=2024-03-29T01:26:00+00:00 2024-03-29T01:24:02.319979786Z [2024-03-29T01:24:02.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:24:02.320738687Z [2024-03-29T01:24:02.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:23:00+00:00, run_id=scheduled__2024-03-29T01:23:00+00:00, run_start_date=2024-03-29 01:24:00.513267+00:00, run_end_date=2024-03-29 01:24:02.320229+00:00, run_duration=1.806962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:23:00+00:00, data_interval_end=2024-03-29 01:24:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:24:02.341385083Z [2024-03-29T01:24:02.340+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:24:00+00:00, run_after=2024-03-29T01:25:00+00:00 2024-03-29T01:24:02.411755949Z [2024-03-29T01:24:02.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:22:00+00:00 exited with status success for try_number 1 2024-03-29T01:24:02.412143376Z [2024-03-29T01:24:02.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:23:00+00:00 exited with status success for try_number 1 2024-03-29T01:24:02.424266182Z [2024-03-29T01:24:02.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:22:00+00:00, map_index=-1, run_start_date=2024-03-29 01:24:01.544318+00:00, run_end_date=2024-03-29 01:24:01.960631+00:00, run_duration=0.416313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:24:00.583047+00:00, queued_by_job_id=2, pid=7367 2024-03-29T01:24:02.424964324Z [2024-03-29T01:24:02.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:23:00+00:00, map_index=-1, run_start_date=2024-03-29 01:24:01.479300+00:00, run_end_date=2024-03-29 01:24:02.030480+00:00, run_duration=0.55118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:24:00.583047+00:00, queued_by_job_id=2, pid=7366 2024-03-29T01:24:04.009641127Z [2024-03-29T01:24:04.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:24:04.010138491Z [2024-03-29T01:24:04.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:23:00+00:00, run_id=scheduled__2024-03-29T01:23:00+00:00, run_start_date=2024-03-29 01:24:00.516017+00:00, run_end_date=2024-03-29 01:24:04.009623+00:00, run_duration=3.493606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:23:00+00:00, data_interval_end=2024-03-29 01:24:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:24:04.019381861Z [2024-03-29T01:24:04.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:24:00+00:00, run_after=2024-03-29T01:25:00+00:00 2024-03-29T01:24:05.108740454Z [2024-03-29T01:24:05.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:24:05.109439464Z [2024-03-29T01:24:05.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:23:00+00:00, run_id=scheduled__2024-03-29T01:23:00+00:00, run_start_date=2024-03-29 01:24:00.517185+00:00, run_end_date=2024-03-29 01:24:05.108628+00:00, run_duration=4.591443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:23:00+00:00, data_interval_end=2024-03-29 01:24:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:24:05.128637754Z [2024-03-29T01:24:05.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:24:00+00:00, run_after=2024-03-29T01:25:00+00:00 2024-03-29T01:24:05.182564700Z [2024-03-29T01:24:05.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:23:00+00:00 exited with status success for try_number 1 2024-03-29T01:24:05.182590120Z [2024-03-29T01:24:05.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:23:00+00:00 exited with status success for try_number 1 2024-03-29T01:24:05.194558701Z [2024-03-29T01:24:05.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:23:00+00:00, map_index=-1, run_start_date=2024-03-29 01:24:02.674071+00:00, run_end_date=2024-03-29 01:24:03.967476+00:00, run_duration=1.293405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:24:00.583047+00:00, queued_by_job_id=2, pid=7390 2024-03-29T01:24:05.194589734Z [2024-03-29T01:24:05.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:23:00+00:00, map_index=-1, run_start_date=2024-03-29 01:24:02.760046+00:00, run_end_date=2024-03-29 01:24:04.552978+00:00, run_duration=1.792932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:24:00.583047+00:00, queued_by_job_id=2, pid=7391 2024-03-29T01:25:00.870160855Z [2024-03-29T01:25:00.869+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:25:00.885835501Z [2024-03-29T01:25:00.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:25:00+00:00, run_after=2024-03-29T01:26:00+00:00 2024-03-29T01:25:00.908531439Z [2024-03-29T01:25:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:25:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:25:00.927943667Z [2024-03-29T01:25:00.927+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:25:00+00:00, run_after=2024-03-29T01:26:00+00:00 2024-03-29T01:25:01.050572234Z [2024-03-29T01:25:01.050+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:25:01.050601476Z 2024-03-29T01:25:01.050605796Z 2024-03-29T01:25:01.050609148Z 2024-03-29T01:25:01.050612288Z 2024-03-29T01:25:01.050928544Z [2024-03-29T01:25:01.050+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:25:01.051218169Z [2024-03-29T01:25:01.050+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:25:01.051499629Z [2024-03-29T01:25:01.051+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:25:01.051783070Z [2024-03-29T01:25:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:25:01.052953160Z [2024-03-29T01:25:01.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:25:01.052996648Z 2024-03-29T01:25:01.053002521Z 2024-03-29T01:25:01.053007283Z 2024-03-29T01:25:01.053011791Z 2024-03-29T01:25:01.057943584Z [2024-03-29T01:25:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:25:01.058330663Z [2024-03-29T01:25:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:25:01.058736313Z [2024-03-29T01:25:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:25:01.058898840Z [2024-03-29T01:25:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:25:01.059165010Z [2024-03-29T01:25:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:25:01.059309299Z [2024-03-29T01:25:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:25:01.059836172Z [2024-03-29T01:25:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:25:01.060094596Z [2024-03-29T01:25:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:25:01.533678799Z [2024-03-29T01:25:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:25:01.533915635Z [2024-03-29T01:25:01.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status queued for try_number 1 2024-03-29T01:25:01.534149950Z [2024-03-29T01:25:01.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status queued for try_number 1 2024-03-29T01:25:01.534374834Z [2024-03-29T01:25:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status queued for try_number 1 2024-03-29T01:25:01.543809790Z [2024-03-29T01:25:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6492ac23-d577-475d-89de-deb1ef75f1d8 2024-03-29T01:25:01.543900262Z [2024-03-29T01:25:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10f4a5e4-fff7-4970-a8dd-4659e4478c15 2024-03-29T01:25:01.544089675Z [2024-03-29T01:25:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9e4dd2d-5551-4e1b-9110-42de980bc3e1 2024-03-29T01:25:01.544256467Z [2024-03-29T01:25:01.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b524aad-9c0f-469a-bde4-fb5a8aecb03c 2024-03-29T01:25:03.114982160Z [2024-03-29T01:25:03.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:25:03.116253898Z [2024-03-29T01:25:03.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:24:00+00:00, run_id=scheduled__2024-03-29T01:24:00+00:00, run_start_date=2024-03-29 01:25:00.943441+00:00, run_end_date=2024-03-29 01:25:03.115137+00:00, run_duration=2.171696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:24:00+00:00, data_interval_end=2024-03-29 01:25:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:25:03.141724712Z [2024-03-29T01:25:03.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:25:00+00:00, run_after=2024-03-29T01:26:00+00:00 2024-03-29T01:25:03.296088952Z [2024-03-29T01:25:03.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status success for try_number 1 2024-03-29T01:25:03.307817871Z [2024-03-29T01:25:03.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:24:00+00:00, map_index=-1, run_start_date=2024-03-29 01:25:02.059443+00:00, run_end_date=2024-03-29 01:25:02.576546+00:00, run_duration=0.517103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:25:01.054278+00:00, queued_by_job_id=2, pid=7424 2024-03-29T01:25:04.467568291Z [2024-03-29T01:25:04.466+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:25:04.467608228Z 2024-03-29T01:25:04.467998228Z [2024-03-29T01:25:04.467+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:25:04.469127328Z [2024-03-29T01:25:04.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:25:04.469146221Z 2024-03-29T01:25:04.473208388Z [2024-03-29T01:25:04.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:25:04.473568006Z [2024-03-29T01:25:04.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:25:04.541298617Z [2024-03-29T01:25:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:25:04.541583224Z [2024-03-29T01:25:04.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:25:04.552986904Z [2024-03-29T01:25:04.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ae27cc2-bc81-4d20-8448-b78ab74bf62f 2024-03-29T01:25:04.553374804Z [2024-03-29T01:25:04.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=-1, run_start_date=2024-03-29 01:25:03.455877+00:00, run_end_date=2024-03-29 01:25:04.035825+00:00, run_duration=0.579948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:25:01.054278+00:00, queued_by_job_id=2, pid=7449 2024-03-29T01:25:05.838973679Z [2024-03-29T01:25:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:25:05.839003765Z [2024-03-29T01:25:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:24:00+00:00, run_id=scheduled__2024-03-29T01:24:00+00:00, run_start_date=2024-03-29 01:25:00.945722+00:00, run_end_date=2024-03-29 01:25:05.836633+00:00, run_duration=4.890911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:24:00+00:00, data_interval_end=2024-03-29 01:25:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:25:05.874607048Z [2024-03-29T01:25:05.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:25:00+00:00, run_after=2024-03-29T01:26:00+00:00 2024-03-29T01:25:05.902549259Z [2024-03-29T01:25:05.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:25:05.902576623Z [2024-03-29T01:25:05.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:24:00+00:00, run_id=scheduled__2024-03-29T01:24:00+00:00, run_start_date=2024-03-29 01:25:00.944516+00:00, run_end_date=2024-03-29 01:25:05.897658+00:00, run_duration=4.953142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:24:00+00:00, data_interval_end=2024-03-29 01:25:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:25:05.929651374Z [2024-03-29T01:25:05.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:25:00+00:00, run_after=2024-03-29T01:26:00+00:00 2024-03-29T01:25:05.998238402Z [2024-03-29T01:25:05.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status success for try_number 1 2024-03-29T01:25:05.998336468Z [2024-03-29T01:25:05.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status success for try_number 1 2024-03-29T01:25:06.016275881Z [2024-03-29T01:25:06.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:24:00+00:00, map_index=-1, run_start_date=2024-03-29 01:25:03.702572+00:00, run_end_date=2024-03-29 01:25:05.274350+00:00, run_duration=1.571778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:25:01.054278+00:00, queued_by_job_id=2, pid=7450 2024-03-29T01:25:06.016518195Z [2024-03-29T01:25:06.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:24:00+00:00, map_index=-1, run_start_date=2024-03-29 01:25:03.455148+00:00, run_end_date=2024-03-29 01:25:05.329428+00:00, run_duration=1.87428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:25:01.054278+00:00, queued_by_job_id=2, pid=7448 2024-03-29T01:25:08.327756526Z [2024-03-29T01:25:08.326+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:25:08.327791731Z 2024-03-29T01:25:08.328166353Z [2024-03-29T01:25:08.327+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:25:08.329727380Z [2024-03-29T01:25:08.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:25:08.329744625Z 2024-03-29T01:25:08.333722780Z [2024-03-29T01:25:08.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:25:08.334079602Z [2024-03-29T01:25:08.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:25:08.421267332Z [2024-03-29T01:25:08.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:25:08.421299256Z [2024-03-29T01:25:08.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:25:08.430997618Z [2024-03-29T01:25:08.430+0000] {scheduler_job.py:635} INFO - Setting external_id for to de909c6f-3e77-4e83-b750-1b763dce119a 2024-03-29T01:25:08.431343335Z [2024-03-29T01:25:08.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=-1, run_start_date=2024-03-29 01:25:07.040040+00:00, run_end_date=2024-03-29 01:25:07.638242+00:00, run_duration=0.598202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:25:04.469760+00:00, queued_by_job_id=2, pid=7473 2024-03-29T01:25:11.081857297Z [2024-03-29T01:25:11.081+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:25:11.081881924Z 2024-03-29T01:25:11.082073920Z [2024-03-29T01:25:11.081+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:25:11.082812739Z [2024-03-29T01:25:11.082+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:25:11.082862175Z 2024-03-29T01:25:11.085117254Z [2024-03-29T01:25:11.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:25:11.085256394Z [2024-03-29T01:25:11.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:25:11.140791699Z [2024-03-29T01:25:11.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status queued for try_number 1 2024-03-29T01:25:11.141003486Z [2024-03-29T01:25:11.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:25:11.146737654Z [2024-03-29T01:25:11.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f016093-876c-4164-8d38-4fba4145dbc3 2024-03-29T01:25:11.146939544Z [2024-03-29T01:25:11.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=0, run_start_date=2024-03-29 01:25:10.114977+00:00, run_end_date=2024-03-29 01:25:10.464289+00:00, run_duration=0.349312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:25:08.330429+00:00, queued_by_job_id=2, pid=7481 2024-03-29T01:25:13.408428125Z [2024-03-29T01:25:13.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:25:13.408610696Z [2024-03-29T01:25:13.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:20:00+00:00, run_id=scheduled__2024-03-29T01:20:00+00:00, run_start_date=2024-03-29 01:25:00.942086+00:00, run_end_date=2024-03-29 01:25:13.408244+00:00, run_duration=12.466158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:20:00+00:00, data_interval_end=2024-03-29 01:25:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:25:13.416642175Z [2024-03-29T01:25:13.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:25:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:25:13.460534171Z [2024-03-29T01:25:13.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:20:00+00:00 exited with status success for try_number 1 2024-03-29T01:25:13.468666348Z [2024-03-29T01:25:13.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:20:00+00:00, map_index=-1, run_start_date=2024-03-29 01:25:12.781971+00:00, run_end_date=2024-03-29 01:25:13.157126+00:00, run_duration=0.375155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:25:11.083185+00:00, queued_by_job_id=2, pid=7489 2024-03-29T01:26:00.246022502Z [2024-03-29T01:26:00.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:26:00+00:00, run_after=2024-03-29T01:27:00+00:00 2024-03-29T01:26:00.252813940Z [2024-03-29T01:26:00.252+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:26:00.259485605Z [2024-03-29T01:26:00.259+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:26:00.270514943Z [2024-03-29T01:26:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:26:00+00:00, run_after=2024-03-29T01:27:00+00:00 2024-03-29T01:26:00.337127580Z [2024-03-29T01:26:00.336+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:26:00.337157154Z 2024-03-29T01:26:00.337164129Z 2024-03-29T01:26:00.337167589Z 2024-03-29T01:26:00.337170981Z 2024-03-29T01:26:00.337181002Z [2024-03-29T01:26:00.337+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:26:00.337356665Z [2024-03-29T01:26:00.337+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:26:00.337458224Z [2024-03-29T01:26:00.337+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:26:00.337612544Z [2024-03-29T01:26:00.337+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:26:00.338193630Z [2024-03-29T01:26:00.338+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:26:00.338203296Z 2024-03-29T01:26:00.338207084Z 2024-03-29T01:26:00.338227814Z 2024-03-29T01:26:00.338238674Z 2024-03-29T01:26:00.341633140Z [2024-03-29T01:26:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:26:00.341775952Z [2024-03-29T01:26:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:26:00.342018576Z [2024-03-29T01:26:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:26:00.342168128Z [2024-03-29T01:26:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:26:00.342375292Z [2024-03-29T01:26:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:26:00.342495996Z [2024-03-29T01:26:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:26:00.342738588Z [2024-03-29T01:26:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:26:00.342864558Z [2024-03-29T01:26:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:26:00.927999109Z [2024-03-29T01:26:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status queued for try_number 1 2024-03-29T01:26:00.928053135Z [2024-03-29T01:26:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status queued for try_number 1 2024-03-29T01:26:00.928122908Z [2024-03-29T01:26:00.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status queued for try_number 1 2024-03-29T01:26:00.928198667Z [2024-03-29T01:26:00.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status queued for try_number 1 2024-03-29T01:26:00.956134503Z [2024-03-29T01:26:00.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76ba16cd-6a4f-432c-9566-de80a81a1b88 2024-03-29T01:26:00.958788433Z [2024-03-29T01:26:00.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0f912de-0cff-4809-8e70-8c90b14de89d 2024-03-29T01:26:00.959158533Z [2024-03-29T01:26:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to bce3ffe0-8bc4-48cc-ba8e-3db2e4e97c53 2024-03-29T01:26:00.963071081Z [2024-03-29T01:26:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to 374ba75f-577f-4d2e-a990-ac3f0251d50a 2024-03-29T01:26:03.018883876Z [2024-03-29T01:26:03.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:26:03.019362705Z [2024-03-29T01:26:03.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:24:00+00:00, run_id=scheduled__2024-03-29T01:24:00+00:00, run_start_date=2024-03-29 01:26:00.280099+00:00, run_end_date=2024-03-29 01:26:03.018932+00:00, run_duration=2.738833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:24:00+00:00, data_interval_end=2024-03-29 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:26:03.030515558Z [2024-03-29T01:26:03.030+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:26:00+00:00, run_after=2024-03-29T01:28:00+00:00 2024-03-29T01:26:03.047842916Z [2024-03-29T01:26:03.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:26:03.048081781Z [2024-03-29T01:26:03.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:25:00+00:00, run_id=scheduled__2024-03-29T01:25:00+00:00, run_start_date=2024-03-29 01:26:00.281264+00:00, run_end_date=2024-03-29 01:26:03.047792+00:00, run_duration=2.766528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:25:00+00:00, data_interval_end=2024-03-29 01:26:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:26:03.061600238Z [2024-03-29T01:26:03.061+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:26:00+00:00, run_after=2024-03-29T01:27:00+00:00 2024-03-29T01:26:03.187170713Z [2024-03-29T01:26:03.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:24:00+00:00 exited with status success for try_number 1 2024-03-29T01:26:03.187684297Z [2024-03-29T01:26:03.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status success for try_number 1 2024-03-29T01:26:03.203456076Z [2024-03-29T01:26:03.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:24:00+00:00, map_index=-1, run_start_date=2024-03-29 01:26:01.789953+00:00, run_end_date=2024-03-29 01:26:02.407389+00:00, run_duration=0.617436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:26:00.339153+00:00, queued_by_job_id=2, pid=7512 2024-03-29T01:26:03.204075205Z [2024-03-29T01:26:03.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:25:00+00:00, map_index=-1, run_start_date=2024-03-29 01:26:01.811423+00:00, run_end_date=2024-03-29 01:26:02.663238+00:00, run_duration=0.851815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:26:00.339153+00:00, queued_by_job_id=2, pid=7514 2024-03-29T01:26:05.756601246Z [2024-03-29T01:26:05.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:26:05.757050494Z [2024-03-29T01:26:05.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:25:00+00:00, run_id=scheduled__2024-03-29T01:25:00+00:00, run_start_date=2024-03-29 01:26:00.282229+00:00, run_end_date=2024-03-29 01:26:05.756576+00:00, run_duration=5.474347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:25:00+00:00, data_interval_end=2024-03-29 01:26:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:26:05.767280334Z [2024-03-29T01:26:05.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:26:00+00:00, run_after=2024-03-29T01:27:00+00:00 2024-03-29T01:26:05.849988826Z [2024-03-29T01:26:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status success for try_number 1 2024-03-29T01:26:05.855533599Z [2024-03-29T01:26:05.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:25:00+00:00, map_index=-1, run_start_date=2024-03-29 01:26:02.988213+00:00, run_end_date=2024-03-29 01:26:04.761646+00:00, run_duration=1.773433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:26:00.339153+00:00, queued_by_job_id=2, pid=7536 2024-03-29T01:26:06.902071380Z [2024-03-29T01:26:06.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:26:06.902574113Z [2024-03-29T01:26:06.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:25:00+00:00, run_id=scheduled__2024-03-29T01:25:00+00:00, run_start_date=2024-03-29 01:26:00.283218+00:00, run_end_date=2024-03-29 01:26:06.901945+00:00, run_duration=6.618727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:25:00+00:00, data_interval_end=2024-03-29 01:26:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:26:06.915593555Z [2024-03-29T01:26:06.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:26:00+00:00, run_after=2024-03-29T01:27:00+00:00 2024-03-29T01:26:06.955066460Z [2024-03-29T01:26:06.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status success for try_number 1 2024-03-29T01:26:06.964544643Z [2024-03-29T01:26:06.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:25:00+00:00, map_index=-1, run_start_date=2024-03-29 01:26:03.212207+00:00, run_end_date=2024-03-29 01:26:06.506883+00:00, run_duration=3.294676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:26:00.339153+00:00, queued_by_job_id=2, pid=7537 2024-03-29T01:27:00.662590025Z [2024-03-29T01:27:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:27:00+00:00, run_after=2024-03-29T01:28:00+00:00 2024-03-29T01:27:00.677328609Z [2024-03-29T01:27:00.676+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:27:00.690045085Z [2024-03-29T01:27:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:27:00+00:00, run_after=2024-03-29T01:28:00+00:00 2024-03-29T01:27:00.775200974Z [2024-03-29T01:27:00.774+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:27:00.775227229Z 2024-03-29T01:27:00.775231680Z 2024-03-29T01:27:00.775235320Z 2024-03-29T01:27:00.775518500Z [2024-03-29T01:27:00.775+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:27:00.775608282Z [2024-03-29T01:27:00.775+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:27:00.775803418Z [2024-03-29T01:27:00.775+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:27:00.776699141Z [2024-03-29T01:27:00.776+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:27:00.776709977Z 2024-03-29T01:27:00.776713619Z 2024-03-29T01:27:00.776721084Z 2024-03-29T01:27:00.783140601Z [2024-03-29T01:27:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:27:00.783522621Z [2024-03-29T01:27:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:27:00.783912397Z [2024-03-29T01:27:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:27:00.784174892Z [2024-03-29T01:27:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:27:00.784482559Z [2024-03-29T01:27:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:27:00.784787140Z [2024-03-29T01:27:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:27:01.129753795Z [2024-03-29T01:27:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status queued for try_number 1 2024-03-29T01:27:01.129791406Z [2024-03-29T01:27:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status queued for try_number 1 2024-03-29T01:27:01.129865144Z [2024-03-29T01:27:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status queued for try_number 1 2024-03-29T01:27:01.144588236Z [2024-03-29T01:27:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 218256ec-4ceb-46ef-96a9-04c29b94c601 2024-03-29T01:27:01.145612212Z [2024-03-29T01:27:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 754d7ce1-fe77-445c-a9e7-320dbd993630 2024-03-29T01:27:01.146116066Z [2024-03-29T01:27:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae4f1822-4af1-43c1-862d-28b1d1006ec3 2024-03-29T01:27:02.393724786Z [2024-03-29T01:27:02.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status success for try_number 1 2024-03-29T01:27:02.402216167Z [2024-03-29T01:27:02.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:26:00+00:00, map_index=-1, run_start_date=2024-03-29 01:27:01.779916+00:00, run_end_date=2024-03-29 01:27:02.256739+00:00, run_duration=0.476823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:27:00.777954+00:00, queued_by_job_id=2, pid=7569 2024-03-29T01:27:03.482355212Z [2024-03-29T01:27:03.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:27:03.482738213Z [2024-03-29T01:27:03.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:26:00+00:00, run_id=scheduled__2024-03-29T01:26:00+00:00, run_start_date=2024-03-29 01:27:00.701291+00:00, run_end_date=2024-03-29 01:27:03.482248+00:00, run_duration=2.780957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:26:00+00:00, data_interval_end=2024-03-29 01:27:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:27:03.493135741Z [2024-03-29T01:27:03.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:27:00+00:00, run_after=2024-03-29T01:28:00+00:00 2024-03-29T01:27:06.296516907Z [2024-03-29T01:27:06.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:27:06.296849176Z [2024-03-29T01:27:06.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:26:00+00:00, run_id=scheduled__2024-03-29T01:26:00+00:00, run_start_date=2024-03-29 01:27:00.702641+00:00, run_end_date=2024-03-29 01:27:06.296545+00:00, run_duration=5.593904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:26:00+00:00, data_interval_end=2024-03-29 01:27:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:27:06.305943242Z [2024-03-29T01:27:06.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:27:00+00:00, run_after=2024-03-29T01:28:00+00:00 2024-03-29T01:27:06.314080120Z [2024-03-29T01:27:06.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:27:06.314704335Z [2024-03-29T01:27:06.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:26:00+00:00, run_id=scheduled__2024-03-29T01:26:00+00:00, run_start_date=2024-03-29 01:27:00.703809+00:00, run_end_date=2024-03-29 01:27:06.314299+00:00, run_duration=5.61049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:26:00+00:00, data_interval_end=2024-03-29 01:27:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:27:06.324607434Z [2024-03-29T01:27:06.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:27:00+00:00, run_after=2024-03-29T01:28:00+00:00 2024-03-29T01:27:06.354332652Z [2024-03-29T01:27:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status success for try_number 1 2024-03-29T01:27:06.355010178Z [2024-03-29T01:27:06.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status success for try_number 1 2024-03-29T01:27:06.373417016Z [2024-03-29T01:27:06.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:26:00+00:00, map_index=-1, run_start_date=2024-03-29 01:27:03.139743+00:00, run_end_date=2024-03-29 01:27:05.381374+00:00, run_duration=2.241631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:27:00.777954+00:00, queued_by_job_id=2, pid=7588 2024-03-29T01:27:06.373743245Z [2024-03-29T01:27:06.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:26:00+00:00, map_index=-1, run_start_date=2024-03-29 01:27:03.026324+00:00, run_end_date=2024-03-29 01:27:06.017334+00:00, run_duration=2.99101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:27:00.777954+00:00, queued_by_job_id=2, pid=7587 2024-03-29T01:28:01.042302183Z [2024-03-29T01:28:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:28:00+00:00, run_after=2024-03-29T01:29:00+00:00 2024-03-29T01:28:01.050546138Z [2024-03-29T01:28:01.050+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:28:01.058767296Z [2024-03-29T01:28:01.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:28:01.072949546Z [2024-03-29T01:28:01.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:28:00+00:00, run_after=2024-03-29T01:29:00+00:00 2024-03-29T01:28:01.197913812Z [2024-03-29T01:28:01.197+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:28:01.197950033Z 2024-03-29T01:28:01.197955568Z 2024-03-29T01:28:01.197960016Z 2024-03-29T01:28:01.197964809Z 2024-03-29T01:28:01.198193601Z [2024-03-29T01:28:01.197+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:28:01.198609643Z [2024-03-29T01:28:01.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:28:01.199077053Z [2024-03-29T01:28:01.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:28:01.199532619Z [2024-03-29T01:28:01.199+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:28:01.200708535Z [2024-03-29T01:28:01.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:28:01.200727621Z 2024-03-29T01:28:01.200734631Z 2024-03-29T01:28:01.200740304Z 2024-03-29T01:28:01.200746029Z 2024-03-29T01:28:01.209451222Z [2024-03-29T01:28:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:28:01.210298638Z [2024-03-29T01:28:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:28:01.211146266Z [2024-03-29T01:28:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:28:01.211545504Z [2024-03-29T01:28:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:28:01.211961509Z [2024-03-29T01:28:01.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:28:01.212199861Z [2024-03-29T01:28:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:28:01.212950140Z [2024-03-29T01:28:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:28:01.213264706Z [2024-03-29T01:28:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:28:01.639915069Z [2024-03-29T01:28:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status queued for try_number 1 2024-03-29T01:28:01.639982490Z [2024-03-29T01:28:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:27:00+00:00 exited with status queued for try_number 1 2024-03-29T01:28:01.640009640Z [2024-03-29T01:28:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:27:00+00:00 exited with status queued for try_number 1 2024-03-29T01:28:01.640059044Z [2024-03-29T01:28:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:27:00+00:00 exited with status queued for try_number 1 2024-03-29T01:28:01.669248208Z [2024-03-29T01:28:01.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to e53fa75b-02a3-4f06-9cce-bc78c8c9da3c 2024-03-29T01:28:01.669350820Z [2024-03-29T01:28:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3882ea7-4f74-4021-9c6d-7743f3046e3b 2024-03-29T01:28:01.669476512Z [2024-03-29T01:28:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a44f88d-af8e-4853-9668-fa36f4d75713 2024-03-29T01:28:01.669589175Z [2024-03-29T01:28:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0956618b-a509-4a36-8094-b49a4198d5bd 2024-03-29T01:28:03.008968531Z [2024-03-29T01:28:03.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:28:03.009416904Z [2024-03-29T01:28:03.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:26:00+00:00, run_id=scheduled__2024-03-29T01:26:00+00:00, run_start_date=2024-03-29 01:28:01.085296+00:00, run_end_date=2024-03-29 01:28:03.008949+00:00, run_duration=1.923653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:26:00+00:00, data_interval_end=2024-03-29 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:28:03.021553393Z [2024-03-29T01:28:03.021+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:28:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:28:03.030880642Z [2024-03-29T01:28:03.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:28:03.031047673Z [2024-03-29T01:28:03.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:27:00+00:00, run_id=scheduled__2024-03-29T01:27:00+00:00, run_start_date=2024-03-29 01:28:01.086735+00:00, run_end_date=2024-03-29 01:28:03.030754+00:00, run_duration=1.944019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:27:00+00:00, data_interval_end=2024-03-29 01:28:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:28:03.043157893Z [2024-03-29T01:28:03.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:28:00+00:00, run_after=2024-03-29T01:29:00+00:00 2024-03-29T01:28:03.100004730Z [2024-03-29T01:28:03.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:27:00+00:00 exited with status success for try_number 1 2024-03-29T01:28:03.110910465Z [2024-03-29T01:28:03.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:27:00+00:00, map_index=-1, run_start_date=2024-03-29 01:28:02.125701+00:00, run_end_date=2024-03-29 01:28:02.720291+00:00, run_duration=0.59459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:28:01.203148+00:00, queued_by_job_id=2, pid=7620 2024-03-29T01:28:04.213640213Z [2024-03-29T01:28:04.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:26:00+00:00 exited with status success for try_number 1 2024-03-29T01:28:04.223632615Z [2024-03-29T01:28:04.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:26:00+00:00, map_index=-1, run_start_date=2024-03-29 01:28:02.315593+00:00, run_end_date=2024-03-29 01:28:02.944805+00:00, run_duration=0.629212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:28:01.203148+00:00, queued_by_job_id=2, pid=7621 2024-03-29T01:28:07.234703706Z [2024-03-29T01:28:07.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:28:07.234726712Z [2024-03-29T01:28:07.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:27:00+00:00, run_id=scheduled__2024-03-29T01:27:00+00:00, run_start_date=2024-03-29 01:28:01.089364+00:00, run_end_date=2024-03-29 01:28:07.229759+00:00, run_duration=6.140395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:27:00+00:00, data_interval_end=2024-03-29 01:28:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:28:07.258562174Z [2024-03-29T01:28:07.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:28:00+00:00, run_after=2024-03-29T01:29:00+00:00 2024-03-29T01:28:07.261304474Z [2024-03-29T01:28:07.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:28:07.261491297Z [2024-03-29T01:28:07.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:27:00+00:00, run_id=scheduled__2024-03-29T01:27:00+00:00, run_start_date=2024-03-29 01:28:01.088205+00:00, run_end_date=2024-03-29 01:28:07.261253+00:00, run_duration=6.173048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:27:00+00:00, data_interval_end=2024-03-29 01:28:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:28:07.271064350Z [2024-03-29T01:28:07.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:28:00+00:00, run_after=2024-03-29T01:29:00+00:00 2024-03-29T01:28:07.320258020Z [2024-03-29T01:28:07.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:27:00+00:00 exited with status success for try_number 1 2024-03-29T01:28:07.320340232Z [2024-03-29T01:28:07.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:27:00+00:00 exited with status success for try_number 1 2024-03-29T01:28:07.328024972Z [2024-03-29T01:28:07.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:27:00+00:00, map_index=-1, run_start_date=2024-03-29 01:28:03.968804+00:00, run_end_date=2024-03-29 01:28:06.811676+00:00, run_duration=2.842872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:28:01.203148+00:00, queued_by_job_id=2, pid=7645 2024-03-29T01:28:07.328153554Z [2024-03-29T01:28:07.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:27:00+00:00, map_index=-1, run_start_date=2024-03-29 01:28:03.931732+00:00, run_end_date=2024-03-29 01:28:06.299561+00:00, run_duration=2.367829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:28:01.203148+00:00, queued_by_job_id=2, pid=7644 2024-03-29T01:28:45.406094697Z [2024-03-29T01:28:45.404+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:29:00.431180933Z [2024-03-29T01:29:00.430+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:29:00.451336955Z [2024-03-29T01:29:00.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:29:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:29:00.483195976Z [2024-03-29T01:29:00.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:29:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:29:00.603252906Z [2024-03-29T01:29:00.602+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:29:00.603306964Z 2024-03-29T01:29:00.603312660Z 2024-03-29T01:29:00.603339046Z 2024-03-29T01:29:00.603672658Z [2024-03-29T01:29:00.603+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:29:00.603970935Z [2024-03-29T01:29:00.603+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:29:00.604199529Z [2024-03-29T01:29:00.603+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:29:00.605327492Z [2024-03-29T01:29:00.605+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:29:00.605375005Z 2024-03-29T01:29:00.605381320Z 2024-03-29T01:29:00.605386252Z 2024-03-29T01:29:00.611337060Z [2024-03-29T01:29:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:29:00.611621749Z [2024-03-29T01:29:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:29:00.612044582Z [2024-03-29T01:29:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:29:00.612320639Z [2024-03-29T01:29:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:29:00.612732353Z [2024-03-29T01:29:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:29:00.612994725Z [2024-03-29T01:29:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:29:00.862394522Z [2024-03-29T01:29:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status queued for try_number 1 2024-03-29T01:29:00.862574573Z [2024-03-29T01:29:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status queued for try_number 1 2024-03-29T01:29:00.862695121Z [2024-03-29T01:29:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status queued for try_number 1 2024-03-29T01:29:00.871576958Z [2024-03-29T01:29:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to de342f1d-92ff-4aaf-98bc-c35371ef9745 2024-03-29T01:29:00.871780548Z [2024-03-29T01:29:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe5db056-f857-4d0e-83b7-e7e3a0479f78 2024-03-29T01:29:00.871964477Z [2024-03-29T01:29:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to eacb687a-445d-4948-a359-f807410cdd58 2024-03-29T01:29:03.306581566Z [2024-03-29T01:29:03.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:29:03.306957358Z [2024-03-29T01:29:03.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:28:00+00:00, run_id=scheduled__2024-03-29T01:28:00+00:00, run_start_date=2024-03-29 01:29:00.502246+00:00, run_end_date=2024-03-29 01:29:03.306384+00:00, run_duration=2.804138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:28:00+00:00, data_interval_end=2024-03-29 01:29:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:29:03.323478244Z [2024-03-29T01:29:03.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:29:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:29:03.418501659Z [2024-03-29T01:29:03.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status success for try_number 1 2024-03-29T01:29:03.423750875Z [2024-03-29T01:29:03.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:28:00+00:00, map_index=-1, run_start_date=2024-03-29 01:29:01.618549+00:00, run_end_date=2024-03-29 01:29:02.192011+00:00, run_duration=0.573462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:29:00.606802+00:00, queued_by_job_id=2, pid=7677 2024-03-29T01:29:05.565964436Z [2024-03-29T01:29:05.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:29:05.567255547Z [2024-03-29T01:29:05.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:28:00+00:00, run_id=scheduled__2024-03-29T01:28:00+00:00, run_start_date=2024-03-29 01:29:00.503548+00:00, run_end_date=2024-03-29 01:29:05.565873+00:00, run_duration=5.062325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:28:00+00:00, data_interval_end=2024-03-29 01:29:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:29:05.577075142Z [2024-03-29T01:29:05.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:29:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:29:05.585298914Z [2024-03-29T01:29:05.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:29:05.585426426Z [2024-03-29T01:29:05.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:28:00+00:00, run_id=scheduled__2024-03-29T01:28:00+00:00, run_start_date=2024-03-29 01:29:00.504809+00:00, run_end_date=2024-03-29 01:29:05.585167+00:00, run_duration=5.080358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:28:00+00:00, data_interval_end=2024-03-29 01:29:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:29:05.596703063Z [2024-03-29T01:29:05.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:29:00+00:00, run_after=2024-03-29T01:30:00+00:00 2024-03-29T01:29:05.676002111Z [2024-03-29T01:29:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status success for try_number 1 2024-03-29T01:29:05.676263713Z [2024-03-29T01:29:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status success for try_number 1 2024-03-29T01:29:05.682046560Z [2024-03-29T01:29:05.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:28:00+00:00, map_index=-1, run_start_date=2024-03-29 01:29:03.050396+00:00, run_end_date=2024-03-29 01:29:04.731747+00:00, run_duration=1.681351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:29:00.606802+00:00, queued_by_job_id=2, pid=7695 2024-03-29T01:29:05.682304186Z [2024-03-29T01:29:05.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:28:00+00:00, map_index=-1, run_start_date=2024-03-29 01:29:03.265447+00:00, run_end_date=2024-03-29 01:29:05.299881+00:00, run_duration=2.034434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:29:00.606802+00:00, queued_by_job_id=2, pid=7696 2024-03-29T01:30:01.039557784Z [2024-03-29T01:30:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:35:00+00:00 2024-03-29T01:30:01.062787091Z [2024-03-29T01:30:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:31:00+00:00 2024-03-29T01:30:01.085082815Z [2024-03-29T01:30:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:31:00+00:00 2024-03-29T01:30:01.096264881Z [2024-03-29T01:30:01.095+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:30:01.106302623Z [2024-03-29T01:30:01.105+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:30:01.236964400Z [2024-03-29T01:30:01.236+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:30:01.236992312Z 2024-03-29T01:30:01.237013842Z 2024-03-29T01:30:01.237017611Z 2024-03-29T01:30:01.237020664Z 2024-03-29T01:30:01.237023681Z 2024-03-29T01:30:01.237120155Z [2024-03-29T01:30:01.236+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:30:01.237337959Z [2024-03-29T01:30:01.237+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:30:01.237563636Z [2024-03-29T01:30:01.237+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:30:01.237706710Z [2024-03-29T01:30:01.237+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:30:01.237865165Z [2024-03-29T01:30:01.237+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:30:01.239263921Z [2024-03-29T01:30:01.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:30:01.239301823Z 2024-03-29T01:30:01.239306534Z 2024-03-29T01:30:01.239310132Z 2024-03-29T01:30:01.239313356Z 2024-03-29T01:30:01.239316690Z 2024-03-29T01:30:01.247155967Z [2024-03-29T01:30:01.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:30:01.247492644Z [2024-03-29T01:30:01.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:30:01.247847341Z [2024-03-29T01:30:01.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:30:01.247999990Z [2024-03-29T01:30:01.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:30:01.248338349Z [2024-03-29T01:30:01.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:30:01.248570367Z [2024-03-29T01:30:01.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:30:01.248984727Z [2024-03-29T01:30:01.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:30:01.249030786Z [2024-03-29T01:30:01.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:30:01.249534332Z [2024-03-29T01:30:01.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:30:01.249766851Z [2024-03-29T01:30:01.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:30:01.876015301Z [2024-03-29T01:30:01.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:01.876299060Z [2024-03-29T01:30:01.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:01.876522891Z [2024-03-29T01:30:01.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:29:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:01.876770220Z [2024-03-29T01:30:01.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:29:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:01.876967080Z [2024-03-29T01:30:01.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:29:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:01.898043509Z [2024-03-29T01:30:01.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86753bac-b2a4-44d7-96a1-2e0a2e034b62 2024-03-29T01:30:01.898739855Z [2024-03-29T01:30:01.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf07588f-acdf-4a72-b22f-22bdd9d69508 2024-03-29T01:30:01.898965374Z [2024-03-29T01:30:01.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cb1535f-4f78-48bf-bc4c-2da1e98437d1 2024-03-29T01:30:01.899187778Z [2024-03-29T01:30:01.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 384d9006-dd64-4db8-8117-db5633c59a6d 2024-03-29T01:30:01.899379877Z [2024-03-29T01:30:01.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3afb3c20-333b-4ef4-a7d8-579555077ff4 2024-03-29T01:30:03.291392396Z [2024-03-29T01:30:03.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:30:03.292147011Z [2024-03-29T01:30:03.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:29:00+00:00, run_id=scheduled__2024-03-29T01:29:00+00:00, run_start_date=2024-03-29 01:30:01.126230+00:00, run_end_date=2024-03-29 01:30:03.291562+00:00, run_duration=2.165332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:29:00+00:00, data_interval_end=2024-03-29 01:30:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:30:03.320589110Z [2024-03-29T01:30:03.320+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:31:00+00:00 2024-03-29T01:30:04.537033133Z [2024-03-29T01:30:04.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:30:04.537404736Z [2024-03-29T01:30:04.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:28:00+00:00, run_id=scheduled__2024-03-29T01:28:00+00:00, run_start_date=2024-03-29 01:30:01.124550+00:00, run_end_date=2024-03-29 01:30:04.536910+00:00, run_duration=3.41236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:28:00+00:00, data_interval_end=2024-03-29 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:30:04.572384120Z [2024-03-29T01:30:04.572+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:32:00+00:00 2024-03-29T01:30:04.802992280Z [2024-03-29T01:30:04.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:28:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:04.803175048Z [2024-03-29T01:30:04.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:29:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:04.814536335Z [2024-03-29T01:30:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:28:00+00:00, map_index=-1, run_start_date=2024-03-29 01:30:02.819735+00:00, run_end_date=2024-03-29 01:30:03.487861+00:00, run_duration=0.668126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:01.241329+00:00, queued_by_job_id=2, pid=7731 2024-03-29T01:30:04.814677405Z [2024-03-29T01:30:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:29:00+00:00, map_index=-1, run_start_date=2024-03-29 01:30:02.538075+00:00, run_end_date=2024-03-29 01:30:03.215835+00:00, run_duration=0.67776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:01.241329+00:00, queued_by_job_id=2, pid=7730 2024-03-29T01:30:05.996913476Z [2024-03-29T01:30:05.996+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:30:05.996959214Z 2024-03-29T01:30:05.996969584Z [2024-03-29T01:30:05.996+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:30:05.997359146Z [2024-03-29T01:30:05.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:30:05.997370382Z 2024-03-29T01:30:06.006616784Z [2024-03-29T01:30:06.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:30:06.006651990Z [2024-03-29T01:30:06.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:30:06.120360723Z [2024-03-29T01:30:06.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:06.120443122Z [2024-03-29T01:30:06.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:06.142545707Z [2024-03-29T01:30:06.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1620e190-3f6d-4693-830b-2817a5769497 2024-03-29T01:30:06.147208464Z [2024-03-29T01:30:06.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:25:00+00:00, map_index=-1, run_start_date=2024-03-29 01:30:04.735632+00:00, run_end_date=2024-03-29 01:30:05.450910+00:00, run_duration=0.715278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:01.241329+00:00, queued_by_job_id=2, pid=7756 2024-03-29T01:30:07.013401028Z [2024-03-29T01:30:07.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:30:07.013801453Z [2024-03-29T01:30:07.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:29:00+00:00, run_id=scheduled__2024-03-29T01:29:00+00:00, run_start_date=2024-03-29 01:30:01.127919+00:00, run_end_date=2024-03-29 01:30:07.013290+00:00, run_duration=5.885371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:29:00+00:00, data_interval_end=2024-03-29 01:30:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:30:07.032478574Z [2024-03-29T01:30:07.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:31:00+00:00 2024-03-29T01:30:07.137195139Z [2024-03-29T01:30:07.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:29:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:07.143639005Z [2024-03-29T01:30:07.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:29:00+00:00, map_index=-1, run_start_date=2024-03-29 01:30:04.675009+00:00, run_end_date=2024-03-29 01:30:06.693768+00:00, run_duration=2.018759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:01.241329+00:00, queued_by_job_id=2, pid=7755 2024-03-29T01:30:09.402984802Z [2024-03-29T01:30:09.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:30:09.403349698Z [2024-03-29T01:30:09.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:29:00+00:00, run_id=scheduled__2024-03-29T01:29:00+00:00, run_start_date=2024-03-29 01:30:01.129832+00:00, run_end_date=2024-03-29 01:30:09.402869+00:00, run_duration=8.273037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:29:00+00:00, data_interval_end=2024-03-29 01:30:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:30:09.418029847Z [2024-03-29T01:30:09.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:31:00+00:00 2024-03-29T01:30:09.451491506Z [2024-03-29T01:30:09.451+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:30:09.451521118Z 2024-03-29T01:30:09.451608904Z [2024-03-29T01:30:09.451+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:30:09.452377418Z [2024-03-29T01:30:09.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:30:09.452393625Z 2024-03-29T01:30:09.454937979Z [2024-03-29T01:30:09.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:30:09.455105544Z [2024-03-29T01:30:09.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:30:09.502332059Z [2024-03-29T01:30:09.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:09.502363663Z [2024-03-29T01:30:09.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:29:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:09.502388137Z [2024-03-29T01:30:09.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:09.512545585Z [2024-03-29T01:30:09.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:25:00+00:00, map_index=-1, run_start_date=2024-03-29 01:30:08.753330+00:00, run_end_date=2024-03-29 01:30:09.153994+00:00, run_duration=0.400664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:05.997714+00:00, queued_by_job_id=2, pid=7785 2024-03-29T01:30:09.512970063Z [2024-03-29T01:30:09.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8573525c-0e75-4823-ac40-5bec8a3b8d65 2024-03-29T01:30:09.513236492Z [2024-03-29T01:30:09.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:29:00+00:00, map_index=-1, run_start_date=2024-03-29 01:30:05.260746+00:00, run_end_date=2024-03-29 01:30:08.344606+00:00, run_duration=3.08386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:01.241329+00:00, queued_by_job_id=2, pid=7766 2024-03-29T01:30:11.799246564Z [2024-03-29T01:30:11.798+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:30:11.799273798Z 2024-03-29T01:30:11.799278660Z [2024-03-29T01:30:11.798+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:30:11.800121185Z [2024-03-29T01:30:11.799+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:30:11.800130560Z 2024-03-29T01:30:11.803451358Z [2024-03-29T01:30:11.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:30:11.803474218Z [2024-03-29T01:30:11.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:30:11.859550533Z [2024-03-29T01:30:11.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status queued for try_number 1 2024-03-29T01:30:11.861868660Z [2024-03-29T01:30:11.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:11.868944067Z [2024-03-29T01:30:11.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b8a5458-3b0f-4a6e-84e6-e7c839a7a0a9 2024-03-29T01:30:11.869319429Z [2024-03-29T01:30:11.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:25:00+00:00, map_index=0, run_start_date=2024-03-29 01:30:11.028127+00:00, run_end_date=2024-03-29 01:30:11.335630+00:00, run_duration=0.307503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:09.452765+00:00, queued_by_job_id=2, pid=7793 2024-03-29T01:30:14.435653071Z [2024-03-29T01:30:14.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:30:14.436107348Z [2024-03-29T01:30:14.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:25:00+00:00, run_id=scheduled__2024-03-29T01:25:00+00:00, run_start_date=2024-03-29 01:30:01.122579+00:00, run_end_date=2024-03-29 01:30:14.435757+00:00, run_duration=13.313178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:25:00+00:00, data_interval_end=2024-03-29 01:30:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:30:14.445212247Z [2024-03-29T01:30:14.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:30:00+00:00, run_after=2024-03-29T01:35:00+00:00 2024-03-29T01:30:14.491935091Z [2024-03-29T01:30:14.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:25:00+00:00 exited with status success for try_number 1 2024-03-29T01:30:14.502611309Z [2024-03-29T01:30:14.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:25:00+00:00, map_index=-1, run_start_date=2024-03-29 01:30:13.439695+00:00, run_end_date=2024-03-29 01:30:13.798883+00:00, run_duration=0.359188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:30:11.799728+00:00, queued_by_job_id=2, pid=7801 2024-03-29T01:31:01.023615227Z [2024-03-29T01:31:01.023+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:31:01.040947036Z [2024-03-29T01:31:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:31:00+00:00, run_after=2024-03-29T01:32:00+00:00 2024-03-29T01:31:01.053814017Z [2024-03-29T01:31:01.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:31:00+00:00, run_after=2024-03-29T01:32:00+00:00 2024-03-29T01:31:01.114913519Z [2024-03-29T01:31:01.114+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:31:01.114938044Z 2024-03-29T01:31:01.114941924Z 2024-03-29T01:31:01.114958715Z 2024-03-29T01:31:01.115183729Z [2024-03-29T01:31:01.114+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:31:01.115377551Z [2024-03-29T01:31:01.115+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:31:01.115615396Z [2024-03-29T01:31:01.115+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:31:01.116537424Z [2024-03-29T01:31:01.116+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:31:01.116549745Z 2024-03-29T01:31:01.116554168Z 2024-03-29T01:31:01.116558871Z 2024-03-29T01:31:01.120051520Z [2024-03-29T01:31:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:31:01.120225110Z [2024-03-29T01:31:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:31:01.120638027Z [2024-03-29T01:31:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:31:01.120864809Z [2024-03-29T01:31:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:31:01.121182134Z [2024-03-29T01:31:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:31:01.121369122Z [2024-03-29T01:31:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:31:01.325809592Z [2024-03-29T01:31:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:31:01.325924536Z [2024-03-29T01:31:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:31:01.326079532Z [2024-03-29T01:31:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:31:01.344725126Z [2024-03-29T01:31:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to c15632f3-0de5-429b-9a53-7955f0c14141 2024-03-29T01:31:01.344980248Z [2024-03-29T01:31:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54f7b513-193e-4e57-81ef-b73386f14723 2024-03-29T01:31:01.345229603Z [2024-03-29T01:31:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f81efef-e9b5-49e0-928b-8b4512d1ace3 2024-03-29T01:31:02.964604720Z [2024-03-29T01:31:02.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:31:02.965311424Z [2024-03-29T01:31:02.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:30:00+00:00, run_id=scheduled__2024-03-29T01:30:00+00:00, run_start_date=2024-03-29 01:31:01.064315+00:00, run_end_date=2024-03-29 01:31:02.964559+00:00, run_duration=1.900244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:30:00+00:00, data_interval_end=2024-03-29 01:31:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:31:02.993773582Z [2024-03-29T01:31:02.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:31:00+00:00, run_after=2024-03-29T01:32:00+00:00 2024-03-29T01:31:03.090870283Z [2024-03-29T01:31:03.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:31:03.097628874Z [2024-03-29T01:31:03.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=-1, run_start_date=2024-03-29 01:31:01.957922+00:00, run_end_date=2024-03-29 01:31:02.473237+00:00, run_duration=0.515315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:31:01.117458+00:00, queued_by_job_id=2, pid=7823 2024-03-29T01:31:05.053074035Z [2024-03-29T01:31:05.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:31:05.053452004Z [2024-03-29T01:31:05.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:30:00+00:00, run_id=scheduled__2024-03-29T01:30:00+00:00, run_start_date=2024-03-29 01:31:01.065476+00:00, run_end_date=2024-03-29 01:31:05.052980+00:00, run_duration=3.987504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:30:00+00:00, data_interval_end=2024-03-29 01:31:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:31:05.067712744Z [2024-03-29T01:31:05.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:31:00+00:00, run_after=2024-03-29T01:32:00+00:00 2024-03-29T01:31:05.115360110Z [2024-03-29T01:31:05.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:31:05.124754314Z [2024-03-29T01:31:05.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=-1, run_start_date=2024-03-29 01:31:03.174609+00:00, run_end_date=2024-03-29 01:31:04.775552+00:00, run_duration=1.600943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:31:01.117458+00:00, queued_by_job_id=2, pid=7841 2024-03-29T01:31:06.164871673Z [2024-03-29T01:31:06.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:31:06.165246022Z [2024-03-29T01:31:06.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:30:00+00:00, run_id=scheduled__2024-03-29T01:30:00+00:00, run_start_date=2024-03-29 01:31:01.066514+00:00, run_end_date=2024-03-29 01:31:06.164793+00:00, run_duration=5.098279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:30:00+00:00, data_interval_end=2024-03-29 01:31:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:31:06.175605914Z [2024-03-29T01:31:06.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:31:00+00:00, run_after=2024-03-29T01:32:00+00:00 2024-03-29T01:31:06.210492883Z [2024-03-29T01:31:06.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:31:06.217376367Z [2024-03-29T01:31:06.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=-1, run_start_date=2024-03-29 01:31:03.355820+00:00, run_end_date=2024-03-29 01:31:05.373068+00:00, run_duration=2.017248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:31:01.117458+00:00, queued_by_job_id=2, pid=7842 2024-03-29T01:32:00.888409701Z [2024-03-29T01:32:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:32:00+00:00, run_after=2024-03-29T01:33:00+00:00 2024-03-29T01:32:00.898816980Z [2024-03-29T01:32:00.898+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:32:00.913824180Z [2024-03-29T01:32:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:32:00+00:00, run_after=2024-03-29T01:33:00+00:00 2024-03-29T01:32:00.921140317Z [2024-03-29T01:32:00.920+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:32:01.012567028Z [2024-03-29T01:32:01.012+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:32:01.012590566Z 2024-03-29T01:32:01.012594992Z 2024-03-29T01:32:01.012598372Z 2024-03-29T01:32:01.012606574Z 2024-03-29T01:32:01.012625783Z [2024-03-29T01:32:01.012+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:32:01.012820058Z [2024-03-29T01:32:01.012+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:32:01.012886668Z [2024-03-29T01:32:01.012+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:32:01.012953759Z [2024-03-29T01:32:01.012+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:32:01.013474287Z [2024-03-29T01:32:01.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:32:01.013479622Z 2024-03-29T01:32:01.013483384Z 2024-03-29T01:32:01.013486801Z 2024-03-29T01:32:01.013490239Z 2024-03-29T01:32:01.017454541Z [2024-03-29T01:32:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:32:01.017536956Z [2024-03-29T01:32:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:32:01.017788074Z [2024-03-29T01:32:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:32:01.017896644Z [2024-03-29T01:32:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:32:01.018059181Z [2024-03-29T01:32:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:32:01.018139408Z [2024-03-29T01:32:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:32:01.018304233Z [2024-03-29T01:32:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:32:01.018389166Z [2024-03-29T01:32:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:32:01.591946108Z [2024-03-29T01:32:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:32:01.592075070Z [2024-03-29T01:32:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:31:00+00:00 exited with status queued for try_number 1 2024-03-29T01:32:01.592101161Z [2024-03-29T01:32:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:31:00+00:00 exited with status queued for try_number 1 2024-03-29T01:32:01.592106099Z [2024-03-29T01:32:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:31:00+00:00 exited with status queued for try_number 1 2024-03-29T01:32:01.616110106Z [2024-03-29T01:32:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67945f2b-4d16-4fb8-b916-be1458ee248c 2024-03-29T01:32:01.616147860Z [2024-03-29T01:32:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0b559dc-677e-44d2-a5f4-6cca41961fe0 2024-03-29T01:32:01.616222641Z [2024-03-29T01:32:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to d52b2e48-5b8c-44ff-b80a-657e7fe7439b 2024-03-29T01:32:01.616375141Z [2024-03-29T01:32:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d1dce4d-9099-45e6-80a5-c19689e88f06 2024-03-29T01:32:02.723314200Z [2024-03-29T01:32:02.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:32:02.723652704Z [2024-03-29T01:32:02.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:30:00+00:00, run_id=scheduled__2024-03-29T01:30:00+00:00, run_start_date=2024-03-29 01:32:00.932429+00:00, run_end_date=2024-03-29 01:32:02.723236+00:00, run_duration=1.790807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:30:00+00:00, data_interval_end=2024-03-29 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:32:02.744041320Z [2024-03-29T01:32:02.743+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:32:00+00:00, run_after=2024-03-29T01:34:00+00:00 2024-03-29T01:32:02.765825868Z [2024-03-29T01:32:02.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:32:02.766004664Z [2024-03-29T01:32:02.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:31:00+00:00, run_id=scheduled__2024-03-29T01:31:00+00:00, run_start_date=2024-03-29 01:32:00.933675+00:00, run_end_date=2024-03-29 01:32:02.765732+00:00, run_duration=1.832057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:31:00+00:00, data_interval_end=2024-03-29 01:32:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:32:02.777219679Z [2024-03-29T01:32:02.776+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:32:00+00:00, run_after=2024-03-29T01:33:00+00:00 2024-03-29T01:32:02.855340962Z [2024-03-29T01:32:02.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:32:02.866321261Z [2024-03-29T01:32:02.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=-1, run_start_date=2024-03-29 01:32:01.993994+00:00, run_end_date=2024-03-29 01:32:02.518850+00:00, run_duration=0.524856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:32:01.014290+00:00, queued_by_job_id=2, pid=7875 2024-03-29T01:32:03.884479256Z [2024-03-29T01:32:03.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:31:00+00:00 exited with status success for try_number 1 2024-03-29T01:32:03.889679143Z [2024-03-29T01:32:03.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:31:00+00:00, map_index=-1, run_start_date=2024-03-29 01:32:02.198821+00:00, run_end_date=2024-03-29 01:32:02.648880+00:00, run_duration=0.450059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:32:01.014290+00:00, queued_by_job_id=2, pid=7877 2024-03-29T01:32:04.953951892Z [2024-03-29T01:32:04.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:32:04.953983006Z [2024-03-29T01:32:04.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:31:00+00:00, run_id=scheduled__2024-03-29T01:31:00+00:00, run_start_date=2024-03-29 01:32:00.934772+00:00, run_end_date=2024-03-29 01:32:04.953335+00:00, run_duration=4.018563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:31:00+00:00, data_interval_end=2024-03-29 01:32:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:32:04.966554783Z [2024-03-29T01:32:04.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:32:00+00:00, run_after=2024-03-29T01:33:00+00:00 2024-03-29T01:32:05.029091088Z [2024-03-29T01:32:05.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:31:00+00:00 exited with status success for try_number 1 2024-03-29T01:32:05.033184067Z [2024-03-29T01:32:05.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:31:00+00:00, map_index=-1, run_start_date=2024-03-29 01:32:03.138718+00:00, run_end_date=2024-03-29 01:32:04.582374+00:00, run_duration=1.443656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:32:01.014290+00:00, queued_by_job_id=2, pid=7894 2024-03-29T01:32:05.354907775Z [2024-03-29T01:32:05.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:32:05.358578146Z [2024-03-29T01:32:05.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:31:00+00:00, run_id=scheduled__2024-03-29T01:31:00+00:00, run_start_date=2024-03-29 01:32:00.936438+00:00, run_end_date=2024-03-29 01:32:05.357897+00:00, run_duration=4.421459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:31:00+00:00, data_interval_end=2024-03-29 01:32:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:32:05.379033729Z [2024-03-29T01:32:05.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:32:00+00:00, run_after=2024-03-29T01:33:00+00:00 2024-03-29T01:32:05.422567186Z [2024-03-29T01:32:05.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:31:00+00:00 exited with status success for try_number 1 2024-03-29T01:32:05.433635824Z [2024-03-29T01:32:05.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:31:00+00:00, map_index=-1, run_start_date=2024-03-29 01:32:03.478070+00:00, run_end_date=2024-03-29 01:32:05.042333+00:00, run_duration=1.564263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:32:01.014290+00:00, queued_by_job_id=2, pid=7905 2024-03-29T01:33:00.535892695Z [2024-03-29T01:33:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:33:00+00:00, run_after=2024-03-29T01:34:00+00:00 2024-03-29T01:33:00.547063440Z [2024-03-29T01:33:00.545+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:33:00.570138900Z [2024-03-29T01:33:00.569+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:33:00+00:00, run_after=2024-03-29T01:34:00+00:00 2024-03-29T01:33:00.653452472Z [2024-03-29T01:33:00.652+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:33:00.653494650Z 2024-03-29T01:33:00.653501118Z 2024-03-29T01:33:00.653506539Z 2024-03-29T01:33:00.653672143Z [2024-03-29T01:33:00.653+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:33:00.653899434Z [2024-03-29T01:33:00.653+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:33:00.654704704Z [2024-03-29T01:33:00.653+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:33:00.655786265Z [2024-03-29T01:33:00.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:33:00.655806206Z 2024-03-29T01:33:00.655811561Z 2024-03-29T01:33:00.655816309Z 2024-03-29T01:33:00.661088314Z [2024-03-29T01:33:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:33:00.661462118Z [2024-03-29T01:33:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:33:00.662068077Z [2024-03-29T01:33:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:33:00.662376467Z [2024-03-29T01:33:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:33:00.663090269Z [2024-03-29T01:33:00.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:33:00.663373299Z [2024-03-29T01:33:00.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:33:00.980060600Z [2024-03-29T01:33:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status queued for try_number 1 2024-03-29T01:33:00.980395211Z [2024-03-29T01:33:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status queued for try_number 1 2024-03-29T01:33:00.980660146Z [2024-03-29T01:33:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status queued for try_number 1 2024-03-29T01:33:00.996779774Z [2024-03-29T01:33:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e73a894-5287-4765-b963-864dde68db62 2024-03-29T01:33:00.997251999Z [2024-03-29T01:33:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to addf268b-7a90-4128-b5ef-177f6f8e698d 2024-03-29T01:33:00.997601352Z [2024-03-29T01:33:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1054a898-324e-4ddf-8dbf-b4ae7304bfff 2024-03-29T01:33:02.289853711Z [2024-03-29T01:33:02.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:33:02.290911432Z [2024-03-29T01:33:02.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:32:00+00:00, run_id=scheduled__2024-03-29T01:32:00+00:00, run_start_date=2024-03-29 01:33:00.584876+00:00, run_end_date=2024-03-29 01:33:02.290382+00:00, run_duration=1.705506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:32:00+00:00, data_interval_end=2024-03-29 01:33:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:33:02.303327429Z [2024-03-29T01:33:02.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:33:00+00:00, run_after=2024-03-29T01:34:00+00:00 2024-03-29T01:33:02.347866666Z [2024-03-29T01:33:02.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status success for try_number 1 2024-03-29T01:33:02.356958020Z [2024-03-29T01:33:02.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:32:00+00:00, map_index=-1, run_start_date=2024-03-29 01:33:01.464568+00:00, run_end_date=2024-03-29 01:33:01.896006+00:00, run_duration=0.431438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:33:00.657277+00:00, queued_by_job_id=2, pid=7932 2024-03-29T01:33:04.319712335Z [2024-03-29T01:33:04.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:33:04.320204489Z [2024-03-29T01:33:04.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:32:00+00:00, run_id=scheduled__2024-03-29T01:32:00+00:00, run_start_date=2024-03-29 01:33:00.586255+00:00, run_end_date=2024-03-29 01:33:04.319838+00:00, run_duration=3.733583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:32:00+00:00, data_interval_end=2024-03-29 01:33:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:33:04.331193842Z [2024-03-29T01:33:04.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:33:00+00:00, run_after=2024-03-29T01:34:00+00:00 2024-03-29T01:33:04.339137991Z [2024-03-29T01:33:04.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:33:04.339574393Z [2024-03-29T01:33:04.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:32:00+00:00, run_id=scheduled__2024-03-29T01:32:00+00:00, run_start_date=2024-03-29 01:33:00.587709+00:00, run_end_date=2024-03-29 01:33:04.339222+00:00, run_duration=3.751513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:32:00+00:00, data_interval_end=2024-03-29 01:33:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:33:04.350495354Z [2024-03-29T01:33:04.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:33:00+00:00, run_after=2024-03-29T01:34:00+00:00 2024-03-29T01:33:04.569190950Z [2024-03-29T01:33:04.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status success for try_number 1 2024-03-29T01:33:04.569551474Z [2024-03-29T01:33:04.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status success for try_number 1 2024-03-29T01:33:04.578732159Z [2024-03-29T01:33:04.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:32:00+00:00, map_index=-1, run_start_date=2024-03-29 01:33:02.516267+00:00, run_end_date=2024-03-29 01:33:04.246907+00:00, run_duration=1.73064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:33:00.657277+00:00, queued_by_job_id=2, pid=7950 2024-03-29T01:33:04.579744858Z [2024-03-29T01:33:04.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:32:00+00:00, map_index=-1, run_start_date=2024-03-29 01:33:02.613958+00:00, run_end_date=2024-03-29 01:33:04.266793+00:00, run_duration=1.652835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:33:00.657277+00:00, queued_by_job_id=2, pid=7951 2024-03-29T01:33:45.461524969Z [2024-03-29T01:33:45.460+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:34:00.312803195Z [2024-03-29T01:34:00.312+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:34:00.325147239Z [2024-03-29T01:34:00.324+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:34:00+00:00, run_after=2024-03-29T01:35:00+00:00 2024-03-29T01:34:00.336792878Z [2024-03-29T01:34:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:34:00+00:00, run_after=2024-03-29T01:35:00+00:00 2024-03-29T01:34:00.343772329Z [2024-03-29T01:34:00.343+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:34:00.425263664Z [2024-03-29T01:34:00.424+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:34:00.425294949Z 2024-03-29T01:34:00.425301097Z 2024-03-29T01:34:00.425305832Z 2024-03-29T01:34:00.425310521Z 2024-03-29T01:34:00.425360604Z [2024-03-29T01:34:00.425+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:34:00.425482742Z [2024-03-29T01:34:00.425+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:34:00.425572249Z [2024-03-29T01:34:00.425+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:34:00.425713784Z [2024-03-29T01:34:00.425+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:34:00.426388806Z [2024-03-29T01:34:00.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:34:00.426405180Z 2024-03-29T01:34:00.426410401Z 2024-03-29T01:34:00.426414625Z 2024-03-29T01:34:00.426420620Z 2024-03-29T01:34:00.430339739Z [2024-03-29T01:34:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:34:00.430618578Z [2024-03-29T01:34:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:34:00.430790027Z [2024-03-29T01:34:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:34:00.430895536Z [2024-03-29T01:34:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:34:00.431188393Z [2024-03-29T01:34:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:34:00.431254212Z [2024-03-29T01:34:00.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:34:00.431573595Z [2024-03-29T01:34:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:34:00.431588968Z [2024-03-29T01:34:00.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:34:01.033077436Z [2024-03-29T01:34:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status queued for try_number 1 2024-03-29T01:34:01.033788311Z [2024-03-29T01:34:01.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:33:00+00:00 exited with status queued for try_number 1 2024-03-29T01:34:01.033930254Z [2024-03-29T01:34:01.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:33:00+00:00 exited with status queued for try_number 1 2024-03-29T01:34:01.034084423Z [2024-03-29T01:34:01.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:33:00+00:00 exited with status queued for try_number 1 2024-03-29T01:34:01.060609912Z [2024-03-29T01:34:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3f46ea3-29c6-4d46-b40e-eaf31aeca7cc 2024-03-29T01:34:01.060919424Z [2024-03-29T01:34:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6616e2c2-1bb8-4497-a0d1-87b1fe8751a9 2024-03-29T01:34:01.061324768Z [2024-03-29T01:34:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to e90eb153-2164-49e0-b24a-a084c76e2d94 2024-03-29T01:34:01.061557040Z [2024-03-29T01:34:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c5c352b-7111-4451-a822-3cf0075fe963 2024-03-29T01:34:02.268485753Z [2024-03-29T01:34:02.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:34:02.269271168Z [2024-03-29T01:34:02.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:33:00+00:00, run_id=scheduled__2024-03-29T01:33:00+00:00, run_start_date=2024-03-29 01:34:00.355977+00:00, run_end_date=2024-03-29 01:34:02.268654+00:00, run_duration=1.912677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:33:00+00:00, data_interval_end=2024-03-29 01:34:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:34:02.286690115Z [2024-03-29T01:34:02.286+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:34:00+00:00, run_after=2024-03-29T01:35:00+00:00 2024-03-29T01:34:02.300131806Z [2024-03-29T01:34:02.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:34:02.301069751Z [2024-03-29T01:34:02.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:32:00+00:00, run_id=scheduled__2024-03-29T01:32:00+00:00, run_start_date=2024-03-29 01:34:00.354269+00:00, run_end_date=2024-03-29 01:34:02.300259+00:00, run_duration=1.94599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:32:00+00:00, data_interval_end=2024-03-29 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:34:02.319384073Z [2024-03-29T01:34:02.318+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:34:00+00:00, run_after=2024-03-29T01:36:00+00:00 2024-03-29T01:34:02.389394702Z [2024-03-29T01:34:02.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:32:00+00:00 exited with status success for try_number 1 2024-03-29T01:34:02.389955570Z [2024-03-29T01:34:02.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:33:00+00:00 exited with status success for try_number 1 2024-03-29T01:34:02.406103375Z [2024-03-29T01:34:02.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:33:00+00:00, map_index=-1, run_start_date=2024-03-29 01:34:01.234655+00:00, run_end_date=2024-03-29 01:34:01.769399+00:00, run_duration=0.534744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:34:00.427219+00:00, queued_by_job_id=2, pid=7984 2024-03-29T01:34:02.406749186Z [2024-03-29T01:34:02.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:32:00+00:00, map_index=-1, run_start_date=2024-03-29 01:34:01.485136+00:00, run_end_date=2024-03-29 01:34:01.917005+00:00, run_duration=0.431869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:34:00.427219+00:00, queued_by_job_id=2, pid=7985 2024-03-29T01:34:04.747927646Z [2024-03-29T01:34:04.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:34:04.748547671Z [2024-03-29T01:34:04.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:33:00+00:00, run_id=scheduled__2024-03-29T01:33:00+00:00, run_start_date=2024-03-29 01:34:00.357412+00:00, run_end_date=2024-03-29 01:34:04.747826+00:00, run_duration=4.390414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:33:00+00:00, data_interval_end=2024-03-29 01:34:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:34:04.760741723Z [2024-03-29T01:34:04.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:34:00+00:00, run_after=2024-03-29T01:35:00+00:00 2024-03-29T01:34:04.769804287Z [2024-03-29T01:34:04.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:34:04.770034623Z [2024-03-29T01:34:04.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:33:00+00:00, run_id=scheduled__2024-03-29T01:33:00+00:00, run_start_date=2024-03-29 01:34:00.358677+00:00, run_end_date=2024-03-29 01:34:04.769628+00:00, run_duration=4.410951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:33:00+00:00, data_interval_end=2024-03-29 01:34:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:34:04.780390503Z [2024-03-29T01:34:04.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:34:00+00:00, run_after=2024-03-29T01:35:00+00:00 2024-03-29T01:34:04.827769652Z [2024-03-29T01:34:04.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:33:00+00:00 exited with status success for try_number 1 2024-03-29T01:34:04.827870239Z [2024-03-29T01:34:04.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:33:00+00:00 exited with status success for try_number 1 2024-03-29T01:34:04.839507570Z [2024-03-29T01:34:04.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:33:00+00:00, map_index=-1, run_start_date=2024-03-29 01:34:02.728624+00:00, run_end_date=2024-03-29 01:34:04.430640+00:00, run_duration=1.702016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:34:00.427219+00:00, queued_by_job_id=2, pid=8008 2024-03-29T01:34:04.839640361Z [2024-03-29T01:34:04.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:33:00+00:00, map_index=-1, run_start_date=2024-03-29 01:34:02.752721+00:00, run_end_date=2024-03-29 01:34:04.125354+00:00, run_duration=1.372633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:34:00.427219+00:00, queued_by_job_id=2, pid=8009 2024-03-29T01:35:00.912636415Z [2024-03-29T01:35:00.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:35:00+00:00, run_after=2024-03-29T01:36:00+00:00 2024-03-29T01:35:00.929862353Z [2024-03-29T01:35:00.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:35:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:35:00.941799025Z [2024-03-29T01:35:00.941+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:35:00.958775050Z [2024-03-29T01:35:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:35:00+00:00, run_after=2024-03-29T01:36:00+00:00 2024-03-29T01:35:01.059246817Z [2024-03-29T01:35:01.058+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:35:01.059284698Z 2024-03-29T01:35:01.059294743Z 2024-03-29T01:35:01.059299312Z 2024-03-29T01:35:01.059304010Z 2024-03-29T01:35:01.059585161Z [2024-03-29T01:35:01.059+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:35:01.059754859Z [2024-03-29T01:35:01.059+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:35:01.059898791Z [2024-03-29T01:35:01.059+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:35:01.060099147Z [2024-03-29T01:35:01.059+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:35:01.060918193Z [2024-03-29T01:35:01.060+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:35:01.060930132Z 2024-03-29T01:35:01.060933913Z 2024-03-29T01:35:01.060937457Z 2024-03-29T01:35:01.060957356Z 2024-03-29T01:35:01.065327066Z [2024-03-29T01:35:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:35:01.065608258Z [2024-03-29T01:35:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:35:01.066014526Z [2024-03-29T01:35:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:35:01.066229267Z [2024-03-29T01:35:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:35:01.066640024Z [2024-03-29T01:35:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:35:01.066887066Z [2024-03-29T01:35:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:35:01.067315955Z [2024-03-29T01:35:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:35:01.067562171Z [2024-03-29T01:35:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:35:01.472383766Z [2024-03-29T01:35:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:35:01.472798939Z [2024-03-29T01:35:01.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status queued for try_number 1 2024-03-29T01:35:01.473034332Z [2024-03-29T01:35:01.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status queued for try_number 1 2024-03-29T01:35:01.473333518Z [2024-03-29T01:35:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status queued for try_number 1 2024-03-29T01:35:01.488216747Z [2024-03-29T01:35:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6b01163-ee1b-4510-b40f-1a6e764faa9b 2024-03-29T01:35:01.492947062Z [2024-03-29T01:35:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebec9ac9-6f0c-4488-aeb6-83b4481e85b0 2024-03-29T01:35:01.493539091Z [2024-03-29T01:35:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3077261a-0df7-4603-96bd-cc4e8c01ec4e 2024-03-29T01:35:01.493804478Z [2024-03-29T01:35:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c928bbb-eee7-40d4-a01f-93a2b844a8c7 2024-03-29T01:35:03.028564478Z [2024-03-29T01:35:03.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:35:03.029156812Z [2024-03-29T01:35:03.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:34:00+00:00, run_id=scheduled__2024-03-29T01:34:00+00:00, run_start_date=2024-03-29 01:35:00.974194+00:00, run_end_date=2024-03-29 01:35:03.028475+00:00, run_duration=2.054281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:34:00+00:00, data_interval_end=2024-03-29 01:35:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:35:03.061657466Z [2024-03-29T01:35:03.061+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:35:00+00:00, run_after=2024-03-29T01:36:00+00:00 2024-03-29T01:35:03.219850648Z [2024-03-29T01:35:03.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status success for try_number 1 2024-03-29T01:35:03.236748899Z [2024-03-29T01:35:03.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:34:00+00:00, map_index=-1, run_start_date=2024-03-29 01:35:01.966760+00:00, run_end_date=2024-03-29 01:35:02.462813+00:00, run_duration=0.496053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:35:01.061883+00:00, queued_by_job_id=2, pid=8041 2024-03-29T01:35:05.314491803Z [2024-03-29T01:35:05.314+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:35:05.314529785Z 2024-03-29T01:35:05.314782032Z [2024-03-29T01:35:05.314+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:35:05.316149162Z [2024-03-29T01:35:05.315+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:35:05.316181543Z 2024-03-29T01:35:05.320248301Z [2024-03-29T01:35:05.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:35:05.320426614Z [2024-03-29T01:35:05.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:35:05.379479021Z [2024-03-29T01:35:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:35:05.379573473Z [2024-03-29T01:35:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:35:05.389116766Z [2024-03-29T01:35:05.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d50d66a-c0aa-46c7-b559-ce77d45d6d44 2024-03-29T01:35:05.389553648Z [2024-03-29T01:35:05.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=-1, run_start_date=2024-03-29 01:35:03.474691+00:00, run_end_date=2024-03-29 01:35:04.147509+00:00, run_duration=0.672818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:35:01.061883+00:00, queued_by_job_id=2, pid=8066 2024-03-29T01:35:06.097840308Z [2024-03-29T01:35:06.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:35:06.099328583Z [2024-03-29T01:35:06.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:34:00+00:00, run_id=scheduled__2024-03-29T01:34:00+00:00, run_start_date=2024-03-29 01:35:00.975962+00:00, run_end_date=2024-03-29 01:35:06.097685+00:00, run_duration=5.121723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:34:00+00:00, data_interval_end=2024-03-29 01:35:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:35:06.113789401Z [2024-03-29T01:35:06.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:35:00+00:00, run_after=2024-03-29T01:36:00+00:00 2024-03-29T01:35:06.138667594Z [2024-03-29T01:35:06.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:35:06.138701300Z [2024-03-29T01:35:06.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:34:00+00:00, run_id=scheduled__2024-03-29T01:34:00+00:00, run_start_date=2024-03-29 01:35:00.977422+00:00, run_end_date=2024-03-29 01:35:06.135639+00:00, run_duration=5.158217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:34:00+00:00, data_interval_end=2024-03-29 01:35:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:35:06.159604574Z [2024-03-29T01:35:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:35:00+00:00, run_after=2024-03-29T01:36:00+00:00 2024-03-29T01:35:06.235234115Z [2024-03-29T01:35:06.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status success for try_number 1 2024-03-29T01:35:06.235278119Z [2024-03-29T01:35:06.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status success for try_number 1 2024-03-29T01:35:06.244377200Z [2024-03-29T01:35:06.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:34:00+00:00, map_index=-1, run_start_date=2024-03-29 01:35:03.815736+00:00, run_end_date=2024-03-29 01:35:05.748160+00:00, run_duration=1.932424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:35:01.061883+00:00, queued_by_job_id=2, pid=8067 2024-03-29T01:35:06.244853832Z [2024-03-29T01:35:06.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:34:00+00:00, map_index=-1, run_start_date=2024-03-29 01:35:03.509901+00:00, run_end_date=2024-03-29 01:35:05.816327+00:00, run_duration=2.306426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:35:01.061883+00:00, queued_by_job_id=2, pid=8065 2024-03-29T01:35:09.309403314Z [2024-03-29T01:35:09.308+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:35:09.309437513Z 2024-03-29T01:35:09.309689155Z [2024-03-29T01:35:09.309+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:35:09.310803781Z [2024-03-29T01:35:09.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:35:09.310818733Z 2024-03-29T01:35:09.314014632Z [2024-03-29T01:35:09.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:35:09.314184275Z [2024-03-29T01:35:09.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:35:09.375038719Z [2024-03-29T01:35:09.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:35:09.375367181Z [2024-03-29T01:35:09.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:35:09.385158540Z [2024-03-29T01:35:09.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b678594-f929-4e14-8cf5-05101d09f04d 2024-03-29T01:35:09.385585489Z [2024-03-29T01:35:09.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=-1, run_start_date=2024-03-29 01:35:07.632648+00:00, run_end_date=2024-03-29 01:35:08.058743+00:00, run_duration=0.426095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:35:05.316678+00:00, queued_by_job_id=2, pid=8090 2024-03-29T01:35:11.631567615Z [2024-03-29T01:35:11.631+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:35:11.631602731Z 2024-03-29T01:35:11.631826331Z [2024-03-29T01:35:11.631+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:35:11.632540971Z [2024-03-29T01:35:11.632+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:35:11.632553816Z 2024-03-29T01:35:11.636088340Z [2024-03-29T01:35:11.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:35:11.636111924Z [2024-03-29T01:35:11.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:35:11.692367007Z [2024-03-29T01:35:11.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status queued for try_number 1 2024-03-29T01:35:11.692876388Z [2024-03-29T01:35:11.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:35:11.702236794Z [2024-03-29T01:35:11.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c243aef-e30e-403d-97a1-9f4a952bc9f1 2024-03-29T01:35:11.702796170Z [2024-03-29T01:35:11.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=0, run_start_date=2024-03-29 01:35:10.955599+00:00, run_end_date=2024-03-29 01:35:11.283388+00:00, run_duration=0.327789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:35:09.311347+00:00, queued_by_job_id=2, pid=8098 2024-03-29T01:35:14.248283122Z [2024-03-29T01:35:14.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:35:14.248522183Z [2024-03-29T01:35:14.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:30:00+00:00, run_id=scheduled__2024-03-29T01:30:00+00:00, run_start_date=2024-03-29 01:35:00.972496+00:00, run_end_date=2024-03-29 01:35:14.248156+00:00, run_duration=13.27566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:30:00+00:00, data_interval_end=2024-03-29 01:35:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:35:14.257201596Z [2024-03-29T01:35:14.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:35:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:35:14.290371693Z [2024-03-29T01:35:14.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:30:00+00:00 exited with status success for try_number 1 2024-03-29T01:35:14.297114355Z [2024-03-29T01:35:14.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:30:00+00:00, map_index=-1, run_start_date=2024-03-29 01:35:13.458879+00:00, run_end_date=2024-03-29 01:35:13.789700+00:00, run_duration=0.330821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:35:11.633004+00:00, queued_by_job_id=2, pid=8106 2024-03-29T01:36:00.881898678Z [2024-03-29T01:36:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:36:00+00:00, run_after=2024-03-29T01:37:00+00:00 2024-03-29T01:36:00.892836143Z [2024-03-29T01:36:00.892+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:36:00.903956980Z [2024-03-29T01:36:00.903+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:36:00.925355679Z [2024-03-29T01:36:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:36:00+00:00, run_after=2024-03-29T01:37:00+00:00 2024-03-29T01:36:01.038402661Z [2024-03-29T01:36:01.037+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:36:01.038457664Z 2024-03-29T01:36:01.038465460Z 2024-03-29T01:36:01.038471203Z 2024-03-29T01:36:01.038475525Z 2024-03-29T01:36:01.038719114Z [2024-03-29T01:36:01.038+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:36:01.038924529Z [2024-03-29T01:36:01.038+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:36:01.039129373Z [2024-03-29T01:36:01.038+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:36:01.039273081Z [2024-03-29T01:36:01.039+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:36:01.040133316Z [2024-03-29T01:36:01.039+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:36:01.040146813Z 2024-03-29T01:36:01.040150667Z 2024-03-29T01:36:01.040154302Z 2024-03-29T01:36:01.040157473Z 2024-03-29T01:36:01.045322340Z [2024-03-29T01:36:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:36:01.045591190Z [2024-03-29T01:36:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:36:01.046098476Z [2024-03-29T01:36:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:36:01.046605991Z [2024-03-29T01:36:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:36:01.047214158Z [2024-03-29T01:36:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:36:01.047466214Z [2024-03-29T01:36:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:36:01.047779289Z [2024-03-29T01:36:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:36:01.048002942Z [2024-03-29T01:36:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:36:01.570189494Z [2024-03-29T01:36:01.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status queued for try_number 1 2024-03-29T01:36:01.570547208Z [2024-03-29T01:36:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status queued for try_number 1 2024-03-29T01:36:01.570792503Z [2024-03-29T01:36:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status queued for try_number 1 2024-03-29T01:36:01.570964111Z [2024-03-29T01:36:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status queued for try_number 1 2024-03-29T01:36:01.596661373Z [2024-03-29T01:36:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a3014d0-3504-4111-9a7c-586d947a1cea 2024-03-29T01:36:01.597019907Z [2024-03-29T01:36:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd4a39fa-7734-4ce0-9e45-2bb33bf39107 2024-03-29T01:36:01.597295617Z [2024-03-29T01:36:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3ff75dd-8875-4c28-9f46-c6b3392887ae 2024-03-29T01:36:01.597493553Z [2024-03-29T01:36:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16b3c76d-b72d-4297-8f05-b6ba7911a2e2 2024-03-29T01:36:02.844850834Z [2024-03-29T01:36:02.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:36:02.845167755Z [2024-03-29T01:36:02.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:34:00+00:00, run_id=scheduled__2024-03-29T01:34:00+00:00, run_start_date=2024-03-29 01:36:00.941648+00:00, run_end_date=2024-03-29 01:36:02.844754+00:00, run_duration=1.903106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:34:00+00:00, data_interval_end=2024-03-29 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:36:02.860078397Z [2024-03-29T01:36:02.859+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:36:00+00:00, run_after=2024-03-29T01:38:00+00:00 2024-03-29T01:36:02.951627167Z [2024-03-29T01:36:02.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:34:00+00:00 exited with status success for try_number 1 2024-03-29T01:36:02.958738672Z [2024-03-29T01:36:02.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:34:00+00:00, map_index=-1, run_start_date=2024-03-29 01:36:02.131749+00:00, run_end_date=2024-03-29 01:36:02.683358+00:00, run_duration=0.551609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:36:01.041435+00:00, queued_by_job_id=2, pid=8129 2024-03-29T01:36:04.046924408Z [2024-03-29T01:36:04.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:36:04.047321567Z [2024-03-29T01:36:04.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:35:00+00:00, run_id=scheduled__2024-03-29T01:35:00+00:00, run_start_date=2024-03-29 01:36:00.943785+00:00, run_end_date=2024-03-29 01:36:04.046932+00:00, run_duration=3.103147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:35:00+00:00, data_interval_end=2024-03-29 01:36:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:36:04.068174295Z [2024-03-29T01:36:04.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:36:00+00:00, run_after=2024-03-29T01:37:00+00:00 2024-03-29T01:36:04.128197001Z [2024-03-29T01:36:04.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status success for try_number 1 2024-03-29T01:36:04.134024738Z [2024-03-29T01:36:04.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:35:00+00:00, map_index=-1, run_start_date=2024-03-29 01:36:02.319910+00:00, run_end_date=2024-03-29 01:36:02.914289+00:00, run_duration=0.594379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:36:01.041435+00:00, queued_by_job_id=2, pid=8130 2024-03-29T01:36:05.683847838Z [2024-03-29T01:36:05.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:36:05.684098506Z [2024-03-29T01:36:05.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:35:00+00:00, run_id=scheduled__2024-03-29T01:35:00+00:00, run_start_date=2024-03-29 01:36:00.945657+00:00, run_end_date=2024-03-29 01:36:05.683812+00:00, run_duration=4.738155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:35:00+00:00, data_interval_end=2024-03-29 01:36:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:36:05.692504336Z [2024-03-29T01:36:05.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:36:00+00:00, run_after=2024-03-29T01:37:00+00:00 2024-03-29T01:36:05.725703351Z [2024-03-29T01:36:05.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status success for try_number 1 2024-03-29T01:36:05.732471017Z [2024-03-29T01:36:05.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:35:00+00:00, map_index=-1, run_start_date=2024-03-29 01:36:03.703170+00:00, run_end_date=2024-03-29 01:36:05.341526+00:00, run_duration=1.638356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:36:01.041435+00:00, queued_by_job_id=2, pid=8153 2024-03-29T01:36:06.460050351Z [2024-03-29T01:36:06.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:36:06.460337822Z [2024-03-29T01:36:06.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:35:00+00:00, run_id=scheduled__2024-03-29T01:35:00+00:00, run_start_date=2024-03-29 01:36:00.947446+00:00, run_end_date=2024-03-29 01:36:06.459944+00:00, run_duration=5.512498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:35:00+00:00, data_interval_end=2024-03-29 01:36:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:36:06.470739574Z [2024-03-29T01:36:06.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:36:00+00:00, run_after=2024-03-29T01:37:00+00:00 2024-03-29T01:36:06.505498765Z [2024-03-29T01:36:06.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status success for try_number 1 2024-03-29T01:36:06.510012352Z [2024-03-29T01:36:06.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:35:00+00:00, map_index=-1, run_start_date=2024-03-29 01:36:03.727213+00:00, run_end_date=2024-03-29 01:36:05.863182+00:00, run_duration=2.135969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:36:01.041435+00:00, queued_by_job_id=2, pid=8154 2024-03-29T01:37:00.789178056Z [2024-03-29T01:37:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:37:00+00:00, run_after=2024-03-29T01:38:00+00:00 2024-03-29T01:37:00.800360248Z [2024-03-29T01:37:00.799+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:37:00.815374961Z [2024-03-29T01:37:00.815+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:37:00+00:00, run_after=2024-03-29T01:38:00+00:00 2024-03-29T01:37:00.885774983Z [2024-03-29T01:37:00.885+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:37:00.885830234Z 2024-03-29T01:37:00.885834354Z 2024-03-29T01:37:00.885837516Z 2024-03-29T01:37:00.885847825Z [2024-03-29T01:37:00.885+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:37:00.885972647Z [2024-03-29T01:37:00.885+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:37:00.886113892Z [2024-03-29T01:37:00.885+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:37:00.886803569Z [2024-03-29T01:37:00.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:37:00.886815026Z 2024-03-29T01:37:00.886820154Z 2024-03-29T01:37:00.886824754Z 2024-03-29T01:37:00.890515123Z [2024-03-29T01:37:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:37:00.890763984Z [2024-03-29T01:37:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:37:00.891185992Z [2024-03-29T01:37:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:37:00.891359560Z [2024-03-29T01:37:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:37:00.891600430Z [2024-03-29T01:37:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:37:00.891713225Z [2024-03-29T01:37:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:37:01.155768556Z [2024-03-29T01:37:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status queued for try_number 1 2024-03-29T01:37:01.155943231Z [2024-03-29T01:37:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status queued for try_number 1 2024-03-29T01:37:01.156104238Z [2024-03-29T01:37:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status queued for try_number 1 2024-03-29T01:37:01.178804293Z [2024-03-29T01:37:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14f87690-88ac-48d9-9c17-34b8452816b8 2024-03-29T01:37:01.179100480Z [2024-03-29T01:37:01.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99c94817-d481-4539-90e6-241de1242eca 2024-03-29T01:37:01.179273888Z [2024-03-29T01:37:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce6698c6-df4d-40e5-a9b1-7400853aa497 2024-03-29T01:37:02.369698301Z [2024-03-29T01:37:02.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:37:02.370991356Z [2024-03-29T01:37:02.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:36:00+00:00, run_id=scheduled__2024-03-29T01:36:00+00:00, run_start_date=2024-03-29 01:37:00.826119+00:00, run_end_date=2024-03-29 01:37:02.369556+00:00, run_duration=1.543437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:36:00+00:00, data_interval_end=2024-03-29 01:37:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:37:02.381881674Z [2024-03-29T01:37:02.381+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:37:00+00:00, run_after=2024-03-29T01:38:00+00:00 2024-03-29T01:37:02.452269610Z [2024-03-29T01:37:02.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status success for try_number 1 2024-03-29T01:37:02.459283391Z [2024-03-29T01:37:02.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:36:00+00:00, map_index=-1, run_start_date=2024-03-29 01:37:01.703741+00:00, run_end_date=2024-03-29 01:37:02.206417+00:00, run_duration=0.502676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:37:00.887704+00:00, queued_by_job_id=2, pid=8186 2024-03-29T01:37:04.868186085Z [2024-03-29T01:37:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:37:04.868464219Z [2024-03-29T01:37:04.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:36:00+00:00, run_id=scheduled__2024-03-29T01:36:00+00:00, run_start_date=2024-03-29 01:37:00.827446+00:00, run_end_date=2024-03-29 01:37:04.868118+00:00, run_duration=4.040672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:36:00+00:00, data_interval_end=2024-03-29 01:37:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:37:04.878093384Z [2024-03-29T01:37:04.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:37:00+00:00, run_after=2024-03-29T01:38:00+00:00 2024-03-29T01:37:04.919503227Z [2024-03-29T01:37:04.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status success for try_number 1 2024-03-29T01:37:04.924477917Z [2024-03-29T01:37:04.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:36:00+00:00, map_index=-1, run_start_date=2024-03-29 01:37:02.877688+00:00, run_end_date=2024-03-29 01:37:04.096157+00:00, run_duration=1.218469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:37:00.887704+00:00, queued_by_job_id=2, pid=8199 2024-03-29T01:37:05.986351771Z [2024-03-29T01:37:05.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:37:05.986379337Z [2024-03-29T01:37:05.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:36:00+00:00, run_id=scheduled__2024-03-29T01:36:00+00:00, run_start_date=2024-03-29 01:37:00.828686+00:00, run_end_date=2024-03-29 01:37:05.983489+00:00, run_duration=5.154803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:36:00+00:00, data_interval_end=2024-03-29 01:37:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:37:06.006569023Z [2024-03-29T01:37:06.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:37:00+00:00, run_after=2024-03-29T01:38:00+00:00 2024-03-29T01:37:06.041269869Z [2024-03-29T01:37:06.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status success for try_number 1 2024-03-29T01:37:06.046732029Z [2024-03-29T01:37:06.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:36:00+00:00, map_index=-1, run_start_date=2024-03-29 01:37:03.235693+00:00, run_end_date=2024-03-29 01:37:04.785754+00:00, run_duration=1.550061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:37:00.887704+00:00, queued_by_job_id=2, pid=8210 2024-03-29T01:38:00.516324065Z [2024-03-29T01:38:00.515+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:38:00+00:00, run_after=2024-03-29T01:39:00+00:00 2024-03-29T01:38:00.524485216Z [2024-03-29T01:38:00.524+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:38:00.538541602Z [2024-03-29T01:38:00.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:38:00+00:00, run_after=2024-03-29T01:39:00+00:00 2024-03-29T01:38:00.546009022Z [2024-03-29T01:38:00.545+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:38:00.653244679Z [2024-03-29T01:38:00.652+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:38:00.653274930Z 2024-03-29T01:38:00.653298530Z 2024-03-29T01:38:00.653301894Z 2024-03-29T01:38:00.653305660Z 2024-03-29T01:38:00.653560773Z [2024-03-29T01:38:00.653+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:38:00.653840393Z [2024-03-29T01:38:00.653+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:38:00.654133090Z [2024-03-29T01:38:00.653+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:38:00.654395598Z [2024-03-29T01:38:00.654+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:38:00.655690074Z [2024-03-29T01:38:00.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:38:00.655702071Z 2024-03-29T01:38:00.655706327Z 2024-03-29T01:38:00.655710127Z 2024-03-29T01:38:00.655713927Z 2024-03-29T01:38:00.661809629Z [2024-03-29T01:38:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:38:00.662538910Z [2024-03-29T01:38:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:38:00.664078523Z [2024-03-29T01:38:00.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:38:00.664403208Z [2024-03-29T01:38:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:38:00.664890293Z [2024-03-29T01:38:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:38:00.665152618Z [2024-03-29T01:38:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:38:00.666473944Z [2024-03-29T01:38:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:38:00.666778620Z [2024-03-29T01:38:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:38:01.095389518Z [2024-03-29T01:38:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status queued for try_number 1 2024-03-29T01:38:01.095484013Z [2024-03-29T01:38:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:37:00+00:00 exited with status queued for try_number 1 2024-03-29T01:38:01.095490240Z [2024-03-29T01:38:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:37:00+00:00 exited with status queued for try_number 1 2024-03-29T01:38:01.095522700Z [2024-03-29T01:38:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:37:00+00:00 exited with status queued for try_number 1 2024-03-29T01:38:01.105915860Z [2024-03-29T01:38:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c1f48c4-f9a9-492c-8cac-93488e770f09 2024-03-29T01:38:01.106006738Z [2024-03-29T01:38:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49ab6fe0-e5f4-4217-bf07-87237bbfd290 2024-03-29T01:38:01.106041662Z [2024-03-29T01:38:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0f38557-cff0-417e-8057-466e25c49602 2024-03-29T01:38:01.106138034Z [2024-03-29T01:38:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ae69a2b-3d01-4a87-a85f-68f2edef818b 2024-03-29T01:38:02.271143087Z [2024-03-29T01:38:02.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:38:02.271512779Z [2024-03-29T01:38:02.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:36:00+00:00, run_id=scheduled__2024-03-29T01:36:00+00:00, run_start_date=2024-03-29 01:38:00.555680+00:00, run_end_date=2024-03-29 01:38:02.271099+00:00, run_duration=1.715419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:36:00+00:00, data_interval_end=2024-03-29 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:38:02.280496341Z [2024-03-29T01:38:02.280+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:38:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:38:02.288735564Z [2024-03-29T01:38:02.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:38:02.288962299Z [2024-03-29T01:38:02.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:37:00+00:00, run_id=scheduled__2024-03-29T01:37:00+00:00, run_start_date=2024-03-29 01:38:00.556893+00:00, run_end_date=2024-03-29 01:38:02.288615+00:00, run_duration=1.731722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:37:00+00:00, data_interval_end=2024-03-29 01:38:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:38:02.299824577Z [2024-03-29T01:38:02.299+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:38:00+00:00, run_after=2024-03-29T01:39:00+00:00 2024-03-29T01:38:02.359164959Z [2024-03-29T01:38:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:36:00+00:00 exited with status success for try_number 1 2024-03-29T01:38:02.359199715Z [2024-03-29T01:38:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:37:00+00:00 exited with status success for try_number 1 2024-03-29T01:38:02.372561555Z [2024-03-29T01:38:02.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:36:00+00:00, map_index=-1, run_start_date=2024-03-29 01:38:01.456981+00:00, run_end_date=2024-03-29 01:38:01.967132+00:00, run_duration=0.510151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:38:00.657607+00:00, queued_by_job_id=2, pid=8237 2024-03-29T01:38:02.372987443Z [2024-03-29T01:38:02.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:37:00+00:00, map_index=-1, run_start_date=2024-03-29 01:38:01.561912+00:00, run_end_date=2024-03-29 01:38:02.100966+00:00, run_duration=0.539054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:38:00.657607+00:00, queued_by_job_id=2, pid=8238 2024-03-29T01:38:04.523825214Z [2024-03-29T01:38:04.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:38:04.524370297Z [2024-03-29T01:38:04.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:37:00+00:00, run_id=scheduled__2024-03-29T01:37:00+00:00, run_start_date=2024-03-29 01:38:00.557940+00:00, run_end_date=2024-03-29 01:38:04.523723+00:00, run_duration=3.965783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:37:00+00:00, data_interval_end=2024-03-29 01:38:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:38:04.535293968Z [2024-03-29T01:38:04.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:38:00+00:00, run_after=2024-03-29T01:39:00+00:00 2024-03-29T01:38:04.587908584Z [2024-03-29T01:38:04.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:37:00+00:00 exited with status success for try_number 1 2024-03-29T01:38:04.593984842Z [2024-03-29T01:38:04.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:37:00+00:00, map_index=-1, run_start_date=2024-03-29 01:38:02.992348+00:00, run_end_date=2024-03-29 01:38:04.429870+00:00, run_duration=1.437522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:38:00.657607+00:00, queued_by_job_id=2, pid=8261 2024-03-29T01:38:05.321531787Z [2024-03-29T01:38:05.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:38:05.321780249Z [2024-03-29T01:38:05.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:37:00+00:00, run_id=scheduled__2024-03-29T01:37:00+00:00, run_start_date=2024-03-29 01:38:00.559010+00:00, run_end_date=2024-03-29 01:38:05.321427+00:00, run_duration=4.762417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:37:00+00:00, data_interval_end=2024-03-29 01:38:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:38:05.332046087Z [2024-03-29T01:38:05.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:38:00+00:00, run_after=2024-03-29T01:39:00+00:00 2024-03-29T01:38:05.372201785Z [2024-03-29T01:38:05.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:37:00+00:00 exited with status success for try_number 1 2024-03-29T01:38:05.378927593Z [2024-03-29T01:38:05.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:37:00+00:00, map_index=-1, run_start_date=2024-03-29 01:38:03.035894+00:00, run_end_date=2024-03-29 01:38:04.757764+00:00, run_duration=1.72187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:38:00.657607+00:00, queued_by_job_id=2, pid=8262 2024-03-29T01:38:45.532384605Z [2024-03-29T01:38:45.531+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:39:00.315567351Z [2024-03-29T01:39:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:39:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:39:00.340411986Z [2024-03-29T01:39:00.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:39:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:39:00.354708977Z [2024-03-29T01:39:00.354+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:39:00.451661278Z [2024-03-29T01:39:00.451+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:39:00.451695383Z 2024-03-29T01:39:00.451721571Z 2024-03-29T01:39:00.451727649Z 2024-03-29T01:39:00.451743126Z [2024-03-29T01:39:00.451+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:39:00.451919038Z [2024-03-29T01:39:00.451+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:39:00.452076906Z [2024-03-29T01:39:00.451+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:39:00.452732721Z [2024-03-29T01:39:00.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:39:00.452748581Z 2024-03-29T01:39:00.452753466Z 2024-03-29T01:39:00.452757693Z 2024-03-29T01:39:00.456885873Z [2024-03-29T01:39:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:39:00.456914475Z [2024-03-29T01:39:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:39:00.457130463Z [2024-03-29T01:39:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:39:00.457246102Z [2024-03-29T01:39:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:39:00.457533470Z [2024-03-29T01:39:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:39:00.457600677Z [2024-03-29T01:39:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:39:00.688065553Z [2024-03-29T01:39:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status queued for try_number 1 2024-03-29T01:39:00.688142132Z [2024-03-29T01:39:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status queued for try_number 1 2024-03-29T01:39:00.688278000Z [2024-03-29T01:39:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status queued for try_number 1 2024-03-29T01:39:00.700533280Z [2024-03-29T01:39:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89ea8267-73b7-440f-812c-81da7ad33f2a 2024-03-29T01:39:00.700821159Z [2024-03-29T01:39:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfd70df8-dbef-427f-b985-2295294b54cf 2024-03-29T01:39:00.701240944Z [2024-03-29T01:39:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b3edf30-0d05-4be4-9345-8f9ac619c64e 2024-03-29T01:39:01.923058834Z [2024-03-29T01:39:01.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:39:01.923722533Z [2024-03-29T01:39:01.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:38:00+00:00, run_id=scheduled__2024-03-29T01:38:00+00:00, run_start_date=2024-03-29 01:39:00.371489+00:00, run_end_date=2024-03-29 01:39:01.922935+00:00, run_duration=1.551446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:38:00+00:00, data_interval_end=2024-03-29 01:39:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:39:01.940911732Z [2024-03-29T01:39:01.940+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:39:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:39:02.016770774Z [2024-03-29T01:39:02.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status success for try_number 1 2024-03-29T01:39:02.027960595Z [2024-03-29T01:39:02.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:38:00+00:00, map_index=-1, run_start_date=2024-03-29 01:39:01.315280+00:00, run_end_date=2024-03-29 01:39:01.726102+00:00, run_duration=0.410822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:39:00.453886+00:00, queued_by_job_id=2, pid=8293 2024-03-29T01:39:05.283151399Z [2024-03-29T01:39:05.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:39:05.283429660Z [2024-03-29T01:39:05.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:38:00+00:00, run_id=scheduled__2024-03-29T01:38:00+00:00, run_start_date=2024-03-29 01:39:00.374372+00:00, run_end_date=2024-03-29 01:39:05.282962+00:00, run_duration=4.90859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:38:00+00:00, data_interval_end=2024-03-29 01:39:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:39:05.294857864Z [2024-03-29T01:39:05.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:39:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:39:05.302262434Z [2024-03-29T01:39:05.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:39:05.302581851Z [2024-03-29T01:39:05.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:38:00+00:00, run_id=scheduled__2024-03-29T01:38:00+00:00, run_start_date=2024-03-29 01:39:00.377687+00:00, run_end_date=2024-03-29 01:39:05.302105+00:00, run_duration=4.924418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:38:00+00:00, data_interval_end=2024-03-29 01:39:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:39:05.317740300Z [2024-03-29T01:39:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:39:00+00:00, run_after=2024-03-29T01:40:00+00:00 2024-03-29T01:39:05.357636852Z [2024-03-29T01:39:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status success for try_number 1 2024-03-29T01:39:05.358029161Z [2024-03-29T01:39:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status success for try_number 1 2024-03-29T01:39:05.373448953Z [2024-03-29T01:39:05.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:38:00+00:00, map_index=-1, run_start_date=2024-03-29 01:39:02.607995+00:00, run_end_date=2024-03-29 01:39:04.680128+00:00, run_duration=2.072133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:39:00.453886+00:00, queued_by_job_id=2, pid=8311 2024-03-29T01:39:05.374709577Z [2024-03-29T01:39:05.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:38:00+00:00, map_index=-1, run_start_date=2024-03-29 01:39:02.720114+00:00, run_end_date=2024-03-29 01:39:04.308867+00:00, run_duration=1.588753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:39:00.453886+00:00, queued_by_job_id=2, pid=8312 2024-03-29T01:40:00.705364697Z [2024-03-29T01:40:00.704+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:40:00.720063953Z [2024-03-29T01:40:00.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:41:00+00:00 2024-03-29T01:40:00.736114575Z [2024-03-29T01:40:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:41:00+00:00 2024-03-29T01:40:00.745088956Z [2024-03-29T01:40:00.744+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:40:00.758794254Z [2024-03-29T01:40:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:45:00+00:00 2024-03-29T01:40:00.876392410Z [2024-03-29T01:40:00.875+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:40:00.876424126Z 2024-03-29T01:40:00.876430046Z 2024-03-29T01:40:00.876435572Z 2024-03-29T01:40:00.876440300Z 2024-03-29T01:40:00.876445538Z 2024-03-29T01:40:00.876504842Z [2024-03-29T01:40:00.876+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:40:00.876719737Z [2024-03-29T01:40:00.876+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:40:00.876867775Z [2024-03-29T01:40:00.876+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:40:00.877057332Z [2024-03-29T01:40:00.876+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:40:00.877283170Z [2024-03-29T01:40:00.877+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:40:00.878121199Z [2024-03-29T01:40:00.877+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:40:00.878142168Z 2024-03-29T01:40:00.878148462Z 2024-03-29T01:40:00.878153441Z 2024-03-29T01:40:00.878158061Z 2024-03-29T01:40:00.878162911Z 2024-03-29T01:40:00.890183491Z [2024-03-29T01:40:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:40:00.890242877Z [2024-03-29T01:40:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:40:00.890251250Z [2024-03-29T01:40:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:40:00.890256506Z [2024-03-29T01:40:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:40:00.890261770Z [2024-03-29T01:40:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:40:00.890266443Z [2024-03-29T01:40:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:40:00.890270955Z [2024-03-29T01:40:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:40:00.890275322Z [2024-03-29T01:40:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:40:00.890279813Z [2024-03-29T01:40:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:40:00.890284545Z [2024-03-29T01:40:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:40:01.679664022Z [2024-03-29T01:40:01.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:01.679701194Z [2024-03-29T01:40:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:01.679787268Z [2024-03-29T01:40:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:39:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:01.679856542Z [2024-03-29T01:40:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:39:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:01.680050965Z [2024-03-29T01:40:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:39:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:01.691597245Z [2024-03-29T01:40:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8f4d7fc-dfc4-467d-b2e7-ac2ded4050df 2024-03-29T01:40:01.691655334Z [2024-03-29T01:40:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28d4cb0f-448b-4433-9744-d68b9be6da91 2024-03-29T01:40:01.691714129Z [2024-03-29T01:40:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18fac6fc-b492-40e1-923f-f8e81fe40ace 2024-03-29T01:40:01.691849811Z [2024-03-29T01:40:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf333c9e-19d4-4ba7-8bc3-5d6105098adc 2024-03-29T01:40:01.691973379Z [2024-03-29T01:40:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23eecad8-f16c-4c9f-9611-16f3dc85be0b 2024-03-29T01:40:03.090029991Z [2024-03-29T01:40:03.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:38:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:03.098590094Z [2024-03-29T01:40:03.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:38:00+00:00, map_index=-1, run_start_date=2024-03-29 01:40:02.406385+00:00, run_end_date=2024-03-29 01:40:02.924256+00:00, run_duration=0.517871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:00.879936+00:00, queued_by_job_id=2, pid=8346 2024-03-29T01:40:04.173553389Z [2024-03-29T01:40:04.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:40:04.173948741Z [2024-03-29T01:40:04.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:38:00+00:00, run_id=scheduled__2024-03-29T01:38:00+00:00, run_start_date=2024-03-29 01:40:00.772902+00:00, run_end_date=2024-03-29 01:40:04.173574+00:00, run_duration=3.400672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:38:00+00:00, data_interval_end=2024-03-29 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:40:04.185045538Z [2024-03-29T01:40:04.184+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:42:00+00:00 2024-03-29T01:40:04.194689141Z [2024-03-29T01:40:04.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:40:04.195186048Z [2024-03-29T01:40:04.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:39:00+00:00, run_id=scheduled__2024-03-29T01:39:00+00:00, run_start_date=2024-03-29 01:40:00.774152+00:00, run_end_date=2024-03-29 01:40:04.194798+00:00, run_duration=3.420646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:39:00+00:00, data_interval_end=2024-03-29 01:40:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:40:04.205976141Z [2024-03-29T01:40:04.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:41:00+00:00 2024-03-29T01:40:04.267843963Z [2024-03-29T01:40:04.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:39:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:04.273863465Z [2024-03-29T01:40:04.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:39:00+00:00, map_index=-1, run_start_date=2024-03-29 01:40:02.451801+00:00, run_end_date=2024-03-29 01:40:02.985398+00:00, run_duration=0.533597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:00.879936+00:00, queued_by_job_id=2, pid=8347 2024-03-29T01:40:05.335179580Z [2024-03-29T01:40:05.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:40:05.335828562Z [2024-03-29T01:40:05.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:39:00+00:00, run_id=scheduled__2024-03-29T01:39:00+00:00, run_start_date=2024-03-29 01:40:00.775309+00:00, run_end_date=2024-03-29 01:40:05.335360+00:00, run_duration=4.560051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:39:00+00:00, data_interval_end=2024-03-29 01:40:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:40:05.348867879Z [2024-03-29T01:40:05.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:41:00+00:00 2024-03-29T01:40:05.417969266Z [2024-03-29T01:40:05.417+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:40:05.418003090Z 2024-03-29T01:40:05.418937757Z [2024-03-29T01:40:05.418+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:40:05.422091083Z [2024-03-29T01:40:05.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:40:05.422124424Z 2024-03-29T01:40:05.426709559Z [2024-03-29T01:40:05.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:40:05.427653773Z [2024-03-29T01:40:05.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:40:05.510082517Z [2024-03-29T01:40:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:05.510174482Z [2024-03-29T01:40:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:05.510180275Z [2024-03-29T01:40:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:39:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:05.521490046Z [2024-03-29T01:40:05.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:35:00+00:00, map_index=-1, run_start_date=2024-03-29 01:40:03.670026+00:00, run_end_date=2024-03-29 01:40:04.173549+00:00, run_duration=0.503523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:00.879936+00:00, queued_by_job_id=2, pid=8376 2024-03-29T01:40:05.521631268Z [2024-03-29T01:40:05.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4f2d396-181c-417e-84a4-e9876ada769f 2024-03-29T01:40:05.521734561Z [2024-03-29T01:40:05.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:39:00+00:00, map_index=-1, run_start_date=2024-03-29 01:40:03.876555+00:00, run_end_date=2024-03-29 01:40:05.239259+00:00, run_duration=1.362704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:00.879936+00:00, queued_by_job_id=2, pid=8378 2024-03-29T01:40:05.565665314Z [2024-03-29T01:40:05.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:40:05.565832242Z [2024-03-29T01:40:05.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:39:00+00:00, run_id=scheduled__2024-03-29T01:39:00+00:00, run_start_date=2024-03-29 01:40:00.776416+00:00, run_end_date=2024-03-29 01:40:05.565575+00:00, run_duration=4.789159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:39:00+00:00, data_interval_end=2024-03-29 01:40:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:40:05.575110743Z [2024-03-29T01:40:05.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:41:00+00:00 2024-03-29T01:40:06.195444525Z [2024-03-29T01:40:06.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:39:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:06.204100903Z [2024-03-29T01:40:06.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:39:00+00:00, map_index=-1, run_start_date=2024-03-29 01:40:03.695808+00:00, run_end_date=2024-03-29 01:40:05.527613+00:00, run_duration=1.831805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:00.879936+00:00, queued_by_job_id=2, pid=8377 2024-03-29T01:40:08.632798184Z [2024-03-29T01:40:08.632+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:40:08.632833633Z 2024-03-29T01:40:08.633196855Z [2024-03-29T01:40:08.632+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:40:08.633932948Z [2024-03-29T01:40:08.633+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:40:08.633944106Z 2024-03-29T01:40:08.636938836Z [2024-03-29T01:40:08.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:40:08.637190274Z [2024-03-29T01:40:08.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:40:08.680192510Z [2024-03-29T01:40:08.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:08.680255068Z [2024-03-29T01:40:08.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:08.685401634Z [2024-03-29T01:40:08.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 592bdf9b-e8d6-4445-9e6d-f3b83c85a966 2024-03-29T01:40:08.685451648Z [2024-03-29T01:40:08.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:35:00+00:00, map_index=-1, run_start_date=2024-03-29 01:40:07.812555+00:00, run_end_date=2024-03-29 01:40:08.176327+00:00, run_duration=0.363772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:05.422915+00:00, queued_by_job_id=2, pid=8401 2024-03-29T01:40:10.895266135Z [2024-03-29T01:40:10.894+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:40:10.895313475Z 2024-03-29T01:40:10.895632660Z [2024-03-29T01:40:10.895+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:40:10.896367431Z [2024-03-29T01:40:10.896+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:40:10.896379442Z 2024-03-29T01:40:10.899059151Z [2024-03-29T01:40:10.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:40:10.899336770Z [2024-03-29T01:40:10.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:40:10.942004551Z [2024-03-29T01:40:10.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status queued for try_number 1 2024-03-29T01:40:10.942353196Z [2024-03-29T01:40:10.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:10.948656428Z [2024-03-29T01:40:10.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e231e16-cf8d-441c-b679-e5d2823e170d 2024-03-29T01:40:10.948775681Z [2024-03-29T01:40:10.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:35:00+00:00, map_index=0, run_start_date=2024-03-29 01:40:10.287617+00:00, run_end_date=2024-03-29 01:40:10.558744+00:00, run_duration=0.271127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:08.634528+00:00, queued_by_job_id=2, pid=8409 2024-03-29T01:40:14.075398677Z [2024-03-29T01:40:14.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:40:14.075747480Z [2024-03-29T01:40:14.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:35:00+00:00, run_id=scheduled__2024-03-29T01:35:00+00:00, run_start_date=2024-03-29 01:40:00.771364+00:00, run_end_date=2024-03-29 01:40:14.075286+00:00, run_duration=13.303922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:35:00+00:00, data_interval_end=2024-03-29 01:40:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:40:14.083438384Z [2024-03-29T01:40:14.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:40:00+00:00, run_after=2024-03-29T01:45:00+00:00 2024-03-29T01:40:14.117022719Z [2024-03-29T01:40:14.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:35:00+00:00 exited with status success for try_number 1 2024-03-29T01:40:14.122791998Z [2024-03-29T01:40:14.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:35:00+00:00, map_index=-1, run_start_date=2024-03-29 01:40:12.645097+00:00, run_end_date=2024-03-29 01:40:13.059653+00:00, run_duration=0.414556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:40:10.896919+00:00, queued_by_job_id=2, pid=8417 2024-03-29T01:41:00.754756267Z [2024-03-29T01:41:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:41:00+00:00, run_after=2024-03-29T01:42:00+00:00 2024-03-29T01:41:00.762124264Z [2024-03-29T01:41:00.761+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:41:00.775408126Z [2024-03-29T01:41:00.774+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:41:00+00:00, run_after=2024-03-29T01:42:00+00:00 2024-03-29T01:41:00.890708053Z [2024-03-29T01:41:00.889+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:41:00.890747826Z 2024-03-29T01:41:00.890753462Z 2024-03-29T01:41:00.890759298Z 2024-03-29T01:41:00.891190487Z [2024-03-29T01:41:00.890+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:41:00.891587583Z [2024-03-29T01:41:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:41:00.891833383Z [2024-03-29T01:41:00.891+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:41:00.893558789Z [2024-03-29T01:41:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:41:00.893574307Z 2024-03-29T01:41:00.893580102Z 2024-03-29T01:41:00.893585254Z 2024-03-29T01:41:00.901619266Z [2024-03-29T01:41:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:41:00.901772785Z [2024-03-29T01:41:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:41:00.902120508Z [2024-03-29T01:41:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:41:00.902293143Z [2024-03-29T01:41:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:41:00.902684498Z [2024-03-29T01:41:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:41:00.902918281Z [2024-03-29T01:41:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:41:01.190818795Z [2024-03-29T01:41:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:41:01.191115482Z [2024-03-29T01:41:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:41:01.191388025Z [2024-03-29T01:41:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:41:01.205448372Z [2024-03-29T01:41:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d20b805-1e62-4301-85f4-ba82b314d5ab 2024-03-29T01:41:01.205748629Z [2024-03-29T01:41:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15497523-0d6b-4708-8467-2bf6c307d29f 2024-03-29T01:41:01.206036291Z [2024-03-29T01:41:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a084809-4fdc-47e7-a2c5-25a72cbaef50 2024-03-29T01:41:02.411293477Z [2024-03-29T01:41:02.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:41:02.411535564Z [2024-03-29T01:41:02.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:40:00+00:00, run_id=scheduled__2024-03-29T01:40:00+00:00, run_start_date=2024-03-29 01:41:00.791773+00:00, run_end_date=2024-03-29 01:41:02.411130+00:00, run_duration=1.619357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:40:00+00:00, data_interval_end=2024-03-29 01:41:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:41:02.423637110Z [2024-03-29T01:41:02.423+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:41:00+00:00, run_after=2024-03-29T01:42:00+00:00 2024-03-29T01:41:02.664384036Z [2024-03-29T01:41:02.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:41:02.673868038Z [2024-03-29T01:41:02.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=-1, run_start_date=2024-03-29 01:41:01.889321+00:00, run_end_date=2024-03-29 01:41:02.319848+00:00, run_duration=0.430527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:41:00.895897+00:00, queued_by_job_id=2, pid=8439 2024-03-29T01:41:05.962579586Z [2024-03-29T01:41:05.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:41:05.962605521Z [2024-03-29T01:41:05.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:40:00+00:00, run_id=scheduled__2024-03-29T01:40:00+00:00, run_start_date=2024-03-29 01:41:00.796908+00:00, run_end_date=2024-03-29 01:41:05.962039+00:00, run_duration=5.165131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:40:00+00:00, data_interval_end=2024-03-29 01:41:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:41:05.978237836Z [2024-03-29T01:41:05.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:41:00+00:00, run_after=2024-03-29T01:42:00+00:00 2024-03-29T01:41:05.994484945Z [2024-03-29T01:41:05.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:41:05.994620686Z [2024-03-29T01:41:05.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:40:00+00:00, run_id=scheduled__2024-03-29T01:40:00+00:00, run_start_date=2024-03-29 01:41:00.800056+00:00, run_end_date=2024-03-29 01:41:05.994378+00:00, run_duration=5.194322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:40:00+00:00, data_interval_end=2024-03-29 01:41:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:41:06.011210093Z [2024-03-29T01:41:06.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:41:00+00:00, run_after=2024-03-29T01:42:00+00:00 2024-03-29T01:41:06.063381643Z [2024-03-29T01:41:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:41:06.063412685Z [2024-03-29T01:41:06.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:41:06.068678132Z [2024-03-29T01:41:06.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=-1, run_start_date=2024-03-29 01:41:03.037680+00:00, run_end_date=2024-03-29 01:41:04.995721+00:00, run_duration=1.958041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:41:00.895897+00:00, queued_by_job_id=2, pid=8457 2024-03-29T01:41:06.068787710Z [2024-03-29T01:41:06.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=-1, run_start_date=2024-03-29 01:41:03.087390+00:00, run_end_date=2024-03-29 01:41:05.381947+00:00, run_duration=2.294557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:41:00.895897+00:00, queued_by_job_id=2, pid=8458 2024-03-29T01:42:00.424314774Z [2024-03-29T01:42:00.423+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:42:00.434821963Z [2024-03-29T01:42:00.434+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:42:00.451575291Z [2024-03-29T01:42:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:42:00+00:00, run_after=2024-03-29T01:43:00+00:00 2024-03-29T01:42:00.469560674Z [2024-03-29T01:42:00.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:42:00+00:00, run_after=2024-03-29T01:43:00+00:00 2024-03-29T01:42:00.557971155Z [2024-03-29T01:42:00.557+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:42:00.558118488Z 2024-03-29T01:42:00.558139298Z 2024-03-29T01:42:00.558342205Z 2024-03-29T01:42:00.558354376Z 2024-03-29T01:42:00.558417875Z [2024-03-29T01:42:00.557+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:42:00.558596531Z [2024-03-29T01:42:00.557+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:42:00.558615664Z [2024-03-29T01:42:00.557+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:42:00.558624954Z [2024-03-29T01:42:00.558+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:42:00.559199711Z [2024-03-29T01:42:00.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:42:00.559254102Z 2024-03-29T01:42:00.559265797Z 2024-03-29T01:42:00.559352546Z 2024-03-29T01:42:00.559362800Z 2024-03-29T01:42:00.563372804Z [2024-03-29T01:42:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:42:00.563424691Z [2024-03-29T01:42:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:42:00.563688542Z [2024-03-29T01:42:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:42:00.563832707Z [2024-03-29T01:42:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:42:00.564123618Z [2024-03-29T01:42:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:42:00.564198984Z [2024-03-29T01:42:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:42:00.564460862Z [2024-03-29T01:42:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:42:00.564584462Z [2024-03-29T01:42:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:42:01.134008386Z [2024-03-29T01:42:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:42:01.134268447Z [2024-03-29T01:42:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:41:00+00:00 exited with status queued for try_number 1 2024-03-29T01:42:01.134460604Z [2024-03-29T01:42:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:41:00+00:00 exited with status queued for try_number 1 2024-03-29T01:42:01.134621214Z [2024-03-29T01:42:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:41:00+00:00 exited with status queued for try_number 1 2024-03-29T01:42:01.150751887Z [2024-03-29T01:42:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b482213-7b0f-4def-a229-58b695a7bf80 2024-03-29T01:42:01.150972144Z [2024-03-29T01:42:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2908a15-7692-474d-8c64-c84d70f7071e 2024-03-29T01:42:01.151280802Z [2024-03-29T01:42:01.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ffa0c15-083b-46d7-aa5e-fc04da525b9c 2024-03-29T01:42:01.151494172Z [2024-03-29T01:42:01.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to af6a5f05-a40c-4796-b42d-35f950d1b1e9 2024-03-29T01:42:02.462684205Z [2024-03-29T01:42:02.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:42:02.463472790Z [2024-03-29T01:42:02.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:40:00+00:00, run_id=scheduled__2024-03-29T01:40:00+00:00, run_start_date=2024-03-29 01:42:00.484210+00:00, run_end_date=2024-03-29 01:42:02.462798+00:00, run_duration=1.978588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:40:00+00:00, data_interval_end=2024-03-29 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:42:02.478000881Z [2024-03-29T01:42:02.477+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:42:00+00:00, run_after=2024-03-29T01:44:00+00:00 2024-03-29T01:42:02.516038636Z [2024-03-29T01:42:02.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:42:02.516163475Z [2024-03-29T01:42:02.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:41:00+00:00, run_id=scheduled__2024-03-29T01:41:00+00:00, run_start_date=2024-03-29 01:42:00.485341+00:00, run_end_date=2024-03-29 01:42:02.515894+00:00, run_duration=2.030553, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:41:00+00:00, data_interval_end=2024-03-29 01:42:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:42:02.550601306Z [2024-03-29T01:42:02.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:42:00+00:00, run_after=2024-03-29T01:43:00+00:00 2024-03-29T01:42:02.612315004Z [2024-03-29T01:42:02.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:42:02.612531320Z [2024-03-29T01:42:02.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:41:00+00:00 exited with status success for try_number 1 2024-03-29T01:42:02.623358500Z [2024-03-29T01:42:02.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=-1, run_start_date=2024-03-29 01:42:01.733943+00:00, run_end_date=2024-03-29 01:42:02.180652+00:00, run_duration=0.446709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:42:00.559984+00:00, queued_by_job_id=2, pid=8490 2024-03-29T01:42:02.624005691Z [2024-03-29T01:42:02.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:41:00+00:00, map_index=-1, run_start_date=2024-03-29 01:42:01.772479+00:00, run_end_date=2024-03-29 01:42:02.316281+00:00, run_duration=0.543802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:42:00.559984+00:00, queued_by_job_id=2, pid=8491 2024-03-29T01:42:05.630641566Z [2024-03-29T01:42:05.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:42:05.630890670Z [2024-03-29T01:42:05.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:41:00+00:00, run_id=scheduled__2024-03-29T01:41:00+00:00, run_start_date=2024-03-29 01:42:00.487305+00:00, run_end_date=2024-03-29 01:42:05.630624+00:00, run_duration=5.143319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:41:00+00:00, data_interval_end=2024-03-29 01:42:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:42:05.641706424Z [2024-03-29T01:42:05.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:42:00+00:00, run_after=2024-03-29T01:43:00+00:00 2024-03-29T01:42:05.669765527Z [2024-03-29T01:42:05.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:42:05.670066499Z [2024-03-29T01:42:05.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:41:00+00:00, run_id=scheduled__2024-03-29T01:41:00+00:00, run_start_date=2024-03-29 01:42:00.486288+00:00, run_end_date=2024-03-29 01:42:05.669764+00:00, run_duration=5.183476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:41:00+00:00, data_interval_end=2024-03-29 01:42:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:42:05.681779142Z [2024-03-29T01:42:05.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:42:00+00:00, run_after=2024-03-29T01:43:00+00:00 2024-03-29T01:42:05.714475885Z [2024-03-29T01:42:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:41:00+00:00 exited with status success for try_number 1 2024-03-29T01:42:05.714725215Z [2024-03-29T01:42:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:41:00+00:00 exited with status success for try_number 1 2024-03-29T01:42:05.721378885Z [2024-03-29T01:42:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:41:00+00:00, map_index=-1, run_start_date=2024-03-29 01:42:03.086105+00:00, run_end_date=2024-03-29 01:42:04.691345+00:00, run_duration=1.60524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:42:00.559984+00:00, queued_by_job_id=2, pid=8514 2024-03-29T01:42:05.721883765Z [2024-03-29T01:42:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:41:00+00:00, map_index=-1, run_start_date=2024-03-29 01:42:03.273224+00:00, run_end_date=2024-03-29 01:42:05.392006+00:00, run_duration=2.118782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:42:00.559984+00:00, queued_by_job_id=2, pid=8515 2024-03-29T01:43:00.285596544Z [2024-03-29T01:43:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:43:00.305749018Z [2024-03-29T01:43:00.305+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:43:00+00:00, run_after=2024-03-29T01:44:00+00:00 2024-03-29T01:43:00.318806301Z [2024-03-29T01:43:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:43:00+00:00, run_after=2024-03-29T01:44:00+00:00 2024-03-29T01:43:00.413904165Z [2024-03-29T01:43:00.413+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:43:00.413930190Z 2024-03-29T01:43:00.413933906Z 2024-03-29T01:43:00.413937640Z 2024-03-29T01:43:00.414208080Z [2024-03-29T01:43:00.414+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:43:00.414503647Z [2024-03-29T01:43:00.414+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:43:00.414732759Z [2024-03-29T01:43:00.414+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:43:00.415389181Z [2024-03-29T01:43:00.415+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:43:00.415400612Z 2024-03-29T01:43:00.415404229Z 2024-03-29T01:43:00.415407556Z 2024-03-29T01:43:00.418697831Z [2024-03-29T01:43:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:43:00.418878299Z [2024-03-29T01:43:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:43:00.419189326Z [2024-03-29T01:43:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:43:00.419286686Z [2024-03-29T01:43:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:43:00.419579832Z [2024-03-29T01:43:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:43:00.419803547Z [2024-03-29T01:43:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:43:00.637265717Z [2024-03-29T01:43:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status queued for try_number 1 2024-03-29T01:43:00.637337062Z [2024-03-29T01:43:00.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status queued for try_number 1 2024-03-29T01:43:00.637541090Z [2024-03-29T01:43:00.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status queued for try_number 1 2024-03-29T01:43:00.645677763Z [2024-03-29T01:43:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2b36275-b2f9-4a00-8633-e775496ed666 2024-03-29T01:43:00.646008212Z [2024-03-29T01:43:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 746382a3-d333-4572-a58a-0ee865f46aac 2024-03-29T01:43:00.646210587Z [2024-03-29T01:43:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9bd80bf-cf95-4652-a7b4-2d3d98307f63 2024-03-29T01:43:02.934253054Z [2024-03-29T01:43:02.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:43:02.934633703Z [2024-03-29T01:43:02.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:42:00+00:00, run_id=scheduled__2024-03-29T01:42:00+00:00, run_start_date=2024-03-29 01:43:00.338245+00:00, run_end_date=2024-03-29 01:43:02.934114+00:00, run_duration=2.595869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:42:00+00:00, data_interval_end=2024-03-29 01:43:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:43:02.947112736Z [2024-03-29T01:43:02.946+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:43:00+00:00, run_after=2024-03-29T01:44:00+00:00 2024-03-29T01:43:03.079852848Z [2024-03-29T01:43:03.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status success for try_number 1 2024-03-29T01:43:03.094566241Z [2024-03-29T01:43:03.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:42:00+00:00, map_index=-1, run_start_date=2024-03-29 01:43:01.306040+00:00, run_end_date=2024-03-29 01:43:01.871281+00:00, run_duration=0.565241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:43:00.416227+00:00, queued_by_job_id=2, pid=8547 2024-03-29T01:43:04.153633284Z [2024-03-29T01:43:04.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:43:04.153876413Z [2024-03-29T01:43:04.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:42:00+00:00, run_id=scheduled__2024-03-29T01:42:00+00:00, run_start_date=2024-03-29 01:43:00.341253+00:00, run_end_date=2024-03-29 01:43:04.153539+00:00, run_duration=3.812286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:42:00+00:00, data_interval_end=2024-03-29 01:43:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:43:04.163537572Z [2024-03-29T01:43:04.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:43:00+00:00, run_after=2024-03-29T01:44:00+00:00 2024-03-29T01:43:04.335252403Z [2024-03-29T01:43:04.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status success for try_number 1 2024-03-29T01:43:04.344455938Z [2024-03-29T01:43:04.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:42:00+00:00, map_index=-1, run_start_date=2024-03-29 01:43:02.792338+00:00, run_end_date=2024-03-29 01:43:04.067833+00:00, run_duration=1.275495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:43:00.416227+00:00, queued_by_job_id=2, pid=8566 2024-03-29T01:43:05.412882684Z [2024-03-29T01:43:05.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:43:05.414143930Z [2024-03-29T01:43:05.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:42:00+00:00, run_id=scheduled__2024-03-29T01:42:00+00:00, run_start_date=2024-03-29 01:43:00.343447+00:00, run_end_date=2024-03-29 01:43:05.413615+00:00, run_duration=5.070168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:42:00+00:00, data_interval_end=2024-03-29 01:43:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:43:05.425682127Z [2024-03-29T01:43:05.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:43:00+00:00, run_after=2024-03-29T01:44:00+00:00 2024-03-29T01:43:05.489387439Z [2024-03-29T01:43:05.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status success for try_number 1 2024-03-29T01:43:05.496711874Z [2024-03-29T01:43:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:42:00+00:00, map_index=-1, run_start_date=2024-03-29 01:43:02.760924+00:00, run_end_date=2024-03-29 01:43:04.597204+00:00, run_duration=1.83628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:43:00.416227+00:00, queued_by_job_id=2, pid=8565 2024-03-29T01:43:45.621147073Z [2024-03-29T01:43:45.620+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:44:00.208817814Z [2024-03-29T01:44:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:44:00+00:00, run_after=2024-03-29T01:45:00+00:00 2024-03-29T01:44:00.215774023Z [2024-03-29T01:44:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:44:00.227150695Z [2024-03-29T01:44:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:44:00+00:00, run_after=2024-03-29T01:45:00+00:00 2024-03-29T01:44:00.233368169Z [2024-03-29T01:44:00.233+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:44:00.323174104Z [2024-03-29T01:44:00.322+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:44:00.323202455Z 2024-03-29T01:44:00.323209563Z 2024-03-29T01:44:00.323215477Z 2024-03-29T01:44:00.323220355Z 2024-03-29T01:44:00.323520081Z [2024-03-29T01:44:00.323+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:44:00.323697969Z [2024-03-29T01:44:00.323+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:44:00.323907164Z [2024-03-29T01:44:00.323+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:44:00.324028060Z [2024-03-29T01:44:00.323+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:44:00.324905094Z [2024-03-29T01:44:00.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:44:00.324911207Z 2024-03-29T01:44:00.324914584Z 2024-03-29T01:44:00.324917929Z 2024-03-29T01:44:00.324921330Z 2024-03-29T01:44:00.330074833Z [2024-03-29T01:44:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:44:00.330212978Z [2024-03-29T01:44:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:44:00.330500738Z [2024-03-29T01:44:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:44:00.330600148Z [2024-03-29T01:44:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:44:00.330760585Z [2024-03-29T01:44:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:44:00.330830599Z [2024-03-29T01:44:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:44:00.331179115Z [2024-03-29T01:44:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:44:00.331222546Z [2024-03-29T01:44:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:44:00.882363004Z [2024-03-29T01:44:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status queued for try_number 1 2024-03-29T01:44:00.882627175Z [2024-03-29T01:44:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:43:00+00:00 exited with status queued for try_number 1 2024-03-29T01:44:00.882771632Z [2024-03-29T01:44:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:43:00+00:00 exited with status queued for try_number 1 2024-03-29T01:44:00.882959892Z [2024-03-29T01:44:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:43:00+00:00 exited with status queued for try_number 1 2024-03-29T01:44:00.911767399Z [2024-03-29T01:44:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f6152cb-f279-48f3-9e90-b16fc0b04866 2024-03-29T01:44:00.912002996Z [2024-03-29T01:44:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19b7624a-0258-4e1e-ac6a-8015e1302096 2024-03-29T01:44:00.912319119Z [2024-03-29T01:44:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33349935-9720-47f8-92bd-bc21c16c88b4 2024-03-29T01:44:00.912553940Z [2024-03-29T01:44:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 603d11e7-d780-4194-be4d-604eb47e6531 2024-03-29T01:44:02.281916438Z [2024-03-29T01:44:02.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:44:02.282489141Z [2024-03-29T01:44:02.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:42:00+00:00, run_id=scheduled__2024-03-29T01:42:00+00:00, run_start_date=2024-03-29 01:44:00.242660+00:00, run_end_date=2024-03-29 01:44:02.281929+00:00, run_duration=2.039269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:42:00+00:00, data_interval_end=2024-03-29 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:44:02.296980281Z [2024-03-29T01:44:02.296+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:44:00+00:00, run_after=2024-03-29T01:46:00+00:00 2024-03-29T01:44:02.307433331Z [2024-03-29T01:44:02.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:44:02.307895070Z [2024-03-29T01:44:02.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:43:00+00:00, run_id=scheduled__2024-03-29T01:43:00+00:00, run_start_date=2024-03-29 01:44:00.243836+00:00, run_end_date=2024-03-29 01:44:02.307402+00:00, run_duration=2.063566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:43:00+00:00, data_interval_end=2024-03-29 01:44:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:44:02.328036296Z [2024-03-29T01:44:02.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:44:00+00:00, run_after=2024-03-29T01:45:00+00:00 2024-03-29T01:44:02.419685212Z [2024-03-29T01:44:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:42:00+00:00 exited with status success for try_number 1 2024-03-29T01:44:02.420535985Z [2024-03-29T01:44:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:43:00+00:00 exited with status success for try_number 1 2024-03-29T01:44:02.429653918Z [2024-03-29T01:44:02.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:42:00+00:00, map_index=-1, run_start_date=2024-03-29 01:44:01.364507+00:00, run_end_date=2024-03-29 01:44:01.785547+00:00, run_duration=0.42104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:44:00.326391+00:00, queued_by_job_id=2, pid=8599 2024-03-29T01:44:02.430313219Z [2024-03-29T01:44:02.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:43:00+00:00, map_index=-1, run_start_date=2024-03-29 01:44:01.667620+00:00, run_end_date=2024-03-29 01:44:02.127288+00:00, run_duration=0.459668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:44:00.326391+00:00, queued_by_job_id=2, pid=8601 2024-03-29T01:44:04.598563536Z [2024-03-29T01:44:04.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:44:04.599104429Z [2024-03-29T01:44:04.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:43:00+00:00, run_id=scheduled__2024-03-29T01:43:00+00:00, run_start_date=2024-03-29 01:44:00.244836+00:00, run_end_date=2024-03-29 01:44:04.598372+00:00, run_duration=4.353536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:43:00+00:00, data_interval_end=2024-03-29 01:44:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:44:04.609452542Z [2024-03-29T01:44:04.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:44:00+00:00, run_after=2024-03-29T01:45:00+00:00 2024-03-29T01:44:04.618376103Z [2024-03-29T01:44:04.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:44:04.618918218Z [2024-03-29T01:44:04.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:43:00+00:00, run_id=scheduled__2024-03-29T01:43:00+00:00, run_start_date=2024-03-29 01:44:00.245770+00:00, run_end_date=2024-03-29 01:44:04.618287+00:00, run_duration=4.372517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:43:00+00:00, data_interval_end=2024-03-29 01:44:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:44:04.629018172Z [2024-03-29T01:44:04.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:44:00+00:00, run_after=2024-03-29T01:45:00+00:00 2024-03-29T01:44:04.664368077Z [2024-03-29T01:44:04.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:43:00+00:00 exited with status success for try_number 1 2024-03-29T01:44:04.664603474Z [2024-03-29T01:44:04.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:43:00+00:00 exited with status success for try_number 1 2024-03-29T01:44:04.671924921Z [2024-03-29T01:44:04.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:43:00+00:00, map_index=-1, run_start_date=2024-03-29 01:44:02.535394+00:00, run_end_date=2024-03-29 01:44:04.443381+00:00, run_duration=1.907987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:44:00.326391+00:00, queued_by_job_id=2, pid=8623 2024-03-29T01:44:04.672319581Z [2024-03-29T01:44:04.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:43:00+00:00, map_index=-1, run_start_date=2024-03-29 01:44:02.767161+00:00, run_end_date=2024-03-29 01:44:04.417880+00:00, run_duration=1.650719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:44:00.326391+00:00, queued_by_job_id=2, pid=8624 2024-03-29T01:45:00.245565326Z [2024-03-29T01:45:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:45:00+00:00, run_after=2024-03-29T01:46:00+00:00 2024-03-29T01:45:00.267379495Z [2024-03-29T01:45:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:45:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:45:00.290220190Z [2024-03-29T01:45:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:45:00+00:00, run_after=2024-03-29T01:46:00+00:00 2024-03-29T01:45:00.302984602Z [2024-03-29T01:45:00.302+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:45:00.398937166Z [2024-03-29T01:45:00.398+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:45:00.399079775Z 2024-03-29T01:45:00.399091480Z 2024-03-29T01:45:00.399096608Z 2024-03-29T01:45:00.399101636Z 2024-03-29T01:45:00.399106200Z [2024-03-29T01:45:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:45:00.399243140Z [2024-03-29T01:45:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:45:00.399471626Z [2024-03-29T01:45:00.399+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:45:00.399695791Z [2024-03-29T01:45:00.399+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:45:00.400549236Z [2024-03-29T01:45:00.400+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:45:00.400561598Z 2024-03-29T01:45:00.400565725Z 2024-03-29T01:45:00.400568990Z 2024-03-29T01:45:00.400572092Z 2024-03-29T01:45:00.405676009Z [2024-03-29T01:45:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:45:00.405902872Z [2024-03-29T01:45:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:45:00.406301153Z [2024-03-29T01:45:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:45:00.406526142Z [2024-03-29T01:45:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:45:00.407040231Z [2024-03-29T01:45:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:45:00.407277987Z [2024-03-29T01:45:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:45:00.407659364Z [2024-03-29T01:45:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:45:00.407873617Z [2024-03-29T01:45:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:45:00.774231581Z [2024-03-29T01:45:00.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:45:00.774262729Z [2024-03-29T01:45:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status queued for try_number 1 2024-03-29T01:45:00.774275853Z [2024-03-29T01:45:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status queued for try_number 1 2024-03-29T01:45:00.774283018Z [2024-03-29T01:45:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status queued for try_number 1 2024-03-29T01:45:00.789459825Z [2024-03-29T01:45:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa455820-2cf6-474a-b70c-68f5a18060f2 2024-03-29T01:45:00.789564163Z [2024-03-29T01:45:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38eba609-6501-43b4-b9c1-8e49b704fa52 2024-03-29T01:45:00.789795691Z [2024-03-29T01:45:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a03f1c7-0cac-48fc-adec-4c279591e368 2024-03-29T01:45:00.789994769Z [2024-03-29T01:45:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d440332-4a0d-4f68-a47f-61ccd5f4c60d 2024-03-29T01:45:03.175099394Z [2024-03-29T01:45:03.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:45:03.175760235Z [2024-03-29T01:45:03.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:44:00+00:00, run_id=scheduled__2024-03-29T01:44:00+00:00, run_start_date=2024-03-29 01:45:00.318848+00:00, run_end_date=2024-03-29 01:45:03.175167+00:00, run_duration=2.856319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:44:00+00:00, data_interval_end=2024-03-29 01:45:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:45:03.203972350Z [2024-03-29T01:45:03.203+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:45:00+00:00, run_after=2024-03-29T01:46:00+00:00 2024-03-29T01:45:03.350806666Z [2024-03-29T01:45:03.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status success for try_number 1 2024-03-29T01:45:03.361251419Z [2024-03-29T01:45:03.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:44:00+00:00, map_index=-1, run_start_date=2024-03-29 01:45:01.550911+00:00, run_end_date=2024-03-29 01:45:01.982290+00:00, run_duration=0.431379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:45:00.401928+00:00, queued_by_job_id=2, pid=8657 2024-03-29T01:45:04.454360319Z [2024-03-29T01:45:04.453+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:45:04.454389517Z 2024-03-29T01:45:04.455844405Z [2024-03-29T01:45:04.455+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:45:04.456675411Z [2024-03-29T01:45:04.456+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:45:04.456688745Z 2024-03-29T01:45:04.467084034Z [2024-03-29T01:45:04.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:45:04.467395968Z [2024-03-29T01:45:04.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:45:04.521924701Z [2024-03-29T01:45:04.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:45:04.522033707Z [2024-03-29T01:45:04.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:45:04.527110707Z [2024-03-29T01:45:04.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73e248b3-a9b8-4375-8bc7-c2fb9f82486d 2024-03-29T01:45:04.527608805Z [2024-03-29T01:45:04.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=-1, run_start_date=2024-03-29 01:45:02.913170+00:00, run_end_date=2024-03-29 01:45:03.402701+00:00, run_duration=0.489531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:45:00.401928+00:00, queued_by_job_id=2, pid=8683 2024-03-29T01:45:04.592797718Z [2024-03-29T01:45:04.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:45:04.593426907Z [2024-03-29T01:45:04.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:44:00+00:00, run_id=scheduled__2024-03-29T01:44:00+00:00, run_start_date=2024-03-29 01:45:00.322158+00:00, run_end_date=2024-03-29 01:45:04.592959+00:00, run_duration=4.270801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:44:00+00:00, data_interval_end=2024-03-29 01:45:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:45:04.604789285Z [2024-03-29T01:45:04.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:45:00+00:00, run_after=2024-03-29T01:46:00+00:00 2024-03-29T01:45:04.693810796Z [2024-03-29T01:45:04.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status success for try_number 1 2024-03-29T01:45:04.705606202Z [2024-03-29T01:45:04.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:44:00+00:00, map_index=-1, run_start_date=2024-03-29 01:45:02.748213+00:00, run_end_date=2024-03-29 01:45:04.472778+00:00, run_duration=1.724565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:45:00.401928+00:00, queued_by_job_id=2, pid=8681 2024-03-29T01:45:05.764332582Z [2024-03-29T01:45:05.763+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:45:05.764518994Z [2024-03-29T01:45:05.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:44:00+00:00, run_id=scheduled__2024-03-29T01:44:00+00:00, run_start_date=2024-03-29 01:45:00.320512+00:00, run_end_date=2024-03-29 01:45:05.764269+00:00, run_duration=5.443757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:44:00+00:00, data_interval_end=2024-03-29 01:45:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:45:05.775567210Z [2024-03-29T01:45:05.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:45:00+00:00, run_after=2024-03-29T01:46:00+00:00 2024-03-29T01:45:05.873480624Z [2024-03-29T01:45:05.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status success for try_number 1 2024-03-29T01:45:05.880486303Z [2024-03-29T01:45:05.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:44:00+00:00, map_index=-1, run_start_date=2024-03-29 01:45:02.836985+00:00, run_end_date=2024-03-29 01:45:05.078356+00:00, run_duration=2.241371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:45:00.401928+00:00, queued_by_job_id=2, pid=8682 2024-03-29T01:45:08.218803857Z [2024-03-29T01:45:08.215+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:45:08.218831185Z 2024-03-29T01:45:08.219074220Z [2024-03-29T01:45:08.218+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:45:08.219917804Z [2024-03-29T01:45:08.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:45:08.219929450Z 2024-03-29T01:45:08.222583442Z [2024-03-29T01:45:08.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:45:08.222670895Z [2024-03-29T01:45:08.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:45:08.391086847Z [2024-03-29T01:45:08.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:45:08.393215440Z [2024-03-29T01:45:08.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:45:08.423190200Z [2024-03-29T01:45:08.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 534ef00f-ca51-4fbc-a686-4d060fb9c4b4 2024-03-29T01:45:08.457062297Z [2024-03-29T01:45:08.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=-1, run_start_date=2024-03-29 01:45:06.746928+00:00, run_end_date=2024-03-29 01:45:07.272486+00:00, run_duration=0.525558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:45:04.457207+00:00, queued_by_job_id=2, pid=8706 2024-03-29T01:45:11.228583294Z [2024-03-29T01:45:11.228+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:45:11.228614925Z 2024-03-29T01:45:11.228900510Z [2024-03-29T01:45:11.228+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:45:11.229645810Z [2024-03-29T01:45:11.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:45:11.229658109Z 2024-03-29T01:45:11.233336854Z [2024-03-29T01:45:11.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:45:11.233596235Z [2024-03-29T01:45:11.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:45:11.299330583Z [2024-03-29T01:45:11.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status queued for try_number 1 2024-03-29T01:45:11.299442652Z [2024-03-29T01:45:11.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:45:11.306192241Z [2024-03-29T01:45:11.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28d18536-d5c7-4eb0-af61-451b26bb68ed 2024-03-29T01:45:11.306419704Z [2024-03-29T01:45:11.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=0, run_start_date=2024-03-29 01:45:10.198016+00:00, run_end_date=2024-03-29 01:45:10.519982+00:00, run_duration=0.321966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:45:08.220292+00:00, queued_by_job_id=2, pid=8714 2024-03-29T01:45:13.508883234Z [2024-03-29T01:45:13.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:45:13.509293245Z [2024-03-29T01:45:13.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:40:00+00:00, run_id=scheduled__2024-03-29T01:40:00+00:00, run_start_date=2024-03-29 01:45:00.317077+00:00, run_end_date=2024-03-29 01:45:13.508733+00:00, run_duration=13.191656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:40:00+00:00, data_interval_end=2024-03-29 01:45:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:45:13.516703489Z [2024-03-29T01:45:13.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:45:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:45:13.549909304Z [2024-03-29T01:45:13.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:40:00+00:00 exited with status success for try_number 1 2024-03-29T01:45:13.556045290Z [2024-03-29T01:45:13.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:40:00+00:00, map_index=-1, run_start_date=2024-03-29 01:45:12.867790+00:00, run_end_date=2024-03-29 01:45:13.226796+00:00, run_duration=0.359006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:45:11.230121+00:00, queued_by_job_id=2, pid=8722 2024-03-29T01:46:00.889370124Z [2024-03-29T01:46:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:46:00+00:00, run_after=2024-03-29T01:47:00+00:00 2024-03-29T01:46:00.906868859Z [2024-03-29T01:46:00.906+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:46:00.922744668Z [2024-03-29T01:46:00.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:46:00+00:00, run_after=2024-03-29T01:47:00+00:00 2024-03-29T01:46:00.931836622Z [2024-03-29T01:46:00.931+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:46:01.047572001Z [2024-03-29T01:46:01.046+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:46:01.047625798Z 2024-03-29T01:46:01.047632709Z 2024-03-29T01:46:01.047638305Z 2024-03-29T01:46:01.047644011Z 2024-03-29T01:46:01.048022973Z [2024-03-29T01:46:01.047+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:46:01.048321962Z [2024-03-29T01:46:01.048+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:46:01.048665916Z [2024-03-29T01:46:01.048+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:46:01.049096528Z [2024-03-29T01:46:01.048+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:46:01.050251924Z [2024-03-29T01:46:01.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:46:01.050269978Z 2024-03-29T01:46:01.050276997Z 2024-03-29T01:46:01.050282641Z 2024-03-29T01:46:01.050288135Z 2024-03-29T01:46:01.057373681Z [2024-03-29T01:46:01.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:46:01.057823335Z [2024-03-29T01:46:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:46:01.058467618Z [2024-03-29T01:46:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:46:01.058865115Z [2024-03-29T01:46:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:46:01.059544188Z [2024-03-29T01:46:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:46:01.059925590Z [2024-03-29T01:46:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:46:01.060428693Z [2024-03-29T01:46:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:46:01.060743246Z [2024-03-29T01:46:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:46:01.641956504Z [2024-03-29T01:46:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status queued for try_number 1 2024-03-29T01:46:01.642053372Z [2024-03-29T01:46:01.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status queued for try_number 1 2024-03-29T01:46:01.642125572Z [2024-03-29T01:46:01.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status queued for try_number 1 2024-03-29T01:46:01.642194740Z [2024-03-29T01:46:01.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status queued for try_number 1 2024-03-29T01:46:01.656662325Z [2024-03-29T01:46:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 873ca023-dd50-42f6-9c26-f99284692241 2024-03-29T01:46:01.656848594Z [2024-03-29T01:46:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea5a900-80ae-435e-b6ab-7a97521207c3 2024-03-29T01:46:01.657067643Z [2024-03-29T01:46:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ced733a-4f8b-46e8-b2de-756b7f11fd07 2024-03-29T01:46:01.657244596Z [2024-03-29T01:46:01.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to e00c4cc8-6f76-408d-baba-e9e9fe08c01f 2024-03-29T01:46:02.908450209Z [2024-03-29T01:46:02.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:46:02.909633512Z [2024-03-29T01:46:02.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:44:00+00:00, run_id=scheduled__2024-03-29T01:44:00+00:00, run_start_date=2024-03-29 01:46:00.947731+00:00, run_end_date=2024-03-29 01:46:02.908366+00:00, run_duration=1.960635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:44:00+00:00, data_interval_end=2024-03-29 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:46:02.924083609Z [2024-03-29T01:46:02.922+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:46:00+00:00, run_after=2024-03-29T01:48:00+00:00 2024-03-29T01:46:02.934069756Z [2024-03-29T01:46:02.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:46:02.934347832Z [2024-03-29T01:46:02.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:45:00+00:00, run_id=scheduled__2024-03-29T01:45:00+00:00, run_start_date=2024-03-29 01:46:00.951047+00:00, run_end_date=2024-03-29 01:46:02.933983+00:00, run_duration=1.982936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:45:00+00:00, data_interval_end=2024-03-29 01:46:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:46:02.951258686Z [2024-03-29T01:46:02.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:46:00+00:00, run_after=2024-03-29T01:47:00+00:00 2024-03-29T01:46:03.056332100Z [2024-03-29T01:46:03.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status success for try_number 1 2024-03-29T01:46:03.068986502Z [2024-03-29T01:46:03.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:45:00+00:00, map_index=-1, run_start_date=2024-03-29 01:46:02.268799+00:00, run_end_date=2024-03-29 01:46:02.783489+00:00, run_duration=0.51469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:46:01.052246+00:00, queued_by_job_id=2, pid=8746 2024-03-29T01:46:04.179964112Z [2024-03-29T01:46:04.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:44:00+00:00 exited with status success for try_number 1 2024-03-29T01:46:04.187279990Z [2024-03-29T01:46:04.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:44:00+00:00, map_index=-1, run_start_date=2024-03-29 01:46:02.422088+00:00, run_end_date=2024-03-29 01:46:02.884883+00:00, run_duration=0.462795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:46:01.052246+00:00, queued_by_job_id=2, pid=8747 2024-03-29T01:46:06.300354221Z [2024-03-29T01:46:06.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:46:06.300688656Z [2024-03-29T01:46:06.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:45:00+00:00, run_id=scheduled__2024-03-29T01:45:00+00:00, run_start_date=2024-03-29 01:46:00.952780+00:00, run_end_date=2024-03-29 01:46:06.300194+00:00, run_duration=5.347414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:45:00+00:00, data_interval_end=2024-03-29 01:46:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:46:06.310782448Z [2024-03-29T01:46:06.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:46:00+00:00, run_after=2024-03-29T01:47:00+00:00 2024-03-29T01:46:06.318041573Z [2024-03-29T01:46:06.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:46:06.318213786Z [2024-03-29T01:46:06.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:45:00+00:00, run_id=scheduled__2024-03-29T01:45:00+00:00, run_start_date=2024-03-29 01:46:00.954343+00:00, run_end_date=2024-03-29 01:46:06.317894+00:00, run_duration=5.363551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:45:00+00:00, data_interval_end=2024-03-29 01:46:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:46:06.332522989Z [2024-03-29T01:46:06.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:46:00+00:00, run_after=2024-03-29T01:47:00+00:00 2024-03-29T01:46:06.366027831Z [2024-03-29T01:46:06.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status success for try_number 1 2024-03-29T01:46:06.367205961Z [2024-03-29T01:46:06.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status success for try_number 1 2024-03-29T01:46:06.372759449Z [2024-03-29T01:46:06.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:45:00+00:00, map_index=-1, run_start_date=2024-03-29 01:46:03.750079+00:00, run_end_date=2024-03-29 01:46:05.321871+00:00, run_duration=1.571792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:46:01.052246+00:00, queued_by_job_id=2, pid=8770 2024-03-29T01:46:06.373033292Z [2024-03-29T01:46:06.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:45:00+00:00, map_index=-1, run_start_date=2024-03-29 01:46:03.903518+00:00, run_end_date=2024-03-29 01:46:05.321420+00:00, run_duration=1.417902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:46:01.052246+00:00, queued_by_job_id=2, pid=8771 2024-03-29T01:47:00.144629927Z [2024-03-29T01:47:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:47:00+00:00, run_after=2024-03-29T01:48:00+00:00 2024-03-29T01:47:00.157080167Z [2024-03-29T01:47:00.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:47:00+00:00, run_after=2024-03-29T01:48:00+00:00 2024-03-29T01:47:00.163338602Z [2024-03-29T01:47:00.163+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:47:00.231178413Z [2024-03-29T01:47:00.230+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:47:00.231205453Z 2024-03-29T01:47:00.231209495Z 2024-03-29T01:47:00.231212669Z 2024-03-29T01:47:00.231373633Z [2024-03-29T01:47:00.231+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:47:00.231591500Z [2024-03-29T01:47:00.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:47:00.231944556Z [2024-03-29T01:47:00.231+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:47:00.233245505Z [2024-03-29T01:47:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:47:00.233254935Z 2024-03-29T01:47:00.233258243Z 2024-03-29T01:47:00.233261437Z 2024-03-29T01:47:00.240009208Z [2024-03-29T01:47:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:47:00.240277566Z [2024-03-29T01:47:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:47:00.240790311Z [2024-03-29T01:47:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:47:00.241089159Z [2024-03-29T01:47:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:47:00.241590756Z [2024-03-29T01:47:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:47:00.241951222Z [2024-03-29T01:47:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:47:00.469144228Z [2024-03-29T01:47:00.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status queued for try_number 1 2024-03-29T01:47:00.469431739Z [2024-03-29T01:47:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status queued for try_number 1 2024-03-29T01:47:00.469665791Z [2024-03-29T01:47:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status queued for try_number 1 2024-03-29T01:47:00.479864180Z [2024-03-29T01:47:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd5c0511-ab96-48e5-bd4f-be9e1ef4ff15 2024-03-29T01:47:00.480092440Z [2024-03-29T01:47:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 400abe3d-9bb4-498f-a4cc-b9821cf9bb76 2024-03-29T01:47:00.480305189Z [2024-03-29T01:47:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to cddc87e1-15e4-4ea3-a7ac-47367a4e74bc 2024-03-29T01:47:02.964838587Z [2024-03-29T01:47:02.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:47:02.965909767Z [2024-03-29T01:47:02.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:46:00+00:00, run_id=scheduled__2024-03-29T01:46:00+00:00, run_start_date=2024-03-29 01:47:00.173541+00:00, run_end_date=2024-03-29 01:47:02.965306+00:00, run_duration=2.791765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:46:00+00:00, data_interval_end=2024-03-29 01:47:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:47:03.001171756Z [2024-03-29T01:47:03.000+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:47:00+00:00, run_after=2024-03-29T01:48:00+00:00 2024-03-29T01:47:03.125330664Z [2024-03-29T01:47:03.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status success for try_number 1 2024-03-29T01:47:03.137415277Z [2024-03-29T01:47:03.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:46:00+00:00, map_index=-1, run_start_date=2024-03-29 01:47:01.554233+00:00, run_end_date=2024-03-29 01:47:02.189167+00:00, run_duration=0.634934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:47:00.235145+00:00, queued_by_job_id=2, pid=8803 2024-03-29T01:47:04.975304389Z [2024-03-29T01:47:04.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:47:04.975328422Z [2024-03-29T01:47:04.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:46:00+00:00, run_id=scheduled__2024-03-29T01:46:00+00:00, run_start_date=2024-03-29 01:47:00.174708+00:00, run_end_date=2024-03-29 01:47:04.973049+00:00, run_duration=4.798341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:46:00+00:00, data_interval_end=2024-03-29 01:47:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:47:04.984217449Z [2024-03-29T01:47:04.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:47:00+00:00, run_after=2024-03-29T01:48:00+00:00 2024-03-29T01:47:05.002639218Z [2024-03-29T01:47:04.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:47:05.002681270Z [2024-03-29T01:47:04.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:46:00+00:00, run_id=scheduled__2024-03-29T01:46:00+00:00, run_start_date=2024-03-29 01:47:00.175802+00:00, run_end_date=2024-03-29 01:47:04.992599+00:00, run_duration=4.816797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:46:00+00:00, data_interval_end=2024-03-29 01:47:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:47:05.013489358Z [2024-03-29T01:47:05.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:47:00+00:00, run_after=2024-03-29T01:48:00+00:00 2024-03-29T01:47:05.089126199Z [2024-03-29T01:47:05.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status success for try_number 1 2024-03-29T01:47:05.104463747Z [2024-03-29T01:47:05.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:46:00+00:00, map_index=-1, run_start_date=2024-03-29 01:47:02.543362+00:00, run_end_date=2024-03-29 01:47:03.860413+00:00, run_duration=1.317051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:47:00.235145+00:00, queued_by_job_id=2, pid=8816 2024-03-29T01:47:06.194056243Z [2024-03-29T01:47:06.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status success for try_number 1 2024-03-29T01:47:06.199626050Z [2024-03-29T01:47:06.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:46:00+00:00, map_index=-1, run_start_date=2024-03-29 01:47:02.991964+00:00, run_end_date=2024-03-29 01:47:04.904808+00:00, run_duration=1.912844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:47:00.235145+00:00, queued_by_job_id=2, pid=8827 2024-03-29T01:48:00.798631216Z [2024-03-29T01:48:00.798+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:48:00+00:00, run_after=2024-03-29T01:49:00+00:00 2024-03-29T01:48:00.818306303Z [2024-03-29T01:48:00.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:48:00+00:00, run_after=2024-03-29T01:49:00+00:00 2024-03-29T01:48:00.826960129Z [2024-03-29T01:48:00.826+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:48:00.834239590Z [2024-03-29T01:48:00.833+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:48:00.927732147Z [2024-03-29T01:48:00.927+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:48:00.927772660Z 2024-03-29T01:48:00.927779242Z 2024-03-29T01:48:00.927784804Z 2024-03-29T01:48:00.927789843Z 2024-03-29T01:48:00.927795136Z [2024-03-29T01:48:00.927+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:48:00.927808396Z [2024-03-29T01:48:00.927+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:48:00.928119028Z [2024-03-29T01:48:00.927+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:48:00.928206451Z [2024-03-29T01:48:00.927+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:48:00.928774445Z [2024-03-29T01:48:00.928+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:48:00.928787951Z 2024-03-29T01:48:00.928793860Z 2024-03-29T01:48:00.928798426Z 2024-03-29T01:48:00.928802981Z 2024-03-29T01:48:00.933342331Z [2024-03-29T01:48:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:48:00.933472763Z [2024-03-29T01:48:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:48:00.933766355Z [2024-03-29T01:48:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:48:00.933921205Z [2024-03-29T01:48:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:48:00.934188092Z [2024-03-29T01:48:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:48:00.934316299Z [2024-03-29T01:48:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:48:00.934699639Z [2024-03-29T01:48:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:48:00.934773826Z [2024-03-29T01:48:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:48:01.375856040Z [2024-03-29T01:48:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status queued for try_number 1 2024-03-29T01:48:01.376265421Z [2024-03-29T01:48:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:47:00+00:00 exited with status queued for try_number 1 2024-03-29T01:48:01.377268727Z [2024-03-29T01:48:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:47:00+00:00 exited with status queued for try_number 1 2024-03-29T01:48:01.377418520Z [2024-03-29T01:48:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:47:00+00:00 exited with status queued for try_number 1 2024-03-29T01:48:01.387342297Z [2024-03-29T01:48:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17943697-8f99-40e6-b807-bc06cc3b491b 2024-03-29T01:48:01.387607434Z [2024-03-29T01:48:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6450fec-928d-4776-af34-2fd77c1a194c 2024-03-29T01:48:01.387773912Z [2024-03-29T01:48:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe8f666c-9953-4a6e-b02b-53527a3b00cd 2024-03-29T01:48:01.387920872Z [2024-03-29T01:48:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56cfa074-d7d7-464e-8ac1-f9de2de00655 2024-03-29T01:48:03.880535230Z [2024-03-29T01:48:03.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:48:03.884169852Z [2024-03-29T01:48:03.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:46:00+00:00, run_id=scheduled__2024-03-29T01:46:00+00:00, run_start_date=2024-03-29 01:48:00.853743+00:00, run_end_date=2024-03-29 01:48:03.880466+00:00, run_duration=3.026723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:46:00+00:00, data_interval_end=2024-03-29 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:48:03.898458352Z [2024-03-29T01:48:03.898+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:48:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:48:03.917698624Z [2024-03-29T01:48:03.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:48:03.918182312Z [2024-03-29T01:48:03.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:47:00+00:00, run_id=scheduled__2024-03-29T01:47:00+00:00, run_start_date=2024-03-29 01:48:00.855847+00:00, run_end_date=2024-03-29 01:48:03.917610+00:00, run_duration=3.061763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:47:00+00:00, data_interval_end=2024-03-29 01:48:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:48:03.936426108Z [2024-03-29T01:48:03.935+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:48:00+00:00, run_after=2024-03-29T01:49:00+00:00 2024-03-29T01:48:04.013395625Z [2024-03-29T01:48:04.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:46:00+00:00 exited with status success for try_number 1 2024-03-29T01:48:04.014244972Z [2024-03-29T01:48:04.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:47:00+00:00 exited with status success for try_number 1 2024-03-29T01:48:04.026027706Z [2024-03-29T01:48:04.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:46:00+00:00, map_index=-1, run_start_date=2024-03-29 01:48:02.023377+00:00, run_end_date=2024-03-29 01:48:02.849904+00:00, run_duration=0.826527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:48:00.929645+00:00, queued_by_job_id=2, pid=8855 2024-03-29T01:48:04.027024967Z [2024-03-29T01:48:04.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:47:00+00:00, map_index=-1, run_start_date=2024-03-29 01:48:02.044260+00:00, run_end_date=2024-03-29 01:48:02.904252+00:00, run_duration=0.859992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:48:00.929645+00:00, queued_by_job_id=2, pid=8857 2024-03-29T01:48:06.004598177Z [2024-03-29T01:48:06.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:48:06.004632843Z [2024-03-29T01:48:06.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:47:00+00:00, run_id=scheduled__2024-03-29T01:47:00+00:00, run_start_date=2024-03-29 01:48:00.857738+00:00, run_end_date=2024-03-29 01:48:06.004011+00:00, run_duration=5.146273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:47:00+00:00, data_interval_end=2024-03-29 01:48:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:48:06.021416496Z [2024-03-29T01:48:06.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:48:00+00:00, run_after=2024-03-29T01:49:00+00:00 2024-03-29T01:48:06.034623737Z [2024-03-29T01:48:06.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:48:06.034651375Z [2024-03-29T01:48:06.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:47:00+00:00, run_id=scheduled__2024-03-29T01:47:00+00:00, run_start_date=2024-03-29 01:48:00.859250+00:00, run_end_date=2024-03-29 01:48:06.033937+00:00, run_duration=5.174687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:47:00+00:00, data_interval_end=2024-03-29 01:48:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:48:06.051244995Z [2024-03-29T01:48:06.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:48:00+00:00, run_after=2024-03-29T01:49:00+00:00 2024-03-29T01:48:06.117573837Z [2024-03-29T01:48:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:47:00+00:00 exited with status success for try_number 1 2024-03-29T01:48:06.117787317Z [2024-03-29T01:48:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:47:00+00:00 exited with status success for try_number 1 2024-03-29T01:48:06.129320471Z [2024-03-29T01:48:06.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:47:00+00:00, map_index=-1, run_start_date=2024-03-29 01:48:03.726581+00:00, run_end_date=2024-03-29 01:48:04.922039+00:00, run_duration=1.195458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:48:00.929645+00:00, queued_by_job_id=2, pid=8880 2024-03-29T01:48:06.129792853Z [2024-03-29T01:48:06.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:47:00+00:00, map_index=-1, run_start_date=2024-03-29 01:48:03.561849+00:00, run_end_date=2024-03-29 01:48:05.280497+00:00, run_duration=1.718648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:48:00.929645+00:00, queued_by_job_id=2, pid=8879 2024-03-29T01:48:45.688119783Z [2024-03-29T01:48:45.687+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:49:00.548290354Z [2024-03-29T01:49:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:49:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:49:00.568906618Z [2024-03-29T01:49:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:49:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:49:00.582060517Z [2024-03-29T01:49:00.581+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:49:00.670143172Z [2024-03-29T01:49:00.669+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:49:00.670168656Z 2024-03-29T01:49:00.670173304Z 2024-03-29T01:49:00.670176866Z 2024-03-29T01:49:00.670222521Z [2024-03-29T01:49:00.670+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:49:00.670340044Z [2024-03-29T01:49:00.670+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:49:00.670467412Z [2024-03-29T01:49:00.670+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:49:00.671470022Z [2024-03-29T01:49:00.671+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:49:00.671491687Z 2024-03-29T01:49:00.671497003Z 2024-03-29T01:49:00.671502388Z 2024-03-29T01:49:00.676581234Z [2024-03-29T01:49:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:49:00.676767340Z [2024-03-29T01:49:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:49:00.677159503Z [2024-03-29T01:49:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:49:00.677623279Z [2024-03-29T01:49:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:49:00.677649493Z [2024-03-29T01:49:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:49:00.677795283Z [2024-03-29T01:49:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:49:00.992726585Z [2024-03-29T01:49:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status queued for try_number 1 2024-03-29T01:49:00.992879412Z [2024-03-29T01:49:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status queued for try_number 1 2024-03-29T01:49:00.993101287Z [2024-03-29T01:49:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status queued for try_number 1 2024-03-29T01:49:01.004909372Z [2024-03-29T01:49:01.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to b00b4757-3647-4f7b-802e-a37dcd653835 2024-03-29T01:49:01.005224914Z [2024-03-29T01:49:01.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fef0207-0d52-423f-9263-573104129b70 2024-03-29T01:49:01.005509461Z [2024-03-29T01:49:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3daf1126-4a58-4f3c-8b51-a84a876f921a 2024-03-29T01:49:02.353661073Z [2024-03-29T01:49:02.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:49:02.354409055Z [2024-03-29T01:49:02.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:48:00+00:00, run_id=scheduled__2024-03-29T01:48:00+00:00, run_start_date=2024-03-29 01:49:00.597223+00:00, run_end_date=2024-03-29 01:49:02.353569+00:00, run_duration=1.756346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:48:00+00:00, data_interval_end=2024-03-29 01:49:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:49:02.381031031Z [2024-03-29T01:49:02.380+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:49:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:49:03.640450783Z [2024-03-29T01:49:03.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status success for try_number 1 2024-03-29T01:49:03.649804026Z [2024-03-29T01:49:03.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:48:00+00:00, map_index=-1, run_start_date=2024-03-29 01:49:01.786258+00:00, run_end_date=2024-03-29 01:49:02.321747+00:00, run_duration=0.535489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:49:00.672494+00:00, queued_by_job_id=2, pid=8912 2024-03-29T01:49:04.716409275Z [2024-03-29T01:49:04.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:49:04.716438171Z [2024-03-29T01:49:04.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:48:00+00:00, run_id=scheduled__2024-03-29T01:48:00+00:00, run_start_date=2024-03-29 01:49:00.599429+00:00, run_end_date=2024-03-29 01:49:04.710670+00:00, run_duration=4.111241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:48:00+00:00, data_interval_end=2024-03-29 01:49:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:49:04.720604261Z [2024-03-29T01:49:04.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:49:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:49:04.759887626Z [2024-03-29T01:49:04.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status success for try_number 1 2024-03-29T01:49:04.766709138Z [2024-03-29T01:49:04.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:48:00+00:00, map_index=-1, run_start_date=2024-03-29 01:49:02.855630+00:00, run_end_date=2024-03-29 01:49:04.182208+00:00, run_duration=1.326578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:49:00.672494+00:00, queued_by_job_id=2, pid=8925 2024-03-29T01:49:05.836271913Z [2024-03-29T01:49:05.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:49:05.836602397Z [2024-03-29T01:49:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:48:00+00:00, run_id=scheduled__2024-03-29T01:48:00+00:00, run_start_date=2024-03-29 01:49:00.601233+00:00, run_end_date=2024-03-29 01:49:05.836202+00:00, run_duration=5.234969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:48:00+00:00, data_interval_end=2024-03-29 01:49:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:49:05.846790186Z [2024-03-29T01:49:05.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:49:00+00:00, run_after=2024-03-29T01:50:00+00:00 2024-03-29T01:49:05.890550432Z [2024-03-29T01:49:05.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status success for try_number 1 2024-03-29T01:49:05.898193770Z [2024-03-29T01:49:05.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:48:00+00:00, map_index=-1, run_start_date=2024-03-29 01:49:03.145140+00:00, run_end_date=2024-03-29 01:49:05.141812+00:00, run_duration=1.996672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:49:00.672494+00:00, queued_by_job_id=2, pid=8931 2024-03-29T01:50:00.049799652Z [2024-03-29T01:50:00.049+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:50:00.063125164Z [2024-03-29T01:50:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:51:00+00:00 2024-03-29T01:50:00.074914306Z [2024-03-29T01:50:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:51:00+00:00 2024-03-29T01:50:00.086008408Z [2024-03-29T01:50:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:55:00+00:00 2024-03-29T01:50:00.093349437Z [2024-03-29T01:50:00.093+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:50:00.184888710Z [2024-03-29T01:50:00.184+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T01:50:00.184917210Z 2024-03-29T01:50:00.184922359Z 2024-03-29T01:50:00.184927129Z 2024-03-29T01:50:00.184931641Z 2024-03-29T01:50:00.184935886Z 2024-03-29T01:50:00.185859267Z [2024-03-29T01:50:00.185+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:50:00.186192315Z [2024-03-29T01:50:00.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:50:00.186561716Z [2024-03-29T01:50:00.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:50:00.186824716Z [2024-03-29T01:50:00.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:50:00.187145774Z [2024-03-29T01:50:00.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:50:00.188194043Z [2024-03-29T01:50:00.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:50:00.188222183Z 2024-03-29T01:50:00.188226354Z 2024-03-29T01:50:00.188230390Z 2024-03-29T01:50:00.188233807Z 2024-03-29T01:50:00.188236950Z 2024-03-29T01:50:00.194425157Z [2024-03-29T01:50:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:50:00.194762566Z [2024-03-29T01:50:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:50:00.195264258Z [2024-03-29T01:50:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:50:00.195575568Z [2024-03-29T01:50:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:50:00.196349049Z [2024-03-29T01:50:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:50:00.197130739Z [2024-03-29T01:50:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:50:00.197466503Z [2024-03-29T01:50:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:50:00.197658994Z [2024-03-29T01:50:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:50:00.197965209Z [2024-03-29T01:50:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:50:00.198165087Z [2024-03-29T01:50:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:50:00.887048604Z [2024-03-29T01:50:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:00.887180914Z [2024-03-29T01:50:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:00.887283441Z [2024-03-29T01:50:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:49:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:00.887411318Z [2024-03-29T01:50:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:49:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:00.887581655Z [2024-03-29T01:50:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:49:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:00.898747083Z [2024-03-29T01:50:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6146827c-6d72-46a5-a488-a4a09936b963 2024-03-29T01:50:00.898882700Z [2024-03-29T01:50:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 639ac02d-0064-49ea-a90a-2b8622420573 2024-03-29T01:50:00.899085655Z [2024-03-29T01:50:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44d69613-bbf8-452c-909a-52e7c0371a3e 2024-03-29T01:50:00.899254414Z [2024-03-29T01:50:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 244019a2-61ca-43ea-98a7-b8eabd2812b1 2024-03-29T01:50:00.899405044Z [2024-03-29T01:50:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa29d045-85d5-4b0e-8c11-deb78cec7846 2024-03-29T01:50:01.816892341Z [2024-03-29T01:50:01.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:50:01.817360766Z [2024-03-29T01:50:01.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:48:00+00:00, run_id=scheduled__2024-03-29T01:48:00+00:00, run_start_date=2024-03-29 01:50:00.105865+00:00, run_end_date=2024-03-29 01:50:01.816917+00:00, run_duration=1.711052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:48:00+00:00, data_interval_end=2024-03-29 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:50:01.830163860Z [2024-03-29T01:50:01.829+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:52:00+00:00 2024-03-29T01:50:02.054123630Z [2024-03-29T01:50:02.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:48:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:02.068252831Z [2024-03-29T01:50:02.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:48:00+00:00, map_index=-1, run_start_date=2024-03-29 01:50:01.120506+00:00, run_end_date=2024-03-29 01:50:01.691937+00:00, run_duration=0.571431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:00.190288+00:00, queued_by_job_id=2, pid=8960 2024-03-29T01:50:03.174272510Z [2024-03-29T01:50:03.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:50:03.174505816Z [2024-03-29T01:50:03.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:49:00+00:00, run_id=scheduled__2024-03-29T01:49:00+00:00, run_start_date=2024-03-29 01:50:00.107545+00:00, run_end_date=2024-03-29 01:50:03.174090+00:00, run_duration=3.066545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:49:00+00:00, data_interval_end=2024-03-29 01:50:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:50:03.185894375Z [2024-03-29T01:50:03.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:51:00+00:00 2024-03-29T01:50:03.271006402Z [2024-03-29T01:50:03.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:49:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:03.278929699Z [2024-03-29T01:50:03.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:49:00+00:00, map_index=-1, run_start_date=2024-03-29 01:50:01.509334+00:00, run_end_date=2024-03-29 01:50:02.337616+00:00, run_duration=0.828282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:00.190288+00:00, queued_by_job_id=2, pid=8966 2024-03-29T01:50:04.382264122Z [2024-03-29T01:50:04.381+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:50:04.382307008Z 2024-03-29T01:50:04.382731944Z [2024-03-29T01:50:04.382+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:50:04.383879596Z [2024-03-29T01:50:04.383+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:50:04.383902164Z 2024-03-29T01:50:04.387898169Z [2024-03-29T01:50:04.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:50:04.387983342Z [2024-03-29T01:50:04.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:50:04.443216008Z [2024-03-29T01:50:04.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:04.443343437Z [2024-03-29T01:50:04.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:04.452361684Z [2024-03-29T01:50:04.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f58b6d9-b2d1-4449-b477-b82e6eeba695 2024-03-29T01:50:04.452955305Z [2024-03-29T01:50:04.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:45:00+00:00, map_index=-1, run_start_date=2024-03-29 01:50:02.943423+00:00, run_end_date=2024-03-29 01:50:03.400189+00:00, run_duration=0.456766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:00.190288+00:00, queued_by_job_id=2, pid=8996 2024-03-29T01:50:05.685322528Z [2024-03-29T01:50:05.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:50:05.685359971Z [2024-03-29T01:50:05.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:49:00+00:00, run_id=scheduled__2024-03-29T01:49:00+00:00, run_start_date=2024-03-29 01:50:00.109552+00:00, run_end_date=2024-03-29 01:50:05.679979+00:00, run_duration=5.570427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:49:00+00:00, data_interval_end=2024-03-29 01:50:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:50:05.719117410Z [2024-03-29T01:50:05.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:51:00+00:00 2024-03-29T01:50:05.738979971Z [2024-03-29T01:50:05.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:50:05.739439652Z [2024-03-29T01:50:05.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:49:00+00:00, run_id=scheduled__2024-03-29T01:49:00+00:00, run_start_date=2024-03-29 01:50:00.111354+00:00, run_end_date=2024-03-29 01:50:05.739012+00:00, run_duration=5.627658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:49:00+00:00, data_interval_end=2024-03-29 01:50:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:50:05.753624803Z [2024-03-29T01:50:05.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:51:00+00:00 2024-03-29T01:50:05.835866109Z [2024-03-29T01:50:05.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:49:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:05.843016958Z [2024-03-29T01:50:05.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:49:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:05.876754145Z [2024-03-29T01:50:05.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:49:00+00:00, map_index=-1, run_start_date=2024-03-29 01:50:02.954703+00:00, run_end_date=2024-03-29 01:50:04.551770+00:00, run_duration=1.597067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:00.190288+00:00, queued_by_job_id=2, pid=8997 2024-03-29T01:50:05.883357980Z [2024-03-29T01:50:05.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:49:00+00:00, map_index=-1, run_start_date=2024-03-29 01:50:02.620451+00:00, run_end_date=2024-03-29 01:50:05.162134+00:00, run_duration=2.541683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:00.190288+00:00, queued_by_job_id=2, pid=8985 2024-03-29T01:50:08.427312326Z [2024-03-29T01:50:08.426+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:50:08.427353257Z 2024-03-29T01:50:08.427369882Z [2024-03-29T01:50:08.427+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:50:08.427904217Z [2024-03-29T01:50:08.427+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:50:08.427926478Z 2024-03-29T01:50:08.430797719Z [2024-03-29T01:50:08.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:50:08.430871074Z [2024-03-29T01:50:08.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:50:08.514746064Z [2024-03-29T01:50:08.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:08.514860492Z [2024-03-29T01:50:08.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:08.525835780Z [2024-03-29T01:50:08.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed304bc5-a4e2-4f71-aad6-1f64019cc3e0 2024-03-29T01:50:08.526179786Z [2024-03-29T01:50:08.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:45:00+00:00, map_index=-1, run_start_date=2024-03-29 01:50:06.701216+00:00, run_end_date=2024-03-29 01:50:07.253942+00:00, run_duration=0.552726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:04.384569+00:00, queued_by_job_id=2, pid=9020 2024-03-29T01:50:11.007907669Z [2024-03-29T01:50:11.007+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:50:11.007938114Z 2024-03-29T01:50:11.007944962Z [2024-03-29T01:50:11.007+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:50:11.008588788Z [2024-03-29T01:50:11.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:50:11.008610170Z 2024-03-29T01:50:11.011263664Z [2024-03-29T01:50:11.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:50:11.011594400Z [2024-03-29T01:50:11.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:50:11.064180149Z [2024-03-29T01:50:11.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status queued for try_number 1 2024-03-29T01:50:11.064818352Z [2024-03-29T01:50:11.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:11.077120889Z [2024-03-29T01:50:11.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4377de2-71a7-4de8-b6af-c216206e997f 2024-03-29T01:50:11.077916888Z [2024-03-29T01:50:11.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:45:00+00:00, map_index=0, run_start_date=2024-03-29 01:50:10.275891+00:00, run_end_date=2024-03-29 01:50:10.628424+00:00, run_duration=0.352533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:08.428305+00:00, queued_by_job_id=2, pid=9028 2024-03-29T01:50:13.532972875Z [2024-03-29T01:50:13.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:50:13.533152279Z [2024-03-29T01:50:13.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:45:00+00:00, run_id=scheduled__2024-03-29T01:45:00+00:00, run_start_date=2024-03-29 01:50:00.104278+00:00, run_end_date=2024-03-29 01:50:13.532841+00:00, run_duration=13.428563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:45:00+00:00, data_interval_end=2024-03-29 01:50:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:50:13.540535510Z [2024-03-29T01:50:13.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:50:00+00:00, run_after=2024-03-29T01:55:00+00:00 2024-03-29T01:50:13.587387869Z [2024-03-29T01:50:13.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:45:00+00:00 exited with status success for try_number 1 2024-03-29T01:50:13.594676330Z [2024-03-29T01:50:13.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:45:00+00:00, map_index=-1, run_start_date=2024-03-29 01:50:12.753173+00:00, run_end_date=2024-03-29 01:50:13.077020+00:00, run_duration=0.323847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:50:11.009024+00:00, queued_by_job_id=2, pid=9036 2024-03-29T01:51:00.132080366Z [2024-03-29T01:51:00.131+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:51:00+00:00, run_after=2024-03-29T01:52:00+00:00 2024-03-29T01:51:00.157385099Z [2024-03-29T01:51:00.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:51:00+00:00, run_after=2024-03-29T01:52:00+00:00 2024-03-29T01:51:00.168847558Z [2024-03-29T01:51:00.168+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:51:00.252637198Z [2024-03-29T01:51:00.252+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:51:00.252680848Z 2024-03-29T01:51:00.252686274Z 2024-03-29T01:51:00.252690764Z 2024-03-29T01:51:00.252933595Z [2024-03-29T01:51:00.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:51:00.253293623Z [2024-03-29T01:51:00.253+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:51:00.253592000Z [2024-03-29T01:51:00.253+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:51:00.255005801Z [2024-03-29T01:51:00.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:51:00.255025356Z 2024-03-29T01:51:00.255031983Z 2024-03-29T01:51:00.255059006Z 2024-03-29T01:51:00.260080146Z [2024-03-29T01:51:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:51:00.260281024Z [2024-03-29T01:51:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:51:00.260772402Z [2024-03-29T01:51:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:51:00.261033957Z [2024-03-29T01:51:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:51:00.261429357Z [2024-03-29T01:51:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:51:00.261697055Z [2024-03-29T01:51:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:51:00.464747820Z [2024-03-29T01:51:00.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:51:00.464916573Z [2024-03-29T01:51:00.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:51:00.465072942Z [2024-03-29T01:51:00.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:51:00.472993618Z [2024-03-29T01:51:00.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8681469e-f230-4d0b-a436-fb50a540e3e9 2024-03-29T01:51:00.473230443Z [2024-03-29T01:51:00.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18f98b32-1ac8-492b-a457-f681cc5f3c1c 2024-03-29T01:51:00.473420496Z [2024-03-29T01:51:00.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48a7ea0d-9ce0-4d38-bfdb-ac7a37a4cd68 2024-03-29T01:51:02.557242852Z [2024-03-29T01:51:02.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:51:02.557278054Z [2024-03-29T01:51:02.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:50:00+00:00, run_id=scheduled__2024-03-29T01:50:00+00:00, run_start_date=2024-03-29 01:51:00.182278+00:00, run_end_date=2024-03-29 01:51:02.555357+00:00, run_duration=2.373079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:50:00+00:00, data_interval_end=2024-03-29 01:51:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:51:02.577669775Z [2024-03-29T01:51:02.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:51:00+00:00, run_after=2024-03-29T01:52:00+00:00 2024-03-29T01:51:02.649953052Z [2024-03-29T01:51:02.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:51:02.657644305Z [2024-03-29T01:51:02.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=-1, run_start_date=2024-03-29 01:51:01.070114+00:00, run_end_date=2024-03-29 01:51:01.535114+00:00, run_duration=0.465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:51:00.256594+00:00, queued_by_job_id=2, pid=9058 2024-03-29T01:51:04.181174551Z [2024-03-29T01:51:04.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:51:04.181473727Z [2024-03-29T01:51:04.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:50:00+00:00, run_id=scheduled__2024-03-29T01:50:00+00:00, run_start_date=2024-03-29 01:51:00.184238+00:00, run_end_date=2024-03-29 01:51:04.181000+00:00, run_duration=3.996762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:50:00+00:00, data_interval_end=2024-03-29 01:51:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:51:04.197098520Z [2024-03-29T01:51:04.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:51:00+00:00, run_after=2024-03-29T01:52:00+00:00 2024-03-29T01:51:04.248471874Z [2024-03-29T01:51:04.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:51:04.253493984Z [2024-03-29T01:51:04.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=-1, run_start_date=2024-03-29 01:51:02.121716+00:00, run_end_date=2024-03-29 01:51:03.562195+00:00, run_duration=1.440479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:51:00.256594+00:00, queued_by_job_id=2, pid=9076 2024-03-29T01:51:05.297996732Z [2024-03-29T01:51:05.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:51:05.298781178Z [2024-03-29T01:51:05.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:50:00+00:00, run_id=scheduled__2024-03-29T01:50:00+00:00, run_start_date=2024-03-29 01:51:00.185884+00:00, run_end_date=2024-03-29 01:51:05.298131+00:00, run_duration=5.112247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:50:00+00:00, data_interval_end=2024-03-29 01:51:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:51:05.312038220Z [2024-03-29T01:51:05.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:51:00+00:00, run_after=2024-03-29T01:52:00+00:00 2024-03-29T01:51:05.351985278Z [2024-03-29T01:51:05.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:51:05.360752367Z [2024-03-29T01:51:05.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=-1, run_start_date=2024-03-29 01:51:02.115814+00:00, run_end_date=2024-03-29 01:51:04.622488+00:00, run_duration=2.506674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:51:00.256594+00:00, queued_by_job_id=2, pid=9077 2024-03-29T01:52:00.838690725Z [2024-03-29T01:52:00.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:52:00+00:00, run_after=2024-03-29T01:53:00+00:00 2024-03-29T01:52:00.847781198Z [2024-03-29T01:52:00.847+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:52:00.858528410Z [2024-03-29T01:52:00.858+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:52:00.874469029Z [2024-03-29T01:52:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:52:00+00:00, run_after=2024-03-29T01:53:00+00:00 2024-03-29T01:52:00.958664382Z [2024-03-29T01:52:00.958+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:52:00.958705879Z 2024-03-29T01:52:00.958710955Z 2024-03-29T01:52:00.958714675Z 2024-03-29T01:52:00.958718734Z 2024-03-29T01:52:00.958939133Z [2024-03-29T01:52:00.958+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:52:00.959146651Z [2024-03-29T01:52:00.958+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:52:00.959359191Z [2024-03-29T01:52:00.959+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:52:00.959629573Z [2024-03-29T01:52:00.959+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:52:00.960332337Z [2024-03-29T01:52:00.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:52:00.960346883Z 2024-03-29T01:52:00.960352761Z 2024-03-29T01:52:00.960357657Z 2024-03-29T01:52:00.960362346Z 2024-03-29T01:52:00.965093896Z [2024-03-29T01:52:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:52:00.965224732Z [2024-03-29T01:52:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:52:00.965591834Z [2024-03-29T01:52:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:52:00.965707111Z [2024-03-29T01:52:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:52:00.965979342Z [2024-03-29T01:52:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:52:00.966102841Z [2024-03-29T01:52:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:52:00.966359332Z [2024-03-29T01:52:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:52:00.966387569Z [2024-03-29T01:52:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:52:01.528078425Z [2024-03-29T01:52:01.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:52:01.529919017Z [2024-03-29T01:52:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:51:00+00:00 exited with status queued for try_number 1 2024-03-29T01:52:01.530044207Z [2024-03-29T01:52:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:51:00+00:00 exited with status queued for try_number 1 2024-03-29T01:52:01.530209794Z [2024-03-29T01:52:01.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:51:00+00:00 exited with status queued for try_number 1 2024-03-29T01:52:01.552027239Z [2024-03-29T01:52:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 101c8dd9-1bd9-484c-a14c-f877e6f56715 2024-03-29T01:52:01.552227270Z [2024-03-29T01:52:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9026b838-e2ee-4d35-91c2-3bed59986469 2024-03-29T01:52:01.552410597Z [2024-03-29T01:52:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to d42ef9df-1f7d-4104-aebf-396e3a9fcb3c 2024-03-29T01:52:01.552627316Z [2024-03-29T01:52:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d2180ff-a827-46c9-845d-7fa52c808a89 2024-03-29T01:52:03.046695796Z [2024-03-29T01:52:03.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:52:03.046960557Z [2024-03-29T01:52:03.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:51:00+00:00, run_id=scheduled__2024-03-29T01:51:00+00:00, run_start_date=2024-03-29 01:52:00.889098+00:00, run_end_date=2024-03-29 01:52:03.046616+00:00, run_duration=2.157518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:51:00+00:00, data_interval_end=2024-03-29 01:52:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:52:03.079433386Z [2024-03-29T01:52:03.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:52:00+00:00, run_after=2024-03-29T01:53:00+00:00 2024-03-29T01:52:03.809526154Z [2024-03-29T01:52:03.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:52:03.809830673Z [2024-03-29T01:52:03.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:50:00+00:00, run_id=scheduled__2024-03-29T01:50:00+00:00, run_start_date=2024-03-29 01:52:00.887655+00:00, run_end_date=2024-03-29 01:52:03.809351+00:00, run_duration=2.921696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:50:00+00:00, data_interval_end=2024-03-29 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:52:03.817622325Z [2024-03-29T01:52:03.817+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:52:00+00:00, run_after=2024-03-29T01:54:00+00:00 2024-03-29T01:52:03.867682338Z [2024-03-29T01:52:03.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:52:03.867850444Z [2024-03-29T01:52:03.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:51:00+00:00 exited with status success for try_number 1 2024-03-29T01:52:03.875539483Z [2024-03-29T01:52:03.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:51:00+00:00, map_index=-1, run_start_date=2024-03-29 01:52:02.439370+00:00, run_end_date=2024-03-29 01:52:02.964991+00:00, run_duration=0.525621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:52:00.961750+00:00, queued_by_job_id=2, pid=9111 2024-03-29T01:52:03.875630074Z [2024-03-29T01:52:03.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=-1, run_start_date=2024-03-29 01:52:02.355452+00:00, run_end_date=2024-03-29 01:52:03.074622+00:00, run_duration=0.71917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:52:00.961750+00:00, queued_by_job_id=2, pid=9110 2024-03-29T01:52:06.025731748Z [2024-03-29T01:52:06.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:52:06.025990637Z [2024-03-29T01:52:06.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:51:00+00:00, run_id=scheduled__2024-03-29T01:51:00+00:00, run_start_date=2024-03-29 01:52:00.890226+00:00, run_end_date=2024-03-29 01:52:06.025613+00:00, run_duration=5.135387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:51:00+00:00, data_interval_end=2024-03-29 01:52:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:52:06.034758013Z [2024-03-29T01:52:06.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:52:00+00:00, run_after=2024-03-29T01:53:00+00:00 2024-03-29T01:52:06.041468524Z [2024-03-29T01:52:06.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:52:06.041734353Z [2024-03-29T01:52:06.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:51:00+00:00, run_id=scheduled__2024-03-29T01:51:00+00:00, run_start_date=2024-03-29 01:52:00.891317+00:00, run_end_date=2024-03-29 01:52:06.041398+00:00, run_duration=5.150081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:51:00+00:00, data_interval_end=2024-03-29 01:52:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:52:06.050903411Z [2024-03-29T01:52:06.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:52:00+00:00, run_after=2024-03-29T01:53:00+00:00 2024-03-29T01:52:06.081952900Z [2024-03-29T01:52:06.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:51:00+00:00 exited with status success for try_number 1 2024-03-29T01:52:06.082054438Z [2024-03-29T01:52:06.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:51:00+00:00 exited with status success for try_number 1 2024-03-29T01:52:06.087882211Z [2024-03-29T01:52:06.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:51:00+00:00, map_index=-1, run_start_date=2024-03-29 01:52:03.795029+00:00, run_end_date=2024-03-29 01:52:05.479365+00:00, run_duration=1.684336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:52:00.961750+00:00, queued_by_job_id=2, pid=9135 2024-03-29T01:52:06.088120073Z [2024-03-29T01:52:06.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:51:00+00:00, map_index=-1, run_start_date=2024-03-29 01:52:03.555435+00:00, run_end_date=2024-03-29 01:52:04.976298+00:00, run_duration=1.420863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:52:00.961750+00:00, queued_by_job_id=2, pid=9134 2024-03-29T01:53:00.572148277Z [2024-03-29T01:53:00.571+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:53:00+00:00, run_after=2024-03-29T01:54:00+00:00 2024-03-29T01:53:00.586322746Z [2024-03-29T01:53:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:53:00+00:00, run_after=2024-03-29T01:54:00+00:00 2024-03-29T01:53:00.594337429Z [2024-03-29T01:53:00.593+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:53:00.664861851Z [2024-03-29T01:53:00.664+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:53:00.664912572Z 2024-03-29T01:53:00.664949863Z 2024-03-29T01:53:00.664954833Z 2024-03-29T01:53:00.664986452Z [2024-03-29T01:53:00.664+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:53:00.665177433Z [2024-03-29T01:53:00.664+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:53:00.665301041Z [2024-03-29T01:53:00.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:53:00.666237021Z [2024-03-29T01:53:00.665+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:53:00.666250227Z 2024-03-29T01:53:00.666254612Z 2024-03-29T01:53:00.666258760Z 2024-03-29T01:53:00.670746151Z [2024-03-29T01:53:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:53:00.670823107Z [2024-03-29T01:53:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:53:00.671056310Z [2024-03-29T01:53:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:53:00.671195207Z [2024-03-29T01:53:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:53:00.671314789Z [2024-03-29T01:53:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:53:00.671397966Z [2024-03-29T01:53:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:53:01.011489392Z [2024-03-29T01:53:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status queued for try_number 1 2024-03-29T01:53:01.011528690Z [2024-03-29T01:53:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status queued for try_number 1 2024-03-29T01:53:01.011575957Z [2024-03-29T01:53:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status queued for try_number 1 2024-03-29T01:53:01.036054489Z [2024-03-29T01:53:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 252ae2ce-adb6-49cf-b8ae-99dd66dd2e82 2024-03-29T01:53:01.036158723Z [2024-03-29T01:53:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3769d62d-21cb-426f-bcaf-1b1972ea3161 2024-03-29T01:53:01.036181460Z [2024-03-29T01:53:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b9d18eb-0ed9-4d27-9240-0afcb3622af5 2024-03-29T01:53:02.311508458Z [2024-03-29T01:53:02.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:53:02.311697536Z [2024-03-29T01:53:02.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:52:00+00:00, run_id=scheduled__2024-03-29T01:52:00+00:00, run_start_date=2024-03-29 01:53:00.604292+00:00, run_end_date=2024-03-29 01:53:02.311348+00:00, run_duration=1.707056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:52:00+00:00, data_interval_end=2024-03-29 01:53:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:53:02.326251118Z [2024-03-29T01:53:02.325+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:53:00+00:00, run_after=2024-03-29T01:54:00+00:00 2024-03-29T01:53:02.402992736Z [2024-03-29T01:53:02.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status success for try_number 1 2024-03-29T01:53:02.411989101Z [2024-03-29T01:53:02.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:52:00+00:00, map_index=-1, run_start_date=2024-03-29 01:53:01.640653+00:00, run_end_date=2024-03-29 01:53:02.075681+00:00, run_duration=0.435028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:53:00.667610+00:00, queued_by_job_id=2, pid=9167 2024-03-29T01:53:04.573420056Z [2024-03-29T01:53:04.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:53:04.573922958Z [2024-03-29T01:53:04.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:52:00+00:00, run_id=scheduled__2024-03-29T01:52:00+00:00, run_start_date=2024-03-29 01:53:00.605443+00:00, run_end_date=2024-03-29 01:53:04.573309+00:00, run_duration=3.967866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:52:00+00:00, data_interval_end=2024-03-29 01:53:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:53:04.588901399Z [2024-03-29T01:53:04.588+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:53:00+00:00, run_after=2024-03-29T01:54:00+00:00 2024-03-29T01:53:04.648186325Z [2024-03-29T01:53:04.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status success for try_number 1 2024-03-29T01:53:04.654715139Z [2024-03-29T01:53:04.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:52:00+00:00, map_index=-1, run_start_date=2024-03-29 01:53:02.726795+00:00, run_end_date=2024-03-29 01:53:04.097185+00:00, run_duration=1.37039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:53:00.667610+00:00, queued_by_job_id=2, pid=9185 2024-03-29T01:53:05.710599297Z [2024-03-29T01:53:05.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:53:05.710624076Z [2024-03-29T01:53:05.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:52:00+00:00, run_id=scheduled__2024-03-29T01:52:00+00:00, run_start_date=2024-03-29 01:53:00.606430+00:00, run_end_date=2024-03-29 01:53:05.707072+00:00, run_duration=5.100642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:52:00+00:00, data_interval_end=2024-03-29 01:53:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:53:05.718572372Z [2024-03-29T01:53:05.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:53:00+00:00, run_after=2024-03-29T01:54:00+00:00 2024-03-29T01:53:05.751659802Z [2024-03-29T01:53:05.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status success for try_number 1 2024-03-29T01:53:05.756504232Z [2024-03-29T01:53:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:52:00+00:00, map_index=-1, run_start_date=2024-03-29 01:53:02.893573+00:00, run_end_date=2024-03-29 01:53:04.640755+00:00, run_duration=1.747182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:53:00.667610+00:00, queued_by_job_id=2, pid=9186 2024-03-29T01:53:45.771858906Z [2024-03-29T01:53:45.771+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:54:00.169463809Z [2024-03-29T01:54:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:54:00+00:00, run_after=2024-03-29T01:55:00+00:00 2024-03-29T01:54:00.198189278Z [2024-03-29T01:54:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:54:00+00:00, run_after=2024-03-29T01:55:00+00:00 2024-03-29T01:54:00.208718101Z [2024-03-29T01:54:00.208+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:54:00.218679108Z [2024-03-29T01:54:00.218+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:54:00.298910850Z [2024-03-29T01:54:00.298+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:54:00.298956033Z 2024-03-29T01:54:00.298965571Z 2024-03-29T01:54:00.298970087Z 2024-03-29T01:54:00.298974187Z 2024-03-29T01:54:00.299004569Z [2024-03-29T01:54:00.298+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:54:00.299186582Z [2024-03-29T01:54:00.298+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:54:00.299442341Z [2024-03-29T01:54:00.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:54:00.299650447Z [2024-03-29T01:54:00.299+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:54:00.300409345Z [2024-03-29T01:54:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:54:00.300423464Z 2024-03-29T01:54:00.300428428Z 2024-03-29T01:54:00.300432736Z 2024-03-29T01:54:00.300440450Z 2024-03-29T01:54:00.304471689Z [2024-03-29T01:54:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:54:00.304665365Z [2024-03-29T01:54:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:54:00.304997091Z [2024-03-29T01:54:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:54:00.305143768Z [2024-03-29T01:54:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:54:00.305431774Z [2024-03-29T01:54:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:54:00.305541008Z [2024-03-29T01:54:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:54:00.305825530Z [2024-03-29T01:54:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:54:00.305917267Z [2024-03-29T01:54:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:54:00.595411053Z [2024-03-29T01:54:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status queued for try_number 1 2024-03-29T01:54:00.595578737Z [2024-03-29T01:54:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:53:00+00:00 exited with status queued for try_number 1 2024-03-29T01:54:00.595727163Z [2024-03-29T01:54:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:53:00+00:00 exited with status queued for try_number 1 2024-03-29T01:54:00.595934962Z [2024-03-29T01:54:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:53:00+00:00 exited with status queued for try_number 1 2024-03-29T01:54:00.605669146Z [2024-03-29T01:54:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to e58541f1-8342-4a0b-96a7-f264d9f1bcd4 2024-03-29T01:54:00.605987769Z [2024-03-29T01:54:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca4cdfcb-48b7-4f10-808d-754aa2b79d5f 2024-03-29T01:54:00.606197847Z [2024-03-29T01:54:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c5b9a00-2f17-4354-af22-413b9f5c4978 2024-03-29T01:54:00.606423235Z [2024-03-29T01:54:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 644a9b21-0102-4d8f-9c9e-818285fc5a13 2024-03-29T01:54:01.805887957Z [2024-03-29T01:54:01.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:54:01.806643971Z [2024-03-29T01:54:01.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:52:00+00:00, run_id=scheduled__2024-03-29T01:52:00+00:00, run_start_date=2024-03-29 01:54:00.233639+00:00, run_end_date=2024-03-29 01:54:01.806060+00:00, run_duration=1.572421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:52:00+00:00, data_interval_end=2024-03-29 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:54:01.825217568Z [2024-03-29T01:54:01.824+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:54:00+00:00, run_after=2024-03-29T01:56:00+00:00 2024-03-29T01:54:01.841311099Z [2024-03-29T01:54:01.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:54:01.841348682Z [2024-03-29T01:54:01.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:53:00+00:00, run_id=scheduled__2024-03-29T01:53:00+00:00, run_start_date=2024-03-29 01:54:00.235127+00:00, run_end_date=2024-03-29 01:54:01.840089+00:00, run_duration=1.604962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:53:00+00:00, data_interval_end=2024-03-29 01:54:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:54:01.855674760Z [2024-03-29T01:54:01.855+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:54:00+00:00, run_after=2024-03-29T01:55:00+00:00 2024-03-29T01:54:01.946251802Z [2024-03-29T01:54:01.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:52:00+00:00 exited with status success for try_number 1 2024-03-29T01:54:01.946359798Z [2024-03-29T01:54:01.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:53:00+00:00 exited with status success for try_number 1 2024-03-29T01:54:01.955027960Z [2024-03-29T01:54:01.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:52:00+00:00, map_index=-1, run_start_date=2024-03-29 01:54:01.051306+00:00, run_end_date=2024-03-29 01:54:01.505619+00:00, run_duration=0.454313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:54:00.301679+00:00, queued_by_job_id=2, pid=9219 2024-03-29T01:54:01.955221595Z [2024-03-29T01:54:01.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:53:00+00:00, map_index=-1, run_start_date=2024-03-29 01:54:01.330514+00:00, run_end_date=2024-03-29 01:54:01.818205+00:00, run_duration=0.487691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:54:00.301679+00:00, queued_by_job_id=2, pid=9221 2024-03-29T01:54:03.890715026Z [2024-03-29T01:54:03.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:54:03.890764092Z [2024-03-29T01:54:03.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:53:00+00:00, run_id=scheduled__2024-03-29T01:53:00+00:00, run_start_date=2024-03-29 01:54:00.236208+00:00, run_end_date=2024-03-29 01:54:03.890157+00:00, run_duration=3.653949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:53:00+00:00, data_interval_end=2024-03-29 01:54:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:54:03.921459463Z [2024-03-29T01:54:03.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:54:00+00:00, run_after=2024-03-29T01:55:00+00:00 2024-03-29T01:54:03.999088724Z [2024-03-29T01:54:03.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:53:00+00:00 exited with status success for try_number 1 2024-03-29T01:54:04.019829365Z [2024-03-29T01:54:04.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:53:00+00:00, map_index=-1, run_start_date=2024-03-29 01:54:02.374571+00:00, run_end_date=2024-03-29 01:54:03.603797+00:00, run_duration=1.229226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:54:00.301679+00:00, queued_by_job_id=2, pid=9243 2024-03-29T01:54:05.075284883Z [2024-03-29T01:54:05.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:54:05.075740498Z [2024-03-29T01:54:05.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:53:00+00:00, run_id=scheduled__2024-03-29T01:53:00+00:00, run_start_date=2024-03-29 01:54:00.237440+00:00, run_end_date=2024-03-29 01:54:05.075266+00:00, run_duration=4.837826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:53:00+00:00, data_interval_end=2024-03-29 01:54:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:54:05.087839650Z [2024-03-29T01:54:05.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:54:00+00:00, run_after=2024-03-29T01:55:00+00:00 2024-03-29T01:54:05.141342297Z [2024-03-29T01:54:05.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:53:00+00:00 exited with status success for try_number 1 2024-03-29T01:54:05.150366417Z [2024-03-29T01:54:05.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:53:00+00:00, map_index=-1, run_start_date=2024-03-29 01:54:02.565657+00:00, run_end_date=2024-03-29 01:54:04.260107+00:00, run_duration=1.69445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:54:00.301679+00:00, queued_by_job_id=2, pid=9244 2024-03-29T01:55:00.549258858Z [2024-03-29T01:55:00.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:55:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:55:00.566013994Z [2024-03-29T01:55:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:55:00+00:00, run_after=2024-03-29T01:56:00+00:00 2024-03-29T01:55:00.579674550Z [2024-03-29T01:55:00.579+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:55:00+00:00, run_after=2024-03-29T01:56:00+00:00 2024-03-29T01:55:00.590793437Z [2024-03-29T01:55:00.590+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:55:00.695297768Z [2024-03-29T01:55:00.694+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:55:00.695342360Z 2024-03-29T01:55:00.695346871Z 2024-03-29T01:55:00.695350043Z 2024-03-29T01:55:00.695353874Z 2024-03-29T01:55:00.695567945Z [2024-03-29T01:55:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:55:00.695783825Z [2024-03-29T01:55:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:55:00.696005702Z [2024-03-29T01:55:00.695+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:55:00.696208071Z [2024-03-29T01:55:00.696+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:55:00.696938198Z [2024-03-29T01:55:00.696+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:55:00.696950742Z 2024-03-29T01:55:00.696954423Z 2024-03-29T01:55:00.696958059Z 2024-03-29T01:55:00.696961428Z 2024-03-29T01:55:00.700902381Z [2024-03-29T01:55:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T01:55:00.701103071Z [2024-03-29T01:55:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:55:00.701367053Z [2024-03-29T01:55:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:55:00.701516380Z [2024-03-29T01:55:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:55:00.701777244Z [2024-03-29T01:55:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:55:00.702037779Z [2024-03-29T01:55:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:55:00.702319708Z [2024-03-29T01:55:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:55:00.702538016Z [2024-03-29T01:55:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:55:01.000539891Z [2024-03-29T01:55:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:55:01.000900607Z [2024-03-29T01:55:01.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status queued for try_number 1 2024-03-29T01:55:01.001138081Z [2024-03-29T01:55:01.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status queued for try_number 1 2024-03-29T01:55:01.001324868Z [2024-03-29T01:55:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status queued for try_number 1 2024-03-29T01:55:01.012853256Z [2024-03-29T01:55:01.012+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2e736b1-b0d3-4b39-b6c9-62b90ea8d4f4 2024-03-29T01:55:01.013344753Z [2024-03-29T01:55:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02547b5a-dc25-4795-95d0-47ddb973fbaa 2024-03-29T01:55:01.013608742Z [2024-03-29T01:55:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4f0b71f-8d50-42c8-a408-25eb8fe382ca 2024-03-29T01:55:01.013894714Z [2024-03-29T01:55:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81b3f9be-283d-41e3-a456-aaa5818d87d4 2024-03-29T01:55:02.623464986Z [2024-03-29T01:55:02.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:55:02.623896002Z [2024-03-29T01:55:02.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:54:00+00:00, run_id=scheduled__2024-03-29T01:54:00+00:00, run_start_date=2024-03-29 01:55:00.608226+00:00, run_end_date=2024-03-29 01:55:02.623337+00:00, run_duration=2.015111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:54:00+00:00, data_interval_end=2024-03-29 01:55:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:55:02.641373874Z [2024-03-29T01:55:02.640+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:55:00+00:00, run_after=2024-03-29T01:56:00+00:00 2024-03-29T01:55:02.734712044Z [2024-03-29T01:55:02.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status success for try_number 1 2024-03-29T01:55:02.744616436Z [2024-03-29T01:55:02.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:54:00+00:00, map_index=-1, run_start_date=2024-03-29 01:55:01.722347+00:00, run_end_date=2024-03-29 01:55:02.222933+00:00, run_duration=0.500586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:55:00.698010+00:00, queued_by_job_id=2, pid=9277 2024-03-29T01:55:04.311302191Z [2024-03-29T01:55:04.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:55:04.311849826Z [2024-03-29T01:55:04.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:54:00+00:00, run_id=scheduled__2024-03-29T01:54:00+00:00, run_start_date=2024-03-29 01:55:00.609747+00:00, run_end_date=2024-03-29 01:55:04.311228+00:00, run_duration=3.701481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:54:00+00:00, data_interval_end=2024-03-29 01:55:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:55:04.323248769Z [2024-03-29T01:55:04.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:55:00+00:00, run_after=2024-03-29T01:56:00+00:00 2024-03-29T01:55:04.352795083Z [2024-03-29T01:55:04.352+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:55:04.352820207Z 2024-03-29T01:55:04.352973995Z [2024-03-29T01:55:04.352+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:55:04.353694141Z [2024-03-29T01:55:04.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:55:04.353707984Z 2024-03-29T01:55:04.358233166Z [2024-03-29T01:55:04.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T01:55:04.358538843Z [2024-03-29T01:55:04.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:55:04.442350521Z [2024-03-29T01:55:04.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:55:04.442678044Z [2024-03-29T01:55:04.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:55:04.442914481Z [2024-03-29T01:55:04.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status success for try_number 1 2024-03-29T01:55:04.451493254Z [2024-03-29T01:55:04.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:54:00+00:00, map_index=-1, run_start_date=2024-03-29 01:55:02.920777+00:00, run_end_date=2024-03-29 01:55:04.212780+00:00, run_duration=1.292003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:55:00.698010+00:00, queued_by_job_id=2, pid=9303 2024-03-29T01:55:04.451867685Z [2024-03-29T01:55:04.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=-1, run_start_date=2024-03-29 01:55:02.848907+00:00, run_end_date=2024-03-29 01:55:03.219250+00:00, run_duration=0.370343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:55:00.698010+00:00, queued_by_job_id=2, pid=9302 2024-03-29T01:55:04.452081909Z [2024-03-29T01:55:04.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12560c5f-c19f-44a6-97fe-fecc869dff49 2024-03-29T01:55:04.493327899Z [2024-03-29T01:55:04.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:55:04.493645246Z [2024-03-29T01:55:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:54:00+00:00, run_id=scheduled__2024-03-29T01:54:00+00:00, run_start_date=2024-03-29 01:55:00.611119+00:00, run_end_date=2024-03-29 01:55:04.493202+00:00, run_duration=3.882083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:54:00+00:00, data_interval_end=2024-03-29 01:55:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:55:04.502998999Z [2024-03-29T01:55:04.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:55:00+00:00, run_after=2024-03-29T01:56:00+00:00 2024-03-29T01:55:04.553462385Z [2024-03-29T01:55:04.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status success for try_number 1 2024-03-29T01:55:04.558751611Z [2024-03-29T01:55:04.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:54:00+00:00, map_index=-1, run_start_date=2024-03-29 01:55:02.680054+00:00, run_end_date=2024-03-29 01:55:04.334209+00:00, run_duration=1.654155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:55:00.698010+00:00, queued_by_job_id=2, pid=9301 2024-03-29T01:55:06.778942893Z [2024-03-29T01:55:06.778+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:55:06.778988324Z 2024-03-29T01:55:06.782112408Z [2024-03-29T01:55:06.778+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:55:06.786178178Z [2024-03-29T01:55:06.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:55:06.786212657Z 2024-03-29T01:55:06.793691797Z [2024-03-29T01:55:06.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T01:55:06.793907348Z [2024-03-29T01:55:06.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T01:55:06.856542568Z [2024-03-29T01:55:06.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:55:06.856624094Z [2024-03-29T01:55:06.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:55:06.866387444Z [2024-03-29T01:55:06.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b595326-a5b2-47d5-8e1d-c72a95e4e121 2024-03-29T01:55:06.866530914Z [2024-03-29T01:55:06.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=-1, run_start_date=2024-03-29 01:55:06.196222+00:00, run_end_date=2024-03-29 01:55:06.547272+00:00, run_duration=0.35105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:55:04.355100+00:00, queued_by_job_id=2, pid=9326 2024-03-29T01:55:09.112471866Z [2024-03-29T01:55:09.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T01:55:09.112521981Z 2024-03-29T01:55:09.112773680Z [2024-03-29T01:55:09.112+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:55:09.113746681Z [2024-03-29T01:55:09.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:55:09.113765037Z 2024-03-29T01:55:09.116821217Z [2024-03-29T01:55:09.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:55:09.117151357Z [2024-03-29T01:55:09.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T01:55:09.168745322Z [2024-03-29T01:55:09.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status queued for try_number 1 2024-03-29T01:55:09.168779216Z [2024-03-29T01:55:09.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:55:09.175621975Z [2024-03-29T01:55:09.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c05c623-ff6e-4920-ae91-bacb795705d7 2024-03-29T01:55:09.175715785Z [2024-03-29T01:55:09.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=0, run_start_date=2024-03-29 01:55:08.610020+00:00, run_end_date=2024-03-29 01:55:08.913750+00:00, run_duration=0.30373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:55:06.789826+00:00, queued_by_job_id=2, pid=9334 2024-03-29T01:55:11.263391554Z [2024-03-29T01:55:11.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:55:11.263974353Z [2024-03-29T01:55:11.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:50:00+00:00, run_id=scheduled__2024-03-29T01:50:00+00:00, run_start_date=2024-03-29 01:55:00.606531+00:00, run_end_date=2024-03-29 01:55:11.263489+00:00, run_duration=10.656958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:50:00+00:00, data_interval_end=2024-03-29 01:55:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T01:55:11.273821059Z [2024-03-29T01:55:11.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:55:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:55:11.315111659Z [2024-03-29T01:55:11.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:50:00+00:00 exited with status success for try_number 1 2024-03-29T01:55:11.322951261Z [2024-03-29T01:55:11.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:50:00+00:00, map_index=-1, run_start_date=2024-03-29 01:55:10.768145+00:00, run_end_date=2024-03-29 01:55:11.121148+00:00, run_duration=0.353003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:55:09.114297+00:00, queued_by_job_id=2, pid=9342 2024-03-29T01:56:00.692876360Z [2024-03-29T01:56:00.692+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:56:00.706356470Z [2024-03-29T01:56:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:56:00+00:00, run_after=2024-03-29T01:57:00+00:00 2024-03-29T01:56:00.720013384Z [2024-03-29T01:56:00.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:56:00+00:00, run_after=2024-03-29T01:57:00+00:00 2024-03-29T01:56:00.728380655Z [2024-03-29T01:56:00.727+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:56:00.807963398Z [2024-03-29T01:56:00.807+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:56:00.807990658Z 2024-03-29T01:56:00.807994824Z 2024-03-29T01:56:00.807998134Z 2024-03-29T01:56:00.808001637Z 2024-03-29T01:56:00.808255533Z [2024-03-29T01:56:00.808+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:56:00.808524570Z [2024-03-29T01:56:00.808+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:56:00.808720463Z [2024-03-29T01:56:00.808+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:56:00.808924911Z [2024-03-29T01:56:00.808+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:56:00.809572591Z [2024-03-29T01:56:00.809+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:56:00.809584780Z 2024-03-29T01:56:00.809588677Z 2024-03-29T01:56:00.809592411Z 2024-03-29T01:56:00.809595914Z 2024-03-29T01:56:00.813443317Z [2024-03-29T01:56:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:56:00.813659106Z [2024-03-29T01:56:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:56:00.813973734Z [2024-03-29T01:56:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:56:00.814118407Z [2024-03-29T01:56:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:56:00.814399245Z [2024-03-29T01:56:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:56:00.814621532Z [2024-03-29T01:56:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:56:00.814867164Z [2024-03-29T01:56:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:56:00.815022898Z [2024-03-29T01:56:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:56:01.148278987Z [2024-03-29T01:56:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status queued for try_number 1 2024-03-29T01:56:01.148314995Z [2024-03-29T01:56:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status queued for try_number 1 2024-03-29T01:56:01.148371884Z [2024-03-29T01:56:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status queued for try_number 1 2024-03-29T01:56:01.148389822Z [2024-03-29T01:56:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status queued for try_number 1 2024-03-29T01:56:01.157236157Z [2024-03-29T01:56:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28152513-7014-4131-940f-da88f8a8f17e 2024-03-29T01:56:01.157288148Z [2024-03-29T01:56:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to dee643b6-4c35-4869-bf43-dec64df997cf 2024-03-29T01:56:01.157488325Z [2024-03-29T01:56:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ac9384c-ed34-4c0f-9bfa-86ec3ce86ae9 2024-03-29T01:56:01.157749832Z [2024-03-29T01:56:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12cbd1d4-8186-4f97-82a8-5dad107cb990 2024-03-29T01:56:02.448132974Z [2024-03-29T01:56:02.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:56:02.448696963Z [2024-03-29T01:56:02.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:55:00+00:00, run_id=scheduled__2024-03-29T01:55:00+00:00, run_start_date=2024-03-29 01:56:00.743403+00:00, run_end_date=2024-03-29 01:56:02.448067+00:00, run_duration=1.704664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:55:00+00:00, data_interval_end=2024-03-29 01:56:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:56:02.470566508Z [2024-03-29T01:56:02.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:56:00+00:00, run_after=2024-03-29T01:57:00+00:00 2024-03-29T01:56:03.525261593Z [2024-03-29T01:56:03.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:56:03.525434528Z [2024-03-29T01:56:03.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:54:00+00:00, run_id=scheduled__2024-03-29T01:54:00+00:00, run_start_date=2024-03-29 01:56:00.741646+00:00, run_end_date=2024-03-29 01:56:03.525102+00:00, run_duration=2.783456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:54:00+00:00, data_interval_end=2024-03-29 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:56:03.535983965Z [2024-03-29T01:56:03.535+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:56:00+00:00, run_after=2024-03-29T01:58:00+00:00 2024-03-29T01:56:03.622191407Z [2024-03-29T01:56:03.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:54:00+00:00 exited with status success for try_number 1 2024-03-29T01:56:03.622223551Z [2024-03-29T01:56:03.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status success for try_number 1 2024-03-29T01:56:03.636812550Z [2024-03-29T01:56:03.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:55:00+00:00, map_index=-1, run_start_date=2024-03-29 01:56:01.923925+00:00, run_end_date=2024-03-29 01:56:02.332594+00:00, run_duration=0.408669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:56:00.810750+00:00, queued_by_job_id=2, pid=9367 2024-03-29T01:56:03.637170074Z [2024-03-29T01:56:03.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:54:00+00:00, map_index=-1, run_start_date=2024-03-29 01:56:01.933765+00:00, run_end_date=2024-03-29 01:56:02.551826+00:00, run_duration=0.618061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:56:00.810750+00:00, queued_by_job_id=2, pid=9366 2024-03-29T01:56:05.815663523Z [2024-03-29T01:56:05.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:56:05.815690823Z [2024-03-29T01:56:05.814+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:55:00+00:00, run_id=scheduled__2024-03-29T01:55:00+00:00, run_start_date=2024-03-29 01:56:00.744657+00:00, run_end_date=2024-03-29 01:56:05.814767+00:00, run_duration=5.07011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:55:00+00:00, data_interval_end=2024-03-29 01:56:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:56:05.824099951Z [2024-03-29T01:56:05.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:56:00+00:00, run_after=2024-03-29T01:57:00+00:00 2024-03-29T01:56:05.835312357Z [2024-03-29T01:56:05.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:56:05.835335613Z [2024-03-29T01:56:05.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:55:00+00:00, run_id=scheduled__2024-03-29T01:55:00+00:00, run_start_date=2024-03-29 01:56:00.745855+00:00, run_end_date=2024-03-29 01:56:05.832174+00:00, run_duration=5.086319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:55:00+00:00, data_interval_end=2024-03-29 01:56:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:56:05.842541132Z [2024-03-29T01:56:05.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:56:00+00:00, run_after=2024-03-29T01:57:00+00:00 2024-03-29T01:56:05.890547445Z [2024-03-29T01:56:05.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status success for try_number 1 2024-03-29T01:56:05.890569464Z [2024-03-29T01:56:05.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status success for try_number 1 2024-03-29T01:56:05.897495523Z [2024-03-29T01:56:05.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:55:00+00:00, map_index=-1, run_start_date=2024-03-29 01:56:03.745326+00:00, run_end_date=2024-03-29 01:56:05.291916+00:00, run_duration=1.54659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:56:00.810750+00:00, queued_by_job_id=2, pid=9396 2024-03-29T01:56:05.897621589Z [2024-03-29T01:56:05.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:55:00+00:00, map_index=-1, run_start_date=2024-03-29 01:56:03.130301+00:00, run_end_date=2024-03-29 01:56:05.358953+00:00, run_duration=2.228652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:56:00.810750+00:00, queued_by_job_id=2, pid=9385 2024-03-29T01:57:00.439359754Z [2024-03-29T01:57:00.438+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:57:00.456067863Z [2024-03-29T01:57:00.455+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:57:00+00:00, run_after=2024-03-29T01:58:00+00:00 2024-03-29T01:57:00.472793566Z [2024-03-29T01:57:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:57:00+00:00, run_after=2024-03-29T01:58:00+00:00 2024-03-29T01:57:00.547842148Z [2024-03-29T01:57:00.547+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:57:00.547906531Z 2024-03-29T01:57:00.547912605Z 2024-03-29T01:57:00.547936722Z 2024-03-29T01:57:00.547969890Z [2024-03-29T01:57:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:57:00.547996282Z [2024-03-29T01:57:00.547+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:57:00.548070384Z [2024-03-29T01:57:00.547+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:57:00.548760726Z [2024-03-29T01:57:00.548+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:57:00.548776902Z 2024-03-29T01:57:00.548781150Z 2024-03-29T01:57:00.548784398Z 2024-03-29T01:57:00.552799272Z [2024-03-29T01:57:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:57:00.552876191Z [2024-03-29T01:57:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:57:00.553150344Z [2024-03-29T01:57:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:57:00.553335243Z [2024-03-29T01:57:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:57:00.553612030Z [2024-03-29T01:57:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:57:00.553773243Z [2024-03-29T01:57:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:57:00.788536694Z [2024-03-29T01:57:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status queued for try_number 1 2024-03-29T01:57:00.788633811Z [2024-03-29T01:57:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status queued for try_number 1 2024-03-29T01:57:00.788805445Z [2024-03-29T01:57:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status queued for try_number 1 2024-03-29T01:57:00.803110889Z [2024-03-29T01:57:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cae7e8a-29cb-4b80-825b-5cf574b1faf7 2024-03-29T01:57:00.803178967Z [2024-03-29T01:57:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56597767-ef5e-4887-93cd-e925cbe4ce07 2024-03-29T01:57:00.803319649Z [2024-03-29T01:57:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to 217f5ae1-5144-4e5a-abb7-679d4136b831 2024-03-29T01:57:03.247035534Z [2024-03-29T01:57:03.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:57:03.247543170Z [2024-03-29T01:57:03.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:56:00+00:00, run_id=scheduled__2024-03-29T01:56:00+00:00, run_start_date=2024-03-29 01:57:00.484474+00:00, run_end_date=2024-03-29 01:57:03.247123+00:00, run_duration=2.762649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:56:00+00:00, data_interval_end=2024-03-29 01:57:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:57:03.259697067Z [2024-03-29T01:57:03.259+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:57:00+00:00, run_after=2024-03-29T01:58:00+00:00 2024-03-29T01:57:03.313336413Z [2024-03-29T01:57:03.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status success for try_number 1 2024-03-29T01:57:03.319802425Z [2024-03-29T01:57:03.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:56:00+00:00, map_index=-1, run_start_date=2024-03-29 01:57:01.590804+00:00, run_end_date=2024-03-29 01:57:02.123242+00:00, run_duration=0.532438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:57:00.549900+00:00, queued_by_job_id=2, pid=9424 2024-03-29T01:57:05.123039520Z [2024-03-29T01:57:05.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:57:05.123356905Z [2024-03-29T01:57:05.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:56:00+00:00, run_id=scheduled__2024-03-29T01:56:00+00:00, run_start_date=2024-03-29 01:57:00.486107+00:00, run_end_date=2024-03-29 01:57:05.122942+00:00, run_duration=4.636835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:56:00+00:00, data_interval_end=2024-03-29 01:57:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:57:05.132726299Z [2024-03-29T01:57:05.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:57:00+00:00, run_after=2024-03-29T01:58:00+00:00 2024-03-29T01:57:05.152566387Z [2024-03-29T01:57:05.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:57:05.152859619Z [2024-03-29T01:57:05.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:56:00+00:00, run_id=scheduled__2024-03-29T01:56:00+00:00, run_start_date=2024-03-29 01:57:00.487583+00:00, run_end_date=2024-03-29 01:57:05.152468+00:00, run_duration=4.664885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:56:00+00:00, data_interval_end=2024-03-29 01:57:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:57:05.191956159Z [2024-03-29T01:57:05.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:57:00+00:00, run_after=2024-03-29T01:58:00+00:00 2024-03-29T01:57:05.222875643Z [2024-03-29T01:57:05.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status success for try_number 1 2024-03-29T01:57:05.223123773Z [2024-03-29T01:57:05.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status success for try_number 1 2024-03-29T01:57:05.229456421Z [2024-03-29T01:57:05.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:56:00+00:00, map_index=-1, run_start_date=2024-03-29 01:57:02.594913+00:00, run_end_date=2024-03-29 01:57:04.769857+00:00, run_duration=2.174944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:57:00.549900+00:00, queued_by_job_id=2, pid=9442 2024-03-29T01:57:05.229697692Z [2024-03-29T01:57:05.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:56:00+00:00, map_index=-1, run_start_date=2024-03-29 01:57:02.829265+00:00, run_end_date=2024-03-29 01:57:04.470574+00:00, run_duration=1.641309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:57:00.549900+00:00, queued_by_job_id=2, pid=9443 2024-03-29T01:58:00.248275651Z [2024-03-29T01:58:00.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:58:00+00:00, run_after=2024-03-29T01:59:00+00:00 2024-03-29T01:58:00.256466549Z [2024-03-29T01:58:00.256+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:58:00.271872732Z [2024-03-29T01:58:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:58:00+00:00, run_after=2024-03-29T01:59:00+00:00 2024-03-29T01:58:00.280354996Z [2024-03-29T01:58:00.280+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:58:00.410867255Z [2024-03-29T01:58:00.410+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T01:58:00.410899600Z 2024-03-29T01:58:00.410908855Z 2024-03-29T01:58:00.410915088Z 2024-03-29T01:58:00.410920592Z 2024-03-29T01:58:00.411280407Z [2024-03-29T01:58:00.410+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T01:58:00.411581809Z [2024-03-29T01:58:00.411+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:58:00.411908544Z [2024-03-29T01:58:00.411+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:58:00.412223643Z [2024-03-29T01:58:00.411+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:58:00.413330339Z [2024-03-29T01:58:00.413+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:58:00.413381148Z 2024-03-29T01:58:00.413390735Z 2024-03-29T01:58:00.413426099Z 2024-03-29T01:58:00.413433484Z 2024-03-29T01:58:00.419629548Z [2024-03-29T01:58:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:58:00.419865424Z [2024-03-29T01:58:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T01:58:00.420251610Z [2024-03-29T01:58:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:58:00.420445142Z [2024-03-29T01:58:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:58:00.420834003Z [2024-03-29T01:58:00.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:58:00.421051208Z [2024-03-29T01:58:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:58:00.421401140Z [2024-03-29T01:58:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:58:00.421602956Z [2024-03-29T01:58:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:58:01.064640111Z [2024-03-29T01:58:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status queued for try_number 1 2024-03-29T01:58:01.065633894Z [2024-03-29T01:58:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:57:00+00:00 exited with status queued for try_number 1 2024-03-29T01:58:01.065956327Z [2024-03-29T01:58:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:57:00+00:00 exited with status queued for try_number 1 2024-03-29T01:58:01.065969979Z [2024-03-29T01:58:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:57:00+00:00 exited with status queued for try_number 1 2024-03-29T01:58:01.078570732Z [2024-03-29T01:58:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2acf8599-1b8c-4ed1-afde-56f28c9a47e0 2024-03-29T01:58:01.078759923Z [2024-03-29T01:58:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to f50bf23e-1e3a-400d-bc9c-3dff7a0089ae 2024-03-29T01:58:01.079411157Z [2024-03-29T01:58:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92f4b843-99e7-48b9-b197-ca5e1e37f159 2024-03-29T01:58:01.079764705Z [2024-03-29T01:58:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 171f9b64-a13f-493d-8715-32c614c9c761 2024-03-29T01:58:02.330781786Z [2024-03-29T01:58:02.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:58:02.331205214Z [2024-03-29T01:58:02.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:56:00+00:00, run_id=scheduled__2024-03-29T01:56:00+00:00, run_start_date=2024-03-29 01:58:00.293665+00:00, run_end_date=2024-03-29 01:58:02.330657+00:00, run_duration=2.036992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:56:00+00:00, data_interval_end=2024-03-29 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T01:58:02.351177451Z [2024-03-29T01:58:02.350+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T01:58:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:58:02.369676558Z [2024-03-29T01:58:02.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:58:02.370846329Z [2024-03-29T01:58:02.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:57:00+00:00, run_id=scheduled__2024-03-29T01:57:00+00:00, run_start_date=2024-03-29 01:58:00.295187+00:00, run_end_date=2024-03-29 01:58:02.369622+00:00, run_duration=2.074435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:57:00+00:00, data_interval_end=2024-03-29 01:58:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:58:02.428156102Z [2024-03-29T01:58:02.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:58:00+00:00, run_after=2024-03-29T01:59:00+00:00 2024-03-29T01:58:02.516524048Z [2024-03-29T01:58:02.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:56:00+00:00 exited with status success for try_number 1 2024-03-29T01:58:02.516617060Z [2024-03-29T01:58:02.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:57:00+00:00 exited with status success for try_number 1 2024-03-29T01:58:02.533051479Z [2024-03-29T01:58:02.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:57:00+00:00, map_index=-1, run_start_date=2024-03-29 01:58:01.327923+00:00, run_end_date=2024-03-29 01:58:01.815326+00:00, run_duration=0.487403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:58:00.414654+00:00, queued_by_job_id=2, pid=9476 2024-03-29T01:58:02.533419727Z [2024-03-29T01:58:02.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:56:00+00:00, map_index=-1, run_start_date=2024-03-29 01:58:01.370224+00:00, run_end_date=2024-03-29 01:58:01.776320+00:00, run_duration=0.406096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:58:00.414654+00:00, queued_by_job_id=2, pid=9477 2024-03-29T01:58:04.268715704Z [2024-03-29T01:58:04.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:58:04.268769431Z [2024-03-29T01:58:04.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:57:00+00:00, run_id=scheduled__2024-03-29T01:57:00+00:00, run_start_date=2024-03-29 01:58:00.296747+00:00, run_end_date=2024-03-29 01:58:04.268210+00:00, run_duration=3.971463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:57:00+00:00, data_interval_end=2024-03-29 01:58:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:58:04.280412165Z [2024-03-29T01:58:04.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:58:00+00:00, run_after=2024-03-29T01:59:00+00:00 2024-03-29T01:58:04.317971704Z [2024-03-29T01:58:04.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:57:00+00:00 exited with status success for try_number 1 2024-03-29T01:58:04.325950407Z [2024-03-29T01:58:04.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:57:00+00:00, map_index=-1, run_start_date=2024-03-29 01:58:02.394798+00:00, run_end_date=2024-03-29 01:58:03.749595+00:00, run_duration=1.354797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:58:00.414654+00:00, queued_by_job_id=2, pid=9500 2024-03-29T01:58:04.406932400Z [2024-03-29T01:58:04.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:58:04.407539432Z [2024-03-29T01:58:04.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:57:00+00:00, run_id=scheduled__2024-03-29T01:57:00+00:00, run_start_date=2024-03-29 01:58:00.297950+00:00, run_end_date=2024-03-29 01:58:04.406792+00:00, run_duration=4.108842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:57:00+00:00, data_interval_end=2024-03-29 01:58:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:58:04.426436432Z [2024-03-29T01:58:04.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:58:00+00:00, run_after=2024-03-29T01:59:00+00:00 2024-03-29T01:58:04.461107580Z [2024-03-29T01:58:04.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:57:00+00:00 exited with status success for try_number 1 2024-03-29T01:58:04.467600060Z [2024-03-29T01:58:04.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:57:00+00:00, map_index=-1, run_start_date=2024-03-29 01:58:02.587620+00:00, run_end_date=2024-03-29 01:58:04.241566+00:00, run_duration=1.653946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:58:00.414654+00:00, queued_by_job_id=2, pid=9501 2024-03-29T01:58:45.829687313Z [2024-03-29T01:58:45.828+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T01:59:00.181868749Z [2024-03-29T01:59:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:59:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:59:00.198182774Z [2024-03-29T01:59:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:59:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:59:00.206588238Z [2024-03-29T01:59:00.206+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T01:59:00.274891889Z [2024-03-29T01:59:00.274+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T01:59:00.274919875Z 2024-03-29T01:59:00.274923516Z 2024-03-29T01:59:00.274926681Z 2024-03-29T01:59:00.274936673Z [2024-03-29T01:59:00.274+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:59:00.275087271Z [2024-03-29T01:59:00.274+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T01:59:00.275244475Z [2024-03-29T01:59:00.275+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T01:59:00.276101784Z [2024-03-29T01:59:00.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T01:59:00.276107119Z 2024-03-29T01:59:00.276110547Z 2024-03-29T01:59:00.276113793Z 2024-03-29T01:59:00.280845226Z [2024-03-29T01:59:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:59:00.280953186Z [2024-03-29T01:59:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T01:59:00.281288882Z [2024-03-29T01:59:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:59:00.281438828Z [2024-03-29T01:59:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T01:59:00.281760163Z [2024-03-29T01:59:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T01:59:00.281906579Z [2024-03-29T01:59:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T01:59:00.554956617Z [2024-03-29T01:59:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status queued for try_number 1 2024-03-29T01:59:00.555192223Z [2024-03-29T01:59:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status queued for try_number 1 2024-03-29T01:59:00.555289102Z [2024-03-29T01:59:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status queued for try_number 1 2024-03-29T01:59:00.570436683Z [2024-03-29T01:59:00.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51eeea45-4930-440d-bb06-6b02c7a0df2e 2024-03-29T01:59:00.570795282Z [2024-03-29T01:59:00.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bde732c-4aa5-4695-9b3b-d45c54288144 2024-03-29T01:59:00.570934720Z [2024-03-29T01:59:00.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c0e22fe-7d0c-4921-a4c0-d6aaccb15d4a 2024-03-29T01:59:01.883483845Z [2024-03-29T01:59:01.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:59:01.883903774Z [2024-03-29T01:59:01.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:58:00+00:00, run_id=scheduled__2024-03-29T01:58:00+00:00, run_start_date=2024-03-29 01:59:00.216774+00:00, run_end_date=2024-03-29 01:59:01.883515+00:00, run_duration=1.666741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:58:00+00:00, data_interval_end=2024-03-29 01:59:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T01:59:01.896525712Z [2024-03-29T01:59:01.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T01:59:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:59:01.959656243Z [2024-03-29T01:59:01.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status success for try_number 1 2024-03-29T01:59:01.968233238Z [2024-03-29T01:59:01.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:58:00+00:00, map_index=-1, run_start_date=2024-03-29 01:59:01.135029+00:00, run_end_date=2024-03-29 01:59:01.548490+00:00, run_duration=0.413461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:59:00.277410+00:00, queued_by_job_id=2, pid=9533 2024-03-29T01:59:04.137882674Z [2024-03-29T01:59:04.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:59:04.139166429Z [2024-03-29T01:59:04.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:58:00+00:00, run_id=scheduled__2024-03-29T01:58:00+00:00, run_start_date=2024-03-29 01:59:00.217918+00:00, run_end_date=2024-03-29 01:59:04.137661+00:00, run_duration=3.919743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:58:00+00:00, data_interval_end=2024-03-29 01:59:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T01:59:04.151181761Z [2024-03-29T01:59:04.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:59:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:59:04.183528699Z [2024-03-29T01:59:04.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status success for try_number 1 2024-03-29T01:59:04.193043207Z [2024-03-29T01:59:04.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:58:00+00:00, map_index=-1, run_start_date=2024-03-29 01:59:02.292618+00:00, run_end_date=2024-03-29 01:59:03.532074+00:00, run_duration=1.239456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:59:00.277410+00:00, queued_by_job_id=2, pid=9551 2024-03-29T01:59:04.832765077Z [2024-03-29T01:59:04.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T01:59:04.833466115Z [2024-03-29T01:59:04.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:58:00+00:00, run_id=scheduled__2024-03-29T01:58:00+00:00, run_start_date=2024-03-29 01:59:00.218953+00:00, run_end_date=2024-03-29 01:59:04.832915+00:00, run_duration=4.613962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:58:00+00:00, data_interval_end=2024-03-29 01:59:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T01:59:04.851272409Z [2024-03-29T01:59:04.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T01:59:00+00:00, run_after=2024-03-29T02:00:00+00:00 2024-03-29T01:59:04.919503804Z [2024-03-29T01:59:04.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status success for try_number 1 2024-03-29T01:59:04.926562895Z [2024-03-29T01:59:04.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:58:00+00:00, map_index=-1, run_start_date=2024-03-29 01:59:02.446719+00:00, run_end_date=2024-03-29 01:59:04.116224+00:00, run_duration=1.669505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 01:59:00.277410+00:00, queued_by_job_id=2, pid=9552 2024-03-29T02:00:00.647190585Z [2024-03-29T02:00:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:01:00+00:00 2024-03-29T02:00:00.654506597Z [2024-03-29T02:00:00.654+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:00:00.668002736Z [2024-03-29T02:00:00.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:01:00+00:00 2024-03-29T02:00:00.681069357Z [2024-03-29T02:00:00.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:05:00+00:00 2024-03-29T02:00:00.689685806Z [2024-03-29T02:00:00.689+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:00:00.796292991Z [2024-03-29T02:00:00.795+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T02:00:00.796318150Z 2024-03-29T02:00:00.796322017Z 2024-03-29T02:00:00.796325803Z 2024-03-29T02:00:00.796328983Z 2024-03-29T02:00:00.796332479Z 2024-03-29T02:00:00.796363368Z [2024-03-29T02:00:00.796+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:00:00.796488586Z [2024-03-29T02:00:00.796+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:00:00.796629105Z [2024-03-29T02:00:00.796+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:00:00.796778658Z [2024-03-29T02:00:00.796+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:00:00.796873926Z [2024-03-29T02:00:00.796+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:00:00.797441630Z [2024-03-29T02:00:00.797+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:00:00.797455915Z 2024-03-29T02:00:00.797462773Z 2024-03-29T02:00:00.797468660Z 2024-03-29T02:00:00.797473898Z 2024-03-29T02:00:00.797479475Z 2024-03-29T02:00:00.803111920Z [2024-03-29T02:00:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:00:00.803457909Z [2024-03-29T02:00:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:00:00.804025707Z [2024-03-29T02:00:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:00:00.804334944Z [2024-03-29T02:00:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:00:00.804876278Z [2024-03-29T02:00:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:00:00.805297215Z [2024-03-29T02:00:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:00:00.805782356Z [2024-03-29T02:00:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:00:00.806059268Z [2024-03-29T02:00:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:00:00.806890055Z [2024-03-29T02:00:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:00:00.807331016Z [2024-03-29T02:00:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:00:01.408126668Z [2024-03-29T02:00:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:01.410721267Z [2024-03-29T02:00:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:01.410946282Z [2024-03-29T02:00:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:59:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:01.411096561Z [2024-03-29T02:00:01.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:59:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:01.411256207Z [2024-03-29T02:00:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:59:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:01.428134288Z [2024-03-29T02:00:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc627ca9-7606-45c4-b8fd-bb73d65b1413 2024-03-29T02:00:01.428618549Z [2024-03-29T02:00:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to c433da24-18b8-4cc8-bef4-23c7e0ed15ea 2024-03-29T02:00:01.428853102Z [2024-03-29T02:00:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a04ffe4-5dd8-4ba1-8948-6609d59a9d03 2024-03-29T02:00:01.429039737Z [2024-03-29T02:00:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eadd428-8f30-4f58-83d4-53807801c72d 2024-03-29T02:00:01.429233028Z [2024-03-29T02:00:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1e000fd-b0bf-46f1-aceb-2c60a884cb86 2024-03-29T02:00:02.914971995Z [2024-03-29T02:00:02.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:00:02.917455040Z [2024-03-29T02:00:02.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 01:58:00+00:00, run_id=scheduled__2024-03-29T01:58:00+00:00, run_start_date=2024-03-29 02:00:00.701340+00:00, run_end_date=2024-03-29 02:00:02.914872+00:00, run_duration=2.213532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:58:00+00:00, data_interval_end=2024-03-29 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:00:02.933304474Z [2024-03-29T02:00:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:02:00+00:00 2024-03-29T02:00:02.944439215Z [2024-03-29T02:00:02.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:00:02.944741900Z [2024-03-29T02:00:02.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 01:59:00+00:00, run_id=scheduled__2024-03-29T01:59:00+00:00, run_start_date=2024-03-29 02:00:00.702321+00:00, run_end_date=2024-03-29 02:00:02.944335+00:00, run_duration=2.242014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:59:00+00:00, data_interval_end=2024-03-29 02:00:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:00:02.963788600Z [2024-03-29T02:00:02.963+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:01:00+00:00 2024-03-29T02:00:03.053208517Z [2024-03-29T02:00:03.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:59:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:03.062627315Z [2024-03-29T02:00:03.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:59:00+00:00, map_index=-1, run_start_date=2024-03-29 02:00:02.097724+00:00, run_end_date=2024-03-29 02:00:02.683150+00:00, run_duration=0.585426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:00.798353+00:00, queued_by_job_id=2, pid=9587 2024-03-29T02:00:04.271525754Z [2024-03-29T02:00:04.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T01:58:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:04.283498069Z [2024-03-29T02:00:04.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T01:58:00+00:00, map_index=-1, run_start_date=2024-03-29 02:00:02.076763+00:00, run_end_date=2024-03-29 02:00:02.852554+00:00, run_duration=0.775791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:00.798353+00:00, queued_by_job_id=2, pid=9586 2024-03-29T02:00:05.373440365Z [2024-03-29T02:00:05.373+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:00:05.373468621Z 2024-03-29T02:00:05.373528224Z [2024-03-29T02:00:05.373+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:00:05.374035917Z [2024-03-29T02:00:05.373+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:00:05.374060242Z 2024-03-29T02:00:05.380608162Z [2024-03-29T02:00:05.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:00:05.380648729Z [2024-03-29T02:00:05.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:00:05.476087041Z [2024-03-29T02:00:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:05.479730553Z [2024-03-29T02:00:05.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:05.496354062Z [2024-03-29T02:00:05.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab41fd80-1f8e-4cad-8b45-20829e17d8ac 2024-03-29T02:00:05.496890034Z [2024-03-29T02:00:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T01:55:00+00:00, map_index=-1, run_start_date=2024-03-29 02:00:03.969661+00:00, run_end_date=2024-03-29 02:00:04.495788+00:00, run_duration=0.526127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:00.798353+00:00, queued_by_job_id=2, pid=9617 2024-03-29T02:00:05.584773767Z [2024-03-29T02:00:05.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:00:05.585345420Z [2024-03-29T02:00:05.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:59:00+00:00, run_id=scheduled__2024-03-29T01:59:00+00:00, run_start_date=2024-03-29 02:00:00.703327+00:00, run_end_date=2024-03-29 02:00:05.584664+00:00, run_duration=4.881337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:59:00+00:00, data_interval_end=2024-03-29 02:00:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:00:05.602138283Z [2024-03-29T02:00:05.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:01:00+00:00 2024-03-29T02:00:05.791723337Z [2024-03-29T02:00:05.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:59:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:05.812847825Z [2024-03-29T02:00:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:59:00+00:00, map_index=-1, run_start_date=2024-03-29 02:00:04.073993+00:00, run_end_date=2024-03-29 02:00:05.358160+00:00, run_duration=1.284167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:00.798353+00:00, queued_by_job_id=2, pid=9618 2024-03-29T02:00:06.833982961Z [2024-03-29T02:00:06.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:00:06.834586794Z [2024-03-29T02:00:06.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:59:00+00:00, run_id=scheduled__2024-03-29T01:59:00+00:00, run_start_date=2024-03-29 02:00:00.704255+00:00, run_end_date=2024-03-29 02:00:06.833881+00:00, run_duration=6.129626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:59:00+00:00, data_interval_end=2024-03-29 02:00:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:00:06.848770986Z [2024-03-29T02:00:06.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:01:00+00:00 2024-03-29T02:00:06.899700682Z [2024-03-29T02:00:06.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T01:59:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:06.905290712Z [2024-03-29T02:00:06.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T01:59:00+00:00, map_index=-1, run_start_date=2024-03-29 02:00:03.803751+00:00, run_end_date=2024-03-29 02:00:06.243297+00:00, run_duration=2.439546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:00.798353+00:00, queued_by_job_id=2, pid=9611 2024-03-29T02:00:09.180001755Z [2024-03-29T02:00:09.179+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:00:09.180033178Z 2024-03-29T02:00:09.180134423Z [2024-03-29T02:00:09.179+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:00:09.181491084Z [2024-03-29T02:00:09.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:00:09.181505446Z 2024-03-29T02:00:09.184634386Z [2024-03-29T02:00:09.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:00:09.184787634Z [2024-03-29T02:00:09.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:00:09.236641877Z [2024-03-29T02:00:09.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:09.236739983Z [2024-03-29T02:00:09.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:09.242686663Z [2024-03-29T02:00:09.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fd7fab7-7597-436b-9fd3-e8ff04dbff0d 2024-03-29T02:00:09.242777728Z [2024-03-29T02:00:09.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T01:55:00+00:00, map_index=-1, run_start_date=2024-03-29 02:00:07.719986+00:00, run_end_date=2024-03-29 02:00:08.140936+00:00, run_duration=0.42095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:05.374367+00:00, queued_by_job_id=2, pid=9641 2024-03-29T02:00:11.489134897Z [2024-03-29T02:00:11.488+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:00:11.489175681Z 2024-03-29T02:00:11.489336808Z [2024-03-29T02:00:11.489+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:00:11.490003914Z [2024-03-29T02:00:11.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:00:11.490018824Z 2024-03-29T02:00:11.493002298Z [2024-03-29T02:00:11.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:00:11.493289626Z [2024-03-29T02:00:11.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:00:11.543168314Z [2024-03-29T02:00:11.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status queued for try_number 1 2024-03-29T02:00:11.544115157Z [2024-03-29T02:00:11.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:11.550975035Z [2024-03-29T02:00:11.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 956776e1-898b-4bfa-9bc3-4b90def3782b 2024-03-29T02:00:11.551378996Z [2024-03-29T02:00:11.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T01:55:00+00:00, map_index=0, run_start_date=2024-03-29 02:00:10.831182+00:00, run_end_date=2024-03-29 02:00:11.146110+00:00, run_duration=0.314928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:09.181941+00:00, queued_by_job_id=2, pid=9649 2024-03-29T02:00:13.636401381Z [2024-03-29T02:00:13.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:00:13.636692548Z [2024-03-29T02:00:13.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 01:55:00+00:00, run_id=scheduled__2024-03-29T01:55:00+00:00, run_start_date=2024-03-29 02:00:00.700048+00:00, run_end_date=2024-03-29 02:00:13.636229+00:00, run_duration=12.936181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 01:55:00+00:00, data_interval_end=2024-03-29 02:00:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:00:13.646261099Z [2024-03-29T02:00:13.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:00:00+00:00, run_after=2024-03-29T02:05:00+00:00 2024-03-29T02:00:13.681033107Z [2024-03-29T02:00:13.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T01:55:00+00:00 exited with status success for try_number 1 2024-03-29T02:00:13.685814373Z [2024-03-29T02:00:13.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T01:55:00+00:00, map_index=-1, run_start_date=2024-03-29 02:00:13.146878+00:00, run_end_date=2024-03-29 02:00:13.501074+00:00, run_duration=0.354196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:00:11.490672+00:00, queued_by_job_id=2, pid=9657 2024-03-29T02:01:00.875775120Z [2024-03-29T02:01:00.875+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:01:00.891430116Z [2024-03-29T02:01:00.891+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:01:00+00:00, run_after=2024-03-29T02:02:00+00:00 2024-03-29T02:01:00.909054303Z [2024-03-29T02:01:00.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:01:00+00:00, run_after=2024-03-29T02:02:00+00:00 2024-03-29T02:01:00.986613547Z [2024-03-29T02:01:00.986+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:01:00.986647092Z 2024-03-29T02:01:00.986653402Z 2024-03-29T02:01:00.986682854Z 2024-03-29T02:01:00.986964433Z [2024-03-29T02:01:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:01:00.987374124Z [2024-03-29T02:01:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:01:00.987663663Z [2024-03-29T02:01:00.987+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:01:00.988567379Z [2024-03-29T02:01:00.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:01:00.988581725Z 2024-03-29T02:01:00.988587353Z 2024-03-29T02:01:00.988591786Z 2024-03-29T02:01:00.992958608Z [2024-03-29T02:01:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:01:00.993047041Z [2024-03-29T02:01:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:01:00.993413662Z [2024-03-29T02:01:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:01:00.993810771Z [2024-03-29T02:01:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:01:00.994287254Z [2024-03-29T02:01:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:01:00.994604980Z [2024-03-29T02:01:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:01:01.235415434Z [2024-03-29T02:01:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:01:01.235528793Z [2024-03-29T02:01:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:01:01.235656170Z [2024-03-29T02:01:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:01:01.245031638Z [2024-03-29T02:01:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fb68b50-9881-4246-b819-d6c9d46f11bf 2024-03-29T02:01:01.245183400Z [2024-03-29T02:01:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 290791f0-2b8f-4494-bf4d-54156d0820b8 2024-03-29T02:01:01.245346511Z [2024-03-29T02:01:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1faab38a-f600-4ec9-8b1f-4a0420d0d1ba 2024-03-29T02:01:02.421159903Z [2024-03-29T02:01:02.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:01:02.421689958Z [2024-03-29T02:01:02.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:00:00+00:00, run_id=scheduled__2024-03-29T02:00:00+00:00, run_start_date=2024-03-29 02:01:00.920736+00:00, run_end_date=2024-03-29 02:01:02.421048+00:00, run_duration=1.500312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:00:00+00:00, data_interval_end=2024-03-29 02:01:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:01:02.431995888Z [2024-03-29T02:01:02.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:01:00+00:00, run_after=2024-03-29T02:02:00+00:00 2024-03-29T02:01:02.644952661Z [2024-03-29T02:01:02.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:01:02.651169417Z [2024-03-29T02:01:02.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=-1, run_start_date=2024-03-29 02:01:01.905044+00:00, run_end_date=2024-03-29 02:01:02.375908+00:00, run_duration=0.470864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:01:00.989456+00:00, queued_by_job_id=2, pid=9679 2024-03-29T02:01:04.850844572Z [2024-03-29T02:01:04.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:01:04.851404135Z [2024-03-29T02:01:04.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:00:00+00:00, run_id=scheduled__2024-03-29T02:00:00+00:00, run_start_date=2024-03-29 02:01:00.922225+00:00, run_end_date=2024-03-29 02:01:04.850777+00:00, run_duration=3.928552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:00:00+00:00, data_interval_end=2024-03-29 02:01:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:01:04.875569780Z [2024-03-29T02:01:04.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:01:00+00:00, run_after=2024-03-29T02:02:00+00:00 2024-03-29T02:01:04.933436501Z [2024-03-29T02:01:04.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:01:04.941008152Z [2024-03-29T02:01:04.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=-1, run_start_date=2024-03-29 02:01:03.055459+00:00, run_end_date=2024-03-29 02:01:04.415953+00:00, run_duration=1.360494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:01:00.989456+00:00, queued_by_job_id=2, pid=9697 2024-03-29T02:01:05.847415264Z [2024-03-29T02:01:05.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:01:05.848482871Z [2024-03-29T02:01:05.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:00:00+00:00, run_id=scheduled__2024-03-29T02:00:00+00:00, run_start_date=2024-03-29 02:01:00.923550+00:00, run_end_date=2024-03-29 02:01:05.847370+00:00, run_duration=4.92382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:00:00+00:00, data_interval_end=2024-03-29 02:01:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:01:05.858530406Z [2024-03-29T02:01:05.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:01:00+00:00, run_after=2024-03-29T02:02:00+00:00 2024-03-29T02:01:06.984147448Z [2024-03-29T02:01:06.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:01:06.990300337Z [2024-03-29T02:01:06.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=-1, run_start_date=2024-03-29 02:01:03.305997+00:00, run_end_date=2024-03-29 02:01:05.648680+00:00, run_duration=2.342683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:01:00.989456+00:00, queued_by_job_id=2, pid=9698 2024-03-29T02:02:00.448892668Z [2024-03-29T02:02:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:02:00+00:00, run_after=2024-03-29T02:03:00+00:00 2024-03-29T02:02:00.465797509Z [2024-03-29T02:02:00.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:02:00+00:00, run_after=2024-03-29T02:03:00+00:00 2024-03-29T02:02:00.476005455Z [2024-03-29T02:02:00.475+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:02:00.483379736Z [2024-03-29T02:02:00.483+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:02:00.577671072Z [2024-03-29T02:02:00.576+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:02:00.577711387Z 2024-03-29T02:02:00.577721143Z 2024-03-29T02:02:00.577729862Z 2024-03-29T02:02:00.577737901Z 2024-03-29T02:02:00.578132444Z [2024-03-29T02:02:00.577+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:02:00.578481499Z [2024-03-29T02:02:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:02:00.578772503Z [2024-03-29T02:02:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:02:00.579023867Z [2024-03-29T02:02:00.578+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:02:00.580593350Z [2024-03-29T02:02:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:02:00.580619369Z 2024-03-29T02:02:00.580630190Z 2024-03-29T02:02:00.580639082Z 2024-03-29T02:02:00.580647500Z 2024-03-29T02:02:00.588429727Z [2024-03-29T02:02:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:02:00.589143924Z [2024-03-29T02:02:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:02:00.589983577Z [2024-03-29T02:02:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:02:00.590468106Z [2024-03-29T02:02:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:02:00.590850024Z [2024-03-29T02:02:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:02:00.591176094Z [2024-03-29T02:02:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:02:00.591803057Z [2024-03-29T02:02:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:02:00.592109102Z [2024-03-29T02:02:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:02:00.942086673Z [2024-03-29T02:02:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:02:00.942348674Z [2024-03-29T02:02:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:01:00+00:00 exited with status queued for try_number 1 2024-03-29T02:02:00.942629891Z [2024-03-29T02:02:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:01:00+00:00 exited with status queued for try_number 1 2024-03-29T02:02:00.942826791Z [2024-03-29T02:02:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:01:00+00:00 exited with status queued for try_number 1 2024-03-29T02:02:00.959925222Z [2024-03-29T02:02:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6615bdf-9b2c-4320-a1d0-2f73ea4b7431 2024-03-29T02:02:00.963010419Z [2024-03-29T02:02:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ed25603-9780-4e9e-bee2-85a8ca0ed3e8 2024-03-29T02:02:00.966988575Z [2024-03-29T02:02:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 434cba05-666f-4e20-95f9-e71720e4826b 2024-03-29T02:02:00.967203650Z [2024-03-29T02:02:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05c82169-4008-4811-9354-72185419f23d 2024-03-29T02:02:02.272787318Z [2024-03-29T02:02:02.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:02:02.275299261Z [2024-03-29T02:02:02.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:00:00+00:00, run_id=scheduled__2024-03-29T02:00:00+00:00, run_start_date=2024-03-29 02:02:00.494553+00:00, run_end_date=2024-03-29 02:02:02.274656+00:00, run_duration=1.780103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:00:00+00:00, data_interval_end=2024-03-29 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:02:02.291850630Z [2024-03-29T02:02:02.291+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:02:00+00:00, run_after=2024-03-29T02:04:00+00:00 2024-03-29T02:02:03.404998250Z [2024-03-29T02:02:03.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:02:03.405415323Z [2024-03-29T02:02:03.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:01:00+00:00, run_id=scheduled__2024-03-29T02:01:00+00:00, run_start_date=2024-03-29 02:02:00.496021+00:00, run_end_date=2024-03-29 02:02:03.405083+00:00, run_duration=2.909062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:01:00+00:00, data_interval_end=2024-03-29 02:02:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:02:03.415704447Z [2024-03-29T02:02:03.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:02:00+00:00, run_after=2024-03-29T02:03:00+00:00 2024-03-29T02:02:03.469486329Z [2024-03-29T02:02:03.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:02:03.469691398Z [2024-03-29T02:02:03.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:01:00+00:00 exited with status success for try_number 1 2024-03-29T02:02:03.476980029Z [2024-03-29T02:02:03.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=-1, run_start_date=2024-03-29 02:02:01.556125+00:00, run_end_date=2024-03-29 02:02:02.132258+00:00, run_duration=0.576133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:02:00.582623+00:00, queued_by_job_id=2, pid=9730 2024-03-29T02:02:03.477301519Z [2024-03-29T02:02:03.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:01:00+00:00, map_index=-1, run_start_date=2024-03-29 02:02:01.871306+00:00, run_end_date=2024-03-29 02:02:02.446828+00:00, run_duration=0.575522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:02:00.582623+00:00, queued_by_job_id=2, pid=9731 2024-03-29T02:02:05.611086940Z [2024-03-29T02:02:05.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:02:05.611312037Z [2024-03-29T02:02:05.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:01:00+00:00, run_id=scheduled__2024-03-29T02:01:00+00:00, run_start_date=2024-03-29 02:02:00.498191+00:00, run_end_date=2024-03-29 02:02:05.611001+00:00, run_duration=5.11281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:01:00+00:00, data_interval_end=2024-03-29 02:02:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:02:05.627883319Z [2024-03-29T02:02:05.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:02:00+00:00, run_after=2024-03-29T02:03:00+00:00 2024-03-29T02:02:05.644327907Z [2024-03-29T02:02:05.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:02:05.644413265Z [2024-03-29T02:02:05.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:01:00+00:00, run_id=scheduled__2024-03-29T02:01:00+00:00, run_start_date=2024-03-29 02:02:00.497105+00:00, run_end_date=2024-03-29 02:02:05.643867+00:00, run_duration=5.146762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:01:00+00:00, data_interval_end=2024-03-29 02:02:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:02:05.653530101Z [2024-03-29T02:02:05.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:02:00+00:00, run_after=2024-03-29T02:03:00+00:00 2024-03-29T02:02:05.707016460Z [2024-03-29T02:02:05.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:01:00+00:00 exited with status success for try_number 1 2024-03-29T02:02:05.707109425Z [2024-03-29T02:02:05.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:01:00+00:00 exited with status success for try_number 1 2024-03-29T02:02:05.715505305Z [2024-03-29T02:02:05.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:01:00+00:00, map_index=-1, run_start_date=2024-03-29 02:02:03.304748+00:00, run_end_date=2024-03-29 02:02:04.635508+00:00, run_duration=1.33076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:02:00.582623+00:00, queued_by_job_id=2, pid=9755 2024-03-29T02:02:05.715628923Z [2024-03-29T02:02:05.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:01:00+00:00, map_index=-1, run_start_date=2024-03-29 02:02:03.224271+00:00, run_end_date=2024-03-29 02:02:04.967193+00:00, run_duration=1.742922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:02:00.582623+00:00, queued_by_job_id=2, pid=9754 2024-03-29T02:03:00.241639561Z [2024-03-29T02:03:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:03:00+00:00, run_after=2024-03-29T02:04:00+00:00 2024-03-29T02:03:00.257880631Z [2024-03-29T02:03:00.257+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:03:00+00:00, run_after=2024-03-29T02:04:00+00:00 2024-03-29T02:03:00.264141968Z [2024-03-29T02:03:00.263+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:03:00.332831818Z [2024-03-29T02:03:00.332+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:03:00.332872010Z 2024-03-29T02:03:00.332878025Z 2024-03-29T02:03:00.332883022Z 2024-03-29T02:03:00.333008665Z [2024-03-29T02:03:00.332+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:03:00.333263010Z [2024-03-29T02:03:00.333+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:03:00.333452574Z [2024-03-29T02:03:00.333+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:03:00.334216969Z [2024-03-29T02:03:00.333+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:03:00.334240626Z 2024-03-29T02:03:00.334246237Z 2024-03-29T02:03:00.334250704Z 2024-03-29T02:03:00.338605857Z [2024-03-29T02:03:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:03:00.338954501Z [2024-03-29T02:03:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:03:00.339299473Z [2024-03-29T02:03:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:03:00.339530957Z [2024-03-29T02:03:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:03:00.339802705Z [2024-03-29T02:03:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:03:00.339978875Z [2024-03-29T02:03:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:03:00.609342787Z [2024-03-29T02:03:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status queued for try_number 1 2024-03-29T02:03:00.609428850Z [2024-03-29T02:03:00.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status queued for try_number 1 2024-03-29T02:03:00.609537702Z [2024-03-29T02:03:00.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status queued for try_number 1 2024-03-29T02:03:00.620415955Z [2024-03-29T02:03:00.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c3bedbf-c598-4388-824e-a1e4b0ded039 2024-03-29T02:03:00.620450443Z [2024-03-29T02:03:00.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to e39eb7f1-903e-4e11-8caa-caed078c719b 2024-03-29T02:03:00.620550871Z [2024-03-29T02:03:00.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad739eb5-2cef-4f70-bcb6-b4ba0afdc384 2024-03-29T02:03:01.786874726Z [2024-03-29T02:03:01.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:03:01.787741162Z [2024-03-29T02:03:01.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:02:00+00:00, run_id=scheduled__2024-03-29T02:02:00+00:00, run_start_date=2024-03-29 02:03:00.273768+00:00, run_end_date=2024-03-29 02:03:01.786781+00:00, run_duration=1.513013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:02:00+00:00, data_interval_end=2024-03-29 02:03:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:03:01.806869467Z [2024-03-29T02:03:01.806+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:03:00+00:00, run_after=2024-03-29T02:04:00+00:00 2024-03-29T02:03:03.013198591Z [2024-03-29T02:03:03.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status success for try_number 1 2024-03-29T02:03:03.019936005Z [2024-03-29T02:03:03.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:02:00+00:00, map_index=-1, run_start_date=2024-03-29 02:03:01.239404+00:00, run_end_date=2024-03-29 02:03:01.720154+00:00, run_duration=0.48075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:03:00.335143+00:00, queued_by_job_id=2, pid=9787 2024-03-29T02:03:04.079119188Z [2024-03-29T02:03:04.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:03:04.079529603Z [2024-03-29T02:03:04.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:02:00+00:00, run_id=scheduled__2024-03-29T02:02:00+00:00, run_start_date=2024-03-29 02:03:00.275062+00:00, run_end_date=2024-03-29 02:03:04.079122+00:00, run_duration=3.80406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:02:00+00:00, data_interval_end=2024-03-29 02:03:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:03:04.090541688Z [2024-03-29T02:03:04.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:03:00+00:00, run_after=2024-03-29T02:04:00+00:00 2024-03-29T02:03:04.146245300Z [2024-03-29T02:03:04.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status success for try_number 1 2024-03-29T02:03:04.155444738Z [2024-03-29T02:03:04.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:02:00+00:00, map_index=-1, run_start_date=2024-03-29 02:03:02.279696+00:00, run_end_date=2024-03-29 02:03:03.755223+00:00, run_duration=1.475527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:03:00.335143+00:00, queued_by_job_id=2, pid=9805 2024-03-29T02:03:05.365581999Z [2024-03-29T02:03:05.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:03:05.366737194Z [2024-03-29T02:03:05.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:02:00+00:00, run_id=scheduled__2024-03-29T02:02:00+00:00, run_start_date=2024-03-29 02:03:00.276353+00:00, run_end_date=2024-03-29 02:03:05.365549+00:00, run_duration=5.089196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:02:00+00:00, data_interval_end=2024-03-29 02:03:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:03:05.388065941Z [2024-03-29T02:03:05.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:03:00+00:00, run_after=2024-03-29T02:04:00+00:00 2024-03-29T02:03:05.437748577Z [2024-03-29T02:03:05.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status success for try_number 1 2024-03-29T02:03:05.449534688Z [2024-03-29T02:03:05.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:02:00+00:00, map_index=-1, run_start_date=2024-03-29 02:03:02.424686+00:00, run_end_date=2024-03-29 02:03:04.253293+00:00, run_duration=1.828607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:03:00.335143+00:00, queued_by_job_id=2, pid=9806 2024-03-29T02:03:45.880000372Z [2024-03-29T02:03:45.877+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:04:01.056114898Z [2024-03-29T02:04:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:04:00+00:00, run_after=2024-03-29T02:05:00+00:00 2024-03-29T02:04:01.064006548Z [2024-03-29T02:04:01.063+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:04:01.070529691Z [2024-03-29T02:04:01.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:04:01.085271788Z [2024-03-29T02:04:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:04:00+00:00, run_after=2024-03-29T02:05:00+00:00 2024-03-29T02:04:01.189912764Z [2024-03-29T02:04:01.189+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:04:01.189945992Z 2024-03-29T02:04:01.189951852Z 2024-03-29T02:04:01.189956486Z 2024-03-29T02:04:01.189961142Z 2024-03-29T02:04:01.190411502Z [2024-03-29T02:04:01.190+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:04:01.190784654Z [2024-03-29T02:04:01.190+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:04:01.191108823Z [2024-03-29T02:04:01.190+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:04:01.191508486Z [2024-03-29T02:04:01.191+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:04:01.192552635Z [2024-03-29T02:04:01.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:04:01.192568145Z 2024-03-29T02:04:01.192573657Z 2024-03-29T02:04:01.192578702Z 2024-03-29T02:04:01.192598052Z 2024-03-29T02:04:01.198553896Z [2024-03-29T02:04:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:04:01.198913186Z [2024-03-29T02:04:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:04:01.199515482Z [2024-03-29T02:04:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:04:01.199782024Z [2024-03-29T02:04:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:04:01.200262616Z [2024-03-29T02:04:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:04:01.200558784Z [2024-03-29T02:04:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:04:01.200974908Z [2024-03-29T02:04:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:04:01.201242061Z [2024-03-29T02:04:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:04:01.758692538Z [2024-03-29T02:04:01.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status queued for try_number 1 2024-03-29T02:04:01.759097939Z [2024-03-29T02:04:01.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:03:00+00:00 exited with status queued for try_number 1 2024-03-29T02:04:01.759340848Z [2024-03-29T02:04:01.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:03:00+00:00 exited with status queued for try_number 1 2024-03-29T02:04:01.759551535Z [2024-03-29T02:04:01.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:03:00+00:00 exited with status queued for try_number 1 2024-03-29T02:04:01.781113290Z [2024-03-29T02:04:01.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31fa86ef-7fed-4d57-96c7-480e1f8ecb55 2024-03-29T02:04:01.787177601Z [2024-03-29T02:04:01.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to c155e589-11ac-4b52-9f48-eb9b9bba7b16 2024-03-29T02:04:01.787594509Z [2024-03-29T02:04:01.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d43d804-a3da-4ded-be31-36d5c5525f17 2024-03-29T02:04:01.788094354Z [2024-03-29T02:04:01.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90d1a45f-322c-4e5d-8526-c694a8356323 2024-03-29T02:04:03.077612732Z [2024-03-29T02:04:03.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:04:03.078080065Z [2024-03-29T02:04:03.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:02:00+00:00, run_id=scheduled__2024-03-29T02:02:00+00:00, run_start_date=2024-03-29 02:04:01.098884+00:00, run_end_date=2024-03-29 02:04:03.077569+00:00, run_duration=1.978685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:02:00+00:00, data_interval_end=2024-03-29 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:04:03.092710127Z [2024-03-29T02:04:03.091+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:04:00+00:00, run_after=2024-03-29T02:06:00+00:00 2024-03-29T02:04:03.104478810Z [2024-03-29T02:04:03.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:04:03.104854330Z [2024-03-29T02:04:03.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:03:00+00:00, run_id=scheduled__2024-03-29T02:03:00+00:00, run_start_date=2024-03-29 02:04:01.100242+00:00, run_end_date=2024-03-29 02:04:03.104423+00:00, run_duration=2.004181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:03:00+00:00, data_interval_end=2024-03-29 02:04:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:04:03.124323464Z [2024-03-29T02:04:03.123+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:04:00+00:00, run_after=2024-03-29T02:05:00+00:00 2024-03-29T02:04:03.205315129Z [2024-03-29T02:04:03.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:02:00+00:00 exited with status success for try_number 1 2024-03-29T02:04:03.205627573Z [2024-03-29T02:04:03.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:03:00+00:00 exited with status success for try_number 1 2024-03-29T02:04:03.221381910Z [2024-03-29T02:04:03.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:03:00+00:00, map_index=-1, run_start_date=2024-03-29 02:04:02.130704+00:00, run_end_date=2024-03-29 02:04:02.675738+00:00, run_duration=0.545034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:04:01.194365+00:00, queued_by_job_id=2, pid=9839 2024-03-29T02:04:03.221919660Z [2024-03-29T02:04:03.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:02:00+00:00, map_index=-1, run_start_date=2024-03-29 02:04:02.288857+00:00, run_end_date=2024-03-29 02:04:02.837209+00:00, run_duration=0.548352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:04:01.194365+00:00, queued_by_job_id=2, pid=9840 2024-03-29T02:04:06.206793159Z [2024-03-29T02:04:06.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:04:06.207008830Z [2024-03-29T02:04:06.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:03:00+00:00, run_id=scheduled__2024-03-29T02:03:00+00:00, run_start_date=2024-03-29 02:04:01.101367+00:00, run_end_date=2024-03-29 02:04:06.206690+00:00, run_duration=5.105323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:03:00+00:00, data_interval_end=2024-03-29 02:04:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:04:06.219136138Z [2024-03-29T02:04:06.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:04:00+00:00, run_after=2024-03-29T02:05:00+00:00 2024-03-29T02:04:06.230306371Z [2024-03-29T02:04:06.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:04:06.230747206Z [2024-03-29T02:04:06.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:03:00+00:00, run_id=scheduled__2024-03-29T02:03:00+00:00, run_start_date=2024-03-29 02:04:01.102417+00:00, run_end_date=2024-03-29 02:04:06.230351+00:00, run_duration=5.127934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:03:00+00:00, data_interval_end=2024-03-29 02:04:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:04:06.253038843Z [2024-03-29T02:04:06.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:04:00+00:00, run_after=2024-03-29T02:05:00+00:00 2024-03-29T02:04:06.298152683Z [2024-03-29T02:04:06.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:03:00+00:00 exited with status success for try_number 1 2024-03-29T02:04:06.298188243Z [2024-03-29T02:04:06.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:03:00+00:00 exited with status success for try_number 1 2024-03-29T02:04:06.305627747Z [2024-03-29T02:04:06.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:03:00+00:00, map_index=-1, run_start_date=2024-03-29 02:04:03.806571+00:00, run_end_date=2024-03-29 02:04:05.264851+00:00, run_duration=1.45828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:04:01.194365+00:00, queued_by_job_id=2, pid=9864 2024-03-29T02:04:06.305707311Z [2024-03-29T02:04:06.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:03:00+00:00, map_index=-1, run_start_date=2024-03-29 02:04:03.781147+00:00, run_end_date=2024-03-29 02:04:05.721364+00:00, run_duration=1.940217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:04:01.194365+00:00, queued_by_job_id=2, pid=9863 2024-03-29T02:05:00.712345383Z [2024-03-29T02:05:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:05:00+00:00, run_after=2024-03-29T02:06:00+00:00 2024-03-29T02:05:00.725186664Z [2024-03-29T02:05:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:05:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:05:00.740248305Z [2024-03-29T02:05:00.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:05:00+00:00, run_after=2024-03-29T02:06:00+00:00 2024-03-29T02:05:00.753306168Z [2024-03-29T02:05:00.752+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:05:00.854274835Z [2024-03-29T02:05:00.853+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:05:00.854305209Z 2024-03-29T02:05:00.854310724Z 2024-03-29T02:05:00.854314881Z 2024-03-29T02:05:00.854318809Z 2024-03-29T02:05:00.854595785Z [2024-03-29T02:05:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:05:00.854815203Z [2024-03-29T02:05:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:05:00.855039688Z [2024-03-29T02:05:00.854+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:05:00.855313897Z [2024-03-29T02:05:00.855+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:05:00.856057865Z [2024-03-29T02:05:00.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:05:00.856090741Z 2024-03-29T02:05:00.856098208Z 2024-03-29T02:05:00.856104103Z 2024-03-29T02:05:00.856110203Z 2024-03-29T02:05:00.860903073Z [2024-03-29T02:05:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:05:00.861256590Z [2024-03-29T02:05:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:05:00.861549050Z [2024-03-29T02:05:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:05:00.861744664Z [2024-03-29T02:05:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:05:00.862006034Z [2024-03-29T02:05:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:05:00.862202406Z [2024-03-29T02:05:00.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:05:00.862566846Z [2024-03-29T02:05:00.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:05:00.862757347Z [2024-03-29T02:05:00.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:05:01.186509564Z [2024-03-29T02:05:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:05:01.186752269Z [2024-03-29T02:05:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status queued for try_number 1 2024-03-29T02:05:01.186961811Z [2024-03-29T02:05:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status queued for try_number 1 2024-03-29T02:05:01.187157044Z [2024-03-29T02:05:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status queued for try_number 1 2024-03-29T02:05:01.201889674Z [2024-03-29T02:05:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6f5e8ce-3da4-4efb-b18b-0bdd99c2f1c9 2024-03-29T02:05:01.202166960Z [2024-03-29T02:05:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 065e7bfb-ec4a-4077-8f7f-4771c363c63b 2024-03-29T02:05:01.202430691Z [2024-03-29T02:05:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6bc84e5-f58c-4f98-9b0b-5aa6bba31fc2 2024-03-29T02:05:01.202678751Z [2024-03-29T02:05:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to a72f22f2-dbb4-4cb3-b1f5-67d8acbde12b 2024-03-29T02:05:03.817609486Z [2024-03-29T02:05:03.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:05:03.818012627Z [2024-03-29T02:05:03.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:04:00+00:00, run_id=scheduled__2024-03-29T02:04:00+00:00, run_start_date=2024-03-29 02:05:00.770610+00:00, run_end_date=2024-03-29 02:05:03.817495+00:00, run_duration=3.046885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:04:00+00:00, data_interval_end=2024-03-29 02:05:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:05:03.838214975Z [2024-03-29T02:05:03.837+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:05:00+00:00, run_after=2024-03-29T02:06:00+00:00 2024-03-29T02:05:03.911528774Z [2024-03-29T02:05:03.911+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:05:03.911566980Z 2024-03-29T02:05:03.911742207Z [2024-03-29T02:05:03.911+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:05:03.912693528Z [2024-03-29T02:05:03.912+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:05:03.912710201Z 2024-03-29T02:05:03.917419911Z [2024-03-29T02:05:03.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:05:03.917732596Z [2024-03-29T02:05:03.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:05:04.033138470Z [2024-03-29T02:05:04.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:05:04.033172013Z [2024-03-29T02:05:04.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:05:04.033268017Z [2024-03-29T02:05:04.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status success for try_number 1 2024-03-29T02:05:04.062219155Z [2024-03-29T02:05:04.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dc0ad3e-7c04-4302-8abd-2fc84b18b28a 2024-03-29T02:05:04.063160193Z [2024-03-29T02:05:04.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:04:00+00:00, map_index=-1, run_start_date=2024-03-29 02:05:02.126239+00:00, run_end_date=2024-03-29 02:05:02.783064+00:00, run_duration=0.656825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:05:00.857042+00:00, queued_by_job_id=2, pid=9898 2024-03-29T02:05:04.063586922Z [2024-03-29T02:05:04.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=-1, run_start_date=2024-03-29 02:05:03.294615+00:00, run_end_date=2024-03-29 02:05:03.778076+00:00, run_duration=0.483461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:05:00.857042+00:00, queued_by_job_id=2, pid=9916 2024-03-29T02:05:06.305118071Z [2024-03-29T02:05:06.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:05:06.305912317Z [2024-03-29T02:05:06.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:04:00+00:00, run_id=scheduled__2024-03-29T02:04:00+00:00, run_start_date=2024-03-29 02:05:00.771706+00:00, run_end_date=2024-03-29 02:05:06.305366+00:00, run_duration=5.53366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:04:00+00:00, data_interval_end=2024-03-29 02:05:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:05:06.323747386Z [2024-03-29T02:05:06.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:05:00+00:00, run_after=2024-03-29T02:06:00+00:00 2024-03-29T02:05:06.332640055Z [2024-03-29T02:05:06.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:05:06.333194793Z [2024-03-29T02:05:06.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:04:00+00:00, run_id=scheduled__2024-03-29T02:04:00+00:00, run_start_date=2024-03-29 02:05:00.772718+00:00, run_end_date=2024-03-29 02:05:06.332842+00:00, run_duration=5.560124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:04:00+00:00, data_interval_end=2024-03-29 02:05:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:05:06.344430285Z [2024-03-29T02:05:06.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:05:00+00:00, run_after=2024-03-29T02:06:00+00:00 2024-03-29T02:05:06.455958090Z [2024-03-29T02:05:06.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status success for try_number 1 2024-03-29T02:05:06.456117431Z [2024-03-29T02:05:06.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status success for try_number 1 2024-03-29T02:05:06.470244057Z [2024-03-29T02:05:06.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:04:00+00:00, map_index=-1, run_start_date=2024-03-29 02:05:03.876130+00:00, run_end_date=2024-03-29 02:05:05.276566+00:00, run_duration=1.400436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:05:00.857042+00:00, queued_by_job_id=2, pid=9932 2024-03-29T02:05:06.470642500Z [2024-03-29T02:05:06.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:04:00+00:00, map_index=-1, run_start_date=2024-03-29 02:05:03.456976+00:00, run_end_date=2024-03-29 02:05:05.364492+00:00, run_duration=1.907516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:05:00.857042+00:00, queued_by_job_id=2, pid=9917 2024-03-29T02:05:07.243230382Z [2024-03-29T02:05:07.236+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:05:07.243276631Z 2024-03-29T02:05:07.243280848Z [2024-03-29T02:05:07.236+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:05:07.243284953Z [2024-03-29T02:05:07.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:05:07.243288148Z 2024-03-29T02:05:07.243293419Z [2024-03-29T02:05:07.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:05:07.243296635Z [2024-03-29T02:05:07.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:05:07.306968049Z [2024-03-29T02:05:07.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:05:07.307144784Z [2024-03-29T02:05:07.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:05:07.319644288Z [2024-03-29T02:05:07.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8efeb158-331b-4b8e-a881-f9cded2de004 2024-03-29T02:05:07.319985304Z [2024-03-29T02:05:07.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=-1, run_start_date=2024-03-29 02:05:06.230165+00:00, run_end_date=2024-03-29 02:05:06.661194+00:00, run_duration=0.431029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:05:03.913337+00:00, queued_by_job_id=2, pid=9946 2024-03-29T02:05:09.583897225Z [2024-03-29T02:05:09.583+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:05:09.583929894Z 2024-03-29T02:05:09.584081178Z [2024-03-29T02:05:09.583+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:05:09.584680559Z [2024-03-29T02:05:09.584+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:05:09.584691459Z 2024-03-29T02:05:09.587422293Z [2024-03-29T02:05:09.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:05:09.587644009Z [2024-03-29T02:05:09.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:05:09.634659917Z [2024-03-29T02:05:09.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status queued for try_number 1 2024-03-29T02:05:09.634858149Z [2024-03-29T02:05:09.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:05:09.640756786Z [2024-03-29T02:05:09.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 232ff35b-2576-400b-9002-9f76a995cae2 2024-03-29T02:05:09.640980648Z [2024-03-29T02:05:09.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=0, run_start_date=2024-03-29 02:05:09.005017+00:00, run_end_date=2024-03-29 02:05:09.357797+00:00, run_duration=0.35278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:05:07.237940+00:00, queued_by_job_id=2, pid=9954 2024-03-29T02:05:11.535827120Z [2024-03-29T02:05:11.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:05:11.536145081Z [2024-03-29T02:05:11.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:00:00+00:00, run_id=scheduled__2024-03-29T02:00:00+00:00, run_start_date=2024-03-29 02:05:00.769330+00:00, run_end_date=2024-03-29 02:05:11.535703+00:00, run_duration=10.766373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:00:00+00:00, data_interval_end=2024-03-29 02:05:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:05:11.542108461Z [2024-03-29T02:05:11.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:05:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:05:12.664913793Z [2024-03-29T02:05:12.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:00:00+00:00 exited with status success for try_number 1 2024-03-29T02:05:12.672062400Z [2024-03-29T02:05:12.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:00:00+00:00, map_index=-1, run_start_date=2024-03-29 02:05:11.220879+00:00, run_end_date=2024-03-29 02:05:11.517345+00:00, run_duration=0.296466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:05:09.585054+00:00, queued_by_job_id=2, pid=9962 2024-03-29T02:06:00.917607772Z [2024-03-29T02:06:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:06:00+00:00, run_after=2024-03-29T02:07:00+00:00 2024-03-29T02:06:00.932097259Z [2024-03-29T02:06:00.925+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:06:00.940158775Z [2024-03-29T02:06:00.939+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:06:00.961807105Z [2024-03-29T02:06:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:06:00+00:00, run_after=2024-03-29T02:07:00+00:00 2024-03-29T02:06:01.060194492Z [2024-03-29T02:06:01.059+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:06:01.060246113Z 2024-03-29T02:06:01.060258331Z 2024-03-29T02:06:01.060264097Z 2024-03-29T02:06:01.060269467Z 2024-03-29T02:06:01.060307256Z [2024-03-29T02:06:01.060+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:06:01.060576524Z [2024-03-29T02:06:01.060+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:06:01.060802782Z [2024-03-29T02:06:01.060+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:06:01.060913685Z [2024-03-29T02:06:01.060+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:06:01.061739107Z [2024-03-29T02:06:01.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:06:01.061755172Z 2024-03-29T02:06:01.061760873Z 2024-03-29T02:06:01.061810941Z 2024-03-29T02:06:01.061817041Z 2024-03-29T02:06:01.068321429Z [2024-03-29T02:06:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:06:01.068505088Z [2024-03-29T02:06:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:06:01.068848587Z [2024-03-29T02:06:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:06:01.068999090Z [2024-03-29T02:06:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:06:01.069249359Z [2024-03-29T02:06:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:06:01.069386648Z [2024-03-29T02:06:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:06:01.069662983Z [2024-03-29T02:06:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:06:01.069831763Z [2024-03-29T02:06:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:06:01.500042289Z [2024-03-29T02:06:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status queued for try_number 1 2024-03-29T02:06:01.500245698Z [2024-03-29T02:06:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:06:01.502898897Z [2024-03-29T02:06:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:06:01.503073324Z [2024-03-29T02:06:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:06:01.528057379Z [2024-03-29T02:06:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1476365-1004-4d06-9114-addb47eab83e 2024-03-29T02:06:01.528119448Z [2024-03-29T02:06:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f2a9904-7888-4fc8-ab32-c47189feca74 2024-03-29T02:06:01.528315748Z [2024-03-29T02:06:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42a4dbd1-8179-4066-a5b6-1c35efc675a8 2024-03-29T02:06:01.528500924Z [2024-03-29T02:06:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28e2c8c3-01a5-4a91-bcdb-39f1159f7b42 2024-03-29T02:06:03.395185725Z [2024-03-29T02:06:03.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:06:03.395849742Z [2024-03-29T02:06:03.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:04:00+00:00, run_id=scheduled__2024-03-29T02:04:00+00:00, run_start_date=2024-03-29 02:06:00.978585+00:00, run_end_date=2024-03-29 02:06:03.395243+00:00, run_duration=2.416658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:04:00+00:00, data_interval_end=2024-03-29 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:06:03.410218303Z [2024-03-29T02:06:03.409+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:06:00+00:00, run_after=2024-03-29T02:08:00+00:00 2024-03-29T02:06:03.424104563Z [2024-03-29T02:06:03.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:06:03.424830904Z [2024-03-29T02:06:03.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:05:00+00:00, run_id=scheduled__2024-03-29T02:05:00+00:00, run_start_date=2024-03-29 02:06:00.980383+00:00, run_end_date=2024-03-29 02:06:03.424293+00:00, run_duration=2.44391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:05:00+00:00, data_interval_end=2024-03-29 02:06:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:06:03.444222310Z [2024-03-29T02:06:03.443+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:06:00+00:00, run_after=2024-03-29T02:07:00+00:00 2024-03-29T02:06:03.517658675Z [2024-03-29T02:06:03.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:04:00+00:00 exited with status success for try_number 1 2024-03-29T02:06:03.518067119Z [2024-03-29T02:06:03.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:06:03.528090158Z [2024-03-29T02:06:03.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:06:02.105942+00:00, run_end_date=2024-03-29 02:06:02.749236+00:00, run_duration=0.643294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:06:01.063932+00:00, queued_by_job_id=2, pid=9986 2024-03-29T02:06:03.528575717Z [2024-03-29T02:06:03.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:04:00+00:00, map_index=-1, run_start_date=2024-03-29 02:06:02.000392+00:00, run_end_date=2024-03-29 02:06:02.688995+00:00, run_duration=0.688603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:06:01.063932+00:00, queued_by_job_id=2, pid=9985 2024-03-29T02:06:06.789643458Z [2024-03-29T02:06:06.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:06:06.790275491Z [2024-03-29T02:06:06.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:05:00+00:00, run_id=scheduled__2024-03-29T02:05:00+00:00, run_start_date=2024-03-29 02:06:00.981692+00:00, run_end_date=2024-03-29 02:06:06.789939+00:00, run_duration=5.808247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:05:00+00:00, data_interval_end=2024-03-29 02:06:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:06:06.804277125Z [2024-03-29T02:06:06.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:06:00+00:00, run_after=2024-03-29T02:07:00+00:00 2024-03-29T02:06:06.819707975Z [2024-03-29T02:06:06.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:06:06.820198384Z [2024-03-29T02:06:06.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:05:00+00:00, run_id=scheduled__2024-03-29T02:05:00+00:00, run_start_date=2024-03-29 02:06:00.983050+00:00, run_end_date=2024-03-29 02:06:06.819886+00:00, run_duration=5.836836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:05:00+00:00, data_interval_end=2024-03-29 02:06:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:06:06.830916006Z [2024-03-29T02:06:06.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:06:00+00:00, run_after=2024-03-29T02:07:00+00:00 2024-03-29T02:06:06.875980744Z [2024-03-29T02:06:06.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:06:06.876304100Z [2024-03-29T02:06:06.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:06:06.888715253Z [2024-03-29T02:06:06.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:06:03.780875+00:00, run_end_date=2024-03-29 02:06:06.630494+00:00, run_duration=2.849619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:06:01.063932+00:00, queued_by_job_id=2, pid=10010 2024-03-29T02:06:06.889117440Z [2024-03-29T02:06:06.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:06:03.726023+00:00, run_end_date=2024-03-29 02:06:05.939932+00:00, run_duration=2.213909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:06:01.063932+00:00, queued_by_job_id=2, pid=10009 2024-03-29T02:07:00.086238920Z [2024-03-29T02:07:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:07:00.099057037Z [2024-03-29T02:07:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:07:00+00:00, run_after=2024-03-29T02:08:00+00:00 2024-03-29T02:07:00.113479098Z [2024-03-29T02:07:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:07:00+00:00, run_after=2024-03-29T02:08:00+00:00 2024-03-29T02:07:00.173599820Z [2024-03-29T02:07:00.173+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:07:00.173635151Z 2024-03-29T02:07:00.173639702Z 2024-03-29T02:07:00.173643599Z 2024-03-29T02:07:00.173815271Z [2024-03-29T02:07:00.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:07:00.173995655Z [2024-03-29T02:07:00.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:07:00.174175580Z [2024-03-29T02:07:00.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:07:00.175139700Z [2024-03-29T02:07:00.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:07:00.175170631Z 2024-03-29T02:07:00.175177499Z 2024-03-29T02:07:00.175207826Z 2024-03-29T02:07:00.178517709Z [2024-03-29T02:07:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:07:00.178779053Z [2024-03-29T02:07:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:07:00.178984040Z [2024-03-29T02:07:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:07:00.179172441Z [2024-03-29T02:07:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:07:00.179424738Z [2024-03-29T02:07:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:07:00.179614134Z [2024-03-29T02:07:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:07:00.446974981Z [2024-03-29T02:07:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status queued for try_number 1 2024-03-29T02:07:00.447050271Z [2024-03-29T02:07:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status queued for try_number 1 2024-03-29T02:07:00.447167540Z [2024-03-29T02:07:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status queued for try_number 1 2024-03-29T02:07:00.463415703Z [2024-03-29T02:07:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbef4e34-0f1e-4ced-abd6-6f680a2248f6 2024-03-29T02:07:00.463466955Z [2024-03-29T02:07:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e4d2e29-9499-42ad-b17d-0d6d249f318b 2024-03-29T02:07:00.463674589Z [2024-03-29T02:07:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 200dbe3d-8cb6-48fd-8bb2-93f186178033 2024-03-29T02:07:01.622411581Z [2024-03-29T02:07:01.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:07:01.622985369Z [2024-03-29T02:07:01.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:06:00+00:00, run_id=scheduled__2024-03-29T02:06:00+00:00, run_start_date=2024-03-29 02:07:00.123432+00:00, run_end_date=2024-03-29 02:07:01.622417+00:00, run_duration=1.498985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:06:00+00:00, data_interval_end=2024-03-29 02:07:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:07:01.636905361Z [2024-03-29T02:07:01.636+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:07:00+00:00, run_after=2024-03-29T02:08:00+00:00 2024-03-29T02:07:01.691155329Z [2024-03-29T02:07:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status success for try_number 1 2024-03-29T02:07:01.696835910Z [2024-03-29T02:07:01.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:06:00+00:00, map_index=-1, run_start_date=2024-03-29 02:07:00.959292+00:00, run_end_date=2024-03-29 02:07:01.329952+00:00, run_duration=0.37066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:07:00.176300+00:00, queued_by_job_id=2, pid=10042 2024-03-29T02:07:04.181972488Z [2024-03-29T02:07:04.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:07:04.182413020Z [2024-03-29T02:07:04.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:06:00+00:00, run_id=scheduled__2024-03-29T02:06:00+00:00, run_start_date=2024-03-29 02:07:00.124551+00:00, run_end_date=2024-03-29 02:07:04.182058+00:00, run_duration=4.057507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:06:00+00:00, data_interval_end=2024-03-29 02:07:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:07:04.193697857Z [2024-03-29T02:07:04.193+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:07:00+00:00, run_after=2024-03-29T02:08:00+00:00 2024-03-29T02:07:04.201886376Z [2024-03-29T02:07:04.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:07:04.202253906Z [2024-03-29T02:07:04.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:06:00+00:00, run_id=scheduled__2024-03-29T02:06:00+00:00, run_start_date=2024-03-29 02:07:00.125445+00:00, run_end_date=2024-03-29 02:07:04.201912+00:00, run_duration=4.076467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:06:00+00:00, data_interval_end=2024-03-29 02:07:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:07:04.213439865Z [2024-03-29T02:07:04.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:07:00+00:00, run_after=2024-03-29T02:08:00+00:00 2024-03-29T02:07:04.249236903Z [2024-03-29T02:07:04.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status success for try_number 1 2024-03-29T02:07:04.250084198Z [2024-03-29T02:07:04.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status success for try_number 1 2024-03-29T02:07:04.260217386Z [2024-03-29T02:07:04.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:06:00+00:00, map_index=-1, run_start_date=2024-03-29 02:07:02.134095+00:00, run_end_date=2024-03-29 02:07:03.591546+00:00, run_duration=1.457451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:07:00.176300+00:00, queued_by_job_id=2, pid=10060 2024-03-29T02:07:04.260954410Z [2024-03-29T02:07:04.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:06:00+00:00, map_index=-1, run_start_date=2024-03-29 02:07:02.166253+00:00, run_end_date=2024-03-29 02:07:03.891345+00:00, run_duration=1.725092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:07:00.176300+00:00, queued_by_job_id=2, pid=10061 2024-03-29T02:08:00.330116373Z [2024-03-29T02:08:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:08:00+00:00, run_after=2024-03-29T02:09:00+00:00 2024-03-29T02:08:00.346138417Z [2024-03-29T02:08:00.345+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:08:00.356672784Z [2024-03-29T02:08:00.356+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:08:00.372599964Z [2024-03-29T02:08:00.372+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:08:00+00:00, run_after=2024-03-29T02:09:00+00:00 2024-03-29T02:08:00.462812094Z [2024-03-29T02:08:00.462+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:08:00.462848476Z 2024-03-29T02:08:00.462854713Z 2024-03-29T02:08:00.462859400Z 2024-03-29T02:08:00.462863928Z 2024-03-29T02:08:00.463326721Z [2024-03-29T02:08:00.462+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:08:00.463728758Z [2024-03-29T02:08:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:08:00.464116423Z [2024-03-29T02:08:00.463+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:08:00.464451749Z [2024-03-29T02:08:00.464+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:08:00.465327137Z [2024-03-29T02:08:00.465+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:08:00.465341902Z 2024-03-29T02:08:00.465347137Z 2024-03-29T02:08:00.465351232Z 2024-03-29T02:08:00.465355466Z 2024-03-29T02:08:00.470982791Z [2024-03-29T02:08:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:08:00.471291236Z [2024-03-29T02:08:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:08:00.471656160Z [2024-03-29T02:08:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:08:00.471896476Z [2024-03-29T02:08:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:08:00.472245857Z [2024-03-29T02:08:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:08:00.473479146Z [2024-03-29T02:08:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:08:00.473864629Z [2024-03-29T02:08:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:08:00.474103513Z [2024-03-29T02:08:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:08:00.893373115Z [2024-03-29T02:08:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status queued for try_number 1 2024-03-29T02:08:00.894994297Z [2024-03-29T02:08:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:07:00+00:00 exited with status queued for try_number 1 2024-03-29T02:08:00.895531156Z [2024-03-29T02:08:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:07:00+00:00 exited with status queued for try_number 1 2024-03-29T02:08:00.899058869Z [2024-03-29T02:08:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:07:00+00:00 exited with status queued for try_number 1 2024-03-29T02:08:00.936227262Z [2024-03-29T02:08:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 422ca7ad-3b40-41e9-8368-647cc5c1711f 2024-03-29T02:08:00.939771197Z [2024-03-29T02:08:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to d65ace3f-7fec-4720-8474-4a23362a276a 2024-03-29T02:08:00.940088718Z [2024-03-29T02:08:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6419996c-d101-41e0-981f-aed5797409b9 2024-03-29T02:08:00.940293266Z [2024-03-29T02:08:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to dab648cc-d359-425b-bc1c-66773dac46a5 2024-03-29T02:08:02.240189190Z [2024-03-29T02:08:02.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:08:02.241370490Z [2024-03-29T02:08:02.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:06:00+00:00, run_id=scheduled__2024-03-29T02:06:00+00:00, run_start_date=2024-03-29 02:08:00.385815+00:00, run_end_date=2024-03-29 02:08:02.240219+00:00, run_duration=1.854404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:06:00+00:00, data_interval_end=2024-03-29 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:08:02.266663401Z [2024-03-29T02:08:02.266+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:08:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:08:02.288468978Z [2024-03-29T02:08:02.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:08:02.288853606Z [2024-03-29T02:08:02.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:07:00+00:00, run_id=scheduled__2024-03-29T02:07:00+00:00, run_start_date=2024-03-29 02:08:00.387049+00:00, run_end_date=2024-03-29 02:08:02.288298+00:00, run_duration=1.901249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:07:00+00:00, data_interval_end=2024-03-29 02:08:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:08:02.310884669Z [2024-03-29T02:08:02.310+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:08:00+00:00, run_after=2024-03-29T02:09:00+00:00 2024-03-29T02:08:02.374187922Z [2024-03-29T02:08:02.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:06:00+00:00 exited with status success for try_number 1 2024-03-29T02:08:02.381220040Z [2024-03-29T02:08:02.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:06:00+00:00, map_index=-1, run_start_date=2024-03-29 02:08:01.560616+00:00, run_end_date=2024-03-29 02:08:02.066173+00:00, run_duration=0.505557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:08:00.466597+00:00, queued_by_job_id=2, pid=10094 2024-03-29T02:08:03.481328269Z [2024-03-29T02:08:03.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:07:00+00:00 exited with status success for try_number 1 2024-03-29T02:08:03.487859521Z [2024-03-29T02:08:03.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:07:00+00:00, map_index=-1, run_start_date=2024-03-29 02:08:01.678585+00:00, run_end_date=2024-03-29 02:08:02.249914+00:00, run_duration=0.571329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:08:00.466597+00:00, queued_by_job_id=2, pid=10095 2024-03-29T02:08:05.006854507Z [2024-03-29T02:08:04.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:08:05.007067645Z [2024-03-29T02:08:04.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:07:00+00:00, run_id=scheduled__2024-03-29T02:07:00+00:00, run_start_date=2024-03-29 02:08:00.389140+00:00, run_end_date=2024-03-29 02:08:04.993288+00:00, run_duration=4.604148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:07:00+00:00, data_interval_end=2024-03-29 02:08:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:08:05.007076198Z [2024-03-29T02:08:05.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:08:00+00:00, run_after=2024-03-29T02:09:00+00:00 2024-03-29T02:08:05.017222323Z [2024-03-29T02:08:05.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:08:05.017288482Z [2024-03-29T02:08:05.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:07:00+00:00, run_id=scheduled__2024-03-29T02:07:00+00:00, run_start_date=2024-03-29 02:08:00.388083+00:00, run_end_date=2024-03-29 02:08:05.016037+00:00, run_duration=4.627954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:07:00+00:00, data_interval_end=2024-03-29 02:08:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:08:05.046855001Z [2024-03-29T02:08:05.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:08:00+00:00, run_after=2024-03-29T02:09:00+00:00 2024-03-29T02:08:05.093320629Z [2024-03-29T02:08:05.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:07:00+00:00 exited with status success for try_number 1 2024-03-29T02:08:05.093724015Z [2024-03-29T02:08:05.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:07:00+00:00 exited with status success for try_number 1 2024-03-29T02:08:05.107654146Z [2024-03-29T02:08:05.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:07:00+00:00, map_index=-1, run_start_date=2024-03-29 02:08:03.051291+00:00, run_end_date=2024-03-29 02:08:04.749047+00:00, run_duration=1.697756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:08:00.466597+00:00, queued_by_job_id=2, pid=10113 2024-03-29T02:08:05.108971462Z [2024-03-29T02:08:05.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:07:00+00:00, map_index=-1, run_start_date=2024-03-29 02:08:03.401776+00:00, run_end_date=2024-03-29 02:08:04.705419+00:00, run_duration=1.303643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:08:00.466597+00:00, queued_by_job_id=2, pid=10124 2024-03-29T02:08:45.948304680Z [2024-03-29T02:08:45.945+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:09:00.657086605Z [2024-03-29T02:09:00.656+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:09:00.680060895Z [2024-03-29T02:09:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:09:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:09:00.698636983Z [2024-03-29T02:09:00.698+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:09:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:09:00.791772161Z [2024-03-29T02:09:00.791+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:09:00.791796734Z 2024-03-29T02:09:00.791800466Z 2024-03-29T02:09:00.791803861Z 2024-03-29T02:09:00.792032788Z [2024-03-29T02:09:00.791+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:09:00.792213211Z [2024-03-29T02:09:00.792+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:09:00.792380619Z [2024-03-29T02:09:00.792+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:09:00.793138705Z [2024-03-29T02:09:00.792+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:09:00.793148819Z 2024-03-29T02:09:00.793152274Z 2024-03-29T02:09:00.793155425Z 2024-03-29T02:09:00.797911963Z [2024-03-29T02:09:00.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:09:00.798162835Z [2024-03-29T02:09:00.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:09:00.798576180Z [2024-03-29T02:09:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:09:00.798792385Z [2024-03-29T02:09:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:09:00.799134136Z [2024-03-29T02:09:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:09:00.799283315Z [2024-03-29T02:09:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:09:01.074951351Z [2024-03-29T02:09:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status queued for try_number 1 2024-03-29T02:09:01.075432195Z [2024-03-29T02:09:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status queued for try_number 1 2024-03-29T02:09:01.076437862Z [2024-03-29T02:09:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status queued for try_number 1 2024-03-29T02:09:01.088874107Z [2024-03-29T02:09:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d92387f-75c1-4777-b1ec-a32aa433e3c8 2024-03-29T02:09:01.089183076Z [2024-03-29T02:09:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7be2b91a-e9ee-48e7-b89d-bc3c212a79d5 2024-03-29T02:09:01.089518480Z [2024-03-29T02:09:01.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a360527-4b60-42bd-afe7-3cff2667e51e 2024-03-29T02:09:03.417643880Z [2024-03-29T02:09:03.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:09:03.418091972Z [2024-03-29T02:09:03.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:08:00+00:00, run_id=scheduled__2024-03-29T02:08:00+00:00, run_start_date=2024-03-29 02:09:00.714551+00:00, run_end_date=2024-03-29 02:09:03.417530+00:00, run_duration=2.702979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:08:00+00:00, data_interval_end=2024-03-29 02:09:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:09:03.427757317Z [2024-03-29T02:09:03.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:09:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:09:03.481241060Z [2024-03-29T02:09:03.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status success for try_number 1 2024-03-29T02:09:03.487591839Z [2024-03-29T02:09:03.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:08:00+00:00, map_index=-1, run_start_date=2024-03-29 02:09:01.853178+00:00, run_end_date=2024-03-29 02:09:02.315269+00:00, run_duration=0.462091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:09:00.794339+00:00, queued_by_job_id=2, pid=10152 2024-03-29T02:09:04.532485647Z [2024-03-29T02:09:04.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:09:04.532868340Z [2024-03-29T02:09:04.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:08:00+00:00, run_id=scheduled__2024-03-29T02:08:00+00:00, run_start_date=2024-03-29 02:09:00.716525+00:00, run_end_date=2024-03-29 02:09:04.532363+00:00, run_duration=3.815838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:08:00+00:00, data_interval_end=2024-03-29 02:09:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:09:04.548644463Z [2024-03-29T02:09:04.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:09:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:09:04.592804883Z [2024-03-29T02:09:04.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status success for try_number 1 2024-03-29T02:09:04.598894422Z [2024-03-29T02:09:04.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:08:00+00:00, map_index=-1, run_start_date=2024-03-29 02:09:02.970574+00:00, run_end_date=2024-03-29 02:09:04.240185+00:00, run_duration=1.269611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:09:00.794339+00:00, queued_by_job_id=2, pid=10170 2024-03-29T02:09:05.760001967Z [2024-03-29T02:09:05.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:09:05.760555031Z [2024-03-29T02:09:05.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:08:00+00:00, run_id=scheduled__2024-03-29T02:08:00+00:00, run_start_date=2024-03-29 02:09:00.718076+00:00, run_end_date=2024-03-29 02:09:05.759948+00:00, run_duration=5.041872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:08:00+00:00, data_interval_end=2024-03-29 02:09:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:09:05.774208533Z [2024-03-29T02:09:05.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:09:00+00:00, run_after=2024-03-29T02:10:00+00:00 2024-03-29T02:09:05.811712165Z [2024-03-29T02:09:05.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status success for try_number 1 2024-03-29T02:09:05.816482297Z [2024-03-29T02:09:05.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:08:00+00:00, map_index=-1, run_start_date=2024-03-29 02:09:02.875832+00:00, run_end_date=2024-03-29 02:09:04.695485+00:00, run_duration=1.819653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:09:00.794339+00:00, queued_by_job_id=2, pid=10169 2024-03-29T02:09:38.226874990Z [2024-03-29T02:09:38.226+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:09:38.226907068Z 2024-03-29T02:09:38.227018325Z [2024-03-29T02:09:38.226+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-03-29T02:09:38.228073575Z [2024-03-29T02:09:38.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:09:38.228090086Z 2024-03-29T02:09:38.230783608Z [2024-03-29T02:09:38.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240329020937_015758', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:09:38.231167039Z [2024-03-29T02:09:38.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240329020937_015758', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-29T02:09:38.285182619Z [2024-03-29T02:09:38.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240329020937_015758 exited with status queued for try_number 1 2024-03-29T02:09:38.296058532Z [2024-03-29T02:09:38.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to 476c5686-d50b-4d90-a6a6-941b159c81e3 2024-03-29T02:09:39.879289834Z [2024-03-29T02:09:39.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:09:39.879546784Z [2024-03-29T02:09:39.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-03-29 02:09:37.967995+00:00, run_id=vdu_down_20240329020937_015758, run_start_date=2024-03-29 02:09:38.195249+00:00, run_end_date=2024-03-29 02:09:39.879190+00:00, run_duration=1.683941, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-29 02:09:37.967995+00:00, data_interval_end=2024-03-29 02:09:37.967995+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-03-29T02:09:39.882934535Z [2024-03-29T02:09:39.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-03-29T02:09:39.909299639Z [2024-03-29T02:09:39.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240329020937_015758 exited with status success for try_number 1 2024-03-29T02:09:39.914724730Z [2024-03-29T02:09:39.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240329020937_015758, map_index=-1, run_start_date=2024-03-29 02:09:38.981445+00:00, run_end_date=2024-03-29 02:09:39.284910+00:00, run_duration=0.303465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:09:38.228555+00:00, queued_by_job_id=2, pid=10195 2024-03-29T02:10:00.337912694Z [2024-03-29T02:10:00.337+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:10:00.352963986Z [2024-03-29T02:10:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:11:00+00:00 2024-03-29T02:10:00.361046043Z [2024-03-29T02:10:00.360+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:10:00.384142624Z [2024-03-29T02:10:00.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:10:00.407946473Z [2024-03-29T02:10:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:11:00+00:00 2024-03-29T02:10:00.547382686Z [2024-03-29T02:10:00.546+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T02:10:00.547425206Z 2024-03-29T02:10:00.547430509Z 2024-03-29T02:10:00.547458670Z 2024-03-29T02:10:00.547462908Z 2024-03-29T02:10:00.547467155Z 2024-03-29T02:10:00.547897781Z [2024-03-29T02:10:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:10:00.553686570Z [2024-03-29T02:10:00.548+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:10:00.553741995Z [2024-03-29T02:10:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:10:00.553751228Z [2024-03-29T02:10:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:10:00.553758870Z [2024-03-29T02:10:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:10:00.554412999Z [2024-03-29T02:10:00.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:10:00.554424035Z 2024-03-29T02:10:00.554429825Z 2024-03-29T02:10:00.554435268Z 2024-03-29T02:10:00.554456540Z 2024-03-29T02:10:00.554463275Z 2024-03-29T02:10:00.559958337Z [2024-03-29T02:10:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:10:00.559982069Z [2024-03-29T02:10:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:10:00.560201189Z [2024-03-29T02:10:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:10:00.560396076Z [2024-03-29T02:10:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:10:00.560624072Z [2024-03-29T02:10:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:10:00.560741516Z [2024-03-29T02:10:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:10:00.560965548Z [2024-03-29T02:10:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:10:00.561112745Z [2024-03-29T02:10:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:10:00.563435631Z [2024-03-29T02:10:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:10:00.563460561Z [2024-03-29T02:10:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:10:01.147726505Z [2024-03-29T02:10:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:01.148266963Z [2024-03-29T02:10:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:01.148538991Z [2024-03-29T02:10:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:09:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:01.148838986Z [2024-03-29T02:10:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:09:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:01.149116413Z [2024-03-29T02:10:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:09:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:01.169232176Z [2024-03-29T02:10:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e26ff8c-f788-45b5-bdda-f870499fff7e 2024-03-29T02:10:01.169552034Z [2024-03-29T02:10:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa8c2919-38ca-4961-acbd-022c70f19b38 2024-03-29T02:10:01.169863011Z [2024-03-29T02:10:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 081c37fc-d5cc-40c6-b14a-743f83108e9d 2024-03-29T02:10:01.170102745Z [2024-03-29T02:10:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to f07296bf-bdc4-4aa7-a14b-2a67f3246809 2024-03-29T02:10:01.170404172Z [2024-03-29T02:10:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36cd5c47-a890-4159-9259-aff693b8a837 2024-03-29T02:10:02.665335915Z [2024-03-29T02:10:02.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:10:02.666096096Z [2024-03-29T02:10:02.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:09:00+00:00, run_id=scheduled__2024-03-29T02:09:00+00:00, run_start_date=2024-03-29 02:10:00.425190+00:00, run_end_date=2024-03-29 02:10:02.665631+00:00, run_duration=2.240441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:09:00+00:00, data_interval_end=2024-03-29 02:10:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:10:02.685150146Z [2024-03-29T02:10:02.684+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:11:00+00:00 2024-03-29T02:10:03.824760531Z [2024-03-29T02:10:03.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:10:03.825548019Z [2024-03-29T02:10:03.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:08:00+00:00, run_id=scheduled__2024-03-29T02:08:00+00:00, run_start_date=2024-03-29 02:10:00.423333+00:00, run_end_date=2024-03-29 02:10:03.825104+00:00, run_duration=3.401771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:08:00+00:00, data_interval_end=2024-03-29 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:10:03.841071634Z [2024-03-29T02:10:03.840+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:10:03.935406277Z [2024-03-29T02:10:03.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:08:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:03.936092426Z [2024-03-29T02:10:03.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:09:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:03.947915228Z [2024-03-29T02:10:03.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:09:00+00:00, map_index=-1, run_start_date=2024-03-29 02:10:01.973799+00:00, run_end_date=2024-03-29 02:10:02.596398+00:00, run_duration=0.622599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:00.555861+00:00, queued_by_job_id=2, pid=10212 2024-03-29T02:10:03.950953623Z [2024-03-29T02:10:03.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:08:00+00:00, map_index=-1, run_start_date=2024-03-29 02:10:02.088731+00:00, run_end_date=2024-03-29 02:10:02.998870+00:00, run_duration=0.910139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:00.555861+00:00, queued_by_job_id=2, pid=10213 2024-03-29T02:10:05.058558390Z [2024-03-29T02:10:05.058+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:10:05.058585358Z 2024-03-29T02:10:05.059214708Z [2024-03-29T02:10:05.058+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:10:05.059922816Z [2024-03-29T02:10:05.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:10:05.059933583Z 2024-03-29T02:10:05.063848674Z [2024-03-29T02:10:05.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:10:05.064253929Z [2024-03-29T02:10:05.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:10:05.137635695Z [2024-03-29T02:10:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:05.137774464Z [2024-03-29T02:10:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:05.151180253Z [2024-03-29T02:10:05.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e0ad549-de22-46e0-8927-c2d75d4664b3 2024-03-29T02:10:05.152550862Z [2024-03-29T02:10:05.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:10:03.450219+00:00, run_end_date=2024-03-29 02:10:04.040733+00:00, run_duration=0.590514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:00.555861+00:00, queued_by_job_id=2, pid=10237 2024-03-29T02:10:05.258214825Z [2024-03-29T02:10:05.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:10:05.258696159Z [2024-03-29T02:10:05.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:09:00+00:00, run_id=scheduled__2024-03-29T02:09:00+00:00, run_start_date=2024-03-29 02:10:00.427033+00:00, run_end_date=2024-03-29 02:10:05.258140+00:00, run_duration=4.831107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:09:00+00:00, data_interval_end=2024-03-29 02:10:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:10:05.271846491Z [2024-03-29T02:10:05.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:11:00+00:00 2024-03-29T02:10:05.357368765Z [2024-03-29T02:10:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:09:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:05.370474819Z [2024-03-29T02:10:05.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:09:00+00:00, map_index=-1, run_start_date=2024-03-29 02:10:03.614264+00:00, run_end_date=2024-03-29 02:10:05.046454+00:00, run_duration=1.43219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:00.555861+00:00, queued_by_job_id=2, pid=10243 2024-03-29T02:10:06.316306941Z [2024-03-29T02:10:06.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:10:06.317047039Z [2024-03-29T02:10:06.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:09:00+00:00, run_id=scheduled__2024-03-29T02:09:00+00:00, run_start_date=2024-03-29 02:10:00.428865+00:00, run_end_date=2024-03-29 02:10:06.316202+00:00, run_duration=5.887337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:09:00+00:00, data_interval_end=2024-03-29 02:10:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:10:06.329431219Z [2024-03-29T02:10:06.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:11:00+00:00 2024-03-29T02:10:06.388695289Z [2024-03-29T02:10:06.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:09:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:06.395240175Z [2024-03-29T02:10:06.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:09:00+00:00, map_index=-1, run_start_date=2024-03-29 02:10:03.855910+00:00, run_end_date=2024-03-29 02:10:05.599958+00:00, run_duration=1.744048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:00.555861+00:00, queued_by_job_id=2, pid=10244 2024-03-29T02:10:08.611906854Z [2024-03-29T02:10:08.611+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:10:08.611931156Z 2024-03-29T02:10:08.612126531Z [2024-03-29T02:10:08.611+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:10:08.612815850Z [2024-03-29T02:10:08.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:10:08.612845230Z 2024-03-29T02:10:08.615252415Z [2024-03-29T02:10:08.614+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:10:08.615280510Z [2024-03-29T02:10:08.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:10:08.666324831Z [2024-03-29T02:10:08.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:08.666360061Z [2024-03-29T02:10:08.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:08.676719647Z [2024-03-29T02:10:08.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00432ec6-dd4b-49c5-815c-418b09210aeb 2024-03-29T02:10:08.677133961Z [2024-03-29T02:10:08.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:10:07.049490+00:00, run_end_date=2024-03-29 02:10:07.514056+00:00, run_duration=0.464566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:05.060608+00:00, queued_by_job_id=2, pid=10267 2024-03-29T02:10:11.230523305Z [2024-03-29T02:10:11.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:10:11.230557090Z 2024-03-29T02:10:11.230716420Z [2024-03-29T02:10:11.230+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:10:11.231547870Z [2024-03-29T02:10:11.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:10:11.231565246Z 2024-03-29T02:10:11.234888348Z [2024-03-29T02:10:11.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:10:11.235187528Z [2024-03-29T02:10:11.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:10:11.291570951Z [2024-03-29T02:10:11.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:10:11.291852207Z [2024-03-29T02:10:11.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:11.300012039Z [2024-03-29T02:10:11.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23dabb0d-6989-4eb7-b431-b72b2df64504 2024-03-29T02:10:11.300357726Z [2024-03-29T02:10:11.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=0, run_start_date=2024-03-29 02:10:10.286908+00:00, run_end_date=2024-03-29 02:10:10.632403+00:00, run_duration=0.345495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:08.613231+00:00, queued_by_job_id=2, pid=10275 2024-03-29T02:10:13.683000090Z [2024-03-29T02:10:13.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:10:13.683450440Z [2024-03-29T02:10:13.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:05:00+00:00, run_id=scheduled__2024-03-29T02:05:00+00:00, run_start_date=2024-03-29 02:10:00.421024+00:00, run_end_date=2024-03-29 02:10:13.682869+00:00, run_duration=13.261845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:05:00+00:00, data_interval_end=2024-03-29 02:10:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:10:13.692065957Z [2024-03-29T02:10:13.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:10:13.726185837Z [2024-03-29T02:10:13.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:10:13.732352937Z [2024-03-29T02:10:13.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:10:12.856670+00:00, run_end_date=2024-03-29 02:10:13.240488+00:00, run_duration=0.383818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:10:11.232131+00:00, queued_by_job_id=2, pid=10283 2024-03-29T02:11:01.006231450Z [2024-03-29T02:11:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:01.016704569Z [2024-03-29T02:11:01.016+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:11:01.034602467Z [2024-03-29T02:11:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:01.108721091Z [2024-03-29T02:11:01.108+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:11:01.108758738Z 2024-03-29T02:11:01.108764555Z 2024-03-29T02:11:01.108769552Z 2024-03-29T02:11:01.108894678Z [2024-03-29T02:11:01.108+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:11:01.109025044Z [2024-03-29T02:11:01.108+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:11:01.109162023Z [2024-03-29T02:11:01.109+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:11:01.110002623Z [2024-03-29T02:11:01.109+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:01.110014924Z 2024-03-29T02:11:01.110019174Z 2024-03-29T02:11:01.110022671Z 2024-03-29T02:11:01.124180378Z [2024-03-29T02:11:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:11:01.124341079Z [2024-03-29T02:11:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:11:01.124606372Z [2024-03-29T02:11:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:11:01.124790472Z [2024-03-29T02:11:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:11:01.125064696Z [2024-03-29T02:11:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:11:01.125215623Z [2024-03-29T02:11:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:11:01.697027454Z [2024-03-29T02:11:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:01.697079648Z [2024-03-29T02:11:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:01.697117002Z [2024-03-29T02:11:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:01.776220934Z [2024-03-29T02:11:01.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40650b44-3893-40c3-98c4-e0dbbbc1d587 2024-03-29T02:11:01.776368409Z [2024-03-29T02:11:01.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad87bc81-057c-4e18-ac8a-3c9045889ebf 2024-03-29T02:11:01.776516752Z [2024-03-29T02:11:01.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78836a41-629d-4b9f-a7ec-8f803f296837 2024-03-29T02:11:05.038819185Z [2024-03-29T02:11:05.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:05.108404378Z [2024-03-29T02:11:05.108+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:11:05.108430957Z 2024-03-29T02:11:05.108556946Z [2024-03-29T02:11:05.108+0000] {scheduler_job.py:425} INFO - DAG vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:11:05.109134924Z [2024-03-29T02:11:05.108+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:05.109145474Z 2024-03-29T02:11:05.111955904Z [2024-03-29T02:11:05.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:11:05.112273849Z [2024-03-29T02:11:05.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:11:05.414197086Z [2024-03-29T02:11:05.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:05.508128821Z [2024-03-29T02:11:05.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f492943-c76c-468f-a1dd-12081e655a77 2024-03-29T02:11:07.318540660Z [2024-03-29T02:11:07.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:11:07.318565872Z [2024-03-29T02:11:07.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:10:00+00:00, run_id=scheduled__2024-03-29T02:10:00+00:00, run_start_date=2024-03-29 02:11:01.048286+00:00, run_end_date=2024-03-29 02:11:07.309554+00:00, run_duration=6.261268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:10:00+00:00, data_interval_end=2024-03-29 02:11:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:11:07.348299956Z [2024-03-29T02:11:07.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:07.582411123Z [2024-03-29T02:11:07.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:07.591974069Z [2024-03-29T02:11:07.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:04.558330+00:00, run_end_date=2024-03-29 02:11:05.834408+00:00, run_duration=1.276078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:01.111230+00:00, queued_by_job_id=2, pid=10312 2024-03-29T02:11:08.675865745Z [2024-03-29T02:11:08.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:11:08.678894394Z [2024-03-29T02:11:08.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:10:00+00:00, run_id=scheduled__2024-03-29T02:10:00+00:00, run_start_date=2024-03-29 02:11:01.049556+00:00, run_end_date=2024-03-29 02:11:08.675779+00:00, run_duration=7.626223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:10:00+00:00, data_interval_end=2024-03-29 02:11:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:11:08.714942664Z [2024-03-29T02:11:08.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:08.839432697Z [2024-03-29T02:11:08.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:08.845781655Z [2024-03-29T02:11:08.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:04.849726+00:00, run_end_date=2024-03-29 02:11:07.923461+00:00, run_duration=3.073735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:01.111230+00:00, queued_by_job_id=2, pid=10313 2024-03-29T02:11:09.443034539Z [2024-03-29T02:11:09.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:11:09.478132056Z [2024-03-29T02:11:09.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:11:09.478384651Z [2024-03-29T02:11:09.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:10:00+00:00, run_id=scheduled__2024-03-29T02:10:00+00:00, run_start_date=2024-03-29 02:11:01.050726+00:00, run_end_date=2024-03-29 02:11:09.478027+00:00, run_duration=8.427301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:10:00+00:00, data_interval_end=2024-03-29 02:11:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:11:09.487303536Z [2024-03-29T02:11:09.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:09.508447992Z [2024-03-29T02:11:09.508+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:11:09.508472611Z 2024-03-29T02:11:09.508525799Z [2024-03-29T02:11:09.508+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:11:09.509270304Z [2024-03-29T02:11:09.509+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:09.509297663Z 2024-03-29T02:11:09.511515975Z [2024-03-29T02:11:09.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:11:09.511709803Z [2024-03-29T02:11:09.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:11:09.559141863Z [2024-03-29T02:11:09.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:09.559345391Z [2024-03-29T02:11:09.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:09.567383888Z [2024-03-29T02:11:09.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:06.572458+00:00, run_end_date=2024-03-29 02:11:09.016694+00:00, run_duration=2.444236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:01.111230+00:00, queued_by_job_id=2, pid=10330 2024-03-29T02:11:09.567621250Z [2024-03-29T02:11:09.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b40ae4e-12f1-4db1-9567-414fa35902a8 2024-03-29T02:11:10.728442665Z [2024-03-29T02:11:10.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:11:10.728836088Z [2024-03-29T02:11:10.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, execution_date=2024-03-29 02:10:00+00:00, run_id=scheduled__2024-03-29T02:10:00+00:00, run_start_date=2024-03-29 02:11:05.049484+00:00, run_end_date=2024-03-29 02:11:10.728430+00:00, run_duration=5.678946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:10:00+00:00, data_interval_end=2024-03-29 02:11:00+00:00, dag_hash=4adc0cc80ebfbed5309f7793dbe06851 2024-03-29T02:11:10.742206337Z [2024-03-29T02:11:10.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:10.809718532Z [2024-03-29T02:11:10.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:10.817431650Z [2024-03-29T02:11:10.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:08.776025+00:00, run_end_date=2024-03-29 02:11:10.171336+00:00, run_duration=1.395311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:05.109679+00:00, queued_by_job_id=2, pid=10342 2024-03-29T02:11:11.916370702Z [2024-03-29T02:11:11.915+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:11:11.916425320Z 2024-03-29T02:11:11.917539173Z [2024-03-29T02:11:11.917+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:11:11.920973860Z [2024-03-29T02:11:11.919+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:11.920995999Z 2024-03-29T02:11:11.925655401Z [2024-03-29T02:11:11.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='split_metrics', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:11:11.925967752Z [2024-03-29T02:11:11.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'split_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:11:11.982926553Z [2024-03-29T02:11:11.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.split_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:11.982988908Z [2024-03-29T02:11:11.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:11.989905831Z [2024-03-29T02:11:11.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20e8d68c-f135-4b7b-beb0-c0b949206794 2024-03-29T02:11:11.990366598Z [2024-03-29T02:11:11.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:11.146216+00:00, run_end_date=2024-03-29 02:11:11.429443+00:00, run_duration=0.283227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:09.509616+00:00, queued_by_job_id=2, pid=10355 2024-03-29T02:11:14.862758468Z [2024-03-29T02:11:14.862+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:11:14.862788524Z 2024-03-29T02:11:14.863004710Z [2024-03-29T02:11:14.862+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:11:14.863964537Z [2024-03-29T02:11:14.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:14.863979731Z 2024-03-29T02:11:14.866563926Z [2024-03-29T02:11:14.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:11:14.866801584Z [2024-03-29T02:11:14.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'collect_metrics', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:11:14.910832542Z [2024-03-29T02:11:14.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.collect_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:14.910927934Z [2024-03-29T02:11:14.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.split_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:14.917140179Z [2024-03-29T02:11:14.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 565469c1-ddd0-4ce7-ac82-60fa36ed3317 2024-03-29T02:11:14.917241612Z [2024-03-29T02:11:14.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=split_metrics, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:13.420561+00:00, run_end_date=2024-03-29 02:11:13.769195+00:00, run_duration=0.348634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:11.922060+00:00, queued_by_job_id=2, pid=10368 2024-03-29T02:11:17.184734554Z [2024-03-29T02:11:17.184+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:11:17.184761032Z 2024-03-29T02:11:17.184933300Z [2024-03-29T02:11:17.184+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:11:17.185690782Z [2024-03-29T02:11:17.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:17.185697817Z 2024-03-29T02:11:17.188429324Z [2024-03-29T02:11:17.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:11:17.188655163Z [2024-03-29T02:11:17.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'send_prometheus', 'scheduled__2024-03-29T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:11:17.307656518Z [2024-03-29T02:11:17.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.send_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:17.307831867Z [2024-03-29T02:11:17.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.collect_metrics run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:17.313958915Z [2024-03-29T02:11:17.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad3e9fda-9e8f-4a0d-b9d0-25e2817bf2ed 2024-03-29T02:11:17.314253635Z [2024-03-29T02:11:17.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=0, run_start_date=2024-03-29 02:11:16.477369+00:00, run_end_date=2024-03-29 02:11:16.773456+00:00, run_duration=0.296087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:14.864404+00:00, queued_by_job_id=2, pid=10376 2024-03-29T02:11:19.642388529Z [2024-03-29T02:11:19.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:11:19.642846573Z [2024-03-29T02:11:19.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, execution_date=2024-03-29 02:05:00+00:00, run_id=scheduled__2024-03-29T02:05:00+00:00, run_start_date=2024-03-29 02:11:09.453456+00:00, run_end_date=2024-03-29 02:11:19.642421+00:00, run_duration=10.188965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:05:00+00:00, data_interval_end=2024-03-29 02:10:00+00:00, dag_hash=f0df30d227b92b2f37bfcc275acf20d9 2024-03-29T02:11:19.648984863Z [2024-03-29T02:11:19.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:10:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:11:19.692689532Z [2024-03-29T02:11:19.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.send_prometheus run_id=scheduled__2024-03-29T02:05:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:19.701611324Z [2024-03-29T02:11:19.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:05:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:18.909536+00:00, run_end_date=2024-03-29 02:11:19.252846+00:00, run_duration=0.34331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:17.186171+00:00, queued_by_job_id=2, pid=10394 2024-03-29T02:11:24.964095833Z [2024-03-29T02:11:24.963+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:11:25.032855461Z [2024-03-29T02:11:25.032+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:11:25.032911218Z 2024-03-29T02:11:25.033085282Z [2024-03-29T02:11:25.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:11:25.034114245Z [2024-03-29T02:11:25.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:25.034126985Z 2024-03-29T02:11:25.037763017Z [2024-03-29T02:11:25.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:11:25.037851993Z [2024-03-29T02:11:25.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:11:25.089959352Z [2024-03-29T02:11:25.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:11:25.096531789Z [2024-03-29T02:11:25.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 672cd0a1-e557-4169-a0b2-d2a10e7c471e 2024-03-29T02:11:28.995846782Z [2024-03-29T02:11:28.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:11:28.996177732Z [2024-03-29T02:11:28.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, execution_date=2024-03-29 02:10:00+00:00, run_id=scheduled__2024-03-29T02:10:00+00:00, run_start_date=2024-03-29 02:11:24.978031+00:00, run_end_date=2024-03-29 02:11:28.995757+00:00, run_duration=4.017726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:10:00+00:00, data_interval_end=2024-03-29 02:11:00+00:00, dag_hash=6edd419c2ab1c32129065e629f78d57b 2024-03-29T02:11:29.010200962Z [2024-03-29T02:11:29.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:11:00+00:00, run_after=2024-03-29T02:12:00+00:00 2024-03-29T02:11:29.043644842Z [2024-03-29T02:11:29.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:11:29.049752206Z [2024-03-29T02:11:29.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:11:26.686601+00:00, run_end_date=2024-03-29 02:11:28.195095+00:00, run_duration=1.508494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:25.034759+00:00, queued_by_job_id=2, pid=10405 2024-03-29T02:11:38.103626555Z [2024-03-29T02:11:38.102+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:11:38.103677746Z 2024-03-29T02:11:38.104067244Z [2024-03-29T02:11:38.103+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-03-29T02:11:38.105426189Z [2024-03-29T02:11:38.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:11:38.105439922Z 2024-03-29T02:11:38.109393257Z [2024-03-29T02:11:38.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240329021137_806244', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:11:38.109823577Z [2024-03-29T02:11:38.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240329021137_806244', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-29T02:11:38.170717050Z [2024-03-29T02:11:38.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240329021137_806244 exited with status queued for try_number 1 2024-03-29T02:11:38.175539106Z [2024-03-29T02:11:38.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b0bc872-72f3-41cd-9e95-7eb66125ad5f 2024-03-29T02:11:39.294870485Z [2024-03-29T02:11:39.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:11:39.295121130Z [2024-03-29T02:11:39.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-03-29 02:11:37.956124+00:00, run_id=vdu_down_20240329021137_806244, run_start_date=2024-03-29 02:11:38.070779+00:00, run_end_date=2024-03-29 02:11:39.294855+00:00, run_duration=1.224076, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-29 02:11:37.956124+00:00, data_interval_end=2024-03-29 02:11:37.956124+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-03-29T02:11:39.297805402Z [2024-03-29T02:11:39.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-03-29T02:11:39.335038594Z [2024-03-29T02:11:39.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240329021137_806244 exited with status success for try_number 1 2024-03-29T02:11:39.341423616Z [2024-03-29T02:11:39.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240329021137_806244, map_index=-1, run_start_date=2024-03-29 02:11:38.765744+00:00, run_end_date=2024-03-29 02:11:39.125257+00:00, run_duration=0.359513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:11:38.106132+00:00, queued_by_job_id=2, pid=10412 2024-03-29T02:12:00.214108990Z [2024-03-29T02:12:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:12:00.227487348Z [2024-03-29T02:12:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:12:00.236367655Z [2024-03-29T02:12:00.236+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:12:00.246556993Z [2024-03-29T02:12:00.246+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:12:00.256240623Z [2024-03-29T02:12:00.255+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:12:00.268679232Z [2024-03-29T02:12:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:12:00.385533560Z [2024-03-29T02:12:00.385+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-03-29T02:12:00.385570789Z 2024-03-29T02:12:00.385580831Z 2024-03-29T02:12:00.385588916Z 2024-03-29T02:12:00.385597026Z 2024-03-29T02:12:00.385605370Z 2024-03-29T02:12:00.385613186Z 2024-03-29T02:12:00.385869944Z [2024-03-29T02:12:00.385+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:12:00.386291436Z [2024-03-29T02:12:00.385+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:12:00.386649026Z [2024-03-29T02:12:00.386+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:12:00.387020601Z [2024-03-29T02:12:00.386+0000] {scheduler_job.py:425} INFO - DAG vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:12:00.387401209Z [2024-03-29T02:12:00.386+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:12:00.387724526Z [2024-03-29T02:12:00.387+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:12:00.388757091Z [2024-03-29T02:12:00.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:12:00.388766760Z 2024-03-29T02:12:00.388772715Z 2024-03-29T02:12:00.388778235Z 2024-03-29T02:12:00.388783418Z 2024-03-29T02:12:00.388788640Z 2024-03-29T02:12:00.388815596Z 2024-03-29T02:12:00.395507256Z [2024-03-29T02:12:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:00.395814188Z [2024-03-29T02:12:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:12:00.396222730Z [2024-03-29T02:12:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:00.396360179Z [2024-03-29T02:12:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:12:00.396746518Z [2024-03-29T02:12:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:00.396941032Z [2024-03-29T02:12:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:12:00.397233370Z [2024-03-29T02:12:00.397+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:00.397531479Z [2024-03-29T02:12:00.397+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:12:00.397850186Z [2024-03-29T02:12:00.397+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:00.397865082Z [2024-03-29T02:12:00.397+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:12:00.398280581Z [2024-03-29T02:12:00.397+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:00.398320860Z [2024-03-29T02:12:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:12:00.995442792Z [2024-03-29T02:12:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:12:00.995489381Z [2024-03-29T02:12:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status queued for try_number 1 2024-03-29T02:12:00.997742533Z [2024-03-29T02:12:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status queued for try_number 1 2024-03-29T02:12:00.997849036Z [2024-03-29T02:12:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status queued for try_number 1 2024-03-29T02:12:00.997872448Z [2024-03-29T02:12:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status queued for try_number 1 2024-03-29T02:12:00.997964212Z [2024-03-29T02:12:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status queued for try_number 1 2024-03-29T02:12:01.010922670Z [2024-03-29T02:12:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7acb44cb-e074-4015-a5f5-7614e1f7a00f 2024-03-29T02:12:01.010964572Z [2024-03-29T02:12:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d5f0818-9276-40e8-96ee-936f60569ad6 2024-03-29T02:12:01.011123416Z [2024-03-29T02:12:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to b724ebf0-6f1a-41a2-a726-6a8e68a7ca54 2024-03-29T02:12:01.011238307Z [2024-03-29T02:12:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88c849a5-cf6f-425e-9cdd-b232c25b00c9 2024-03-29T02:12:01.011372166Z [2024-03-29T02:12:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 736de4ac-1850-46e5-b71d-efaca0b73ef0 2024-03-29T02:12:01.011501719Z [2024-03-29T02:12:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04554997-94fa-4b84-988a-6440fe52694e 2024-03-29T02:12:03.422251451Z [2024-03-29T02:12:03.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:12:03.422529364Z [2024-03-29T02:12:03.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:10:00+00:00, run_id=scheduled__2024-03-29T02:10:00+00:00, run_start_date=2024-03-29 02:12:00.281172+00:00, run_end_date=2024-03-29 02:12:03.422088+00:00, run_duration=3.140916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:10:00+00:00, data_interval_end=2024-03-29 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:12:03.433804969Z [2024-03-29T02:12:03.433+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:12:03.444881888Z [2024-03-29T02:12:03.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:12:03.445181245Z [2024-03-29T02:12:03.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:11:00+00:00, run_id=scheduled__2024-03-29T02:11:00+00:00, run_start_date=2024-03-29 02:12:00.282332+00:00, run_end_date=2024-03-29 02:12:03.444738+00:00, run_duration=3.162406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:11:00+00:00, data_interval_end=2024-03-29 02:12:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:12:03.457725231Z [2024-03-29T02:12:03.457+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:12:03.558144767Z [2024-03-29T02:12:03.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:12:03.558179088Z [2024-03-29T02:12:03.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status failed for try_number 1 2024-03-29T02:12:03.558289324Z [2024-03-29T02:12:03.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status success for try_number 1 2024-03-29T02:12:03.567639250Z [2024-03-29T02:12:03.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:12:01.548812+00:00, run_end_date=2024-03-29 02:12:02.211732+00:00, run_duration=0.66292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:00.390577+00:00, queued_by_job_id=2, pid=10429 2024-03-29T02:12:03.567821684Z [2024-03-29T02:12:03.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:11:00+00:00, map_index=-1, run_start_date=2024-03-29 02:12:02.138514+00:00, run_end_date=2024-03-29 02:12:02.786969+00:00, run_duration=0.648455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:00.390577+00:00, queued_by_job_id=2, pid=10436 2024-03-29T02:12:03.568090392Z [2024-03-29T02:12:03.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:00.390577+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:12:03.568531146Z [2024-03-29T02:12:03.568+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:03.571975563Z [2024-03-29T02:12:03.570+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:03.590038360Z [2024-03-29T02:12:03.589+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240329T021100, start_date=, end_date=20240329T021203 2024-03-29T02:12:04.814302066Z [2024-03-29T02:12:04.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status failed for try_number 1 2024-03-29T02:12:04.819879003Z [2024-03-29T02:12:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:00.390577+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:12:04.820362226Z [2024-03-29T02:12:04.820+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:04.822747800Z [2024-03-29T02:12:04.822+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:04.845080398Z [2024-03-29T02:12:04.844+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240329T021100, start_date=, end_date=20240329T021204 2024-03-29T02:12:05.906584350Z [2024-03-29T02:12:05.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:12:05.906648138Z [2024-03-29T02:12:05.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:11:00+00:00, run_id=scheduled__2024-03-29T02:11:00+00:00, run_start_date=2024-03-29 02:12:00.283481+00:00, run_end_date=2024-03-29 02:12:05.903966+00:00, run_duration=5.620485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:11:00+00:00, data_interval_end=2024-03-29 02:12:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:12:05.919795046Z [2024-03-29T02:12:05.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:12:06.100880718Z [2024-03-29T02:12:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status success for try_number 1 2024-03-29T02:12:06.107645623Z [2024-03-29T02:12:06.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:11:00+00:00, map_index=-1, run_start_date=2024-03-29 02:12:03.279147+00:00, run_end_date=2024-03-29 02:12:05.390607+00:00, run_duration=2.11146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:00.390577+00:00, queued_by_job_id=2, pid=10455 2024-03-29T02:12:07.180016413Z [2024-03-29T02:12:07.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:12:07.180520455Z [2024-03-29T02:12:07.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:11:00+00:00, run_id=scheduled__2024-03-29T02:11:00+00:00, run_start_date=2024-03-29 02:12:00.285644+00:00, run_end_date=2024-03-29 02:12:07.179943+00:00, run_duration=6.894299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:11:00+00:00, data_interval_end=2024-03-29 02:12:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:12:07.196681205Z [2024-03-29T02:12:07.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:12:07.389884103Z [2024-03-29T02:12:07.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status success for try_number 1 2024-03-29T02:12:07.396874667Z [2024-03-29T02:12:07.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:11:00+00:00, map_index=-1, run_start_date=2024-03-29 02:12:04.180035+00:00, run_end_date=2024-03-29 02:12:06.415446+00:00, run_duration=2.235411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:00.390577+00:00, queued_by_job_id=2, pid=10481 2024-03-29T02:12:13.816187711Z [2024-03-29T02:12:13.815+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:12:13.816220356Z 2024-03-29T02:12:13.816357082Z [2024-03-29T02:12:13.816+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:12:13.816957630Z [2024-03-29T02:12:13.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:12:13.816976774Z 2024-03-29T02:12:13.819177406Z [2024-03-29T02:12:13.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:11:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:13.819380558Z [2024-03-29T02:12:13.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:12:13.860006823Z [2024-03-29T02:12:13.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status queued for try_number 2 2024-03-29T02:12:13.866968946Z [2024-03-29T02:12:13.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7af7ab9c-0a1e-48aa-ae7a-9280e59f4331 2024-03-29T02:12:15.023763342Z [2024-03-29T02:12:15.023+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:12:15.023814558Z 2024-03-29T02:12:15.023825870Z [2024-03-29T02:12:15.023+0000] {scheduler_job.py:425} INFO - DAG vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:12:15.024467134Z [2024-03-29T02:12:15.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:12:15.024488127Z 2024-03-29T02:12:15.027463708Z [2024-03-29T02:12:15.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:11:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:12:15.027571196Z [2024-03-29T02:12:15.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:12:15.076386983Z [2024-03-29T02:12:15.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status queued for try_number 2 2024-03-29T02:12:15.087160059Z [2024-03-29T02:12:15.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to d55b7175-d27a-4cf0-9957-3b4dd39ec70a 2024-03-29T02:12:16.149878445Z [2024-03-29T02:12:16.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status failed for try_number 2 2024-03-29T02:12:16.160735034Z [2024-03-29T02:12:16.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-29 02:12:03.574779+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:13.817251+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:12:16.161362619Z [2024-03-29T02:12:16.161+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:16.164885996Z [2024-03-29T02:12:16.164+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:16.187479647Z [2024-03-29T02:12:16.186+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240329T021100, start_date=, end_date=20240329T021216 2024-03-29T02:12:17.267942485Z [2024-03-29T02:12:17.267+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-29T02:12:17.268486738Z [2024-03-29T02:12:17.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, execution_date=2024-03-29 02:11:00+00:00, run_id=scheduled__2024-03-29T02:11:00+00:00, run_start_date=2024-03-29 02:12:00.286951+00:00, run_end_date=2024-03-29 02:12:17.267806+00:00, run_duration=16.980855, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:11:00+00:00, data_interval_end=2024-03-29 02:12:00+00:00, dag_hash=6edd419c2ab1c32129065e629f78d57b 2024-03-29T02:12:17.291297309Z [2024-03-29T02:12:17.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:12:17.325521124Z [2024-03-29T02:12:17.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:11:00+00:00 exited with status failed for try_number 2 2024-03-29T02:12:17.330301764Z [2024-03-29T02:12:17.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-29 02:12:04.826084+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:12:15.025059+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:12:17.330879172Z [2024-03-29T02:12:17.330+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:17.333563058Z [2024-03-29T02:12:17.333+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:12:17.349577798Z [2024-03-29T02:12:17.349+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240329T021100, start_date=, end_date=20240329T021217 2024-03-29T02:12:18.397471117Z [2024-03-29T02:12:18.397+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-29T02:12:18.397866125Z [2024-03-29T02:12:18.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, execution_date=2024-03-29 02:11:00+00:00, run_id=scheduled__2024-03-29T02:11:00+00:00, run_start_date=2024-03-29 02:12:00.284544+00:00, run_end_date=2024-03-29 02:12:18.397350+00:00, run_duration=18.112806, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:11:00+00:00, data_interval_end=2024-03-29 02:12:00+00:00, dag_hash=4adc0cc80ebfbed5309f7793dbe06851 2024-03-29T02:12:18.409366297Z [2024-03-29T02:12:18.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:12:00+00:00, run_after=2024-03-29T02:13:00+00:00 2024-03-29T02:13:00.348870224Z [2024-03-29T02:13:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:00.362961798Z [2024-03-29T02:13:00.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:00.374194508Z [2024-03-29T02:13:00.373+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:13:00.392155609Z [2024-03-29T02:13:00.391+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:00.401347946Z [2024-03-29T02:13:00.400+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:13:00.530394340Z [2024-03-29T02:13:00.530+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T02:13:00.530422778Z 2024-03-29T02:13:00.530426542Z 2024-03-29T02:13:00.530429679Z 2024-03-29T02:13:00.530432963Z 2024-03-29T02:13:00.530436251Z 2024-03-29T02:13:00.530673326Z [2024-03-29T02:13:00.530+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:13:00.530893495Z [2024-03-29T02:13:00.530+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:13:00.531049827Z [2024-03-29T02:13:00.530+0000] {scheduler_job.py:425} INFO - DAG vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:13:00.531218904Z [2024-03-29T02:13:00.531+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:13:00.531387784Z [2024-03-29T02:13:00.531+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:13:00.532015552Z [2024-03-29T02:13:00.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:13:00.532040231Z 2024-03-29T02:13:00.532047694Z 2024-03-29T02:13:00.532052663Z 2024-03-29T02:13:00.532057491Z 2024-03-29T02:13:00.532062046Z 2024-03-29T02:13:00.535627572Z [2024-03-29T02:13:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:13:00.535934674Z [2024-03-29T02:13:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:13:00.536435014Z [2024-03-29T02:13:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:13:00.536721070Z [2024-03-29T02:13:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:13:00.537113392Z [2024-03-29T02:13:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:13:00.537286362Z [2024-03-29T02:13:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:13:00.537624728Z [2024-03-29T02:13:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:13:00.537809382Z [2024-03-29T02:13:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:13:00.538185775Z [2024-03-29T02:13:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:13:00.538384142Z [2024-03-29T02:13:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:13:01.014627650Z [2024-03-29T02:13:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 1 2024-03-29T02:13:01.014715204Z [2024-03-29T02:13:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 1 2024-03-29T02:13:01.014976177Z [2024-03-29T02:13:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 1 2024-03-29T02:13:01.015007862Z [2024-03-29T02:13:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 1 2024-03-29T02:13:01.015250654Z [2024-03-29T02:13:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 1 2024-03-29T02:13:01.037800210Z [2024-03-29T02:13:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32b58632-ea0d-4cdd-8a9f-ea2ea3dfb06a 2024-03-29T02:13:01.038159097Z [2024-03-29T02:13:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3494eb11-3844-4e6b-b1b7-a36d1f963c77 2024-03-29T02:13:01.038590704Z [2024-03-29T02:13:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to bba0c88c-252d-462c-9da8-bd907dbc95bd 2024-03-29T02:13:01.038961391Z [2024-03-29T02:13:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c0ecd12-ea73-46c8-ad2f-28c5ed960998 2024-03-29T02:13:01.039282655Z [2024-03-29T02:13:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed211406-7b54-483d-94d7-bac8634c25ec 2024-03-29T02:13:02.571736267Z [2024-03-29T02:13:02.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:13:02.572131009Z [2024-03-29T02:13:02.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:12:00+00:00, run_id=scheduled__2024-03-29T02:12:00+00:00, run_start_date=2024-03-29 02:13:00.415631+00:00, run_end_date=2024-03-29 02:13:02.571608+00:00, run_duration=2.155977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:12:00+00:00, data_interval_end=2024-03-29 02:13:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:13:02.590878339Z [2024-03-29T02:13:02.590+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:02.696573436Z [2024-03-29T02:13:02.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status success for try_number 1 2024-03-29T02:13:02.704595653Z [2024-03-29T02:13:02.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=2024-03-29 02:13:01.447912+00:00, run_end_date=2024-03-29 02:13:02.119404+00:00, run_duration=0.671492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:13:00.532937+00:00, queued_by_job_id=2, pid=10534 2024-03-29T02:13:03.851264050Z [2024-03-29T02:13:03.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status failed for try_number 1 2024-03-29T02:13:03.851693010Z [2024-03-29T02:13:03.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status failed for try_number 1 2024-03-29T02:13:03.866983842Z [2024-03-29T02:13:03.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:13:00.532937+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:13:03.867682799Z [2024-03-29T02:13:03.867+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:03.870235524Z [2024-03-29T02:13:03.869+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:03.883996785Z [2024-03-29T02:13:03.883+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240329T021200, start_date=, end_date=20240329T021303 2024-03-29T02:13:03.891368332Z [2024-03-29T02:13:03.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:13:00.532937+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:13:03.892471734Z [2024-03-29T02:13:03.891+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:03.894692717Z [2024-03-29T02:13:03.894+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:03.907920630Z [2024-03-29T02:13:03.907+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240329T021200, start_date=, end_date=20240329T021303 2024-03-29T02:13:05.775637027Z [2024-03-29T02:13:05.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:13:05.776099939Z [2024-03-29T02:13:05.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:12:00+00:00, run_id=scheduled__2024-03-29T02:12:00+00:00, run_start_date=2024-03-29 02:13:00.417115+00:00, run_end_date=2024-03-29 02:13:05.775801+00:00, run_duration=5.358686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:12:00+00:00, data_interval_end=2024-03-29 02:13:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:13:05.787618912Z [2024-03-29T02:13:05.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:05.867439803Z [2024-03-29T02:13:05.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status success for try_number 1 2024-03-29T02:13:05.872207209Z [2024-03-29T02:13:05.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=2024-03-29 02:13:03.122372+00:00, run_end_date=2024-03-29 02:13:05.074957+00:00, run_duration=1.952585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:13:00.532937+00:00, queued_by_job_id=2, pid=10554 2024-03-29T02:13:06.907908445Z [2024-03-29T02:13:06.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:13:06.908394447Z [2024-03-29T02:13:06.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:12:00+00:00, run_id=scheduled__2024-03-29T02:12:00+00:00, run_start_date=2024-03-29 02:13:00.419614+00:00, run_end_date=2024-03-29 02:13:06.907820+00:00, run_duration=6.488206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:12:00+00:00, data_interval_end=2024-03-29 02:13:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:13:06.916901933Z [2024-03-29T02:13:06.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:06.959278870Z [2024-03-29T02:13:06.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status success for try_number 1 2024-03-29T02:13:06.963518530Z [2024-03-29T02:13:06.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=2024-03-29 02:13:03.287161+00:00, run_end_date=2024-03-29 02:13:06.678267+00:00, run_duration=3.391106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:13:00.532937+00:00, queued_by_job_id=2, pid=10555 2024-03-29T02:13:14.385419683Z [2024-03-29T02:13:14.385+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-29T02:13:14.385461691Z 2024-03-29T02:13:14.385465930Z 2024-03-29T02:13:14.385636921Z [2024-03-29T02:13:14.385+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:13:14.385821106Z [2024-03-29T02:13:14.385+0000] {scheduler_job.py:425} INFO - DAG vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e has 0/16 running and queued tasks 2024-03-29T02:13:14.386408687Z [2024-03-29T02:13:14.386+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:13:14.386417659Z 2024-03-29T02:13:14.386422214Z 2024-03-29T02:13:14.389131215Z [2024-03-29T02:13:14.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:13:14.389310539Z [2024-03-29T02:13:14.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:13:14.389718325Z [2024-03-29T02:13:14.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:13:14.389971699Z [2024-03-29T02:13:14.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:13:14.531701459Z [2024-03-29T02:13:14.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 2 2024-03-29T02:13:14.531816469Z [2024-03-29T02:13:14.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 2 2024-03-29T02:13:14.538662676Z [2024-03-29T02:13:14.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5f4fc07-70bb-41cb-9280-44923d8f15e6 2024-03-29T02:13:14.538749598Z [2024-03-29T02:13:14.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f502355-f6e7-4ae3-9709-fb8246963f5b 2024-03-29T02:13:16.033146412Z [2024-03-29T02:13:16.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status failed for try_number 2 2024-03-29T02:13:16.036303953Z [2024-03-29T02:13:16.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-29 02:13:03.872650+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:13:14.387013+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:13:16.036703897Z [2024-03-29T02:13:16.036+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:16.038964484Z [2024-03-29T02:13:16.038+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:16.052222377Z [2024-03-29T02:13:16.051+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240329T021200, start_date=, end_date=20240329T021316 2024-03-29T02:13:16.588522856Z [2024-03-29T02:13:16.587+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-29T02:13:16.588917522Z [2024-03-29T02:13:16.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e, execution_date=2024-03-29 02:12:00+00:00, run_id=scheduled__2024-03-29T02:12:00+00:00, run_start_date=2024-03-29 02:13:00.418372+00:00, run_end_date=2024-03-29 02:13:16.588427+00:00, run_duration=16.170055, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:12:00+00:00, data_interval_end=2024-03-29 02:13:00+00:00, dag_hash=4adc0cc80ebfbed5309f7793dbe06851 2024-03-29T02:13:16.602476948Z [2024-03-29T02:13:16.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:16.656630415Z [2024-03-29T02:13:16.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status failed for try_number 2 2024-03-29T02:13:16.661245839Z [2024-03-29T02:13:16.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-29 02:13:03.897110+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:13:14.387013+00:00, queued_by_job_id=2, pid=None 2024-03-29T02:13:16.661579975Z [2024-03-29T02:13:16.661+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:16.664442988Z [2024-03-29T02:13:16.664+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-29T02:13:16.676342995Z [2024-03-29T02:13:16.676+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240329T021200, start_date=, end_date=20240329T021316 2024-03-29T02:13:17.732687626Z [2024-03-29T02:13:17.732+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-29T02:13:17.733034718Z [2024-03-29T02:13:17.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e, execution_date=2024-03-29 02:12:00+00:00, run_id=scheduled__2024-03-29T02:12:00+00:00, run_start_date=2024-03-29 02:13:00.420790+00:00, run_end_date=2024-03-29 02:13:17.732554+00:00, run_duration=17.311764, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:12:00+00:00, data_interval_end=2024-03-29 02:13:00+00:00, dag_hash=6edd419c2ab1c32129065e629f78d57b 2024-03-29T02:13:17.742242179Z [2024-03-29T02:13:17.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ea9d251d-feab-4d95-8709-1550a82a0d0e to 2024-03-29T02:13:00+00:00, run_after=2024-03-29T02:14:00+00:00 2024-03-29T02:13:46.019749233Z [2024-03-29T02:13:46.019+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:14:00.440066645Z [2024-03-29T02:14:00.439+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:14:00.462256592Z [2024-03-29T02:14:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:14:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:14:00.478413858Z [2024-03-29T02:14:00.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:14:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:14:00.489241061Z [2024-03-29T02:14:00.488+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:14:00.622806876Z [2024-03-29T02:14:00.622+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:14:00.622844721Z 2024-03-29T02:14:00.622850317Z 2024-03-29T02:14:00.622855213Z 2024-03-29T02:14:00.622859741Z 2024-03-29T02:14:00.623485642Z [2024-03-29T02:14:00.623+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:14:00.624194477Z [2024-03-29T02:14:00.623+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:14:00.624736826Z [2024-03-29T02:14:00.624+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:14:00.625182439Z [2024-03-29T02:14:00.624+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:14:00.626272961Z [2024-03-29T02:14:00.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:14:00.626290726Z 2024-03-29T02:14:00.626301750Z 2024-03-29T02:14:00.626306740Z 2024-03-29T02:14:00.626311182Z 2024-03-29T02:14:00.632373101Z [2024-03-29T02:14:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:14:00.632801487Z [2024-03-29T02:14:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:14:00.633474064Z [2024-03-29T02:14:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:14:00.633910904Z [2024-03-29T02:14:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:14:00.634431874Z [2024-03-29T02:14:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:14:00.634869242Z [2024-03-29T02:14:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:14:00.635485766Z [2024-03-29T02:14:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:14:00.635794129Z [2024-03-29T02:14:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:14:01.009548475Z [2024-03-29T02:14:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status queued for try_number 1 2024-03-29T02:14:01.009669506Z [2024-03-29T02:14:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:13:00+00:00 exited with status queued for try_number 1 2024-03-29T02:14:01.009778418Z [2024-03-29T02:14:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:13:00+00:00 exited with status queued for try_number 1 2024-03-29T02:14:01.009952538Z [2024-03-29T02:14:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:13:00+00:00 exited with status queued for try_number 1 2024-03-29T02:14:01.022647229Z [2024-03-29T02:14:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10c015f5-d41f-4820-8859-2d52e3004dba 2024-03-29T02:14:01.022823543Z [2024-03-29T02:14:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4af43e30-9a0c-4ced-bba4-2e4b82181997 2024-03-29T02:14:01.022988007Z [2024-03-29T02:14:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb3baffa-1dbf-421b-be59-cda181e7bd1e 2024-03-29T02:14:01.023223009Z [2024-03-29T02:14:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9408022c-baa2-458a-88a9-a5b8b32fae88 2024-03-29T02:14:03.095189159Z [2024-03-29T02:14:03.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:14:03.095399705Z [2024-03-29T02:14:03.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:12:00+00:00, run_id=scheduled__2024-03-29T02:12:00+00:00, run_start_date=2024-03-29 02:14:00.503908+00:00, run_end_date=2024-03-29 02:14:03.095075+00:00, run_duration=2.591167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:12:00+00:00, data_interval_end=2024-03-29 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:14:03.103401936Z [2024-03-29T02:14:03.103+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:14:00+00:00, run_after=2024-03-29T02:16:00+00:00 2024-03-29T02:14:03.111657323Z [2024-03-29T02:14:03.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:14:03.111805794Z [2024-03-29T02:14:03.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:13:00+00:00, run_id=scheduled__2024-03-29T02:13:00+00:00, run_start_date=2024-03-29 02:14:00.507680+00:00, run_end_date=2024-03-29 02:14:03.111558+00:00, run_duration=2.603878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:13:00+00:00, data_interval_end=2024-03-29 02:14:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:14:03.123321312Z [2024-03-29T02:14:03.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:14:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:14:03.209565732Z [2024-03-29T02:14:03.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:12:00+00:00 exited with status success for try_number 1 2024-03-29T02:14:03.210355193Z [2024-03-29T02:14:03.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:13:00+00:00 exited with status success for try_number 1 2024-03-29T02:14:03.226364628Z [2024-03-29T02:14:03.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:12:00+00:00, map_index=-1, run_start_date=2024-03-29 02:14:01.639957+00:00, run_end_date=2024-03-29 02:14:02.281037+00:00, run_duration=0.64108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:14:00.628350+00:00, queued_by_job_id=2, pid=10632 2024-03-29T02:14:03.226936296Z [2024-03-29T02:14:03.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:13:00+00:00, map_index=-1, run_start_date=2024-03-29 02:14:01.936339+00:00, run_end_date=2024-03-29 02:14:02.404073+00:00, run_duration=0.467734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:14:00.628350+00:00, queued_by_job_id=2, pid=10633 2024-03-29T02:14:05.374835434Z [2024-03-29T02:14:05.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:14:05.375334640Z [2024-03-29T02:14:05.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:13:00+00:00, run_id=scheduled__2024-03-29T02:13:00+00:00, run_start_date=2024-03-29 02:14:00.510391+00:00, run_end_date=2024-03-29 02:14:05.374858+00:00, run_duration=4.864467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:13:00+00:00, data_interval_end=2024-03-29 02:14:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:14:05.386417530Z [2024-03-29T02:14:05.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:14:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:14:05.432344619Z [2024-03-29T02:14:05.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:13:00+00:00 exited with status success for try_number 1 2024-03-29T02:14:05.438077774Z [2024-03-29T02:14:05.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:13:00+00:00, map_index=-1, run_start_date=2024-03-29 02:14:03.406927+00:00, run_end_date=2024-03-29 02:14:05.146898+00:00, run_duration=1.739971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:14:00.628350+00:00, queued_by_job_id=2, pid=10656 2024-03-29T02:14:07.223257206Z [2024-03-29T02:14:07.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:14:07.223288920Z [2024-03-29T02:14:07.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:13:00+00:00, run_id=scheduled__2024-03-29T02:13:00+00:00, run_start_date=2024-03-29 02:14:00.512953+00:00, run_end_date=2024-03-29 02:14:07.217970+00:00, run_duration=6.705017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:13:00+00:00, data_interval_end=2024-03-29 02:14:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:14:07.238117877Z [2024-03-29T02:14:07.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:14:00+00:00, run_after=2024-03-29T02:15:00+00:00 2024-03-29T02:14:07.334640726Z [2024-03-29T02:14:07.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:13:00+00:00 exited with status success for try_number 1 2024-03-29T02:14:07.342217848Z [2024-03-29T02:14:07.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:13:00+00:00, map_index=-1, run_start_date=2024-03-29 02:14:03.659507+00:00, run_end_date=2024-03-29 02:14:06.409739+00:00, run_duration=2.750232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:14:00.628350+00:00, queued_by_job_id=2, pid=10657 2024-03-29T02:15:00.146979085Z [2024-03-29T02:15:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:15:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:15:00.158310088Z [2024-03-29T02:15:00.157+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:15:00.175094993Z [2024-03-29T02:15:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:15:00+00:00, run_after=2024-03-29T02:16:00+00:00 2024-03-29T02:15:00.190951369Z [2024-03-29T02:15:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:15:00+00:00, run_after=2024-03-29T02:16:00+00:00 2024-03-29T02:15:00.284636981Z [2024-03-29T02:15:00.284+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:15:00.284692752Z 2024-03-29T02:15:00.284701495Z 2024-03-29T02:15:00.284707495Z 2024-03-29T02:15:00.284713329Z 2024-03-29T02:15:00.284785459Z [2024-03-29T02:15:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:15:00.284807818Z [2024-03-29T02:15:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:15:00.285116832Z [2024-03-29T02:15:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:15:00.285202886Z [2024-03-29T02:15:00.285+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:15:00.286134307Z [2024-03-29T02:15:00.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:15:00.286152910Z 2024-03-29T02:15:00.286158843Z 2024-03-29T02:15:00.286163864Z 2024-03-29T02:15:00.286168324Z 2024-03-29T02:15:00.289579044Z [2024-03-29T02:15:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:15:00.290180073Z [2024-03-29T02:15:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:15:00.291016495Z [2024-03-29T02:15:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:15:00.291604572Z [2024-03-29T02:15:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:15:00.291948391Z [2024-03-29T02:15:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:15:00.292145630Z [2024-03-29T02:15:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:15:00.292508163Z [2024-03-29T02:15:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:15:00.292758957Z [2024-03-29T02:15:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:15:00.706224494Z [2024-03-29T02:15:00.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:15:00.710256954Z [2024-03-29T02:15:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status queued for try_number 1 2024-03-29T02:15:00.710422644Z [2024-03-29T02:15:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status queued for try_number 1 2024-03-29T02:15:00.710773155Z [2024-03-29T02:15:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status queued for try_number 1 2024-03-29T02:15:00.739927780Z [2024-03-29T02:15:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b6d7550-43a3-4626-b079-889a55a499a8 2024-03-29T02:15:00.740039269Z [2024-03-29T02:15:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to aac63661-f4d8-44cd-a8f1-a79d7c4224e6 2024-03-29T02:15:00.740234046Z [2024-03-29T02:15:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dee9d0a-30f8-4045-8ff0-f287c30a304c 2024-03-29T02:15:00.740410991Z [2024-03-29T02:15:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to e501e7c5-5179-4069-9d08-8871b12b538b 2024-03-29T02:15:02.249126846Z [2024-03-29T02:15:02.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:15:02.251464455Z [2024-03-29T02:15:02.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:14:00+00:00, run_id=scheduled__2024-03-29T02:14:00+00:00, run_start_date=2024-03-29 02:15:00.202210+00:00, run_end_date=2024-03-29 02:15:02.250560+00:00, run_duration=2.04835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:14:00+00:00, data_interval_end=2024-03-29 02:15:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:15:02.276081131Z [2024-03-29T02:15:02.275+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:15:00+00:00, run_after=2024-03-29T02:16:00+00:00 2024-03-29T02:15:02.347721565Z [2024-03-29T02:15:02.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status success for try_number 1 2024-03-29T02:15:02.354207878Z [2024-03-29T02:15:02.353+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:14:00+00:00, map_index=-1, run_start_date=2024-03-29 02:15:01.451668+00:00, run_end_date=2024-03-29 02:15:01.942666+00:00, run_duration=0.490998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:15:00.287114+00:00, queued_by_job_id=2, pid=10692 2024-03-29T02:15:03.454941086Z [2024-03-29T02:15:03.454+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:15:03.454986234Z 2024-03-29T02:15:03.455266389Z [2024-03-29T02:15:03.454+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:15:03.456144268Z [2024-03-29T02:15:03.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:15:03.456157215Z 2024-03-29T02:15:03.458851016Z [2024-03-29T02:15:03.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:15:03.459129493Z [2024-03-29T02:15:03.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:15:03.557825268Z [2024-03-29T02:15:03.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:15:03.574513030Z [2024-03-29T02:15:03.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45f3eb89-788c-4370-b96a-65d8c8e63ebf 2024-03-29T02:15:03.746679975Z [2024-03-29T02:15:03.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:15:03.752690529Z [2024-03-29T02:15:03.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:15:02.934757+00:00, run_end_date=2024-03-29 02:15:03.352890+00:00, run_duration=0.418133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:15:00.287114+00:00, queued_by_job_id=2, pid=10717 2024-03-29T02:15:04.805264607Z [2024-03-29T02:15:04.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:15:04.805582402Z [2024-03-29T02:15:04.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:14:00+00:00, run_id=scheduled__2024-03-29T02:14:00+00:00, run_start_date=2024-03-29 02:15:00.203300+00:00, run_end_date=2024-03-29 02:15:04.805152+00:00, run_duration=4.601852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:14:00+00:00, data_interval_end=2024-03-29 02:15:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:15:04.816621325Z [2024-03-29T02:15:04.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:15:00+00:00, run_after=2024-03-29T02:16:00+00:00 2024-03-29T02:15:04.824486321Z [2024-03-29T02:15:04.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:15:04.824704168Z [2024-03-29T02:15:04.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:14:00+00:00, run_id=scheduled__2024-03-29T02:14:00+00:00, run_start_date=2024-03-29 02:15:00.204394+00:00, run_end_date=2024-03-29 02:15:04.824364+00:00, run_duration=4.61997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:14:00+00:00, data_interval_end=2024-03-29 02:15:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:15:04.834966426Z [2024-03-29T02:15:04.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:15:00+00:00, run_after=2024-03-29T02:16:00+00:00 2024-03-29T02:15:04.883790444Z [2024-03-29T02:15:04.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status success for try_number 1 2024-03-29T02:15:04.883909464Z [2024-03-29T02:15:04.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status success for try_number 1 2024-03-29T02:15:04.893164565Z [2024-03-29T02:15:04.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:14:00+00:00, map_index=-1, run_start_date=2024-03-29 02:15:02.620844+00:00, run_end_date=2024-03-29 02:15:03.881746+00:00, run_duration=1.260902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:15:00.287114+00:00, queued_by_job_id=2, pid=10711 2024-03-29T02:15:04.893511132Z [2024-03-29T02:15:04.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:14:00+00:00, map_index=-1, run_start_date=2024-03-29 02:15:02.596369+00:00, run_end_date=2024-03-29 02:15:04.262536+00:00, run_duration=1.666167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:15:00.287114+00:00, queued_by_job_id=2, pid=10710 2024-03-29T02:15:07.102026489Z [2024-03-29T02:15:07.101+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:15:07.102077294Z 2024-03-29T02:15:07.102155674Z [2024-03-29T02:15:07.101+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:15:07.102855446Z [2024-03-29T02:15:07.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:15:07.102866237Z 2024-03-29T02:15:07.105869397Z [2024-03-29T02:15:07.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:15:07.106025535Z [2024-03-29T02:15:07.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:15:07.169981226Z [2024-03-29T02:15:07.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:15:07.170065331Z [2024-03-29T02:15:07.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:15:07.177559032Z [2024-03-29T02:15:07.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19a37dde-3fa3-4f6d-8a5b-9d5f17aa56ce 2024-03-29T02:15:07.177720697Z [2024-03-29T02:15:07.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:15:05.465805+00:00, run_end_date=2024-03-29 02:15:06.015744+00:00, run_duration=0.549939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:15:03.456647+00:00, queued_by_job_id=2, pid=10740 2024-03-29T02:15:09.597108884Z [2024-03-29T02:15:09.596+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:15:09.597138335Z 2024-03-29T02:15:09.597547925Z [2024-03-29T02:15:09.597+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:15:09.598336680Z [2024-03-29T02:15:09.598+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:15:09.598353763Z 2024-03-29T02:15:09.601542505Z [2024-03-29T02:15:09.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:15:09.601826988Z [2024-03-29T02:15:09.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:15:09.669747481Z [2024-03-29T02:15:09.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status queued for try_number 1 2024-03-29T02:15:09.669779135Z [2024-03-29T02:15:09.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:15:09.680177003Z [2024-03-29T02:15:09.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4495ee1c-6e96-4e63-bbcb-2a6453280e1e 2024-03-29T02:15:09.680405817Z [2024-03-29T02:15:09.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=0, run_start_date=2024-03-29 02:15:09.009538+00:00, run_end_date=2024-03-29 02:15:09.308361+00:00, run_duration=0.298823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:15:07.103631+00:00, queued_by_job_id=2, pid=10748 2024-03-29T02:15:11.947886086Z [2024-03-29T02:15:11.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:15:11.948231553Z [2024-03-29T02:15:11.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:10:00+00:00, run_id=scheduled__2024-03-29T02:10:00+00:00, run_start_date=2024-03-29 02:15:00.201074+00:00, run_end_date=2024-03-29 02:15:11.947789+00:00, run_duration=11.746715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:10:00+00:00, data_interval_end=2024-03-29 02:15:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:15:11.960649148Z [2024-03-29T02:15:11.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:15:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:15:12.003138048Z [2024-03-29T02:15:12.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:10:00+00:00 exited with status success for try_number 1 2024-03-29T02:15:12.016193374Z [2024-03-29T02:15:12.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:10:00+00:00, map_index=-1, run_start_date=2024-03-29 02:15:11.152630+00:00, run_end_date=2024-03-29 02:15:11.500914+00:00, run_duration=0.348284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:15:09.598926+00:00, queued_by_job_id=2, pid=10756 2024-03-29T02:16:01.048966696Z [2024-03-29T02:16:01.048+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:16:01.069422900Z [2024-03-29T02:16:01.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:16:00+00:00, run_after=2024-03-29T02:17:00+00:00 2024-03-29T02:16:01.079764070Z [2024-03-29T02:16:01.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:16:01.098537979Z [2024-03-29T02:16:01.098+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:16:00+00:00, run_after=2024-03-29T02:17:00+00:00 2024-03-29T02:16:01.204106970Z [2024-03-29T02:16:01.203+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:16:01.204141975Z 2024-03-29T02:16:01.204150662Z 2024-03-29T02:16:01.204155819Z 2024-03-29T02:16:01.204160749Z 2024-03-29T02:16:01.204500484Z [2024-03-29T02:16:01.204+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:16:01.204827862Z [2024-03-29T02:16:01.204+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:16:01.205195957Z [2024-03-29T02:16:01.204+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:16:01.205534315Z [2024-03-29T02:16:01.205+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:16:01.206794715Z [2024-03-29T02:16:01.206+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:16:01.206813997Z 2024-03-29T02:16:01.206831379Z 2024-03-29T02:16:01.206836680Z 2024-03-29T02:16:01.206842101Z 2024-03-29T02:16:01.212757760Z [2024-03-29T02:16:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:16:01.213318544Z [2024-03-29T02:16:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:16:01.213886427Z [2024-03-29T02:16:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:16:01.214213956Z [2024-03-29T02:16:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:16:01.214804281Z [2024-03-29T02:16:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:16:01.215243966Z [2024-03-29T02:16:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:16:01.215803656Z [2024-03-29T02:16:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:16:01.216209895Z [2024-03-29T02:16:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:16:01.844853077Z [2024-03-29T02:16:01.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status queued for try_number 1 2024-03-29T02:16:01.845318662Z [2024-03-29T02:16:01.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status queued for try_number 1 2024-03-29T02:16:01.845533218Z [2024-03-29T02:16:01.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status queued for try_number 1 2024-03-29T02:16:01.850465266Z [2024-03-29T02:16:01.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status queued for try_number 1 2024-03-29T02:16:01.878933857Z [2024-03-29T02:16:01.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9132ff0-27ad-4201-9a36-1291493405be 2024-03-29T02:16:01.879107755Z [2024-03-29T02:16:01.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to bed1cbbf-cc56-4022-9649-e65f6e8390d6 2024-03-29T02:16:01.879280389Z [2024-03-29T02:16:01.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b772c52-9198-4989-885d-d9be693aadc8 2024-03-29T02:16:01.879380143Z [2024-03-29T02:16:01.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88cb9c2b-ee2e-4fd0-800c-a2a15f128e7f 2024-03-29T02:16:02.966855275Z [2024-03-29T02:16:02.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:16:02.967667454Z [2024-03-29T02:16:02.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:14:00+00:00, run_id=scheduled__2024-03-29T02:14:00+00:00, run_start_date=2024-03-29 02:16:01.112307+00:00, run_end_date=2024-03-29 02:16:02.967050+00:00, run_duration=1.854743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:14:00+00:00, data_interval_end=2024-03-29 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:16:02.981766830Z [2024-03-29T02:16:02.981+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:16:00+00:00, run_after=2024-03-29T02:18:00+00:00 2024-03-29T02:16:03.125606125Z [2024-03-29T02:16:03.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:14:00+00:00 exited with status success for try_number 1 2024-03-29T02:16:03.132799975Z [2024-03-29T02:16:03.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:14:00+00:00, map_index=-1, run_start_date=2024-03-29 02:16:02.141018+00:00, run_end_date=2024-03-29 02:16:02.763057+00:00, run_duration=0.622039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:16:01.208401+00:00, queued_by_job_id=2, pid=10779 2024-03-29T02:16:04.210499198Z [2024-03-29T02:16:04.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:16:04.210890509Z [2024-03-29T02:16:04.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:15:00+00:00, run_id=scheduled__2024-03-29T02:15:00+00:00, run_start_date=2024-03-29 02:16:01.114088+00:00, run_end_date=2024-03-29 02:16:04.210287+00:00, run_duration=3.096199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:15:00+00:00, data_interval_end=2024-03-29 02:16:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:16:04.221880372Z [2024-03-29T02:16:04.221+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:16:00+00:00, run_after=2024-03-29T02:17:00+00:00 2024-03-29T02:16:04.281702569Z [2024-03-29T02:16:04.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status success for try_number 1 2024-03-29T02:16:04.287649695Z [2024-03-29T02:16:04.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:15:00+00:00, map_index=-1, run_start_date=2024-03-29 02:16:02.443225+00:00, run_end_date=2024-03-29 02:16:03.067707+00:00, run_duration=0.624482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:16:01.208401+00:00, queued_by_job_id=2, pid=10782 2024-03-29T02:16:05.337821109Z [2024-03-29T02:16:05.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:16:05.338121682Z [2024-03-29T02:16:05.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:15:00+00:00, run_id=scheduled__2024-03-29T02:15:00+00:00, run_start_date=2024-03-29 02:16:01.115749+00:00, run_end_date=2024-03-29 02:16:05.337696+00:00, run_duration=4.221947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:15:00+00:00, data_interval_end=2024-03-29 02:16:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:16:05.348526508Z [2024-03-29T02:16:05.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:16:00+00:00, run_after=2024-03-29T02:17:00+00:00 2024-03-29T02:16:05.401482083Z [2024-03-29T02:16:05.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status success for try_number 1 2024-03-29T02:16:05.409119075Z [2024-03-29T02:16:05.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:15:00+00:00, map_index=-1, run_start_date=2024-03-29 02:16:03.619967+00:00, run_end_date=2024-03-29 02:16:05.082785+00:00, run_duration=1.462818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:16:01.208401+00:00, queued_by_job_id=2, pid=10804 2024-03-29T02:16:06.455862000Z [2024-03-29T02:16:06.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:16:06.456030515Z [2024-03-29T02:16:06.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:15:00+00:00, run_id=scheduled__2024-03-29T02:15:00+00:00, run_start_date=2024-03-29 02:16:01.117834+00:00, run_end_date=2024-03-29 02:16:06.455736+00:00, run_duration=5.337902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:15:00+00:00, data_interval_end=2024-03-29 02:16:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:16:06.472426046Z [2024-03-29T02:16:06.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:16:00+00:00, run_after=2024-03-29T02:17:00+00:00 2024-03-29T02:16:06.510347921Z [2024-03-29T02:16:06.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status success for try_number 1 2024-03-29T02:16:06.523683109Z [2024-03-29T02:16:06.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:15:00+00:00, map_index=-1, run_start_date=2024-03-29 02:16:03.524676+00:00, run_end_date=2024-03-29 02:16:05.934596+00:00, run_duration=2.40992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:16:01.208401+00:00, queued_by_job_id=2, pid=10803 2024-03-29T02:17:00.978263523Z [2024-03-29T02:17:00.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:17:00+00:00, run_after=2024-03-29T02:18:00+00:00 2024-03-29T02:17:00.993622619Z [2024-03-29T02:17:00.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:17:00+00:00, run_after=2024-03-29T02:18:00+00:00 2024-03-29T02:17:01.004099810Z [2024-03-29T02:17:01.003+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:17:01.084665876Z [2024-03-29T02:17:01.084+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:17:01.084700089Z 2024-03-29T02:17:01.084705972Z 2024-03-29T02:17:01.084711167Z 2024-03-29T02:17:01.085043331Z [2024-03-29T02:17:01.084+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:17:01.085323282Z [2024-03-29T02:17:01.085+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:17:01.085612184Z [2024-03-29T02:17:01.085+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:17:01.086760531Z [2024-03-29T02:17:01.086+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:17:01.086783997Z 2024-03-29T02:17:01.086788960Z 2024-03-29T02:17:01.086793246Z 2024-03-29T02:17:01.091672066Z [2024-03-29T02:17:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:17:01.092036209Z [2024-03-29T02:17:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:17:01.092528041Z [2024-03-29T02:17:01.092+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:17:01.092825964Z [2024-03-29T02:17:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:17:01.093310499Z [2024-03-29T02:17:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:17:01.093737503Z [2024-03-29T02:17:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:17:01.363730705Z [2024-03-29T02:17:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status queued for try_number 1 2024-03-29T02:17:01.363796999Z [2024-03-29T02:17:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status queued for try_number 1 2024-03-29T02:17:01.363893596Z [2024-03-29T02:17:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status queued for try_number 1 2024-03-29T02:17:01.373953111Z [2024-03-29T02:17:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f168767-dea1-474c-b461-509fb91101dc 2024-03-29T02:17:01.374296580Z [2024-03-29T02:17:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to d599eb85-8bc7-4efc-b6ec-b6a8c89abc9a 2024-03-29T02:17:01.374697730Z [2024-03-29T02:17:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cbe4e88-2a8b-465a-9062-7d3b00ba3756 2024-03-29T02:17:02.638328868Z [2024-03-29T02:17:02.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status success for try_number 1 2024-03-29T02:17:02.648696223Z [2024-03-29T02:17:02.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:16:00+00:00, map_index=-1, run_start_date=2024-03-29 02:17:01.976090+00:00, run_end_date=2024-03-29 02:17:02.444264+00:00, run_duration=0.468174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:17:01.088050+00:00, queued_by_job_id=2, pid=10837 2024-03-29T02:17:02.805825775Z [2024-03-29T02:17:02.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:17:02.806256406Z [2024-03-29T02:17:02.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:16:00+00:00, run_id=scheduled__2024-03-29T02:16:00+00:00, run_start_date=2024-03-29 02:17:01.016011+00:00, run_end_date=2024-03-29 02:17:02.805744+00:00, run_duration=1.789733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:16:00+00:00, data_interval_end=2024-03-29 02:17:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:17:02.817231993Z [2024-03-29T02:17:02.816+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:17:00+00:00, run_after=2024-03-29T02:18:00+00:00 2024-03-29T02:17:05.050436001Z [2024-03-29T02:17:05.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:17:05.051096714Z [2024-03-29T02:17:05.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:16:00+00:00, run_id=scheduled__2024-03-29T02:16:00+00:00, run_start_date=2024-03-29 02:17:01.017166+00:00, run_end_date=2024-03-29 02:17:05.050549+00:00, run_duration=4.033383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:16:00+00:00, data_interval_end=2024-03-29 02:17:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:17:05.062101843Z [2024-03-29T02:17:05.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:17:00+00:00, run_after=2024-03-29T02:18:00+00:00 2024-03-29T02:17:05.100950963Z [2024-03-29T02:17:05.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status success for try_number 1 2024-03-29T02:17:05.107864732Z [2024-03-29T02:17:05.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:16:00+00:00, map_index=-1, run_start_date=2024-03-29 02:17:03.123430+00:00, run_end_date=2024-03-29 02:17:04.625787+00:00, run_duration=1.502357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:17:01.088050+00:00, queued_by_job_id=2, pid=10856 2024-03-29T02:17:06.147928887Z [2024-03-29T02:17:06.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:17:06.148154692Z [2024-03-29T02:17:06.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:16:00+00:00, run_id=scheduled__2024-03-29T02:16:00+00:00, run_start_date=2024-03-29 02:17:01.018166+00:00, run_end_date=2024-03-29 02:17:06.147862+00:00, run_duration=5.129696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:16:00+00:00, data_interval_end=2024-03-29 02:17:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:17:06.160135580Z [2024-03-29T02:17:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:17:00+00:00, run_after=2024-03-29T02:18:00+00:00 2024-03-29T02:17:06.209532059Z [2024-03-29T02:17:06.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status success for try_number 1 2024-03-29T02:17:06.214925095Z [2024-03-29T02:17:06.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:16:00+00:00, map_index=-1, run_start_date=2024-03-29 02:17:02.995530+00:00, run_end_date=2024-03-29 02:17:05.208923+00:00, run_duration=2.213393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:17:01.088050+00:00, queued_by_job_id=2, pid=10855 2024-03-29T02:18:00.734821582Z [2024-03-29T02:18:00.734+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:18:00.748326278Z [2024-03-29T02:18:00.747+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:18:00.770538431Z [2024-03-29T02:18:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:18:00+00:00, run_after=2024-03-29T02:19:00+00:00 2024-03-29T02:18:00.787051620Z [2024-03-29T02:18:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:18:00+00:00, run_after=2024-03-29T02:19:00+00:00 2024-03-29T02:18:00.879429889Z [2024-03-29T02:18:00.878+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:18:00.879468993Z 2024-03-29T02:18:00.879473792Z 2024-03-29T02:18:00.879477434Z 2024-03-29T02:18:00.879480870Z 2024-03-29T02:18:00.879594421Z [2024-03-29T02:18:00.879+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:18:00.879699927Z [2024-03-29T02:18:00.879+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:18:00.879879667Z [2024-03-29T02:18:00.879+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:18:00.880014470Z [2024-03-29T02:18:00.879+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:18:00.880672623Z [2024-03-29T02:18:00.880+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:18:00.880678711Z 2024-03-29T02:18:00.880682125Z 2024-03-29T02:18:00.880686131Z 2024-03-29T02:18:00.880689825Z 2024-03-29T02:18:00.884638707Z [2024-03-29T02:18:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:18:00.884822994Z [2024-03-29T02:18:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:18:00.885074688Z [2024-03-29T02:18:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:18:00.885204727Z [2024-03-29T02:18:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:18:00.885540250Z [2024-03-29T02:18:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:18:00.885638166Z [2024-03-29T02:18:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:18:00.886023482Z [2024-03-29T02:18:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:18:00.886299359Z [2024-03-29T02:18:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:18:01.414658305Z [2024-03-29T02:18:01.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status queued for try_number 1 2024-03-29T02:18:01.414885317Z [2024-03-29T02:18:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:17:00+00:00 exited with status queued for try_number 1 2024-03-29T02:18:01.416182702Z [2024-03-29T02:18:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:17:00+00:00 exited with status queued for try_number 1 2024-03-29T02:18:01.416394466Z [2024-03-29T02:18:01.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:17:00+00:00 exited with status queued for try_number 1 2024-03-29T02:18:01.434784414Z [2024-03-29T02:18:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac314a6f-174e-423f-9c9c-662904500cec 2024-03-29T02:18:01.435250582Z [2024-03-29T02:18:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 940ed30f-4191-4a8b-8e22-a3ce606cb3d4 2024-03-29T02:18:01.435430444Z [2024-03-29T02:18:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3aaa462-c518-44d5-ab50-95dbfe8d3893 2024-03-29T02:18:01.435610152Z [2024-03-29T02:18:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to acf15f01-4c5a-4f2e-8919-87918b3bf7af 2024-03-29T02:18:03.100005257Z [2024-03-29T02:18:03.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:18:03.100392511Z [2024-03-29T02:18:03.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:16:00+00:00, run_id=scheduled__2024-03-29T02:16:00+00:00, run_start_date=2024-03-29 02:18:00.799990+00:00, run_end_date=2024-03-29 02:18:03.099973+00:00, run_duration=2.299983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:16:00+00:00, data_interval_end=2024-03-29 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:18:03.109956717Z [2024-03-29T02:18:03.109+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:18:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:18:03.121094089Z [2024-03-29T02:18:03.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:18:03.122333916Z [2024-03-29T02:18:03.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:17:00+00:00, run_id=scheduled__2024-03-29T02:17:00+00:00, run_start_date=2024-03-29 02:18:00.802849+00:00, run_end_date=2024-03-29 02:18:03.121004+00:00, run_duration=2.318155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:17:00+00:00, data_interval_end=2024-03-29 02:18:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:18:03.146175698Z [2024-03-29T02:18:03.145+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:18:00+00:00, run_after=2024-03-29T02:19:00+00:00 2024-03-29T02:18:03.223673409Z [2024-03-29T02:18:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:16:00+00:00 exited with status success for try_number 1 2024-03-29T02:18:03.223973844Z [2024-03-29T02:18:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:17:00+00:00 exited with status success for try_number 1 2024-03-29T02:18:03.237372422Z [2024-03-29T02:18:03.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:17:00+00:00, map_index=-1, run_start_date=2024-03-29 02:18:02.214549+00:00, run_end_date=2024-03-29 02:18:02.725128+00:00, run_duration=0.510579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:18:00.881688+00:00, queued_by_job_id=2, pid=10890 2024-03-29T02:18:03.238197261Z [2024-03-29T02:18:03.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:16:00+00:00, map_index=-1, run_start_date=2024-03-29 02:18:02.187359+00:00, run_end_date=2024-03-29 02:18:02.740733+00:00, run_duration=0.553374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:18:00.881688+00:00, queued_by_job_id=2, pid=10889 2024-03-29T02:18:05.902137836Z [2024-03-29T02:18:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:18:05.902270180Z [2024-03-29T02:18:05.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:17:00+00:00, run_id=scheduled__2024-03-29T02:17:00+00:00, run_start_date=2024-03-29 02:18:00.808447+00:00, run_end_date=2024-03-29 02:18:05.902009+00:00, run_duration=5.093562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:17:00+00:00, data_interval_end=2024-03-29 02:18:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:18:05.937103616Z [2024-03-29T02:18:05.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:18:00+00:00, run_after=2024-03-29T02:19:00+00:00 2024-03-29T02:18:05.956189279Z [2024-03-29T02:18:05.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:18:05.956206682Z [2024-03-29T02:18:05.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:17:00+00:00, run_id=scheduled__2024-03-29T02:17:00+00:00, run_start_date=2024-03-29 02:18:00.810013+00:00, run_end_date=2024-03-29 02:18:05.954708+00:00, run_duration=5.144695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:17:00+00:00, data_interval_end=2024-03-29 02:18:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:18:05.972031426Z [2024-03-29T02:18:05.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:18:00+00:00, run_after=2024-03-29T02:19:00+00:00 2024-03-29T02:18:06.073553680Z [2024-03-29T02:18:06.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:17:00+00:00 exited with status success for try_number 1 2024-03-29T02:18:06.073584207Z [2024-03-29T02:18:06.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:17:00+00:00 exited with status success for try_number 1 2024-03-29T02:18:06.085546285Z [2024-03-29T02:18:06.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:17:00+00:00, map_index=-1, run_start_date=2024-03-29 02:18:03.464781+00:00, run_end_date=2024-03-29 02:18:04.853549+00:00, run_duration=1.388768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:18:00.881688+00:00, queued_by_job_id=2, pid=10913 2024-03-29T02:18:06.085576299Z [2024-03-29T02:18:06.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:17:00+00:00, map_index=-1, run_start_date=2024-03-29 02:18:03.339142+00:00, run_end_date=2024-03-29 02:18:05.206395+00:00, run_duration=1.867253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:18:00.881688+00:00, queued_by_job_id=2, pid=10912 2024-03-29T02:18:46.087294963Z [2024-03-29T02:18:46.086+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:19:00.506970995Z [2024-03-29T02:19:00.506+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:19:00.526533337Z [2024-03-29T02:19:00.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:19:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:19:00.541972203Z [2024-03-29T02:19:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:19:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:19:00.626007268Z [2024-03-29T02:19:00.625+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:19:00.626030612Z 2024-03-29T02:19:00.626034523Z 2024-03-29T02:19:00.626037989Z 2024-03-29T02:19:00.626524051Z [2024-03-29T02:19:00.625+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:19:00.626745221Z [2024-03-29T02:19:00.626+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:19:00.626924557Z [2024-03-29T02:19:00.626+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:19:00.627685620Z [2024-03-29T02:19:00.627+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:19:00.627698889Z 2024-03-29T02:19:00.627702413Z 2024-03-29T02:19:00.627705809Z 2024-03-29T02:19:00.631985218Z [2024-03-29T02:19:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:19:00.632024956Z [2024-03-29T02:19:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:19:00.632242071Z [2024-03-29T02:19:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:19:00.632337048Z [2024-03-29T02:19:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:19:00.632508674Z [2024-03-29T02:19:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:19:00.632547003Z [2024-03-29T02:19:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:19:01.042678035Z [2024-03-29T02:19:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status queued for try_number 1 2024-03-29T02:19:01.042931507Z [2024-03-29T02:19:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status queued for try_number 1 2024-03-29T02:19:01.042940911Z [2024-03-29T02:19:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status queued for try_number 1 2024-03-29T02:19:01.058579431Z [2024-03-29T02:19:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf1a929a-928e-49fc-8f6d-6c6acf4b3699 2024-03-29T02:19:01.058612168Z [2024-03-29T02:19:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to b87596fe-1718-49be-820e-cc9990cbefe0 2024-03-29T02:19:01.058618063Z [2024-03-29T02:19:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4e26122-f4f6-4092-b212-35bf0730238e 2024-03-29T02:19:03.469626736Z [2024-03-29T02:19:03.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:19:03.470265963Z [2024-03-29T02:19:03.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:18:00+00:00, run_id=scheduled__2024-03-29T02:18:00+00:00, run_start_date=2024-03-29 02:19:00.552547+00:00, run_end_date=2024-03-29 02:19:03.469789+00:00, run_duration=2.917242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:18:00+00:00, data_interval_end=2024-03-29 02:19:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:19:03.480483886Z [2024-03-29T02:19:03.480+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:19:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:19:03.539219821Z [2024-03-29T02:19:03.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status success for try_number 1 2024-03-29T02:19:03.545705511Z [2024-03-29T02:19:03.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:18:00+00:00, map_index=-1, run_start_date=2024-03-29 02:19:02.076668+00:00, run_end_date=2024-03-29 02:19:02.734216+00:00, run_duration=0.657548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:19:00.628802+00:00, queued_by_job_id=2, pid=10946 2024-03-29T02:19:08.533458261Z [2024-03-29T02:19:08.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:19:08.533788827Z [2024-03-29T02:19:08.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:18:00+00:00, run_id=scheduled__2024-03-29T02:18:00+00:00, run_start_date=2024-03-29 02:19:00.553751+00:00, run_end_date=2024-03-29 02:19:08.533347+00:00, run_duration=7.979596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:18:00+00:00, data_interval_end=2024-03-29 02:19:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:19:08.543435170Z [2024-03-29T02:19:08.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:19:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:19:08.558529970Z [2024-03-29T02:19:08.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:19:08.559010176Z [2024-03-29T02:19:08.558+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:18:00+00:00, run_id=scheduled__2024-03-29T02:18:00+00:00, run_start_date=2024-03-29 02:19:00.554791+00:00, run_end_date=2024-03-29 02:19:08.558384+00:00, run_duration=8.003593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:18:00+00:00, data_interval_end=2024-03-29 02:19:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:19:08.580165321Z [2024-03-29T02:19:08.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:19:00+00:00, run_after=2024-03-29T02:20:00+00:00 2024-03-29T02:19:08.695431405Z [2024-03-29T02:19:08.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status success for try_number 1 2024-03-29T02:19:08.695590261Z [2024-03-29T02:19:08.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status success for try_number 1 2024-03-29T02:19:08.706000660Z [2024-03-29T02:19:08.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:18:00+00:00, map_index=-1, run_start_date=2024-03-29 02:19:04.236322+00:00, run_end_date=2024-03-29 02:19:07.434941+00:00, run_duration=3.198619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:19:00.628802+00:00, queued_by_job_id=2, pid=10964 2024-03-29T02:19:08.706378504Z [2024-03-29T02:19:08.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:18:00+00:00, map_index=-1, run_start_date=2024-03-29 02:19:04.345719+00:00, run_end_date=2024-03-29 02:19:08.020078+00:00, run_duration=3.674359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:19:00.628802+00:00, queued_by_job_id=2, pid=10965 2024-03-29T02:20:00.086536558Z [2024-03-29T02:20:00.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:25:00+00:00 2024-03-29T02:20:00.093785628Z [2024-03-29T02:20:00.093+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:20:00.100444503Z [2024-03-29T02:20:00.100+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:20:00.112040594Z [2024-03-29T02:20:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:21:00+00:00 2024-03-29T02:20:00.124862154Z [2024-03-29T02:20:00.124+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:21:00+00:00 2024-03-29T02:20:00.205925582Z [2024-03-29T02:20:00.205+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T02:20:00.205949796Z 2024-03-29T02:20:00.205954371Z 2024-03-29T02:20:00.205959287Z 2024-03-29T02:20:00.205994447Z 2024-03-29T02:20:00.205999679Z 2024-03-29T02:20:00.206020132Z [2024-03-29T02:20:00.205+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:20:00.206284059Z [2024-03-29T02:20:00.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:20:00.206407320Z [2024-03-29T02:20:00.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:20:00.206539427Z [2024-03-29T02:20:00.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:20:00.206671059Z [2024-03-29T02:20:00.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:20:00.207266137Z [2024-03-29T02:20:00.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:20:00.207279968Z 2024-03-29T02:20:00.207284882Z 2024-03-29T02:20:00.207289347Z 2024-03-29T02:20:00.207293390Z 2024-03-29T02:20:00.207297471Z 2024-03-29T02:20:00.211044277Z [2024-03-29T02:20:00.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:20:00.211186392Z [2024-03-29T02:20:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:20:00.211427444Z [2024-03-29T02:20:00.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:20:00.211706516Z [2024-03-29T02:20:00.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:20:00.211950293Z [2024-03-29T02:20:00.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:20:00.212087003Z [2024-03-29T02:20:00.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:20:00.212342793Z [2024-03-29T02:20:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:20:00.212491930Z [2024-03-29T02:20:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:20:00.212777363Z [2024-03-29T02:20:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:20:00.212907850Z [2024-03-29T02:20:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:20:00.812715659Z [2024-03-29T02:20:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:00.813061375Z [2024-03-29T02:20:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:00.813259029Z [2024-03-29T02:20:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:19:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:00.813426009Z [2024-03-29T02:20:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:19:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:00.813597387Z [2024-03-29T02:20:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:19:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:00.836315971Z [2024-03-29T02:20:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a90eb2b-e4b8-4b50-aca7-e777581940a3 2024-03-29T02:20:00.838246406Z [2024-03-29T02:20:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ad6835b-f1f2-4ef3-bd23-a03d5bc22104 2024-03-29T02:20:00.838546302Z [2024-03-29T02:20:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93da0688-4831-4b96-9b27-36b2f172aa8a 2024-03-29T02:20:00.838731566Z [2024-03-29T02:20:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to f537e884-7973-4547-bc91-d582ecd79b7c 2024-03-29T02:20:00.838918565Z [2024-03-29T02:20:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd76c82e-3e1e-49cb-9014-0e82f2225496 2024-03-29T02:20:03.520493896Z [2024-03-29T02:20:03.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:20:03.526716312Z [2024-03-29T02:20:03.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:18:00+00:00, run_id=scheduled__2024-03-29T02:18:00+00:00, run_start_date=2024-03-29 02:20:00.136481+00:00, run_end_date=2024-03-29 02:20:03.520408+00:00, run_duration=3.383927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:18:00+00:00, data_interval_end=2024-03-29 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:20:03.553364878Z [2024-03-29T02:20:03.553+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:22:00+00:00 2024-03-29T02:20:03.576106650Z [2024-03-29T02:20:03.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:20:03.576636566Z [2024-03-29T02:20:03.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:19:00+00:00, run_id=scheduled__2024-03-29T02:19:00+00:00, run_start_date=2024-03-29 02:20:00.137641+00:00, run_end_date=2024-03-29 02:20:03.576032+00:00, run_duration=3.438391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:19:00+00:00, data_interval_end=2024-03-29 02:20:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:20:03.601274433Z [2024-03-29T02:20:03.600+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:21:00+00:00 2024-03-29T02:20:03.773105140Z [2024-03-29T02:20:03.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:18:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:03.773340600Z [2024-03-29T02:20:03.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:19:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:03.792766489Z [2024-03-29T02:20:03.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:18:00+00:00, map_index=-1, run_start_date=2024-03-29 02:20:01.963416+00:00, run_end_date=2024-03-29 02:20:02.704735+00:00, run_duration=0.741319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:00.208199+00:00, queued_by_job_id=2, pid=10999 2024-03-29T02:20:03.793084199Z [2024-03-29T02:20:03.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:19:00+00:00, map_index=-1, run_start_date=2024-03-29 02:20:01.996214+00:00, run_end_date=2024-03-29 02:20:03.169126+00:00, run_duration=1.172912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:00.208199+00:00, queued_by_job_id=2, pid=11000 2024-03-29T02:20:05.158618254Z [2024-03-29T02:20:05.152+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:20:05.158649931Z 2024-03-29T02:20:05.158656597Z [2024-03-29T02:20:05.152+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:20:05.158662462Z [2024-03-29T02:20:05.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:20:05.158668482Z 2024-03-29T02:20:05.158693983Z [2024-03-29T02:20:05.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:20:05.158718696Z [2024-03-29T02:20:05.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:20:05.270982719Z [2024-03-29T02:20:05.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:05.271135289Z [2024-03-29T02:20:05.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:05.277311444Z [2024-03-29T02:20:05.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to c97c63a5-7200-4bcc-9c72-04b5ab3f814f 2024-03-29T02:20:05.277756079Z [2024-03-29T02:20:05.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:15:00+00:00, map_index=-1, run_start_date=2024-03-29 02:20:03.782009+00:00, run_end_date=2024-03-29 02:20:04.391520+00:00, run_duration=0.609511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:00.208199+00:00, queued_by_job_id=2, pid=11028 2024-03-29T02:20:06.497157149Z [2024-03-29T02:20:06.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:20:06.497663550Z [2024-03-29T02:20:06.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:19:00+00:00, run_id=scheduled__2024-03-29T02:19:00+00:00, run_start_date=2024-03-29 02:20:00.138630+00:00, run_end_date=2024-03-29 02:20:06.497172+00:00, run_duration=6.358542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:19:00+00:00, data_interval_end=2024-03-29 02:20:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:20:06.509514705Z [2024-03-29T02:20:06.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:21:00+00:00 2024-03-29T02:20:06.518350179Z [2024-03-29T02:20:06.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:20:06.518655364Z [2024-03-29T02:20:06.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:19:00+00:00, run_id=scheduled__2024-03-29T02:19:00+00:00, run_start_date=2024-03-29 02:20:00.139577+00:00, run_end_date=2024-03-29 02:20:06.518273+00:00, run_duration=6.378696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:19:00+00:00, data_interval_end=2024-03-29 02:20:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:20:06.529433352Z [2024-03-29T02:20:06.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:21:00+00:00 2024-03-29T02:20:06.578364976Z [2024-03-29T02:20:06.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:19:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:06.578388602Z [2024-03-29T02:20:06.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:19:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:06.589657086Z [2024-03-29T02:20:06.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:19:00+00:00, map_index=-1, run_start_date=2024-03-29 02:20:04.124939+00:00, run_end_date=2024-03-29 02:20:05.670278+00:00, run_duration=1.545339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:00.208199+00:00, queued_by_job_id=2, pid=11031 2024-03-29T02:20:06.589680564Z [2024-03-29T02:20:06.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:19:00+00:00, map_index=-1, run_start_date=2024-03-29 02:20:04.128908+00:00, run_end_date=2024-03-29 02:20:06.202403+00:00, run_duration=2.073495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:00.208199+00:00, queued_by_job_id=2, pid=11030 2024-03-29T02:20:08.628415953Z [2024-03-29T02:20:08.627+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:20:08.628447619Z 2024-03-29T02:20:08.628637080Z [2024-03-29T02:20:08.628+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:20:08.629691918Z [2024-03-29T02:20:08.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:20:08.629700456Z 2024-03-29T02:20:08.633251125Z [2024-03-29T02:20:08.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:20:08.633404127Z [2024-03-29T02:20:08.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:20:08.683279962Z [2024-03-29T02:20:08.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:08.683438570Z [2024-03-29T02:20:08.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:08.689240454Z [2024-03-29T02:20:08.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6628f26-eee2-4a8c-8995-a349ed025e50 2024-03-29T02:20:08.689541665Z [2024-03-29T02:20:08.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:15:00+00:00, map_index=-1, run_start_date=2024-03-29 02:20:07.341394+00:00, run_end_date=2024-03-29 02:20:07.708598+00:00, run_duration=0.367204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:05.154091+00:00, queued_by_job_id=2, pid=11054 2024-03-29T02:20:10.935737492Z [2024-03-29T02:20:10.935+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:20:10.935791208Z 2024-03-29T02:20:10.935817290Z [2024-03-29T02:20:10.935+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:20:10.936446161Z [2024-03-29T02:20:10.936+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:20:10.936467335Z 2024-03-29T02:20:10.939069796Z [2024-03-29T02:20:10.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:20:10.939277224Z [2024-03-29T02:20:10.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:20:11.008883491Z [2024-03-29T02:20:11.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status queued for try_number 1 2024-03-29T02:20:11.009021784Z [2024-03-29T02:20:11.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:11.021682012Z [2024-03-29T02:20:11.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f6d522f-bbd6-4df5-9ff7-80b4be38d562 2024-03-29T02:20:11.021983765Z [2024-03-29T02:20:11.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:15:00+00:00, map_index=0, run_start_date=2024-03-29 02:20:10.379344+00:00, run_end_date=2024-03-29 02:20:10.717437+00:00, run_duration=0.338093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:08.630489+00:00, queued_by_job_id=2, pid=11062 2024-03-29T02:20:13.701467254Z [2024-03-29T02:20:13.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:20:13.702195311Z [2024-03-29T02:20:13.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:15:00+00:00, run_id=scheduled__2024-03-29T02:15:00+00:00, run_start_date=2024-03-29 02:20:00.134848+00:00, run_end_date=2024-03-29 02:20:13.701595+00:00, run_duration=13.566747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:15:00+00:00, data_interval_end=2024-03-29 02:20:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:20:13.714024155Z [2024-03-29T02:20:13.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:20:00+00:00, run_after=2024-03-29T02:25:00+00:00 2024-03-29T02:20:13.752609421Z [2024-03-29T02:20:13.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:15:00+00:00 exited with status success for try_number 1 2024-03-29T02:20:13.758837380Z [2024-03-29T02:20:13.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:15:00+00:00, map_index=-1, run_start_date=2024-03-29 02:20:12.720900+00:00, run_end_date=2024-03-29 02:20:13.163006+00:00, run_duration=0.442106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:20:10.936919+00:00, queued_by_job_id=2, pid=11070 2024-03-29T02:21:00.285874397Z [2024-03-29T02:21:00.285+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:21:00.310321772Z [2024-03-29T02:21:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:21:00+00:00, run_after=2024-03-29T02:22:00+00:00 2024-03-29T02:21:00.330579245Z [2024-03-29T02:21:00.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:21:00+00:00, run_after=2024-03-29T02:22:00+00:00 2024-03-29T02:21:00.403639861Z [2024-03-29T02:21:00.403+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:21:00.403685072Z 2024-03-29T02:21:00.403695377Z 2024-03-29T02:21:00.403704034Z 2024-03-29T02:21:00.403789981Z [2024-03-29T02:21:00.403+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:21:00.404158701Z [2024-03-29T02:21:00.403+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:21:00.404457277Z [2024-03-29T02:21:00.404+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:21:00.405569181Z [2024-03-29T02:21:00.405+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:21:00.405593448Z 2024-03-29T02:21:00.405602482Z 2024-03-29T02:21:00.405610783Z 2024-03-29T02:21:00.409888721Z [2024-03-29T02:21:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:21:00.410026268Z [2024-03-29T02:21:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:21:00.410565985Z [2024-03-29T02:21:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:21:00.410745705Z [2024-03-29T02:21:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:21:00.411114230Z [2024-03-29T02:21:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:21:00.411466895Z [2024-03-29T02:21:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:21:00.683720645Z [2024-03-29T02:21:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:21:00.684008934Z [2024-03-29T02:21:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:21:00.684157159Z [2024-03-29T02:21:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:21:00.697407428Z [2024-03-29T02:21:00.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b4cd2fe-3953-4f7e-af85-c9a1a4819f38 2024-03-29T02:21:00.697470464Z [2024-03-29T02:21:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to 925dd00c-2b01-4276-be6a-901fc550a63b 2024-03-29T02:21:00.697680609Z [2024-03-29T02:21:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6854a291-c81d-4c31-a8fb-43863c3c4827 2024-03-29T02:21:01.911912874Z [2024-03-29T02:21:01.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:21:01.912477976Z [2024-03-29T02:21:01.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:20:00+00:00, run_id=scheduled__2024-03-29T02:20:00+00:00, run_start_date=2024-03-29 02:21:00.342124+00:00, run_end_date=2024-03-29 02:21:01.911736+00:00, run_duration=1.569612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:20:00+00:00, data_interval_end=2024-03-29 02:21:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:21:01.929579883Z [2024-03-29T02:21:01.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:21:00+00:00, run_after=2024-03-29T02:22:00+00:00 2024-03-29T02:21:02.008764347Z [2024-03-29T02:21:02.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:21:02.016049160Z [2024-03-29T02:21:02.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=-1, run_start_date=2024-03-29 02:21:01.232278+00:00, run_end_date=2024-03-29 02:21:01.613792+00:00, run_duration=0.381514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:21:00.406524+00:00, queued_by_job_id=2, pid=11092 2024-03-29T02:21:03.996645326Z [2024-03-29T02:21:03.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:21:03.997819418Z [2024-03-29T02:21:03.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:20:00+00:00, run_id=scheduled__2024-03-29T02:20:00+00:00, run_start_date=2024-03-29 02:21:00.343278+00:00, run_end_date=2024-03-29 02:21:03.996760+00:00, run_duration=3.653482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:20:00+00:00, data_interval_end=2024-03-29 02:21:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:21:04.022304740Z [2024-03-29T02:21:04.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:21:00+00:00, run_after=2024-03-29T02:22:00+00:00 2024-03-29T02:21:04.077702349Z [2024-03-29T02:21:04.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:21:04.084606479Z [2024-03-29T02:21:04.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=-1, run_start_date=2024-03-29 02:21:02.330429+00:00, run_end_date=2024-03-29 02:21:03.648386+00:00, run_duration=1.317957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:21:00.406524+00:00, queued_by_job_id=2, pid=11105 2024-03-29T02:21:05.505738062Z [2024-03-29T02:21:05.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:21:05.506411620Z [2024-03-29T02:21:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:20:00+00:00, run_id=scheduled__2024-03-29T02:20:00+00:00, run_start_date=2024-03-29 02:21:00.344343+00:00, run_end_date=2024-03-29 02:21:05.506084+00:00, run_duration=5.161741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:20:00+00:00, data_interval_end=2024-03-29 02:21:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:21:05.522940037Z [2024-03-29T02:21:05.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:21:00+00:00, run_after=2024-03-29T02:22:00+00:00 2024-03-29T02:21:05.555511596Z [2024-03-29T02:21:05.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:21:05.562953326Z [2024-03-29T02:21:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=-1, run_start_date=2024-03-29 02:21:02.849851+00:00, run_end_date=2024-03-29 02:21:04.563597+00:00, run_duration=1.713746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:21:00.406524+00:00, queued_by_job_id=2, pid=11116 2024-03-29T02:22:00.134759695Z [2024-03-29T02:22:00.134+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:22:00.151064540Z [2024-03-29T02:22:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:22:00+00:00, run_after=2024-03-29T02:23:00+00:00 2024-03-29T02:22:00.157819705Z [2024-03-29T02:22:00.157+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:22:00.169296075Z [2024-03-29T02:22:00.169+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:22:00+00:00, run_after=2024-03-29T02:23:00+00:00 2024-03-29T02:22:00.294546676Z [2024-03-29T02:22:00.288+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:22:00.294563571Z 2024-03-29T02:22:00.294567705Z 2024-03-29T02:22:00.294582967Z 2024-03-29T02:22:00.294599514Z 2024-03-29T02:22:00.294603751Z [2024-03-29T02:22:00.288+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:22:00.294606852Z [2024-03-29T02:22:00.288+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:22:00.294609938Z [2024-03-29T02:22:00.288+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:22:00.294613086Z [2024-03-29T02:22:00.288+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:22:00.294616162Z [2024-03-29T02:22:00.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:22:00.294619198Z 2024-03-29T02:22:00.294622280Z 2024-03-29T02:22:00.294625392Z 2024-03-29T02:22:00.294628376Z 2024-03-29T02:22:00.294632408Z [2024-03-29T02:22:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:22:00.294636036Z [2024-03-29T02:22:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:22:00.294639843Z [2024-03-29T02:22:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:22:00.294642963Z [2024-03-29T02:22:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:22:00.294645994Z [2024-03-29T02:22:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:22:00.294649069Z [2024-03-29T02:22:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:22:00.294652152Z [2024-03-29T02:22:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:22:00.294661882Z [2024-03-29T02:22:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:22:00.652875334Z [2024-03-29T02:22:00.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:22:00.654975823Z [2024-03-29T02:22:00.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:21:00+00:00 exited with status queued for try_number 1 2024-03-29T02:22:00.655187908Z [2024-03-29T02:22:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:21:00+00:00 exited with status queued for try_number 1 2024-03-29T02:22:00.655289487Z [2024-03-29T02:22:00.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:21:00+00:00 exited with status queued for try_number 1 2024-03-29T02:22:00.666531331Z [2024-03-29T02:22:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95505b44-7f5e-4079-8950-8f4bc4ed9ef1 2024-03-29T02:22:00.666920339Z [2024-03-29T02:22:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0310b6c8-466f-4344-9dfa-a5b5c0d56545 2024-03-29T02:22:00.667334005Z [2024-03-29T02:22:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 818c5cf0-e8dd-40e5-9a58-cbb92e5ea3f2 2024-03-29T02:22:00.667689869Z [2024-03-29T02:22:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to d51e061f-65d6-49e6-a309-b645873a4754 2024-03-29T02:22:02.950370656Z [2024-03-29T02:22:02.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:22:02.951049781Z [2024-03-29T02:22:02.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:20:00+00:00, run_id=scheduled__2024-03-29T02:20:00+00:00, run_start_date=2024-03-29 02:22:00.181774+00:00, run_end_date=2024-03-29 02:22:02.950284+00:00, run_duration=2.76851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:20:00+00:00, data_interval_end=2024-03-29 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:22:02.966556725Z [2024-03-29T02:22:02.966+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:22:00+00:00, run_after=2024-03-29T02:24:00+00:00 2024-03-29T02:22:02.977614330Z [2024-03-29T02:22:02.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:22:02.978188378Z [2024-03-29T02:22:02.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:21:00+00:00, run_id=scheduled__2024-03-29T02:21:00+00:00, run_start_date=2024-03-29 02:22:00.183062+00:00, run_end_date=2024-03-29 02:22:02.977509+00:00, run_duration=2.794447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:21:00+00:00, data_interval_end=2024-03-29 02:22:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:22:02.999118201Z [2024-03-29T02:22:02.998+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:22:00+00:00, run_after=2024-03-29T02:23:00+00:00 2024-03-29T02:22:03.068329130Z [2024-03-29T02:22:03.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:22:03.068547703Z [2024-03-29T02:22:03.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:21:00+00:00 exited with status success for try_number 1 2024-03-29T02:22:03.076285711Z [2024-03-29T02:22:03.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=-1, run_start_date=2024-03-29 02:22:01.331772+00:00, run_end_date=2024-03-29 02:22:01.824810+00:00, run_duration=0.493038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:22:00.290592+00:00, queued_by_job_id=2, pid=11145 2024-03-29T02:22:03.076724933Z [2024-03-29T02:22:03.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:21:00+00:00, map_index=-1, run_start_date=2024-03-29 02:22:01.296531+00:00, run_end_date=2024-03-29 02:22:01.850712+00:00, run_duration=0.554181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:22:00.290592+00:00, queued_by_job_id=2, pid=11144 2024-03-29T02:22:04.120608413Z [2024-03-29T02:22:04.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:22:04.121145965Z [2024-03-29T02:22:04.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:21:00+00:00, run_id=scheduled__2024-03-29T02:21:00+00:00, run_start_date=2024-03-29 02:22:00.188212+00:00, run_end_date=2024-03-29 02:22:04.120583+00:00, run_duration=3.932371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:21:00+00:00, data_interval_end=2024-03-29 02:22:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:22:04.137352288Z [2024-03-29T02:22:04.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:22:00+00:00, run_after=2024-03-29T02:23:00+00:00 2024-03-29T02:22:04.186673833Z [2024-03-29T02:22:04.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:21:00+00:00 exited with status success for try_number 1 2024-03-29T02:22:04.194265134Z [2024-03-29T02:22:04.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:21:00+00:00, map_index=-1, run_start_date=2024-03-29 02:22:02.518456+00:00, run_end_date=2024-03-29 02:22:03.767322+00:00, run_duration=1.248866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:22:00.290592+00:00, queued_by_job_id=2, pid=11163 2024-03-29T02:22:05.882526654Z [2024-03-29T02:22:05.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:22:05.882562043Z [2024-03-29T02:22:05.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:21:00+00:00, run_id=scheduled__2024-03-29T02:21:00+00:00, run_start_date=2024-03-29 02:22:00.189747+00:00, run_end_date=2024-03-29 02:22:05.881581+00:00, run_duration=5.691834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:21:00+00:00, data_interval_end=2024-03-29 02:22:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:22:05.892170167Z [2024-03-29T02:22:05.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:22:00+00:00, run_after=2024-03-29T02:23:00+00:00 2024-03-29T02:22:05.920949735Z [2024-03-29T02:22:05.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:21:00+00:00 exited with status success for try_number 1 2024-03-29T02:22:05.930521948Z [2024-03-29T02:22:05.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:21:00+00:00, map_index=-1, run_start_date=2024-03-29 02:22:02.850691+00:00, run_end_date=2024-03-29 02:22:05.237272+00:00, run_duration=2.386581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:22:00.290592+00:00, queued_by_job_id=2, pid=11174 2024-03-29T02:23:00.891468520Z [2024-03-29T02:23:00.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:23:00+00:00, run_after=2024-03-29T02:24:00+00:00 2024-03-29T02:23:00.898853771Z [2024-03-29T02:23:00.898+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:23:00.911424815Z [2024-03-29T02:23:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:23:00+00:00, run_after=2024-03-29T02:24:00+00:00 2024-03-29T02:23:00.991562611Z [2024-03-29T02:23:00.990+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:23:00.991593260Z 2024-03-29T02:23:00.991597458Z 2024-03-29T02:23:00.991600889Z 2024-03-29T02:23:00.992002887Z [2024-03-29T02:23:00.991+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:23:00.992466339Z [2024-03-29T02:23:00.992+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:23:00.992890639Z [2024-03-29T02:23:00.992+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:23:00.994616881Z [2024-03-29T02:23:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:23:00.994654800Z 2024-03-29T02:23:00.994661768Z 2024-03-29T02:23:00.994667725Z 2024-03-29T02:23:01.001151243Z [2024-03-29T02:23:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:23:01.001792759Z [2024-03-29T02:23:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:23:01.002575077Z [2024-03-29T02:23:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:23:01.003012396Z [2024-03-29T02:23:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:23:01.003562698Z [2024-03-29T02:23:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:23:01.003928490Z [2024-03-29T02:23:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:23:01.267571366Z [2024-03-29T02:23:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status queued for try_number 1 2024-03-29T02:23:01.267606755Z [2024-03-29T02:23:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status queued for try_number 1 2024-03-29T02:23:01.267635424Z [2024-03-29T02:23:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status queued for try_number 1 2024-03-29T02:23:01.279838878Z [2024-03-29T02:23:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3560c83a-7a1e-4b35-9ea9-9c682dd03914 2024-03-29T02:23:01.280008776Z [2024-03-29T02:23:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90fd2351-254c-4809-a6db-d2230a214f36 2024-03-29T02:23:01.280393957Z [2024-03-29T02:23:01.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28ea94de-a3b8-45ea-9e59-469a47fdb66d 2024-03-29T02:23:02.465667730Z [2024-03-29T02:23:02.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:23:02.466274491Z [2024-03-29T02:23:02.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:22:00+00:00, run_id=scheduled__2024-03-29T02:22:00+00:00, run_start_date=2024-03-29 02:23:00.921995+00:00, run_end_date=2024-03-29 02:23:02.465576+00:00, run_duration=1.543581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:22:00+00:00, data_interval_end=2024-03-29 02:23:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:23:02.485468359Z [2024-03-29T02:23:02.484+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:23:00+00:00, run_after=2024-03-29T02:24:00+00:00 2024-03-29T02:23:02.560110137Z [2024-03-29T02:23:02.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status success for try_number 1 2024-03-29T02:23:02.568842529Z [2024-03-29T02:23:02.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:22:00+00:00, map_index=-1, run_start_date=2024-03-29 02:23:01.947176+00:00, run_end_date=2024-03-29 02:23:02.334215+00:00, run_duration=0.387039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:23:00.996147+00:00, queued_by_job_id=2, pid=11201 2024-03-29T02:23:05.162042545Z [2024-03-29T02:23:05.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:23:05.162627219Z [2024-03-29T02:23:05.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:22:00+00:00, run_id=scheduled__2024-03-29T02:22:00+00:00, run_start_date=2024-03-29 02:23:00.923375+00:00, run_end_date=2024-03-29 02:23:05.161179+00:00, run_duration=4.237804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:22:00+00:00, data_interval_end=2024-03-29 02:23:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:23:05.199888602Z [2024-03-29T02:23:05.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:23:00+00:00, run_after=2024-03-29T02:24:00+00:00 2024-03-29T02:23:06.348328347Z [2024-03-29T02:23:06.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:23:06.348735820Z [2024-03-29T02:23:06.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:22:00+00:00, run_id=scheduled__2024-03-29T02:22:00+00:00, run_start_date=2024-03-29 02:23:00.924483+00:00, run_end_date=2024-03-29 02:23:06.348196+00:00, run_duration=5.423713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:22:00+00:00, data_interval_end=2024-03-29 02:23:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:23:06.359879809Z [2024-03-29T02:23:06.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:23:00+00:00, run_after=2024-03-29T02:24:00+00:00 2024-03-29T02:23:06.388873164Z [2024-03-29T02:23:06.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status success for try_number 1 2024-03-29T02:23:06.389123044Z [2024-03-29T02:23:06.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status success for try_number 1 2024-03-29T02:23:06.395274541Z [2024-03-29T02:23:06.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:22:00+00:00, map_index=-1, run_start_date=2024-03-29 02:23:03.225312+00:00, run_end_date=2024-03-29 02:23:05.103924+00:00, run_duration=1.878612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:23:00.996147+00:00, queued_by_job_id=2, pid=11220 2024-03-29T02:23:06.395578842Z [2024-03-29T02:23:06.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:22:00+00:00, map_index=-1, run_start_date=2024-03-29 02:23:03.070011+00:00, run_end_date=2024-03-29 02:23:05.627567+00:00, run_duration=2.557556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:23:00.996147+00:00, queued_by_job_id=2, pid=11219 2024-03-29T02:23:46.162522707Z [2024-03-29T02:23:46.161+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:24:00.782519344Z [2024-03-29T02:24:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:24:00+00:00, run_after=2024-03-29T02:25:00+00:00 2024-03-29T02:24:00.791073673Z [2024-03-29T02:24:00.790+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:24:00.807650942Z [2024-03-29T02:24:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:24:00+00:00, run_after=2024-03-29T02:25:00+00:00 2024-03-29T02:24:00.816140928Z [2024-03-29T02:24:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:24:00.926197300Z [2024-03-29T02:24:00.925+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:24:00.926222843Z 2024-03-29T02:24:00.926227670Z 2024-03-29T02:24:00.926230988Z 2024-03-29T02:24:00.926234340Z 2024-03-29T02:24:00.926457082Z [2024-03-29T02:24:00.926+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:24:00.926725771Z [2024-03-29T02:24:00.926+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:24:00.926934566Z [2024-03-29T02:24:00.926+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:24:00.927131487Z [2024-03-29T02:24:00.926+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:24:00.927821171Z [2024-03-29T02:24:00.927+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:24:00.927833459Z 2024-03-29T02:24:00.927837399Z 2024-03-29T02:24:00.927841094Z 2024-03-29T02:24:00.927844267Z 2024-03-29T02:24:00.932246523Z [2024-03-29T02:24:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:24:00.932552847Z [2024-03-29T02:24:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:24:00.932915960Z [2024-03-29T02:24:00.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:24:00.933142708Z [2024-03-29T02:24:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:24:00.933519488Z [2024-03-29T02:24:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:24:00.933749195Z [2024-03-29T02:24:00.933+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:24:00.934049459Z [2024-03-29T02:24:00.933+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:24:00.934234436Z [2024-03-29T02:24:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:24:01.520745915Z [2024-03-29T02:24:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status queued for try_number 1 2024-03-29T02:24:01.520811782Z [2024-03-29T02:24:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:23:00+00:00 exited with status queued for try_number 1 2024-03-29T02:24:01.520916498Z [2024-03-29T02:24:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:23:00+00:00 exited with status queued for try_number 1 2024-03-29T02:24:01.521024456Z [2024-03-29T02:24:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:23:00+00:00 exited with status queued for try_number 1 2024-03-29T02:24:01.549330488Z [2024-03-29T02:24:01.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 316e6c7b-7c32-4273-b37c-4be023bc2cdd 2024-03-29T02:24:01.549594735Z [2024-03-29T02:24:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c40fcfe-816b-4a74-b12e-bf1a122c785f 2024-03-29T02:24:01.549831234Z [2024-03-29T02:24:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3b5f36b-3c11-41d3-be29-833b4511f841 2024-03-29T02:24:01.550032773Z [2024-03-29T02:24:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 954078bf-ca79-4bdb-98fd-3f54ee24cae1 2024-03-29T02:24:04.181556764Z [2024-03-29T02:24:04.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:24:04.185342221Z [2024-03-29T02:24:04.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:22:00+00:00, run_id=scheduled__2024-03-29T02:22:00+00:00, run_start_date=2024-03-29 02:24:00.831065+00:00, run_end_date=2024-03-29 02:24:04.181465+00:00, run_duration=3.3504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:22:00+00:00, data_interval_end=2024-03-29 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:24:04.205100470Z [2024-03-29T02:24:04.203+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:24:00+00:00, run_after=2024-03-29T02:26:00+00:00 2024-03-29T02:24:04.233149574Z [2024-03-29T02:24:04.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:24:04.233757293Z [2024-03-29T02:24:04.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:23:00+00:00, run_id=scheduled__2024-03-29T02:23:00+00:00, run_start_date=2024-03-29 02:24:00.832922+00:00, run_end_date=2024-03-29 02:24:04.233024+00:00, run_duration=3.400102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:23:00+00:00, data_interval_end=2024-03-29 02:24:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:24:04.252313454Z [2024-03-29T02:24:04.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:24:00+00:00, run_after=2024-03-29T02:25:00+00:00 2024-03-29T02:24:04.307379042Z [2024-03-29T02:24:04.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:22:00+00:00 exited with status success for try_number 1 2024-03-29T02:24:04.307409455Z [2024-03-29T02:24:04.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:23:00+00:00 exited with status success for try_number 1 2024-03-29T02:24:04.315358481Z [2024-03-29T02:24:04.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:22:00+00:00, map_index=-1, run_start_date=2024-03-29 02:24:02.153652+00:00, run_end_date=2024-03-29 02:24:02.986596+00:00, run_duration=0.832944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:24:00.928798+00:00, queued_by_job_id=2, pid=11248 2024-03-29T02:24:04.315682291Z [2024-03-29T02:24:04.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:23:00+00:00, map_index=-1, run_start_date=2024-03-29 02:24:02.756368+00:00, run_end_date=2024-03-29 02:24:03.688705+00:00, run_duration=0.932337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:24:00.928798+00:00, queued_by_job_id=2, pid=11254 2024-03-29T02:24:07.901670433Z [2024-03-29T02:24:07.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:24:07.901996185Z [2024-03-29T02:24:07.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:23:00+00:00, run_id=scheduled__2024-03-29T02:23:00+00:00, run_start_date=2024-03-29 02:24:00.836342+00:00, run_end_date=2024-03-29 02:24:07.901567+00:00, run_duration=7.065225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:23:00+00:00, data_interval_end=2024-03-29 02:24:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:24:07.911744173Z [2024-03-29T02:24:07.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:24:00+00:00, run_after=2024-03-29T02:25:00+00:00 2024-03-29T02:24:07.947668069Z [2024-03-29T02:24:07.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:23:00+00:00 exited with status success for try_number 1 2024-03-29T02:24:07.960833844Z [2024-03-29T02:24:07.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:23:00+00:00, map_index=-1, run_start_date=2024-03-29 02:24:03.978912+00:00, run_end_date=2024-03-29 02:24:07.164734+00:00, run_duration=3.185822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:24:00.928798+00:00, queued_by_job_id=2, pid=11272 2024-03-29T02:24:09.013660663Z [2024-03-29T02:24:09.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:24:09.013949270Z [2024-03-29T02:24:09.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:23:00+00:00, run_id=scheduled__2024-03-29T02:23:00+00:00, run_start_date=2024-03-29 02:24:00.834680+00:00, run_end_date=2024-03-29 02:24:09.013537+00:00, run_duration=8.178857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:23:00+00:00, data_interval_end=2024-03-29 02:24:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:24:09.023268587Z [2024-03-29T02:24:09.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:24:00+00:00, run_after=2024-03-29T02:25:00+00:00 2024-03-29T02:24:09.053282574Z [2024-03-29T02:24:09.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:23:00+00:00 exited with status success for try_number 1 2024-03-29T02:24:09.058097022Z [2024-03-29T02:24:09.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:23:00+00:00, map_index=-1, run_start_date=2024-03-29 02:24:05.064507+00:00, run_end_date=2024-03-29 02:24:08.242704+00:00, run_duration=3.178197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:24:00.928798+00:00, queued_by_job_id=2, pid=11283 2024-03-29T02:25:00.713090353Z [2024-03-29T02:25:00.712+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:25:00+00:00, run_after=2024-03-29T02:26:00+00:00 2024-03-29T02:25:00.733195873Z [2024-03-29T02:25:00.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:25:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:25:00.753937894Z [2024-03-29T02:25:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:25:00+00:00, run_after=2024-03-29T02:26:00+00:00 2024-03-29T02:25:00.766687519Z [2024-03-29T02:25:00.764+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:25:00.881811863Z [2024-03-29T02:25:00.881+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:25:00.881845519Z 2024-03-29T02:25:00.881851425Z 2024-03-29T02:25:00.881877692Z 2024-03-29T02:25:00.881884059Z 2024-03-29T02:25:00.881917761Z [2024-03-29T02:25:00.881+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:25:00.882133550Z [2024-03-29T02:25:00.881+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:25:00.882325240Z [2024-03-29T02:25:00.882+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:25:00.882572381Z [2024-03-29T02:25:00.882+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:25:00.883628510Z [2024-03-29T02:25:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:25:00.883647559Z 2024-03-29T02:25:00.883653109Z 2024-03-29T02:25:00.883657246Z 2024-03-29T02:25:00.883661431Z 2024-03-29T02:25:00.890551082Z [2024-03-29T02:25:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:25:00.890898674Z [2024-03-29T02:25:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:25:00.891388500Z [2024-03-29T02:25:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:25:00.891988467Z [2024-03-29T02:25:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:25:00.892423673Z [2024-03-29T02:25:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:25:00.892578595Z [2024-03-29T02:25:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:25:00.892918728Z [2024-03-29T02:25:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:25:00.893154492Z [2024-03-29T02:25:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:25:01.230513002Z [2024-03-29T02:25:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:25:01.230561087Z [2024-03-29T02:25:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status queued for try_number 1 2024-03-29T02:25:01.232637253Z [2024-03-29T02:25:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status queued for try_number 1 2024-03-29T02:25:01.232810463Z [2024-03-29T02:25:01.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status queued for try_number 1 2024-03-29T02:25:01.247436889Z [2024-03-29T02:25:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 877e39a0-4c5a-4978-a7ea-1a747ccfcca4 2024-03-29T02:25:01.247480962Z [2024-03-29T02:25:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to fad8caf7-721c-46b9-bd7a-9f98323ff0c6 2024-03-29T02:25:01.247646694Z [2024-03-29T02:25:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01adfadc-135b-4499-9786-b82ddfda7b09 2024-03-29T02:25:01.247700922Z [2024-03-29T02:25:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68a957bb-e5de-4139-aec7-f6591813bcfd 2024-03-29T02:25:03.619161197Z [2024-03-29T02:25:03.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:25:03.619379859Z [2024-03-29T02:25:03.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:24:00+00:00, run_id=scheduled__2024-03-29T02:24:00+00:00, run_start_date=2024-03-29 02:25:00.780949+00:00, run_end_date=2024-03-29 02:25:03.619048+00:00, run_duration=2.838099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:24:00+00:00, data_interval_end=2024-03-29 02:25:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:25:03.634381902Z [2024-03-29T02:25:03.633+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:25:00+00:00, run_after=2024-03-29T02:26:00+00:00 2024-03-29T02:25:03.734344093Z [2024-03-29T02:25:03.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status success for try_number 1 2024-03-29T02:25:03.744802806Z [2024-03-29T02:25:03.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:24:00+00:00, map_index=-1, run_start_date=2024-03-29 02:25:02.415068+00:00, run_end_date=2024-03-29 02:25:02.946977+00:00, run_duration=0.531909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:25:00.885707+00:00, queued_by_job_id=2, pid=11311 2024-03-29T02:25:05.076722729Z [2024-03-29T02:25:05.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:25:05.076758996Z 2024-03-29T02:25:05.077147223Z [2024-03-29T02:25:05.076+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:25:05.078138567Z [2024-03-29T02:25:05.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:25:05.078155291Z 2024-03-29T02:25:05.081822790Z [2024-03-29T02:25:05.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:25:05.082136442Z [2024-03-29T02:25:05.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:25:05.170848215Z [2024-03-29T02:25:05.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:25:05.170875312Z [2024-03-29T02:25:05.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:25:05.201183315Z [2024-03-29T02:25:05.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f6ba563-986d-4ff5-b117-fb059089946e 2024-03-29T02:25:05.201208233Z [2024-03-29T02:25:05.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=-1, run_start_date=2024-03-29 02:25:03.716307+00:00, run_end_date=2024-03-29 02:25:04.130139+00:00, run_duration=0.413832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:25:00.885707+00:00, queued_by_job_id=2, pid=11335 2024-03-29T02:25:06.181918435Z [2024-03-29T02:25:06.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:25:06.184325426Z [2024-03-29T02:25:06.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:24:00+00:00, run_id=scheduled__2024-03-29T02:24:00+00:00, run_start_date=2024-03-29 02:25:00.783060+00:00, run_end_date=2024-03-29 02:25:06.181815+00:00, run_duration=5.398755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:24:00+00:00, data_interval_end=2024-03-29 02:25:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:25:06.198989721Z [2024-03-29T02:25:06.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:25:00+00:00, run_after=2024-03-29T02:26:00+00:00 2024-03-29T02:25:06.209085104Z [2024-03-29T02:25:06.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:25:06.209780901Z [2024-03-29T02:25:06.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:24:00+00:00, run_id=scheduled__2024-03-29T02:24:00+00:00, run_start_date=2024-03-29 02:25:00.784961+00:00, run_end_date=2024-03-29 02:25:06.208943+00:00, run_duration=5.423982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:24:00+00:00, data_interval_end=2024-03-29 02:25:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:25:06.222528372Z [2024-03-29T02:25:06.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:25:00+00:00, run_after=2024-03-29T02:26:00+00:00 2024-03-29T02:25:06.283102719Z [2024-03-29T02:25:06.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status success for try_number 1 2024-03-29T02:25:06.283332846Z [2024-03-29T02:25:06.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status success for try_number 1 2024-03-29T02:25:06.318786134Z [2024-03-29T02:25:06.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:24:00+00:00, map_index=-1, run_start_date=2024-03-29 02:25:03.901446+00:00, run_end_date=2024-03-29 02:25:06.004065+00:00, run_duration=2.102619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:25:00.885707+00:00, queued_by_job_id=2, pid=11336 2024-03-29T02:25:06.319657553Z [2024-03-29T02:25:06.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:24:00+00:00, map_index=-1, run_start_date=2024-03-29 02:25:03.985097+00:00, run_end_date=2024-03-29 02:25:05.886358+00:00, run_duration=1.901261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:25:00.885707+00:00, queued_by_job_id=2, pid=11337 2024-03-29T02:25:08.745457347Z [2024-03-29T02:25:08.745+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:25:08.745488515Z 2024-03-29T02:25:08.745783733Z [2024-03-29T02:25:08.745+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:25:08.746436688Z [2024-03-29T02:25:08.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:25:08.746484300Z 2024-03-29T02:25:08.749968716Z [2024-03-29T02:25:08.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:25:08.750095143Z [2024-03-29T02:25:08.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:25:08.804544912Z [2024-03-29T02:25:08.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:25:08.804841654Z [2024-03-29T02:25:08.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:25:08.813820523Z [2024-03-29T02:25:08.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9db8cc9-9202-44fb-b315-88f13c7c12c6 2024-03-29T02:25:08.814391888Z [2024-03-29T02:25:08.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=-1, run_start_date=2024-03-29 02:25:07.560148+00:00, run_end_date=2024-03-29 02:25:07.940522+00:00, run_duration=0.380374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:25:05.078902+00:00, queued_by_job_id=2, pid=11360 2024-03-29T02:25:11.086853281Z [2024-03-29T02:25:11.086+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:25:11.086885765Z 2024-03-29T02:25:11.087012262Z [2024-03-29T02:25:11.086+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:25:11.087895562Z [2024-03-29T02:25:11.087+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:25:11.087907200Z 2024-03-29T02:25:11.091217119Z [2024-03-29T02:25:11.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:25:11.091449078Z [2024-03-29T02:25:11.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:25:11.139727388Z [2024-03-29T02:25:11.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status queued for try_number 1 2024-03-29T02:25:11.140034891Z [2024-03-29T02:25:11.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:25:11.156593719Z [2024-03-29T02:25:11.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f417114-ae04-4043-94cf-877826e3e2c5 2024-03-29T02:25:11.157756049Z [2024-03-29T02:25:11.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=0, run_start_date=2024-03-29 02:25:10.442758+00:00, run_end_date=2024-03-29 02:25:10.765868+00:00, run_duration=0.32311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:25:08.747397+00:00, queued_by_job_id=2, pid=11368 2024-03-29T02:25:13.844712904Z [2024-03-29T02:25:13.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:25:13.845421339Z [2024-03-29T02:25:13.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:20:00+00:00, run_id=scheduled__2024-03-29T02:20:00+00:00, run_start_date=2024-03-29 02:25:00.779155+00:00, run_end_date=2024-03-29 02:25:13.844665+00:00, run_duration=13.06551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:20:00+00:00, data_interval_end=2024-03-29 02:25:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:25:13.858920231Z [2024-03-29T02:25:13.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:25:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:25:13.898434677Z [2024-03-29T02:25:13.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:20:00+00:00 exited with status success for try_number 1 2024-03-29T02:25:13.904793425Z [2024-03-29T02:25:13.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:20:00+00:00, map_index=-1, run_start_date=2024-03-29 02:25:12.804948+00:00, run_end_date=2024-03-29 02:25:13.177391+00:00, run_duration=0.372443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:25:11.088381+00:00, queued_by_job_id=2, pid=11376 2024-03-29T02:26:00.503847464Z [2024-03-29T02:26:00.503+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:26:00.509796611Z [2024-03-29T02:26:00.509+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:26:00.536255308Z [2024-03-29T02:26:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:26:00+00:00, run_after=2024-03-29T02:27:00+00:00 2024-03-29T02:26:00.549461912Z [2024-03-29T02:26:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:26:00+00:00, run_after=2024-03-29T02:27:00+00:00 2024-03-29T02:26:00.642840785Z [2024-03-29T02:26:00.642+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:26:00.642895799Z 2024-03-29T02:26:00.642915147Z 2024-03-29T02:26:00.642930861Z 2024-03-29T02:26:00.642944083Z 2024-03-29T02:26:00.643127644Z [2024-03-29T02:26:00.642+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:26:00.643596434Z [2024-03-29T02:26:00.643+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:26:00.643923802Z [2024-03-29T02:26:00.643+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:26:00.644198987Z [2024-03-29T02:26:00.644+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:26:00.645104489Z [2024-03-29T02:26:00.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:26:00.645119302Z 2024-03-29T02:26:00.645124776Z 2024-03-29T02:26:00.645129561Z 2024-03-29T02:26:00.645134051Z 2024-03-29T02:26:00.650194183Z [2024-03-29T02:26:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:26:00.650734222Z [2024-03-29T02:26:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:26:00.651270295Z [2024-03-29T02:26:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:26:00.651562281Z [2024-03-29T02:26:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:26:00.651992534Z [2024-03-29T02:26:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:26:00.652261382Z [2024-03-29T02:26:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:26:00.652729045Z [2024-03-29T02:26:00.652+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:26:00.652993850Z [2024-03-29T02:26:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:26:01.057506393Z [2024-03-29T02:26:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status queued for try_number 1 2024-03-29T02:26:01.057554004Z [2024-03-29T02:26:01.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status queued for try_number 1 2024-03-29T02:26:01.058756202Z [2024-03-29T02:26:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status queued for try_number 1 2024-03-29T02:26:01.061057036Z [2024-03-29T02:26:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status queued for try_number 1 2024-03-29T02:26:01.080789107Z [2024-03-29T02:26:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d8f6c11-a373-4e89-baee-6c3596da9afb 2024-03-29T02:26:01.080821856Z [2024-03-29T02:26:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to f27b2a8d-712c-4d97-820b-534310211bcd 2024-03-29T02:26:01.080825572Z [2024-03-29T02:26:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37691fc8-7a1a-4696-b6d1-2ccc868be76e 2024-03-29T02:26:01.080828935Z [2024-03-29T02:26:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4bb7259-07bd-40bb-a720-235ee593afeb 2024-03-29T02:26:03.451758763Z [2024-03-29T02:26:03.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:26:03.452365345Z [2024-03-29T02:26:03.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:24:00+00:00, run_id=scheduled__2024-03-29T02:24:00+00:00, run_start_date=2024-03-29 02:26:00.562198+00:00, run_end_date=2024-03-29 02:26:03.451723+00:00, run_duration=2.889525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:24:00+00:00, data_interval_end=2024-03-29 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:26:03.474013447Z [2024-03-29T02:26:03.473+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:26:00+00:00, run_after=2024-03-29T02:28:00+00:00 2024-03-29T02:26:03.491172834Z [2024-03-29T02:26:03.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:26:03.492362831Z [2024-03-29T02:26:03.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:25:00+00:00, run_id=scheduled__2024-03-29T02:25:00+00:00, run_start_date=2024-03-29 02:26:00.563687+00:00, run_end_date=2024-03-29 02:26:03.491324+00:00, run_duration=2.927637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:25:00+00:00, data_interval_end=2024-03-29 02:26:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:26:03.506160633Z [2024-03-29T02:26:03.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:26:00+00:00, run_after=2024-03-29T02:27:00+00:00 2024-03-29T02:26:03.637605744Z [2024-03-29T02:26:03.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:24:00+00:00 exited with status success for try_number 1 2024-03-29T02:26:03.637670007Z [2024-03-29T02:26:03.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status success for try_number 1 2024-03-29T02:26:03.652231064Z [2024-03-29T02:26:03.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:24:00+00:00, map_index=-1, run_start_date=2024-03-29 02:26:01.930720+00:00, run_end_date=2024-03-29 02:26:02.449759+00:00, run_duration=0.519039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:26:00.646495+00:00, queued_by_job_id=2, pid=11399 2024-03-29T02:26:03.652273549Z [2024-03-29T02:26:03.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:25:00+00:00, map_index=-1, run_start_date=2024-03-29 02:26:02.086075+00:00, run_end_date=2024-03-29 02:26:02.585157+00:00, run_duration=0.499082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:26:00.646495+00:00, queued_by_job_id=2, pid=11401 2024-03-29T02:26:05.553108722Z [2024-03-29T02:26:05.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:26:05.553317705Z [2024-03-29T02:26:05.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:25:00+00:00, run_id=scheduled__2024-03-29T02:25:00+00:00, run_start_date=2024-03-29 02:26:00.564760+00:00, run_end_date=2024-03-29 02:26:05.552982+00:00, run_duration=4.988222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:25:00+00:00, data_interval_end=2024-03-29 02:26:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:26:05.564904150Z [2024-03-29T02:26:05.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:26:00+00:00, run_after=2024-03-29T02:27:00+00:00 2024-03-29T02:26:05.694345256Z [2024-03-29T02:26:05.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status success for try_number 1 2024-03-29T02:26:05.726093561Z [2024-03-29T02:26:05.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:25:00+00:00, map_index=-1, run_start_date=2024-03-29 02:26:03.113530+00:00, run_end_date=2024-03-29 02:26:04.802807+00:00, run_duration=1.689277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:26:00.646495+00:00, queued_by_job_id=2, pid=11418 2024-03-29T02:26:06.683877640Z [2024-03-29T02:26:06.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:26:06.684246279Z [2024-03-29T02:26:06.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:25:00+00:00, run_id=scheduled__2024-03-29T02:25:00+00:00, run_start_date=2024-03-29 02:26:00.565890+00:00, run_end_date=2024-03-29 02:26:06.683892+00:00, run_duration=6.118002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:25:00+00:00, data_interval_end=2024-03-29 02:26:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:26:06.694546509Z [2024-03-29T02:26:06.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:26:00+00:00, run_after=2024-03-29T02:27:00+00:00 2024-03-29T02:26:06.723926453Z [2024-03-29T02:26:06.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status success for try_number 1 2024-03-29T02:26:06.728428565Z [2024-03-29T02:26:06.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:25:00+00:00, map_index=-1, run_start_date=2024-03-29 02:26:03.421906+00:00, run_end_date=2024-03-29 02:26:06.449159+00:00, run_duration=3.027253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:26:00.646495+00:00, queued_by_job_id=2, pid=11429 2024-03-29T02:27:00.443886427Z [2024-03-29T02:27:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:27:00+00:00, run_after=2024-03-29T02:28:00+00:00 2024-03-29T02:27:00.451178328Z [2024-03-29T02:27:00.450+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:27:00.464715524Z [2024-03-29T02:27:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:27:00+00:00, run_after=2024-03-29T02:28:00+00:00 2024-03-29T02:27:00.541984235Z [2024-03-29T02:27:00.541+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:27:00.542009225Z 2024-03-29T02:27:00.542013035Z 2024-03-29T02:27:00.542016703Z 2024-03-29T02:27:00.542217212Z [2024-03-29T02:27:00.541+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:27:00.542258027Z [2024-03-29T02:27:00.542+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:27:00.542345673Z [2024-03-29T02:27:00.542+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:27:00.542901382Z [2024-03-29T02:27:00.542+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:27:00.542909260Z 2024-03-29T02:27:00.542912774Z 2024-03-29T02:27:00.542915971Z 2024-03-29T02:27:00.545999206Z [2024-03-29T02:27:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:27:00.546080418Z [2024-03-29T02:27:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:27:00.546264231Z [2024-03-29T02:27:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:27:00.546340311Z [2024-03-29T02:27:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:27:00.546550570Z [2024-03-29T02:27:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:27:00.546617704Z [2024-03-29T02:27:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:27:00.753745874Z [2024-03-29T02:27:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status queued for try_number 1 2024-03-29T02:27:00.754166419Z [2024-03-29T02:27:00.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status queued for try_number 1 2024-03-29T02:27:00.754511648Z [2024-03-29T02:27:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status queued for try_number 1 2024-03-29T02:27:00.766395417Z [2024-03-29T02:27:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91a4c5cd-f6b8-42d4-ab89-30ab74c50f1a 2024-03-29T02:27:00.766801599Z [2024-03-29T02:27:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fcac370-cbba-4964-9486-6b9ad6d025b9 2024-03-29T02:27:00.767051192Z [2024-03-29T02:27:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e0c9aef-2e84-465e-935a-b2898ef0d31c 2024-03-29T02:27:03.203773924Z [2024-03-29T02:27:03.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:27:03.204985046Z [2024-03-29T02:27:03.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:26:00+00:00, run_id=scheduled__2024-03-29T02:26:00+00:00, run_start_date=2024-03-29 02:27:00.477949+00:00, run_end_date=2024-03-29 02:27:03.204452+00:00, run_duration=2.726503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:26:00+00:00, data_interval_end=2024-03-29 02:27:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:27:03.219390745Z [2024-03-29T02:27:03.218+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:27:00+00:00, run_after=2024-03-29T02:28:00+00:00 2024-03-29T02:27:03.357621217Z [2024-03-29T02:27:03.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status success for try_number 1 2024-03-29T02:27:03.368598703Z [2024-03-29T02:27:03.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:26:00+00:00, map_index=-1, run_start_date=2024-03-29 02:27:01.500082+00:00, run_end_date=2024-03-29 02:27:02.042061+00:00, run_duration=0.541979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:27:00.543569+00:00, queued_by_job_id=2, pid=11456 2024-03-29T02:27:05.542455847Z [2024-03-29T02:27:05.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:27:05.543105198Z [2024-03-29T02:27:05.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:26:00+00:00, run_id=scheduled__2024-03-29T02:26:00+00:00, run_start_date=2024-03-29 02:27:00.479459+00:00, run_end_date=2024-03-29 02:27:05.542355+00:00, run_duration=5.062896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:26:00+00:00, data_interval_end=2024-03-29 02:27:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:27:05.561189238Z [2024-03-29T02:27:05.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:27:00+00:00, run_after=2024-03-29T02:28:00+00:00 2024-03-29T02:27:05.569022672Z [2024-03-29T02:27:05.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:27:05.569371243Z [2024-03-29T02:27:05.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:26:00+00:00, run_id=scheduled__2024-03-29T02:26:00+00:00, run_start_date=2024-03-29 02:27:00.480872+00:00, run_end_date=2024-03-29 02:27:05.568922+00:00, run_duration=5.08805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:26:00+00:00, data_interval_end=2024-03-29 02:27:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:27:05.578880777Z [2024-03-29T02:27:05.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:27:00+00:00, run_after=2024-03-29T02:28:00+00:00 2024-03-29T02:27:05.637230370Z [2024-03-29T02:27:05.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status success for try_number 1 2024-03-29T02:27:05.637277796Z [2024-03-29T02:27:05.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status success for try_number 1 2024-03-29T02:27:05.681623031Z [2024-03-29T02:27:05.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:26:00+00:00, map_index=-1, run_start_date=2024-03-29 02:27:03.017748+00:00, run_end_date=2024-03-29 02:27:05.403905+00:00, run_duration=2.386157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:27:00.543569+00:00, queued_by_job_id=2, pid=11475 2024-03-29T02:27:05.688668069Z [2024-03-29T02:27:05.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:26:00+00:00, map_index=-1, run_start_date=2024-03-29 02:27:02.713194+00:00, run_end_date=2024-03-29 02:27:05.104900+00:00, run_duration=2.391706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:27:00.543569+00:00, queued_by_job_id=2, pid=11473 2024-03-29T02:28:00.229432691Z [2024-03-29T02:28:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:28:00+00:00, run_after=2024-03-29T02:29:00+00:00 2024-03-29T02:28:00.241736871Z [2024-03-29T02:28:00.241+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:28:00.267194539Z [2024-03-29T02:28:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:28:00+00:00, run_after=2024-03-29T02:29:00+00:00 2024-03-29T02:28:00.288073824Z [2024-03-29T02:28:00.287+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:28:00.369766290Z [2024-03-29T02:28:00.369+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:28:00.369789042Z 2024-03-29T02:28:00.369793310Z 2024-03-29T02:28:00.369796972Z 2024-03-29T02:28:00.369800271Z 2024-03-29T02:28:00.370125991Z [2024-03-29T02:28:00.369+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:28:00.370385715Z [2024-03-29T02:28:00.370+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:28:00.370636084Z [2024-03-29T02:28:00.370+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:28:00.370835101Z [2024-03-29T02:28:00.370+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:28:00.371491734Z [2024-03-29T02:28:00.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:28:00.371552366Z 2024-03-29T02:28:00.371560063Z 2024-03-29T02:28:00.371565675Z 2024-03-29T02:28:00.371570870Z 2024-03-29T02:28:00.374837410Z [2024-03-29T02:28:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:28:00.375139350Z [2024-03-29T02:28:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:28:00.375525949Z [2024-03-29T02:28:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:28:00.375758877Z [2024-03-29T02:28:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:28:00.376078898Z [2024-03-29T02:28:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:28:00.376300209Z [2024-03-29T02:28:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:28:00.376656201Z [2024-03-29T02:28:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:28:00.377375165Z [2024-03-29T02:28:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:28:00.844423098Z [2024-03-29T02:28:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status queued for try_number 1 2024-03-29T02:28:00.844485306Z [2024-03-29T02:28:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:27:00+00:00 exited with status queued for try_number 1 2024-03-29T02:28:00.844563436Z [2024-03-29T02:28:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:27:00+00:00 exited with status queued for try_number 1 2024-03-29T02:28:00.844652514Z [2024-03-29T02:28:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:27:00+00:00 exited with status queued for try_number 1 2024-03-29T02:28:00.869547622Z [2024-03-29T02:28:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1edbcde2-9bd9-4601-a844-ec9d1b31a56c 2024-03-29T02:28:00.869611333Z [2024-03-29T02:28:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c54b2a8-6aa1-40bf-a626-ca0cecaca8cd 2024-03-29T02:28:00.869714925Z [2024-03-29T02:28:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffb7e48e-71cd-4a81-8823-5c2104c49924 2024-03-29T02:28:00.869821797Z [2024-03-29T02:28:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1df7fd1-a954-47c4-9c13-2933d7d68230 2024-03-29T02:28:02.243534210Z [2024-03-29T02:28:02.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:28:02.255437418Z [2024-03-29T02:28:02.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:26:00+00:00, run_id=scheduled__2024-03-29T02:26:00+00:00, run_start_date=2024-03-29 02:28:00.307211+00:00, run_end_date=2024-03-29 02:28:02.243593+00:00, run_duration=1.936382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:26:00+00:00, data_interval_end=2024-03-29 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:28:02.272181169Z [2024-03-29T02:28:02.271+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:28:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:28:02.284211655Z [2024-03-29T02:28:02.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:28:02.284790540Z [2024-03-29T02:28:02.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:27:00+00:00, run_id=scheduled__2024-03-29T02:27:00+00:00, run_start_date=2024-03-29 02:28:00.308498+00:00, run_end_date=2024-03-29 02:28:02.284260+00:00, run_duration=1.975762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:27:00+00:00, data_interval_end=2024-03-29 02:28:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:28:02.306363669Z [2024-03-29T02:28:02.305+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:28:00+00:00, run_after=2024-03-29T02:29:00+00:00 2024-03-29T02:28:02.376159496Z [2024-03-29T02:28:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:27:00+00:00 exited with status success for try_number 1 2024-03-29T02:28:02.387213977Z [2024-03-29T02:28:02.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:27:00+00:00, map_index=-1, run_start_date=2024-03-29 02:28:01.556103+00:00, run_end_date=2024-03-29 02:28:02.031683+00:00, run_duration=0.47558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:28:00.372379+00:00, queued_by_job_id=2, pid=11507 2024-03-29T02:28:03.500428386Z [2024-03-29T02:28:03.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:26:00+00:00 exited with status success for try_number 1 2024-03-29T02:28:03.510147457Z [2024-03-29T02:28:03.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:26:00+00:00, map_index=-1, run_start_date=2024-03-29 02:28:01.623519+00:00, run_end_date=2024-03-29 02:28:02.117842+00:00, run_duration=0.494323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:28:00.372379+00:00, queued_by_job_id=2, pid=11508 2024-03-29T02:28:05.672847129Z [2024-03-29T02:28:05.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:28:05.673290269Z [2024-03-29T02:28:05.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:27:00+00:00, run_id=scheduled__2024-03-29T02:27:00+00:00, run_start_date=2024-03-29 02:28:00.309566+00:00, run_end_date=2024-03-29 02:28:05.672978+00:00, run_duration=5.363412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:27:00+00:00, data_interval_end=2024-03-29 02:28:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:28:05.681971281Z [2024-03-29T02:28:05.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:28:00+00:00, run_after=2024-03-29T02:29:00+00:00 2024-03-29T02:28:05.689041335Z [2024-03-29T02:28:05.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:28:05.689476751Z [2024-03-29T02:28:05.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:27:00+00:00, run_id=scheduled__2024-03-29T02:27:00+00:00, run_start_date=2024-03-29 02:28:00.310577+00:00, run_end_date=2024-03-29 02:28:05.689164+00:00, run_duration=5.378587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:27:00+00:00, data_interval_end=2024-03-29 02:28:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:28:05.699770891Z [2024-03-29T02:28:05.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:28:00+00:00, run_after=2024-03-29T02:29:00+00:00 2024-03-29T02:28:05.767694041Z [2024-03-29T02:28:05.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:27:00+00:00 exited with status success for try_number 1 2024-03-29T02:28:05.768021698Z [2024-03-29T02:28:05.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:27:00+00:00 exited with status success for try_number 1 2024-03-29T02:28:05.774596900Z [2024-03-29T02:28:05.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:27:00+00:00, map_index=-1, run_start_date=2024-03-29 02:28:02.879125+00:00, run_end_date=2024-03-29 02:28:04.588740+00:00, run_duration=1.709615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:28:00.372379+00:00, queued_by_job_id=2, pid=11526 2024-03-29T02:28:05.775055230Z [2024-03-29T02:28:05.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:27:00+00:00, map_index=-1, run_start_date=2024-03-29 02:28:03.253273+00:00, run_end_date=2024-03-29 02:28:04.580510+00:00, run_duration=1.327237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:28:00.372379+00:00, queued_by_job_id=2, pid=11532 2024-03-29T02:28:46.247884105Z [2024-03-29T02:28:46.247+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:29:00.895398514Z [2024-03-29T02:29:00.894+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:29:00.915972326Z [2024-03-29T02:29:00.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:29:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:29:00.932021589Z [2024-03-29T02:29:00.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:29:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:29:01.037064150Z [2024-03-29T02:29:01.036+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:29:01.037102771Z 2024-03-29T02:29:01.037109996Z 2024-03-29T02:29:01.037116016Z 2024-03-29T02:29:01.037545239Z [2024-03-29T02:29:01.037+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:29:01.037863963Z [2024-03-29T02:29:01.037+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:29:01.038321137Z [2024-03-29T02:29:01.037+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:29:01.039490942Z [2024-03-29T02:29:01.039+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:29:01.039525022Z 2024-03-29T02:29:01.039571056Z 2024-03-29T02:29:01.039582857Z 2024-03-29T02:29:01.044823198Z [2024-03-29T02:29:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:29:01.045072022Z [2024-03-29T02:29:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:29:01.045523402Z [2024-03-29T02:29:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:29:01.045867097Z [2024-03-29T02:29:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:29:01.046488894Z [2024-03-29T02:29:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:29:01.046763625Z [2024-03-29T02:29:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:29:01.308205747Z [2024-03-29T02:29:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status queued for try_number 1 2024-03-29T02:29:01.308551213Z [2024-03-29T02:29:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status queued for try_number 1 2024-03-29T02:29:01.308903254Z [2024-03-29T02:29:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status queued for try_number 1 2024-03-29T02:29:01.317631798Z [2024-03-29T02:29:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fb9f2e5-2017-47db-86a9-db705f206f79 2024-03-29T02:29:01.317962427Z [2024-03-29T02:29:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 056da647-34a9-4db4-b381-aa3d6049e45b 2024-03-29T02:29:01.318216056Z [2024-03-29T02:29:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97e30402-8f4a-4dfa-bb9d-a5e1b335236a 2024-03-29T02:29:03.139912001Z [2024-03-29T02:29:03.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:29:03.141538068Z [2024-03-29T02:29:03.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:28:00+00:00, run_id=scheduled__2024-03-29T02:28:00+00:00, run_start_date=2024-03-29 02:29:00.957282+00:00, run_end_date=2024-03-29 02:29:03.140471+00:00, run_duration=2.183189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:28:00+00:00, data_interval_end=2024-03-29 02:29:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:29:03.157984667Z [2024-03-29T02:29:03.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:29:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:29:03.271683132Z [2024-03-29T02:29:03.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status success for try_number 1 2024-03-29T02:29:03.292048396Z [2024-03-29T02:29:03.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:28:00+00:00, map_index=-1, run_start_date=2024-03-29 02:29:01.867775+00:00, run_end_date=2024-03-29 02:29:02.360121+00:00, run_duration=0.492346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:29:01.040589+00:00, queued_by_job_id=2, pid=11564 2024-03-29T02:29:05.475955747Z [2024-03-29T02:29:05.475+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:29:05.476641831Z [2024-03-29T02:29:05.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:28:00+00:00, run_id=scheduled__2024-03-29T02:28:00+00:00, run_start_date=2024-03-29 02:29:00.963009+00:00, run_end_date=2024-03-29 02:29:05.475850+00:00, run_duration=4.512841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:28:00+00:00, data_interval_end=2024-03-29 02:29:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:29:05.487976821Z [2024-03-29T02:29:05.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:29:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:29:05.499498140Z [2024-03-29T02:29:05.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:29:05.499904817Z [2024-03-29T02:29:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:28:00+00:00, run_id=scheduled__2024-03-29T02:28:00+00:00, run_start_date=2024-03-29 02:29:00.960047+00:00, run_end_date=2024-03-29 02:29:05.499410+00:00, run_duration=4.539363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:28:00+00:00, data_interval_end=2024-03-29 02:29:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:29:05.512850853Z [2024-03-29T02:29:05.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:29:00+00:00, run_after=2024-03-29T02:30:00+00:00 2024-03-29T02:29:05.550123040Z [2024-03-29T02:29:05.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status success for try_number 1 2024-03-29T02:29:05.550538176Z [2024-03-29T02:29:05.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status success for try_number 1 2024-03-29T02:29:05.561177618Z [2024-03-29T02:29:05.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:28:00+00:00, map_index=-1, run_start_date=2024-03-29 02:29:03.404096+00:00, run_end_date=2024-03-29 02:29:04.821128+00:00, run_duration=1.417032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:29:01.040589+00:00, queued_by_job_id=2, pid=11588 2024-03-29T02:29:05.562687070Z [2024-03-29T02:29:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:28:00+00:00, map_index=-1, run_start_date=2024-03-29 02:29:02.930830+00:00, run_end_date=2024-03-29 02:29:04.986396+00:00, run_duration=2.055566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:29:01.040589+00:00, queued_by_job_id=2, pid=11577 2024-03-29T02:30:00.203323965Z [2024-03-29T02:30:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:35:00+00:00 2024-03-29T02:30:00.213351083Z [2024-03-29T02:30:00.212+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:30:00.222264647Z [2024-03-29T02:30:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:30:00.241219639Z [2024-03-29T02:30:00.240+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:31:00+00:00 2024-03-29T02:30:00.268708540Z [2024-03-29T02:30:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:31:00+00:00 2024-03-29T02:30:00.372412877Z [2024-03-29T02:30:00.371+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T02:30:00.372452698Z 2024-03-29T02:30:00.372461773Z 2024-03-29T02:30:00.372470629Z 2024-03-29T02:30:00.372499975Z 2024-03-29T02:30:00.372529677Z 2024-03-29T02:30:00.372771727Z [2024-03-29T02:30:00.372+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:30:00.373998961Z [2024-03-29T02:30:00.372+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:30:00.375044816Z [2024-03-29T02:30:00.374+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:30:00.375390537Z [2024-03-29T02:30:00.375+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:30:00.375662236Z [2024-03-29T02:30:00.375+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:30:00.376714339Z [2024-03-29T02:30:00.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:30:00.376729534Z 2024-03-29T02:30:00.376734649Z 2024-03-29T02:30:00.376758467Z 2024-03-29T02:30:00.376764406Z 2024-03-29T02:30:00.376768629Z 2024-03-29T02:30:00.382666354Z [2024-03-29T02:30:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:30:00.382980076Z [2024-03-29T02:30:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:30:00.383406761Z [2024-03-29T02:30:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:30:00.383676011Z [2024-03-29T02:30:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:30:00.384076799Z [2024-03-29T02:30:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:30:00.384393607Z [2024-03-29T02:30:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:30:00.384813981Z [2024-03-29T02:30:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:30:00.385150358Z [2024-03-29T02:30:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:30:00.385396119Z [2024-03-29T02:30:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:30:00.385534408Z [2024-03-29T02:30:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:30:00.980370104Z [2024-03-29T02:30:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:00.982984642Z [2024-03-29T02:30:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:00.983376091Z [2024-03-29T02:30:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:29:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:00.983685353Z [2024-03-29T02:30:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:29:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:00.983858639Z [2024-03-29T02:30:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:29:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:01.010535169Z [2024-03-29T02:30:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35c93222-a99c-47e1-8e94-08dad9e13a8a 2024-03-29T02:30:01.010895159Z [2024-03-29T02:30:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b398094-13ca-47ff-ac37-5fc0595a9be0 2024-03-29T02:30:01.011193248Z [2024-03-29T02:30:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c60fd31-4863-4541-bc73-af6512c23ab9 2024-03-29T02:30:01.011378226Z [2024-03-29T02:30:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79afda82-e31c-42ec-871f-0ffd7c61f9d7 2024-03-29T02:30:01.011646545Z [2024-03-29T02:30:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6738fc2-70d2-4a3b-813e-b29273b0ead4 2024-03-29T02:30:02.414937739Z [2024-03-29T02:30:02.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:30:02.415662334Z [2024-03-29T02:30:02.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:28:00+00:00, run_id=scheduled__2024-03-29T02:28:00+00:00, run_start_date=2024-03-29 02:30:00.286154+00:00, run_end_date=2024-03-29 02:30:02.415043+00:00, run_duration=2.128889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:28:00+00:00, data_interval_end=2024-03-29 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:30:02.432794425Z [2024-03-29T02:30:02.432+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:32:00+00:00 2024-03-29T02:30:02.444293620Z [2024-03-29T02:30:02.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:30:02.444986816Z [2024-03-29T02:30:02.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:29:00+00:00, run_id=scheduled__2024-03-29T02:29:00+00:00, run_start_date=2024-03-29 02:30:00.287664+00:00, run_end_date=2024-03-29 02:30:02.444437+00:00, run_duration=2.156773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:29:00+00:00, data_interval_end=2024-03-29 02:30:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:30:02.469340873Z [2024-03-29T02:30:02.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:31:00+00:00 2024-03-29T02:30:02.548529099Z [2024-03-29T02:30:02.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:28:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:02.551605924Z [2024-03-29T02:30:02.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:29:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:02.559758667Z [2024-03-29T02:30:02.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:29:00+00:00, map_index=-1, run_start_date=2024-03-29 02:30:01.474917+00:00, run_end_date=2024-03-29 02:30:02.139094+00:00, run_duration=0.664177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:00.378697+00:00, queued_by_job_id=2, pid=11617 2024-03-29T02:30:02.560708453Z [2024-03-29T02:30:02.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:28:00+00:00, map_index=-1, run_start_date=2024-03-29 02:30:01.547217+00:00, run_end_date=2024-03-29 02:30:02.103803+00:00, run_duration=0.556586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:00.378697+00:00, queued_by_job_id=2, pid=11618 2024-03-29T02:30:04.120608349Z [2024-03-29T02:30:04.120+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:30:04.120644269Z 2024-03-29T02:30:04.121262414Z [2024-03-29T02:30:04.120+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:30:04.122559689Z [2024-03-29T02:30:04.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:30:04.122577815Z 2024-03-29T02:30:04.127485795Z [2024-03-29T02:30:04.127+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:30:04.127946551Z [2024-03-29T02:30:04.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:30:04.203948093Z [2024-03-29T02:30:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:04.204310417Z [2024-03-29T02:30:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:04.213094512Z [2024-03-29T02:30:04.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to b91cd7df-df83-4cc3-8d83-3ddf3a856157 2024-03-29T02:30:04.213582504Z [2024-03-29T02:30:04.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:25:00+00:00, map_index=-1, run_start_date=2024-03-29 02:30:03.225952+00:00, run_end_date=2024-03-29 02:30:03.733173+00:00, run_duration=0.507221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:00.378697+00:00, queued_by_job_id=2, pid=11637 2024-03-29T02:30:05.454292970Z [2024-03-29T02:30:05.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:30:05.455319203Z [2024-03-29T02:30:05.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:29:00+00:00, run_id=scheduled__2024-03-29T02:29:00+00:00, run_start_date=2024-03-29 02:30:00.288958+00:00, run_end_date=2024-03-29 02:30:05.454673+00:00, run_duration=5.165715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:29:00+00:00, data_interval_end=2024-03-29 02:30:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:30:05.471624061Z [2024-03-29T02:30:05.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:31:00+00:00 2024-03-29T02:30:05.547689936Z [2024-03-29T02:30:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:29:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:05.559736235Z [2024-03-29T02:30:05.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:29:00+00:00, map_index=-1, run_start_date=2024-03-29 02:30:03.538605+00:00, run_end_date=2024-03-29 02:30:04.867403+00:00, run_duration=1.328798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:00.378697+00:00, queued_by_job_id=2, pid=11648 2024-03-29T02:30:06.653401466Z [2024-03-29T02:30:06.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:30:06.653434304Z [2024-03-29T02:30:06.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:29:00+00:00, run_id=scheduled__2024-03-29T02:29:00+00:00, run_start_date=2024-03-29 02:30:00.290307+00:00, run_end_date=2024-03-29 02:30:06.646904+00:00, run_duration=6.356597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:29:00+00:00, data_interval_end=2024-03-29 02:30:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:30:06.663926877Z [2024-03-29T02:30:06.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:31:00+00:00 2024-03-29T02:30:06.782177651Z [2024-03-29T02:30:06.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:29:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:06.788850711Z [2024-03-29T02:30:06.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:29:00+00:00, map_index=-1, run_start_date=2024-03-29 02:30:03.698291+00:00, run_end_date=2024-03-29 02:30:05.448605+00:00, run_duration=1.750314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:00.378697+00:00, queued_by_job_id=2, pid=11654 2024-03-29T02:30:07.941244770Z [2024-03-29T02:30:07.940+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:30:07.941283151Z 2024-03-29T02:30:07.941426489Z [2024-03-29T02:30:07.941+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:30:07.943326856Z [2024-03-29T02:30:07.942+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:30:07.943365479Z 2024-03-29T02:30:07.948017794Z [2024-03-29T02:30:07.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:30:07.948220065Z [2024-03-29T02:30:07.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:30:08.028659197Z [2024-03-29T02:30:08.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:08.028885352Z [2024-03-29T02:30:08.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:08.037328347Z [2024-03-29T02:30:08.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a5196c6-d89b-40d7-b414-dcaba86d93fc 2024-03-29T02:30:08.037547410Z [2024-03-29T02:30:08.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:25:00+00:00, map_index=-1, run_start_date=2024-03-29 02:30:06.472582+00:00, run_end_date=2024-03-29 02:30:06.876896+00:00, run_duration=0.404314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:04.123814+00:00, queued_by_job_id=2, pid=11672 2024-03-29T02:30:10.347884942Z [2024-03-29T02:30:10.347+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:30:10.347918890Z 2024-03-29T02:30:10.347935204Z [2024-03-29T02:30:10.347+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:30:10.348581165Z [2024-03-29T02:30:10.348+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:30:10.348597671Z 2024-03-29T02:30:10.351063339Z [2024-03-29T02:30:10.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:30:10.351307363Z [2024-03-29T02:30:10.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:30:10.411463958Z [2024-03-29T02:30:10.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status queued for try_number 1 2024-03-29T02:30:10.411686462Z [2024-03-29T02:30:10.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:10.417790306Z [2024-03-29T02:30:10.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36d48762-6009-499e-ac0b-09edbce67457 2024-03-29T02:30:10.418066122Z [2024-03-29T02:30:10.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:25:00+00:00, map_index=0, run_start_date=2024-03-29 02:30:09.769271+00:00, run_end_date=2024-03-29 02:30:10.075362+00:00, run_duration=0.306091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:07.944772+00:00, queued_by_job_id=2, pid=11680 2024-03-29T02:30:12.633551303Z [2024-03-29T02:30:12.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:30:12.633949609Z [2024-03-29T02:30:12.633+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:25:00+00:00, run_id=scheduled__2024-03-29T02:25:00+00:00, run_start_date=2024-03-29 02:30:00.284444+00:00, run_end_date=2024-03-29 02:30:12.633529+00:00, run_duration=12.349085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:25:00+00:00, data_interval_end=2024-03-29 02:30:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:30:12.640825174Z [2024-03-29T02:30:12.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:30:00+00:00, run_after=2024-03-29T02:35:00+00:00 2024-03-29T02:30:12.673143273Z [2024-03-29T02:30:12.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:25:00+00:00 exited with status success for try_number 1 2024-03-29T02:30:12.681076472Z [2024-03-29T02:30:12.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:25:00+00:00, map_index=-1, run_start_date=2024-03-29 02:30:12.016249+00:00, run_end_date=2024-03-29 02:30:12.362671+00:00, run_duration=0.346422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:30:10.349015+00:00, queued_by_job_id=2, pid=11688 2024-03-29T02:31:00.733103157Z [2024-03-29T02:31:00.732+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:31:00.747231733Z [2024-03-29T02:31:00.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:31:00+00:00, run_after=2024-03-29T02:32:00+00:00 2024-03-29T02:31:00.769184941Z [2024-03-29T02:31:00.768+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:31:00+00:00, run_after=2024-03-29T02:32:00+00:00 2024-03-29T02:31:00.852003205Z [2024-03-29T02:31:00.851+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:31:00.852044573Z 2024-03-29T02:31:00.852048249Z 2024-03-29T02:31:00.852051391Z 2024-03-29T02:31:00.852208356Z [2024-03-29T02:31:00.851+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:31:00.852306349Z [2024-03-29T02:31:00.852+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:31:00.852388238Z [2024-03-29T02:31:00.852+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:31:00.853102507Z [2024-03-29T02:31:00.852+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:31:00.853107413Z 2024-03-29T02:31:00.853110809Z 2024-03-29T02:31:00.853114106Z 2024-03-29T02:31:00.856631351Z [2024-03-29T02:31:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:31:00.856702008Z [2024-03-29T02:31:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:31:00.856891453Z [2024-03-29T02:31:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:31:00.856970248Z [2024-03-29T02:31:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:31:00.857140372Z [2024-03-29T02:31:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:31:00.857209618Z [2024-03-29T02:31:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:31:01.102526290Z [2024-03-29T02:31:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:31:01.102629686Z [2024-03-29T02:31:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:31:01.102694633Z [2024-03-29T02:31:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:31:01.112013912Z [2024-03-29T02:31:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to bec913b7-d1c9-4598-8cf2-f5624d73cefd 2024-03-29T02:31:01.112042920Z [2024-03-29T02:31:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a127f4d-e34d-4718-8e9d-5284a986ea95 2024-03-29T02:31:01.112429207Z [2024-03-29T02:31:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f7a1f6b-eafd-4152-a725-7d6021a2e96a 2024-03-29T02:31:02.346140620Z [2024-03-29T02:31:02.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:31:02.346490815Z [2024-03-29T02:31:02.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:30:00+00:00, run_id=scheduled__2024-03-29T02:30:00+00:00, run_start_date=2024-03-29 02:31:00.784757+00:00, run_end_date=2024-03-29 02:31:02.346032+00:00, run_duration=1.561275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:30:00+00:00, data_interval_end=2024-03-29 02:31:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:31:02.357443483Z [2024-03-29T02:31:02.357+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:31:00+00:00, run_after=2024-03-29T02:32:00+00:00 2024-03-29T02:31:02.475120394Z [2024-03-29T02:31:02.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:31:02.483004345Z [2024-03-29T02:31:02.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=-1, run_start_date=2024-03-29 02:31:01.702599+00:00, run_end_date=2024-03-29 02:31:02.168558+00:00, run_duration=0.465959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:31:00.853970+00:00, queued_by_job_id=2, pid=11710 2024-03-29T02:31:04.846620189Z [2024-03-29T02:31:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:31:04.846987963Z [2024-03-29T02:31:04.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:30:00+00:00, run_id=scheduled__2024-03-29T02:30:00+00:00, run_start_date=2024-03-29 02:31:00.786003+00:00, run_end_date=2024-03-29 02:31:04.846611+00:00, run_duration=4.060608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:30:00+00:00, data_interval_end=2024-03-29 02:31:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:31:04.856172977Z [2024-03-29T02:31:04.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:31:00+00:00, run_after=2024-03-29T02:32:00+00:00 2024-03-29T02:31:04.893678212Z [2024-03-29T02:31:04.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:31:04.899248385Z [2024-03-29T02:31:04.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=-1, run_start_date=2024-03-29 02:31:02.895966+00:00, run_end_date=2024-03-29 02:31:04.175999+00:00, run_duration=1.280033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:31:00.853970+00:00, queued_by_job_id=2, pid=11725 2024-03-29T02:31:06.076094912Z [2024-03-29T02:31:06.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:31:06.076445914Z [2024-03-29T02:31:06.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:30:00+00:00, run_id=scheduled__2024-03-29T02:30:00+00:00, run_start_date=2024-03-29 02:31:00.787181+00:00, run_end_date=2024-03-29 02:31:06.075991+00:00, run_duration=5.28881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:30:00+00:00, data_interval_end=2024-03-29 02:31:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:31:06.088324930Z [2024-03-29T02:31:06.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:31:00+00:00, run_after=2024-03-29T02:32:00+00:00 2024-03-29T02:31:06.115638500Z [2024-03-29T02:31:06.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:31:06.123673561Z [2024-03-29T02:31:06.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=-1, run_start_date=2024-03-29 02:31:03.151349+00:00, run_end_date=2024-03-29 02:31:05.063966+00:00, run_duration=1.912617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:31:00.853970+00:00, queued_by_job_id=2, pid=11729 2024-03-29T02:32:00.518886062Z [2024-03-29T02:32:00.518+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:32:00.534372184Z [2024-03-29T02:32:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:32:00+00:00, run_after=2024-03-29T02:33:00+00:00 2024-03-29T02:32:00.547400423Z [2024-03-29T02:32:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:32:00+00:00, run_after=2024-03-29T02:33:00+00:00 2024-03-29T02:32:00.556042844Z [2024-03-29T02:32:00.555+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:32:00.636215638Z [2024-03-29T02:32:00.635+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:32:00.636247926Z 2024-03-29T02:32:00.636253456Z 2024-03-29T02:32:00.636258220Z 2024-03-29T02:32:00.636279820Z 2024-03-29T02:32:00.636286806Z [2024-03-29T02:32:00.636+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:32:00.636468295Z [2024-03-29T02:32:00.636+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:32:00.636714694Z [2024-03-29T02:32:00.636+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:32:00.636909570Z [2024-03-29T02:32:00.636+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:32:00.637547628Z [2024-03-29T02:32:00.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:32:00.637559906Z 2024-03-29T02:32:00.637563503Z 2024-03-29T02:32:00.637566796Z 2024-03-29T02:32:00.637570167Z 2024-03-29T02:32:00.641613264Z [2024-03-29T02:32:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:32:00.641800137Z [2024-03-29T02:32:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:32:00.642128898Z [2024-03-29T02:32:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:32:00.642294683Z [2024-03-29T02:32:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:32:00.642645775Z [2024-03-29T02:32:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:32:00.642814498Z [2024-03-29T02:32:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:32:00.643113351Z [2024-03-29T02:32:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:32:00.643274803Z [2024-03-29T02:32:00.643+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:32:01.064971956Z [2024-03-29T02:32:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:32:01.065203829Z [2024-03-29T02:32:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:31:00+00:00 exited with status queued for try_number 1 2024-03-29T02:32:01.065416220Z [2024-03-29T02:32:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:31:00+00:00 exited with status queued for try_number 1 2024-03-29T02:32:01.065639884Z [2024-03-29T02:32:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:31:00+00:00 exited with status queued for try_number 1 2024-03-29T02:32:01.080670339Z [2024-03-29T02:32:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50c08156-15bf-489e-9997-2973419676f8 2024-03-29T02:32:01.081188816Z [2024-03-29T02:32:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18ccdc18-19dc-4f42-aef0-33546a00f008 2024-03-29T02:32:01.081581401Z [2024-03-29T02:32:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to a47082d9-ccac-496f-9786-9771f9e1ec61 2024-03-29T02:32:01.081887342Z [2024-03-29T02:32:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c321418-bcce-4f0f-8a59-57b00127367f 2024-03-29T02:32:02.294231020Z [2024-03-29T02:32:02.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:32:02.294972610Z [2024-03-29T02:32:02.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:30:00+00:00, run_id=scheduled__2024-03-29T02:30:00+00:00, run_start_date=2024-03-29 02:32:00.565995+00:00, run_end_date=2024-03-29 02:32:02.294131+00:00, run_duration=1.728136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:30:00+00:00, data_interval_end=2024-03-29 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:32:02.306362684Z [2024-03-29T02:32:02.305+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:32:00+00:00, run_after=2024-03-29T02:34:00+00:00 2024-03-29T02:32:02.384848933Z [2024-03-29T02:32:02.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:31:00+00:00 exited with status success for try_number 1 2024-03-29T02:32:02.398550983Z [2024-03-29T02:32:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:31:00+00:00, map_index=-1, run_start_date=2024-03-29 02:32:01.610113+00:00, run_end_date=2024-03-29 02:32:02.176950+00:00, run_duration=0.566837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:32:00.638598+00:00, queued_by_job_id=2, pid=11761 2024-03-29T02:32:03.467900945Z [2024-03-29T02:32:03.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:32:03.468312707Z [2024-03-29T02:32:03.468+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:31:00+00:00, run_id=scheduled__2024-03-29T02:31:00+00:00, run_start_date=2024-03-29 02:32:00.567371+00:00, run_end_date=2024-03-29 02:32:03.467753+00:00, run_duration=2.900382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:31:00+00:00, data_interval_end=2024-03-29 02:32:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:32:03.480601316Z [2024-03-29T02:32:03.480+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:32:00+00:00, run_after=2024-03-29T02:33:00+00:00 2024-03-29T02:32:03.546023373Z [2024-03-29T02:32:03.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:32:03.554514738Z [2024-03-29T02:32:03.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=-1, run_start_date=2024-03-29 02:32:01.740707+00:00, run_end_date=2024-03-29 02:32:02.231952+00:00, run_duration=0.491245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:32:00.638598+00:00, queued_by_job_id=2, pid=11762 2024-03-29T02:32:05.678893782Z [2024-03-29T02:32:05.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:32:05.679207486Z [2024-03-29T02:32:05.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:31:00+00:00, run_id=scheduled__2024-03-29T02:31:00+00:00, run_start_date=2024-03-29 02:32:00.568535+00:00, run_end_date=2024-03-29 02:32:05.678914+00:00, run_duration=5.110379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:31:00+00:00, data_interval_end=2024-03-29 02:32:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:32:05.691149937Z [2024-03-29T02:32:05.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:32:00+00:00, run_after=2024-03-29T02:33:00+00:00 2024-03-29T02:32:05.698361884Z [2024-03-29T02:32:05.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:32:05.698753666Z [2024-03-29T02:32:05.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:31:00+00:00, run_id=scheduled__2024-03-29T02:31:00+00:00, run_start_date=2024-03-29 02:32:00.569600+00:00, run_end_date=2024-03-29 02:32:05.698475+00:00, run_duration=5.128875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:31:00+00:00, data_interval_end=2024-03-29 02:32:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:32:05.709942167Z [2024-03-29T02:32:05.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:32:00+00:00, run_after=2024-03-29T02:33:00+00:00 2024-03-29T02:32:05.750731146Z [2024-03-29T02:32:05.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:31:00+00:00 exited with status success for try_number 1 2024-03-29T02:32:05.750950683Z [2024-03-29T02:32:05.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:31:00+00:00 exited with status success for try_number 1 2024-03-29T02:32:05.758642880Z [2024-03-29T02:32:05.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:31:00+00:00, map_index=-1, run_start_date=2024-03-29 02:32:02.897754+00:00, run_end_date=2024-03-29 02:32:04.521439+00:00, run_duration=1.623685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:32:00.638598+00:00, queued_by_job_id=2, pid=11780 2024-03-29T02:32:05.759418486Z [2024-03-29T02:32:05.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:31:00+00:00, map_index=-1, run_start_date=2024-03-29 02:32:03.359329+00:00, run_end_date=2024-03-29 02:32:04.751416+00:00, run_duration=1.392087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:32:00.638598+00:00, queued_by_job_id=2, pid=11791 2024-03-29T02:33:00.140740492Z [2024-03-29T02:33:00.140+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:33:00.153427805Z [2024-03-29T02:33:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:33:00+00:00, run_after=2024-03-29T02:34:00+00:00 2024-03-29T02:33:00.172497965Z [2024-03-29T02:33:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:33:00+00:00, run_after=2024-03-29T02:34:00+00:00 2024-03-29T02:33:00.254163378Z [2024-03-29T02:33:00.253+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:33:00.254191146Z 2024-03-29T02:33:00.254195970Z 2024-03-29T02:33:00.254200312Z 2024-03-29T02:33:00.254384243Z [2024-03-29T02:33:00.254+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:33:00.254659428Z [2024-03-29T02:33:00.254+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:33:00.254881488Z [2024-03-29T02:33:00.254+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:33:00.255505170Z [2024-03-29T02:33:00.255+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:33:00.255525207Z 2024-03-29T02:33:00.255530484Z 2024-03-29T02:33:00.255535169Z 2024-03-29T02:33:00.258906786Z [2024-03-29T02:33:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:33:00.259125404Z [2024-03-29T02:33:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:33:00.259495860Z [2024-03-29T02:33:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:33:00.259688156Z [2024-03-29T02:33:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:33:00.259939156Z [2024-03-29T02:33:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:33:00.260089253Z [2024-03-29T02:33:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:33:00.478578251Z [2024-03-29T02:33:00.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status queued for try_number 1 2024-03-29T02:33:00.478860313Z [2024-03-29T02:33:00.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status queued for try_number 1 2024-03-29T02:33:00.479088481Z [2024-03-29T02:33:00.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status queued for try_number 1 2024-03-29T02:33:00.488117051Z [2024-03-29T02:33:00.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 286067fe-7877-4b5d-ae40-363016b67bfd 2024-03-29T02:33:00.488500927Z [2024-03-29T02:33:00.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e9e4eb3-5211-4c46-bead-70bb30b609db 2024-03-29T02:33:00.488867672Z [2024-03-29T02:33:00.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 213b6b20-2ac7-49b3-9751-90a4e694c1ad 2024-03-29T02:33:01.668858035Z [2024-03-29T02:33:01.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:33:01.670920290Z [2024-03-29T02:33:01.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:32:00+00:00, run_id=scheduled__2024-03-29T02:32:00+00:00, run_start_date=2024-03-29 02:33:00.184745+00:00, run_end_date=2024-03-29 02:33:01.668949+00:00, run_duration=1.484204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:32:00+00:00, data_interval_end=2024-03-29 02:33:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:33:01.681562195Z [2024-03-29T02:33:01.681+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:33:00+00:00, run_after=2024-03-29T02:34:00+00:00 2024-03-29T02:33:01.735721493Z [2024-03-29T02:33:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status success for try_number 1 2024-03-29T02:33:01.745310280Z [2024-03-29T02:33:01.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:32:00+00:00, map_index=-1, run_start_date=2024-03-29 02:33:01.111754+00:00, run_end_date=2024-03-29 02:33:01.516701+00:00, run_duration=0.404947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:33:00.256325+00:00, queued_by_job_id=2, pid=11818 2024-03-29T02:33:03.930886516Z [2024-03-29T02:33:03.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:33:03.931272754Z [2024-03-29T02:33:03.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:32:00+00:00, run_id=scheduled__2024-03-29T02:32:00+00:00, run_start_date=2024-03-29 02:33:00.185968+00:00, run_end_date=2024-03-29 02:33:03.930794+00:00, run_duration=3.744826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:32:00+00:00, data_interval_end=2024-03-29 02:33:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:33:03.941145744Z [2024-03-29T02:33:03.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:33:00+00:00, run_after=2024-03-29T02:34:00+00:00 2024-03-29T02:33:03.987947561Z [2024-03-29T02:33:03.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status success for try_number 1 2024-03-29T02:33:03.997395895Z [2024-03-29T02:33:03.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:32:00+00:00, map_index=-1, run_start_date=2024-03-29 02:33:02.578425+00:00, run_end_date=2024-03-29 02:33:03.799532+00:00, run_duration=1.221107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:33:00.256325+00:00, queued_by_job_id=2, pid=11837 2024-03-29T02:33:05.051626056Z [2024-03-29T02:33:05.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:33:05.051670310Z [2024-03-29T02:33:05.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:32:00+00:00, run_id=scheduled__2024-03-29T02:32:00+00:00, run_start_date=2024-03-29 02:33:00.187149+00:00, run_end_date=2024-03-29 02:33:05.047554+00:00, run_duration=4.860405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:32:00+00:00, data_interval_end=2024-03-29 02:33:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:33:05.063072384Z [2024-03-29T02:33:05.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:33:00+00:00, run_after=2024-03-29T02:34:00+00:00 2024-03-29T02:33:05.106536205Z [2024-03-29T02:33:05.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status success for try_number 1 2024-03-29T02:33:05.112979092Z [2024-03-29T02:33:05.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:32:00+00:00, map_index=-1, run_start_date=2024-03-29 02:33:02.403699+00:00, run_end_date=2024-03-29 02:33:04.062943+00:00, run_duration=1.659244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:33:00.256325+00:00, queued_by_job_id=2, pid=11836 2024-03-29T02:33:46.315445545Z [2024-03-29T02:33:46.314+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:34:00.461533147Z [2024-03-29T02:34:00.460+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:34:00.471114708Z [2024-03-29T02:34:00.470+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:34:00.487327427Z [2024-03-29T02:34:00.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:34:00+00:00, run_after=2024-03-29T02:35:00+00:00 2024-03-29T02:34:00.503711843Z [2024-03-29T02:34:00.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:34:00+00:00, run_after=2024-03-29T02:35:00+00:00 2024-03-29T02:34:00.584730059Z [2024-03-29T02:34:00.584+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:34:00.584754129Z 2024-03-29T02:34:00.584759044Z 2024-03-29T02:34:00.584762432Z 2024-03-29T02:34:00.584765716Z 2024-03-29T02:34:00.584941314Z [2024-03-29T02:34:00.584+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:34:00.585160218Z [2024-03-29T02:34:00.585+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:34:00.585370982Z [2024-03-29T02:34:00.585+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:34:00.585573359Z [2024-03-29T02:34:00.585+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:34:00.586306759Z [2024-03-29T02:34:00.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:34:00.586320051Z 2024-03-29T02:34:00.586323635Z 2024-03-29T02:34:00.586327168Z 2024-03-29T02:34:00.586330392Z 2024-03-29T02:34:00.589985127Z [2024-03-29T02:34:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:34:00.590250829Z [2024-03-29T02:34:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:34:00.590699403Z [2024-03-29T02:34:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:34:00.590900177Z [2024-03-29T02:34:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:34:00.591144444Z [2024-03-29T02:34:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:34:00.591292087Z [2024-03-29T02:34:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:34:00.591602312Z [2024-03-29T02:34:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:34:00.591733235Z [2024-03-29T02:34:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:34:00.962774935Z [2024-03-29T02:34:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status queued for try_number 1 2024-03-29T02:34:00.963154402Z [2024-03-29T02:34:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:33:00+00:00 exited with status queued for try_number 1 2024-03-29T02:34:00.963529529Z [2024-03-29T02:34:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:33:00+00:00 exited with status queued for try_number 1 2024-03-29T02:34:00.963818711Z [2024-03-29T02:34:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:33:00+00:00 exited with status queued for try_number 1 2024-03-29T02:34:00.978775341Z [2024-03-29T02:34:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 522a04f3-92ff-4f5b-b6ec-662017b99098 2024-03-29T02:34:00.979308555Z [2024-03-29T02:34:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23652d0e-038b-429c-ba94-11945d4bd1fd 2024-03-29T02:34:00.979722180Z [2024-03-29T02:34:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to f67ad47c-3e14-4f6d-bbf7-d24e8b516159 2024-03-29T02:34:00.980200687Z [2024-03-29T02:34:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab307b34-ff2c-4adc-9782-6a6b12ac9f76 2024-03-29T02:34:02.594681682Z [2024-03-29T02:34:02.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:34:02.595666308Z [2024-03-29T02:34:02.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:32:00+00:00, run_id=scheduled__2024-03-29T02:32:00+00:00, run_start_date=2024-03-29 02:34:00.517107+00:00, run_end_date=2024-03-29 02:34:02.594898+00:00, run_duration=2.077791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:32:00+00:00, data_interval_end=2024-03-29 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:34:02.622802788Z [2024-03-29T02:34:02.622+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:34:00+00:00, run_after=2024-03-29T02:36:00+00:00 2024-03-29T02:34:02.707068223Z [2024-03-29T02:34:02.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:32:00+00:00 exited with status success for try_number 1 2024-03-29T02:34:02.707252665Z [2024-03-29T02:34:02.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:33:00+00:00 exited with status success for try_number 1 2024-03-29T02:34:02.718897328Z [2024-03-29T02:34:02.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:33:00+00:00, map_index=-1, run_start_date=2024-03-29 02:34:01.865897+00:00, run_end_date=2024-03-29 02:34:02.512623+00:00, run_duration=0.646726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:34:00.587267+00:00, queued_by_job_id=2, pid=11872 2024-03-29T02:34:02.719314557Z [2024-03-29T02:34:02.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:32:00+00:00, map_index=-1, run_start_date=2024-03-29 02:34:01.567586+00:00, run_end_date=2024-03-29 02:34:02.175658+00:00, run_duration=0.608072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:34:00.587267+00:00, queued_by_job_id=2, pid=11871 2024-03-29T02:34:03.771276204Z [2024-03-29T02:34:03.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:34:03.771648114Z [2024-03-29T02:34:03.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:33:00+00:00, run_id=scheduled__2024-03-29T02:33:00+00:00, run_start_date=2024-03-29 02:34:00.518364+00:00, run_end_date=2024-03-29 02:34:03.771126+00:00, run_duration=3.252762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:33:00+00:00, data_interval_end=2024-03-29 02:34:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:34:03.782232552Z [2024-03-29T02:34:03.781+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:34:00+00:00, run_after=2024-03-29T02:35:00+00:00 2024-03-29T02:34:05.965542598Z [2024-03-29T02:34:05.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:34:05.966018917Z [2024-03-29T02:34:05.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:33:00+00:00, run_id=scheduled__2024-03-29T02:33:00+00:00, run_start_date=2024-03-29 02:34:00.519535+00:00, run_end_date=2024-03-29 02:34:05.965439+00:00, run_duration=5.445904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:33:00+00:00, data_interval_end=2024-03-29 02:34:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:34:05.997597021Z [2024-03-29T02:34:05.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:34:00+00:00, run_after=2024-03-29T02:35:00+00:00 2024-03-29T02:34:06.010587922Z [2024-03-29T02:34:06.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:34:06.010612435Z [2024-03-29T02:34:06.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:33:00+00:00, run_id=scheduled__2024-03-29T02:33:00+00:00, run_start_date=2024-03-29 02:34:00.520682+00:00, run_end_date=2024-03-29 02:34:06.008085+00:00, run_duration=5.487403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:33:00+00:00, data_interval_end=2024-03-29 02:34:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:34:06.021684385Z [2024-03-29T02:34:06.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:34:00+00:00, run_after=2024-03-29T02:35:00+00:00 2024-03-29T02:34:06.053801716Z [2024-03-29T02:34:06.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:33:00+00:00 exited with status success for try_number 1 2024-03-29T02:34:06.054007945Z [2024-03-29T02:34:06.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:33:00+00:00 exited with status success for try_number 1 2024-03-29T02:34:06.064674597Z [2024-03-29T02:34:06.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:33:00+00:00, map_index=-1, run_start_date=2024-03-29 02:34:03.061328+00:00, run_end_date=2024-03-29 02:34:05.048654+00:00, run_duration=1.987326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:34:00.587267+00:00, queued_by_job_id=2, pid=11890 2024-03-29T02:34:06.064940379Z [2024-03-29T02:34:06.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:33:00+00:00, map_index=-1, run_start_date=2024-03-29 02:34:03.527073+00:00, run_end_date=2024-03-29 02:34:05.101747+00:00, run_duration=1.574674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:34:00.587267+00:00, queued_by_job_id=2, pid=11901 2024-03-29T02:35:00.852220166Z [2024-03-29T02:35:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:35:00+00:00, run_after=2024-03-29T02:36:00+00:00 2024-03-29T02:35:00.860918372Z [2024-03-29T02:35:00.860+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:35:00.875771009Z [2024-03-29T02:35:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:35:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:35:00.894765343Z [2024-03-29T02:35:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:35:00+00:00, run_after=2024-03-29T02:36:00+00:00 2024-03-29T02:35:01.019884105Z [2024-03-29T02:35:01.019+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:35:01.019919269Z 2024-03-29T02:35:01.019925813Z 2024-03-29T02:35:01.019931143Z 2024-03-29T02:35:01.019936635Z 2024-03-29T02:35:01.020377769Z [2024-03-29T02:35:01.020+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:35:01.020802839Z [2024-03-29T02:35:01.020+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:35:01.021165546Z [2024-03-29T02:35:01.020+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:35:01.021535506Z [2024-03-29T02:35:01.021+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:35:01.022807489Z [2024-03-29T02:35:01.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:35:01.022822589Z 2024-03-29T02:35:01.022828335Z 2024-03-29T02:35:01.022833228Z 2024-03-29T02:35:01.022838338Z 2024-03-29T02:35:01.029382634Z [2024-03-29T02:35:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:35:01.029724973Z [2024-03-29T02:35:01.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:35:01.030248348Z [2024-03-29T02:35:01.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:35:01.030558330Z [2024-03-29T02:35:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:35:01.031059464Z [2024-03-29T02:35:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:35:01.031399397Z [2024-03-29T02:35:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:35:01.031894015Z [2024-03-29T02:35:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:35:01.032152195Z [2024-03-29T02:35:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:35:01.375823503Z [2024-03-29T02:35:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:35:01.376175462Z [2024-03-29T02:35:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status queued for try_number 1 2024-03-29T02:35:01.376321928Z [2024-03-29T02:35:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status queued for try_number 1 2024-03-29T02:35:01.376519274Z [2024-03-29T02:35:01.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status queued for try_number 1 2024-03-29T02:35:01.400167123Z [2024-03-29T02:35:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03e46263-7530-4cff-8b49-7f55cfbb3142 2024-03-29T02:35:01.400348698Z [2024-03-29T02:35:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to d689463b-b87f-4f75-b5b5-cf9035ceb2e3 2024-03-29T02:35:01.400545029Z [2024-03-29T02:35:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1e0f0a2-18eb-4105-b076-143e72f2fe90 2024-03-29T02:35:01.400788950Z [2024-03-29T02:35:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5376e2e4-0f1c-488d-b5f3-3a39dab3cccf 2024-03-29T02:35:03.519163046Z [2024-03-29T02:35:03.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:35:03.523606626Z [2024-03-29T02:35:03.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:34:00+00:00, run_id=scheduled__2024-03-29T02:34:00+00:00, run_start_date=2024-03-29 02:35:00.910183+00:00, run_end_date=2024-03-29 02:35:03.519021+00:00, run_duration=2.608838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:34:00+00:00, data_interval_end=2024-03-29 02:35:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:35:03.541387186Z [2024-03-29T02:35:03.541+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:35:00+00:00, run_after=2024-03-29T02:36:00+00:00 2024-03-29T02:35:03.642127874Z [2024-03-29T02:35:03.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status success for try_number 1 2024-03-29T02:35:03.662249045Z [2024-03-29T02:35:03.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:34:00+00:00, map_index=-1, run_start_date=2024-03-29 02:35:02.171088+00:00, run_end_date=2024-03-29 02:35:02.595164+00:00, run_duration=0.424076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:35:01.024876+00:00, queued_by_job_id=2, pid=11929 2024-03-29T02:35:04.751016739Z [2024-03-29T02:35:04.750+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:35:04.751065907Z 2024-03-29T02:35:04.751072867Z [2024-03-29T02:35:04.750+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:35:04.751587553Z [2024-03-29T02:35:04.751+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:35:04.751618543Z 2024-03-29T02:35:04.754700655Z [2024-03-29T02:35:04.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:35:04.755157983Z [2024-03-29T02:35:04.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:35:04.809207226Z [2024-03-29T02:35:04.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:35:04.809242883Z [2024-03-29T02:35:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:35:04.820112213Z [2024-03-29T02:35:04.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6017129-afb8-4a78-93bf-c9dd5831c43e 2024-03-29T02:35:04.820494165Z [2024-03-29T02:35:04.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=-1, run_start_date=2024-03-29 02:35:03.697186+00:00, run_end_date=2024-03-29 02:35:04.166579+00:00, run_duration=0.469393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:35:01.024876+00:00, queued_by_job_id=2, pid=11954 2024-03-29T02:35:06.028354317Z [2024-03-29T02:35:06.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:35:06.028533032Z [2024-03-29T02:35:06.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:34:00+00:00, run_id=scheduled__2024-03-29T02:34:00+00:00, run_start_date=2024-03-29 02:35:00.911484+00:00, run_end_date=2024-03-29 02:35:06.028237+00:00, run_duration=5.116753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:34:00+00:00, data_interval_end=2024-03-29 02:35:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:35:06.041355529Z [2024-03-29T02:35:06.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:35:00+00:00, run_after=2024-03-29T02:36:00+00:00 2024-03-29T02:35:06.059212299Z [2024-03-29T02:35:06.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:35:06.059378290Z [2024-03-29T02:35:06.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:34:00+00:00, run_id=scheduled__2024-03-29T02:34:00+00:00, run_start_date=2024-03-29 02:35:00.912940+00:00, run_end_date=2024-03-29 02:35:06.059126+00:00, run_duration=5.146186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:34:00+00:00, data_interval_end=2024-03-29 02:35:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:35:06.082810008Z [2024-03-29T02:35:06.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:35:00+00:00, run_after=2024-03-29T02:36:00+00:00 2024-03-29T02:35:06.141834746Z [2024-03-29T02:35:06.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status success for try_number 1 2024-03-29T02:35:06.141859021Z [2024-03-29T02:35:06.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status success for try_number 1 2024-03-29T02:35:06.150424731Z [2024-03-29T02:35:06.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:34:00+00:00, map_index=-1, run_start_date=2024-03-29 02:35:03.497133+00:00, run_end_date=2024-03-29 02:35:05.239362+00:00, run_duration=1.742229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:35:01.024876+00:00, queued_by_job_id=2, pid=11948 2024-03-29T02:35:06.150553168Z [2024-03-29T02:35:06.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:34:00+00:00, map_index=-1, run_start_date=2024-03-29 02:35:03.780647+00:00, run_end_date=2024-03-29 02:35:05.056124+00:00, run_duration=1.275477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:35:01.024876+00:00, queued_by_job_id=2, pid=11955 2024-03-29T02:35:08.003221660Z [2024-03-29T02:35:08.002+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:35:08.003268396Z 2024-03-29T02:35:08.003302394Z [2024-03-29T02:35:08.003+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:35:08.004021519Z [2024-03-29T02:35:08.003+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:35:08.004039149Z 2024-03-29T02:35:08.006629882Z [2024-03-29T02:35:08.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:35:08.006737334Z [2024-03-29T02:35:08.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:35:08.087321880Z [2024-03-29T02:35:08.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:35:08.087416997Z [2024-03-29T02:35:08.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:35:08.093202937Z [2024-03-29T02:35:08.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe630280-3657-40ab-87d1-d5a481dc57f3 2024-03-29T02:35:08.093233599Z [2024-03-29T02:35:08.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=-1, run_start_date=2024-03-29 02:35:06.912974+00:00, run_end_date=2024-03-29 02:35:07.309534+00:00, run_duration=0.39656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:35:04.751990+00:00, queued_by_job_id=2, pid=11978 2024-03-29T02:35:10.965828036Z [2024-03-29T02:35:10.965+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:35:10.965883427Z 2024-03-29T02:35:10.965890454Z [2024-03-29T02:35:10.965+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:35:10.966473608Z [2024-03-29T02:35:10.966+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:35:10.966491632Z 2024-03-29T02:35:10.969676493Z [2024-03-29T02:35:10.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:35:10.969796016Z [2024-03-29T02:35:10.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:35:11.020635375Z [2024-03-29T02:35:11.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status queued for try_number 1 2024-03-29T02:35:11.020660571Z [2024-03-29T02:35:11.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:35:11.029358389Z [2024-03-29T02:35:11.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e88968d-662b-4dc7-bcdc-c35b4499845b 2024-03-29T02:35:11.029593311Z [2024-03-29T02:35:11.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=0, run_start_date=2024-03-29 02:35:09.658802+00:00, run_end_date=2024-03-29 02:35:09.980266+00:00, run_duration=0.321464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:35:08.004479+00:00, queued_by_job_id=2, pid=11986 2024-03-29T02:35:13.674240148Z [2024-03-29T02:35:13.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:35:13.675282158Z [2024-03-29T02:35:13.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:30:00+00:00, run_id=scheduled__2024-03-29T02:30:00+00:00, run_start_date=2024-03-29 02:35:00.908961+00:00, run_end_date=2024-03-29 02:35:13.674175+00:00, run_duration=12.765214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:30:00+00:00, data_interval_end=2024-03-29 02:35:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:35:13.688459086Z [2024-03-29T02:35:13.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:35:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:35:13.734709382Z [2024-03-29T02:35:13.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:30:00+00:00 exited with status success for try_number 1 2024-03-29T02:35:13.746409203Z [2024-03-29T02:35:13.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:30:00+00:00, map_index=-1, run_start_date=2024-03-29 02:35:12.610514+00:00, run_end_date=2024-03-29 02:35:12.935370+00:00, run_duration=0.324856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:35:10.966856+00:00, queued_by_job_id=2, pid=11994 2024-03-29T02:36:00.154936580Z [2024-03-29T02:36:00.154+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:36:00.168398197Z [2024-03-29T02:36:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:36:00+00:00, run_after=2024-03-29T02:37:00+00:00 2024-03-29T02:36:00.181847101Z [2024-03-29T02:36:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:36:00+00:00, run_after=2024-03-29T02:37:00+00:00 2024-03-29T02:36:00.189582256Z [2024-03-29T02:36:00.189+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:36:00.287658261Z [2024-03-29T02:36:00.287+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:36:00.287699300Z 2024-03-29T02:36:00.287708431Z 2024-03-29T02:36:00.287713501Z 2024-03-29T02:36:00.287718040Z 2024-03-29T02:36:00.287756996Z [2024-03-29T02:36:00.287+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:36:00.287992828Z [2024-03-29T02:36:00.287+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:36:00.288173523Z [2024-03-29T02:36:00.287+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:36:00.288323452Z [2024-03-29T02:36:00.288+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:36:00.289076208Z [2024-03-29T02:36:00.288+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:36:00.289084265Z 2024-03-29T02:36:00.289088623Z 2024-03-29T02:36:00.289092373Z 2024-03-29T02:36:00.289095960Z 2024-03-29T02:36:00.294029290Z [2024-03-29T02:36:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:36:00.294262327Z [2024-03-29T02:36:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:36:00.294845509Z [2024-03-29T02:36:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:36:00.295174709Z [2024-03-29T02:36:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:36:00.295521258Z [2024-03-29T02:36:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:36:00.295775703Z [2024-03-29T02:36:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:36:00.296107041Z [2024-03-29T02:36:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:36:00.296314694Z [2024-03-29T02:36:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:36:00.719621682Z [2024-03-29T02:36:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status queued for try_number 1 2024-03-29T02:36:00.721958508Z [2024-03-29T02:36:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status queued for try_number 1 2024-03-29T02:36:00.722052504Z [2024-03-29T02:36:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status queued for try_number 1 2024-03-29T02:36:00.722138407Z [2024-03-29T02:36:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status queued for try_number 1 2024-03-29T02:36:00.739924803Z [2024-03-29T02:36:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94f7ca8e-cfaa-4abc-8e60-dc76dcba9e1a 2024-03-29T02:36:00.739967437Z [2024-03-29T02:36:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d696f9-2399-4b0f-8b34-85dbba9038f8 2024-03-29T02:36:00.740108054Z [2024-03-29T02:36:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3f12f7f-fafa-4acf-8832-d35063e8eb86 2024-03-29T02:36:00.740186346Z [2024-03-29T02:36:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4df7b844-52d7-40e7-bb2c-2119c17b748c 2024-03-29T02:36:01.991718901Z [2024-03-29T02:36:01.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:36:01.992611305Z [2024-03-29T02:36:01.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:34:00+00:00, run_id=scheduled__2024-03-29T02:34:00+00:00, run_start_date=2024-03-29 02:36:00.203320+00:00, run_end_date=2024-03-29 02:36:01.991610+00:00, run_duration=1.78829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:34:00+00:00, data_interval_end=2024-03-29 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:36:02.006259212Z [2024-03-29T02:36:02.005+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:36:00+00:00, run_after=2024-03-29T02:38:00+00:00 2024-03-29T02:36:02.015959988Z [2024-03-29T02:36:02.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:36:02.016318658Z [2024-03-29T02:36:02.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:35:00+00:00, run_id=scheduled__2024-03-29T02:35:00+00:00, run_start_date=2024-03-29 02:36:00.205085+00:00, run_end_date=2024-03-29 02:36:02.015832+00:00, run_duration=1.810747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:35:00+00:00, data_interval_end=2024-03-29 02:36:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:36:02.028865000Z [2024-03-29T02:36:02.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:36:00+00:00, run_after=2024-03-29T02:37:00+00:00 2024-03-29T02:36:02.088118635Z [2024-03-29T02:36:02.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:34:00+00:00 exited with status success for try_number 1 2024-03-29T02:36:02.088298970Z [2024-03-29T02:36:02.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status success for try_number 1 2024-03-29T02:36:02.096646273Z [2024-03-29T02:36:02.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:34:00+00:00, map_index=-1, run_start_date=2024-03-29 02:36:01.077959+00:00, run_end_date=2024-03-29 02:36:01.519982+00:00, run_duration=0.442023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:36:00.290022+00:00, queued_by_job_id=2, pid=12017 2024-03-29T02:36:02.097058535Z [2024-03-29T02:36:02.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:35:00+00:00, map_index=-1, run_start_date=2024-03-29 02:36:01.256625+00:00, run_end_date=2024-03-29 02:36:01.790421+00:00, run_duration=0.533796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:36:00.290022+00:00, queued_by_job_id=2, pid=12018 2024-03-29T02:36:05.412032302Z [2024-03-29T02:36:05.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:36:05.412662313Z [2024-03-29T02:36:05.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:35:00+00:00, run_id=scheduled__2024-03-29T02:35:00+00:00, run_start_date=2024-03-29 02:36:00.206642+00:00, run_end_date=2024-03-29 02:36:05.412180+00:00, run_duration=5.205538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:35:00+00:00, data_interval_end=2024-03-29 02:36:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:36:05.429462981Z [2024-03-29T02:36:05.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:36:00+00:00, run_after=2024-03-29T02:37:00+00:00 2024-03-29T02:36:05.441221757Z [2024-03-29T02:36:05.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:36:05.441985369Z [2024-03-29T02:36:05.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:35:00+00:00, run_id=scheduled__2024-03-29T02:35:00+00:00, run_start_date=2024-03-29 02:36:00.208084+00:00, run_end_date=2024-03-29 02:36:05.441473+00:00, run_duration=5.233389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:35:00+00:00, data_interval_end=2024-03-29 02:36:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:36:05.458819032Z [2024-03-29T02:36:05.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:36:00+00:00, run_after=2024-03-29T02:37:00+00:00 2024-03-29T02:36:05.509194457Z [2024-03-29T02:36:05.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status success for try_number 1 2024-03-29T02:36:05.509500317Z [2024-03-29T02:36:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status success for try_number 1 2024-03-29T02:36:05.517814048Z [2024-03-29T02:36:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:35:00+00:00, map_index=-1, run_start_date=2024-03-29 02:36:02.880619+00:00, run_end_date=2024-03-29 02:36:04.351781+00:00, run_duration=1.471162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:36:00.290022+00:00, queued_by_job_id=2, pid=12042 2024-03-29T02:36:05.518106797Z [2024-03-29T02:36:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:35:00+00:00, map_index=-1, run_start_date=2024-03-29 02:36:02.558614+00:00, run_end_date=2024-03-29 02:36:04.487563+00:00, run_duration=1.928949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:36:00.290022+00:00, queued_by_job_id=2, pid=12036 2024-03-29T02:37:01.019019859Z [2024-03-29T02:37:01.018+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:37:01.048490234Z [2024-03-29T02:37:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:37:00+00:00, run_after=2024-03-29T02:38:00+00:00 2024-03-29T02:37:01.080193330Z [2024-03-29T02:37:01.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:37:00+00:00, run_after=2024-03-29T02:38:00+00:00 2024-03-29T02:37:01.194516406Z [2024-03-29T02:37:01.194+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:37:01.194551897Z 2024-03-29T02:37:01.194562318Z 2024-03-29T02:37:01.194570314Z 2024-03-29T02:37:01.194641909Z [2024-03-29T02:37:01.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:37:01.194865735Z [2024-03-29T02:37:01.194+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:37:01.195063405Z [2024-03-29T02:37:01.194+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:37:01.195900869Z [2024-03-29T02:37:01.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:37:01.195913249Z 2024-03-29T02:37:01.195918454Z 2024-03-29T02:37:01.195923704Z 2024-03-29T02:37:01.200791190Z [2024-03-29T02:37:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:37:01.200919380Z [2024-03-29T02:37:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:37:01.201211513Z [2024-03-29T02:37:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:37:01.201338464Z [2024-03-29T02:37:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:37:01.201587330Z [2024-03-29T02:37:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:37:01.201729202Z [2024-03-29T02:37:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:37:01.523792193Z [2024-03-29T02:37:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status queued for try_number 1 2024-03-29T02:37:01.524089893Z [2024-03-29T02:37:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status queued for try_number 1 2024-03-29T02:37:01.524326900Z [2024-03-29T02:37:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status queued for try_number 1 2024-03-29T02:37:01.539155370Z [2024-03-29T02:37:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to f99acb0d-2e8e-4458-a923-7f8dd06c933f 2024-03-29T02:37:01.550683829Z [2024-03-29T02:37:01.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to d742614b-241f-4fff-8fe8-e8999e7bd1ad 2024-03-29T02:37:01.551111484Z [2024-03-29T02:37:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc6b0c9a-f651-44d9-8c5f-21244f61e2d4 2024-03-29T02:37:02.857200620Z [2024-03-29T02:37:02.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status success for try_number 1 2024-03-29T02:37:02.865184878Z [2024-03-29T02:37:02.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:36:00+00:00, map_index=-1, run_start_date=2024-03-29 02:37:02.202296+00:00, run_end_date=2024-03-29 02:37:02.673470+00:00, run_duration=0.471174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:37:01.196872+00:00, queued_by_job_id=2, pid=12075 2024-03-29T02:37:03.911811348Z [2024-03-29T02:37:03.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:37:03.912391635Z [2024-03-29T02:37:03.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:36:00+00:00, run_id=scheduled__2024-03-29T02:36:00+00:00, run_start_date=2024-03-29 02:37:01.098009+00:00, run_end_date=2024-03-29 02:37:03.911934+00:00, run_duration=2.813925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:36:00+00:00, data_interval_end=2024-03-29 02:37:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:37:03.925626312Z [2024-03-29T02:37:03.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:37:00+00:00, run_after=2024-03-29T02:38:00+00:00 2024-03-29T02:37:05.043856348Z [2024-03-29T02:37:05.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:37:05.043888354Z [2024-03-29T02:37:05.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:36:00+00:00, run_id=scheduled__2024-03-29T02:36:00+00:00, run_start_date=2024-03-29 02:37:01.100104+00:00, run_end_date=2024-03-29 02:37:05.038670+00:00, run_duration=3.938566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:36:00+00:00, data_interval_end=2024-03-29 02:37:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:37:05.048497804Z [2024-03-29T02:37:05.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:37:00+00:00, run_after=2024-03-29T02:38:00+00:00 2024-03-29T02:37:05.103052894Z [2024-03-29T02:37:05.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status success for try_number 1 2024-03-29T02:37:05.111528525Z [2024-03-29T02:37:05.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:36:00+00:00, map_index=-1, run_start_date=2024-03-29 02:37:03.369347+00:00, run_end_date=2024-03-29 02:37:04.754246+00:00, run_duration=1.384899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:37:01.196872+00:00, queued_by_job_id=2, pid=12094 2024-03-29T02:37:06.150362429Z [2024-03-29T02:37:06.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:37:06.150838301Z [2024-03-29T02:37:06.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:36:00+00:00, run_id=scheduled__2024-03-29T02:36:00+00:00, run_start_date=2024-03-29 02:37:01.102161+00:00, run_end_date=2024-03-29 02:37:06.150528+00:00, run_duration=5.048367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:36:00+00:00, data_interval_end=2024-03-29 02:37:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:37:06.159949177Z [2024-03-29T02:37:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:37:00+00:00, run_after=2024-03-29T02:38:00+00:00 2024-03-29T02:37:06.188373979Z [2024-03-29T02:37:06.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status success for try_number 1 2024-03-29T02:37:06.203876689Z [2024-03-29T02:37:06.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:36:00+00:00, map_index=-1, run_start_date=2024-03-29 02:37:03.195455+00:00, run_end_date=2024-03-29 02:37:05.070225+00:00, run_duration=1.87477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:37:01.196872+00:00, queued_by_job_id=2, pid=12093 2024-03-29T02:38:00.705558486Z [2024-03-29T02:38:00.705+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:38:00.726590577Z [2024-03-29T02:38:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:38:00+00:00, run_after=2024-03-29T02:39:00+00:00 2024-03-29T02:38:00.745514574Z [2024-03-29T02:38:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:38:00+00:00, run_after=2024-03-29T02:39:00+00:00 2024-03-29T02:38:00.757094759Z [2024-03-29T02:38:00.756+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:38:00.851145481Z [2024-03-29T02:38:00.850+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:38:00.851181786Z 2024-03-29T02:38:00.851188156Z 2024-03-29T02:38:00.851215090Z 2024-03-29T02:38:00.851220509Z 2024-03-29T02:38:00.851235631Z [2024-03-29T02:38:00.850+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:38:00.851472832Z [2024-03-29T02:38:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:38:00.851626617Z [2024-03-29T02:38:00.851+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:38:00.851796014Z [2024-03-29T02:38:00.851+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:38:00.852739804Z [2024-03-29T02:38:00.852+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:38:00.852778262Z 2024-03-29T02:38:00.852785349Z 2024-03-29T02:38:00.852798869Z 2024-03-29T02:38:00.852804720Z 2024-03-29T02:38:00.857830894Z [2024-03-29T02:38:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:38:00.858119441Z [2024-03-29T02:38:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:38:00.858645358Z [2024-03-29T02:38:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:38:00.858918225Z [2024-03-29T02:38:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:38:00.859359394Z [2024-03-29T02:38:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:38:00.859701142Z [2024-03-29T02:38:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:38:00.860007338Z [2024-03-29T02:38:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:38:00.860275630Z [2024-03-29T02:38:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:38:01.208241491Z [2024-03-29T02:38:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status queued for try_number 1 2024-03-29T02:38:01.208624953Z [2024-03-29T02:38:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:37:00+00:00 exited with status queued for try_number 1 2024-03-29T02:38:01.208837165Z [2024-03-29T02:38:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:37:00+00:00 exited with status queued for try_number 1 2024-03-29T02:38:01.208989116Z [2024-03-29T02:38:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:37:00+00:00 exited with status queued for try_number 1 2024-03-29T02:38:01.224226738Z [2024-03-29T02:38:01.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2aeed2bc-055b-4ea7-98fd-100d576c98d8 2024-03-29T02:38:01.226984785Z [2024-03-29T02:38:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to 979b1b6d-b150-4b7c-b67c-4d8e74e07944 2024-03-29T02:38:01.242795224Z [2024-03-29T02:38:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to cba6b188-b287-4599-9c9d-b4648917ad63 2024-03-29T02:38:01.243128146Z [2024-03-29T02:38:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee177404-31d9-4440-942c-ce5e831ab966 2024-03-29T02:38:03.195684077Z [2024-03-29T02:38:03.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:38:03.196044222Z [2024-03-29T02:38:03.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:36:00+00:00, run_id=scheduled__2024-03-29T02:36:00+00:00, run_start_date=2024-03-29 02:38:00.772648+00:00, run_end_date=2024-03-29 02:38:03.195344+00:00, run_duration=2.422696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:36:00+00:00, data_interval_end=2024-03-29 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:38:03.210535608Z [2024-03-29T02:38:03.210+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:38:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:38:03.223829317Z [2024-03-29T02:38:03.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:38:03.224161017Z [2024-03-29T02:38:03.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:37:00+00:00, run_id=scheduled__2024-03-29T02:37:00+00:00, run_start_date=2024-03-29 02:38:00.774273+00:00, run_end_date=2024-03-29 02:38:03.223693+00:00, run_duration=2.44942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:37:00+00:00, data_interval_end=2024-03-29 02:38:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:38:03.235638724Z [2024-03-29T02:38:03.235+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:38:00+00:00, run_after=2024-03-29T02:39:00+00:00 2024-03-29T02:38:03.305109066Z [2024-03-29T02:38:03.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:36:00+00:00 exited with status success for try_number 1 2024-03-29T02:38:03.305210161Z [2024-03-29T02:38:03.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:37:00+00:00 exited with status success for try_number 1 2024-03-29T02:38:03.315615522Z [2024-03-29T02:38:03.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:36:00+00:00, map_index=-1, run_start_date=2024-03-29 02:38:02.263116+00:00, run_end_date=2024-03-29 02:38:02.787263+00:00, run_duration=0.524147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:38:00.853840+00:00, queued_by_job_id=2, pid=12129 2024-03-29T02:38:03.315792675Z [2024-03-29T02:38:03.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:37:00+00:00, map_index=-1, run_start_date=2024-03-29 02:38:02.050365+00:00, run_end_date=2024-03-29 02:38:02.608645+00:00, run_duration=0.55828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:38:00.853840+00:00, queued_by_job_id=2, pid=12127 2024-03-29T02:38:06.948208864Z [2024-03-29T02:38:06.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:38:06.948681340Z [2024-03-29T02:38:06.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:37:00+00:00, run_id=scheduled__2024-03-29T02:37:00+00:00, run_start_date=2024-03-29 02:38:00.777126+00:00, run_end_date=2024-03-29 02:38:06.948313+00:00, run_duration=6.171187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:37:00+00:00, data_interval_end=2024-03-29 02:38:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:38:06.957285120Z [2024-03-29T02:38:06.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:38:00+00:00, run_after=2024-03-29T02:39:00+00:00 2024-03-29T02:38:06.963786500Z [2024-03-29T02:38:06.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:38:06.964218658Z [2024-03-29T02:38:06.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:37:00+00:00, run_id=scheduled__2024-03-29T02:37:00+00:00, run_start_date=2024-03-29 02:38:00.775765+00:00, run_end_date=2024-03-29 02:38:06.963909+00:00, run_duration=6.188144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:37:00+00:00, data_interval_end=2024-03-29 02:38:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:38:06.974098534Z [2024-03-29T02:38:06.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:38:00+00:00, run_after=2024-03-29T02:39:00+00:00 2024-03-29T02:38:07.003908720Z [2024-03-29T02:38:07.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:37:00+00:00 exited with status success for try_number 1 2024-03-29T02:38:07.004153611Z [2024-03-29T02:38:07.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:37:00+00:00 exited with status success for try_number 1 2024-03-29T02:38:07.013227614Z [2024-03-29T02:38:07.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:37:00+00:00, map_index=-1, run_start_date=2024-03-29 02:38:03.283514+00:00, run_end_date=2024-03-29 02:38:05.952356+00:00, run_duration=2.668842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:38:00.853840+00:00, queued_by_job_id=2, pid=12152 2024-03-29T02:38:07.013508087Z [2024-03-29T02:38:07.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:37:00+00:00, map_index=-1, run_start_date=2024-03-29 02:38:03.224641+00:00, run_end_date=2024-03-29 02:38:06.541859+00:00, run_duration=3.317218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:38:00.853840+00:00, queued_by_job_id=2, pid=12151 2024-03-29T02:38:46.390547422Z [2024-03-29T02:38:46.390+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:39:00.505218016Z [2024-03-29T02:39:00.504+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:39:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:39:00.516120498Z [2024-03-29T02:39:00.515+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:39:00.535531355Z [2024-03-29T02:39:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:39:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:39:00.619824340Z [2024-03-29T02:39:00.619+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:39:00.619855579Z 2024-03-29T02:39:00.619861367Z 2024-03-29T02:39:00.619887974Z 2024-03-29T02:39:00.620167150Z [2024-03-29T02:39:00.619+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:39:00.620448815Z [2024-03-29T02:39:00.620+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:39:00.620664580Z [2024-03-29T02:39:00.620+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:39:00.621633197Z [2024-03-29T02:39:00.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:39:00.621643685Z 2024-03-29T02:39:00.621647070Z 2024-03-29T02:39:00.621650170Z 2024-03-29T02:39:00.626292376Z [2024-03-29T02:39:00.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:39:00.626509158Z [2024-03-29T02:39:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:39:00.626904459Z [2024-03-29T02:39:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:39:00.627117022Z [2024-03-29T02:39:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:39:00.627505136Z [2024-03-29T02:39:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:39:00.627678154Z [2024-03-29T02:39:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:39:00.889947374Z [2024-03-29T02:39:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status queued for try_number 1 2024-03-29T02:39:00.890047217Z [2024-03-29T02:39:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status queued for try_number 1 2024-03-29T02:39:00.890190051Z [2024-03-29T02:39:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status queued for try_number 1 2024-03-29T02:39:00.903304071Z [2024-03-29T02:39:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to c132e175-7663-4d37-aaeb-cc77c4a21a10 2024-03-29T02:39:00.903481085Z [2024-03-29T02:39:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86f30cca-ee88-4adf-9dbd-2da728ab0b6e 2024-03-29T02:39:00.904090995Z [2024-03-29T02:39:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to b51782a1-6c20-46a1-b365-23e3c618449b 2024-03-29T02:39:02.165657691Z [2024-03-29T02:39:02.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:39:02.165975643Z [2024-03-29T02:39:02.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:38:00+00:00, run_id=scheduled__2024-03-29T02:38:00+00:00, run_start_date=2024-03-29 02:39:00.549118+00:00, run_end_date=2024-03-29 02:39:02.165480+00:00, run_duration=1.616362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:38:00+00:00, data_interval_end=2024-03-29 02:39:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:39:02.180295988Z [2024-03-29T02:39:02.179+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:39:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:39:02.607833542Z [2024-03-29T02:39:02.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status success for try_number 1 2024-03-29T02:39:02.622278600Z [2024-03-29T02:39:02.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:38:00+00:00, map_index=-1, run_start_date=2024-03-29 02:39:01.575996+00:00, run_end_date=2024-03-29 02:39:02.102891+00:00, run_duration=0.526895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:39:00.622848+00:00, queued_by_job_id=2, pid=12184 2024-03-29T02:39:04.918318135Z [2024-03-29T02:39:04.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:39:04.919209913Z [2024-03-29T02:39:04.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:38:00+00:00, run_id=scheduled__2024-03-29T02:38:00+00:00, run_start_date=2024-03-29 02:39:00.550565+00:00, run_end_date=2024-03-29 02:39:04.918257+00:00, run_duration=4.367692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:38:00+00:00, data_interval_end=2024-03-29 02:39:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:39:04.936345114Z [2024-03-29T02:39:04.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:39:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:39:05.000878469Z [2024-03-29T02:39:05.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status success for try_number 1 2024-03-29T02:39:05.018133368Z [2024-03-29T02:39:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:38:00+00:00, map_index=-1, run_start_date=2024-03-29 02:39:03.001463+00:00, run_end_date=2024-03-29 02:39:04.459976+00:00, run_duration=1.458513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:39:00.622848+00:00, queued_by_job_id=2, pid=12202 2024-03-29T02:39:06.018639985Z [2024-03-29T02:39:06.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:39:06.018668341Z [2024-03-29T02:39:06.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:38:00+00:00, run_id=scheduled__2024-03-29T02:38:00+00:00, run_start_date=2024-03-29 02:39:00.551753+00:00, run_end_date=2024-03-29 02:39:06.015070+00:00, run_duration=5.463317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:38:00+00:00, data_interval_end=2024-03-29 02:39:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:39:06.048579324Z [2024-03-29T02:39:06.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:39:00+00:00, run_after=2024-03-29T02:40:00+00:00 2024-03-29T02:39:06.100385650Z [2024-03-29T02:39:06.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status success for try_number 1 2024-03-29T02:39:06.120079782Z [2024-03-29T02:39:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:38:00+00:00, map_index=-1, run_start_date=2024-03-29 02:39:03.014021+00:00, run_end_date=2024-03-29 02:39:04.913980+00:00, run_duration=1.899959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:39:00.622848+00:00, queued_by_job_id=2, pid=12203 2024-03-29T02:40:00.085568415Z [2024-03-29T02:40:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:45:00+00:00 2024-03-29T02:40:00.092663777Z [2024-03-29T02:40:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:40:00.105521495Z [2024-03-29T02:40:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:41:00+00:00 2024-03-29T02:40:00.129646826Z [2024-03-29T02:40:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:41:00+00:00 2024-03-29T02:40:00.137337561Z [2024-03-29T02:40:00.137+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:40:00.261404021Z [2024-03-29T02:40:00.261+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T02:40:00.261425153Z 2024-03-29T02:40:00.261430032Z 2024-03-29T02:40:00.261435212Z 2024-03-29T02:40:00.261439347Z 2024-03-29T02:40:00.261443577Z 2024-03-29T02:40:00.261591881Z [2024-03-29T02:40:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:40:00.261896722Z [2024-03-29T02:40:00.261+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:40:00.262105247Z [2024-03-29T02:40:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:40:00.262279625Z [2024-03-29T02:40:00.262+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:40:00.262420133Z [2024-03-29T02:40:00.262+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:40:00.263178963Z [2024-03-29T02:40:00.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:40:00.263191830Z 2024-03-29T02:40:00.263226080Z 2024-03-29T02:40:00.263230681Z 2024-03-29T02:40:00.263234989Z 2024-03-29T02:40:00.263239007Z 2024-03-29T02:40:00.267049477Z [2024-03-29T02:40:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:40:00.267279586Z [2024-03-29T02:40:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:40:00.267589037Z [2024-03-29T02:40:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:40:00.267741438Z [2024-03-29T02:40:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:40:00.268024867Z [2024-03-29T02:40:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:40:00.268261721Z [2024-03-29T02:40:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:40:00.268536911Z [2024-03-29T02:40:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:40:00.268714055Z [2024-03-29T02:40:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:40:00.268990343Z [2024-03-29T02:40:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:40:00.269328309Z [2024-03-29T02:40:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:40:00.892591768Z [2024-03-29T02:40:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:00.892626557Z [2024-03-29T02:40:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:00.892659174Z [2024-03-29T02:40:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:39:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:00.892700000Z [2024-03-29T02:40:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:39:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:00.892753745Z [2024-03-29T02:40:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:39:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:00.935852185Z [2024-03-29T02:40:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7adcbc6e-3a62-48a8-969d-d1f97194fcfa 2024-03-29T02:40:00.936089678Z [2024-03-29T02:40:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 567324d0-90ff-4642-9a65-0ae2b6dc5cc8 2024-03-29T02:40:00.936295798Z [2024-03-29T02:40:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a7c55f5-5fac-4aa4-a571-7fa8631842c9 2024-03-29T02:40:00.936488894Z [2024-03-29T02:40:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to da5da357-252e-49db-9d1d-a3dfb513632e 2024-03-29T02:40:00.936839368Z [2024-03-29T02:40:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 659e92c6-e945-4972-bdb5-b8307d72d4d3 2024-03-29T02:40:03.058588008Z [2024-03-29T02:40:03.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:40:03.058664851Z [2024-03-29T02:40:03.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:38:00+00:00, run_id=scheduled__2024-03-29T02:38:00+00:00, run_start_date=2024-03-29 02:40:00.153895+00:00, run_end_date=2024-03-29 02:40:03.058297+00:00, run_duration=2.904402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:38:00+00:00, data_interval_end=2024-03-29 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:40:03.070019213Z [2024-03-29T02:40:03.069+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:42:00+00:00 2024-03-29T02:40:04.224198824Z [2024-03-29T02:40:04.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:40:04.224535952Z [2024-03-29T02:40:04.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:39:00+00:00, run_id=scheduled__2024-03-29T02:39:00+00:00, run_start_date=2024-03-29 02:40:00.155027+00:00, run_end_date=2024-03-29 02:40:04.224082+00:00, run_duration=4.069055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:39:00+00:00, data_interval_end=2024-03-29 02:40:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:40:04.255889845Z [2024-03-29T02:40:04.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:41:00+00:00 2024-03-29T02:40:04.399303932Z [2024-03-29T02:40:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:38:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:04.399433858Z [2024-03-29T02:40:04.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:39:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:04.415376203Z [2024-03-29T02:40:04.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:38:00+00:00, map_index=-1, run_start_date=2024-03-29 02:40:01.972278+00:00, run_end_date=2024-03-29 02:40:02.943765+00:00, run_duration=0.971487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:00.264110+00:00, queued_by_job_id=2, pid=12237 2024-03-29T02:40:04.415716018Z [2024-03-29T02:40:04.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:39:00+00:00, map_index=-1, run_start_date=2024-03-29 02:40:01.555977+00:00, run_end_date=2024-03-29 02:40:03.095377+00:00, run_duration=1.5394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:00.264110+00:00, queued_by_job_id=2, pid=12236 2024-03-29T02:40:05.546047537Z [2024-03-29T02:40:05.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:40:05.546089737Z 2024-03-29T02:40:05.546550629Z [2024-03-29T02:40:05.545+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:40:05.547225897Z [2024-03-29T02:40:05.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:40:05.547238117Z 2024-03-29T02:40:05.554057498Z [2024-03-29T02:40:05.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:40:05.554921105Z [2024-03-29T02:40:05.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:40:05.766677249Z [2024-03-29T02:40:05.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:05.766858572Z [2024-03-29T02:40:05.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:05.766949024Z [2024-03-29T02:40:05.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:39:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:05.789950362Z [2024-03-29T02:40:05.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:35:00+00:00, map_index=-1, run_start_date=2024-03-29 02:40:03.839786+00:00, run_end_date=2024-03-29 02:40:04.486903+00:00, run_duration=0.647117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:00.264110+00:00, queued_by_job_id=2, pid=12266 2024-03-29T02:40:05.790104686Z [2024-03-29T02:40:05.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to b00970c1-02a2-413c-9cf0-36aa6cdc69ec 2024-03-29T02:40:05.790233225Z [2024-03-29T02:40:05.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:39:00+00:00, map_index=-1, run_start_date=2024-03-29 02:40:03.901654+00:00, run_end_date=2024-03-29 02:40:05.543044+00:00, run_duration=1.64139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:00.264110+00:00, queued_by_job_id=2, pid=12267 2024-03-29T02:40:05.895958487Z [2024-03-29T02:40:05.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:40:05.897573190Z [2024-03-29T02:40:05.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:39:00+00:00, run_id=scheduled__2024-03-29T02:39:00+00:00, run_start_date=2024-03-29 02:40:00.156194+00:00, run_end_date=2024-03-29 02:40:05.895865+00:00, run_duration=5.739671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:39:00+00:00, data_interval_end=2024-03-29 02:40:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:40:05.939627099Z [2024-03-29T02:40:05.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:41:00+00:00 2024-03-29T02:40:07.288559543Z [2024-03-29T02:40:07.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:40:07.288852188Z [2024-03-29T02:40:07.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:39:00+00:00, run_id=scheduled__2024-03-29T02:39:00+00:00, run_start_date=2024-03-29 02:40:00.157736+00:00, run_end_date=2024-03-29 02:40:07.288513+00:00, run_duration=7.130777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:39:00+00:00, data_interval_end=2024-03-29 02:40:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:40:07.305892887Z [2024-03-29T02:40:07.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:41:00+00:00 2024-03-29T02:40:07.467133746Z [2024-03-29T02:40:07.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:39:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:07.487475229Z [2024-03-29T02:40:07.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:39:00+00:00, map_index=-1, run_start_date=2024-03-29 02:40:03.922789+00:00, run_end_date=2024-03-29 02:40:06.123175+00:00, run_duration=2.200386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:00.264110+00:00, queued_by_job_id=2, pid=12268 2024-03-29T02:40:09.200875346Z [2024-03-29T02:40:09.200+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:40:09.200906698Z 2024-03-29T02:40:09.201666300Z [2024-03-29T02:40:09.201+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:40:09.202574481Z [2024-03-29T02:40:09.202+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:40:09.202606453Z 2024-03-29T02:40:09.207011762Z [2024-03-29T02:40:09.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:40:09.207149644Z [2024-03-29T02:40:09.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:40:09.290975350Z [2024-03-29T02:40:09.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:09.291237863Z [2024-03-29T02:40:09.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:09.297506562Z [2024-03-29T02:40:09.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0310f1ec-d48c-477e-96ac-bf58cde1d593 2024-03-29T02:40:09.297897142Z [2024-03-29T02:40:09.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:35:00+00:00, map_index=-1, run_start_date=2024-03-29 02:40:08.132018+00:00, run_end_date=2024-03-29 02:40:08.585495+00:00, run_duration=0.453477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:05.550558+00:00, queued_by_job_id=2, pid=12291 2024-03-29T02:40:11.608463537Z [2024-03-29T02:40:11.607+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:40:11.608510113Z 2024-03-29T02:40:11.608687733Z [2024-03-29T02:40:11.608+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:40:11.609445422Z [2024-03-29T02:40:11.609+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:40:11.609474409Z 2024-03-29T02:40:11.612775411Z [2024-03-29T02:40:11.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:40:11.613800915Z [2024-03-29T02:40:11.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:40:11.689511486Z [2024-03-29T02:40:11.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status queued for try_number 1 2024-03-29T02:40:11.690124191Z [2024-03-29T02:40:11.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:11.702213839Z [2024-03-29T02:40:11.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a6e4202-05f3-45f9-998d-a9719b3b7a4c 2024-03-29T02:40:11.702532702Z [2024-03-29T02:40:11.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:35:00+00:00, map_index=0, run_start_date=2024-03-29 02:40:11.095479+00:00, run_end_date=2024-03-29 02:40:11.466308+00:00, run_duration=0.370829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:09.203298+00:00, queued_by_job_id=2, pid=12299 2024-03-29T02:40:14.310433504Z [2024-03-29T02:40:14.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:40:14.310801353Z [2024-03-29T02:40:14.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:35:00+00:00, run_id=scheduled__2024-03-29T02:35:00+00:00, run_start_date=2024-03-29 02:40:00.152616+00:00, run_end_date=2024-03-29 02:40:14.310411+00:00, run_duration=14.157795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:35:00+00:00, data_interval_end=2024-03-29 02:40:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:40:14.316809550Z [2024-03-29T02:40:14.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:40:00+00:00, run_after=2024-03-29T02:45:00+00:00 2024-03-29T02:40:14.346662871Z [2024-03-29T02:40:14.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:35:00+00:00 exited with status success for try_number 1 2024-03-29T02:40:14.357192296Z [2024-03-29T02:40:14.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:35:00+00:00, map_index=-1, run_start_date=2024-03-29 02:40:13.487313+00:00, run_end_date=2024-03-29 02:40:13.810603+00:00, run_duration=0.32329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:40:11.609934+00:00, queued_by_job_id=2, pid=12307 2024-03-29T02:41:00.356958362Z [2024-03-29T02:41:00.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:41:00+00:00, run_after=2024-03-29T02:42:00+00:00 2024-03-29T02:41:00.376028794Z [2024-03-29T02:41:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:41:00+00:00, run_after=2024-03-29T02:42:00+00:00 2024-03-29T02:41:00.383507275Z [2024-03-29T02:41:00.383+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:41:00.470090682Z [2024-03-29T02:41:00.469+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:41:00.470125213Z 2024-03-29T02:41:00.470129982Z 2024-03-29T02:41:00.470133765Z 2024-03-29T02:41:00.470305277Z [2024-03-29T02:41:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:41:00.470562770Z [2024-03-29T02:41:00.470+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:41:00.470737388Z [2024-03-29T02:41:00.470+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:41:00.471502742Z [2024-03-29T02:41:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:41:00.471508939Z 2024-03-29T02:41:00.471513289Z 2024-03-29T02:41:00.471516919Z 2024-03-29T02:41:00.475989925Z [2024-03-29T02:41:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:41:00.476179314Z [2024-03-29T02:41:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:41:00.476455123Z [2024-03-29T02:41:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:41:00.476626490Z [2024-03-29T02:41:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:41:00.476881126Z [2024-03-29T02:41:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:41:00.476950952Z [2024-03-29T02:41:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:41:00.717515071Z [2024-03-29T02:41:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:41:00.718828537Z [2024-03-29T02:41:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:41:00.718996198Z [2024-03-29T02:41:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:41:00.726410030Z [2024-03-29T02:41:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to abc59439-399b-4dd8-80eb-88abc76157f2 2024-03-29T02:41:00.726560759Z [2024-03-29T02:41:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf08b670-9818-4fb9-bf9c-e8c48a377d1b 2024-03-29T02:41:00.726677934Z [2024-03-29T02:41:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6dce7b53-1c7b-4fee-b80d-03f7e81433f4 2024-03-29T02:41:03.040491295Z [2024-03-29T02:41:03.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:41:03.040890257Z [2024-03-29T02:41:03.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:40:00+00:00, run_id=scheduled__2024-03-29T02:40:00+00:00, run_start_date=2024-03-29 02:41:00.397232+00:00, run_end_date=2024-03-29 02:41:03.040379+00:00, run_duration=2.643147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:40:00+00:00, data_interval_end=2024-03-29 02:41:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:41:03.053227339Z [2024-03-29T02:41:03.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:41:00+00:00, run_after=2024-03-29T02:42:00+00:00 2024-03-29T02:41:03.114651771Z [2024-03-29T02:41:03.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:41:03.121576451Z [2024-03-29T02:41:03.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=-1, run_start_date=2024-03-29 02:41:01.390695+00:00, run_end_date=2024-03-29 02:41:01.950937+00:00, run_duration=0.560242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:41:00.472631+00:00, queued_by_job_id=2, pid=12330 2024-03-29T02:41:04.645554463Z [2024-03-29T02:41:04.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:41:04.646073115Z [2024-03-29T02:41:04.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:40:00+00:00, run_id=scheduled__2024-03-29T02:40:00+00:00, run_start_date=2024-03-29 02:41:00.398497+00:00, run_end_date=2024-03-29 02:41:04.645449+00:00, run_duration=4.246952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:40:00+00:00, data_interval_end=2024-03-29 02:41:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:41:04.656093341Z [2024-03-29T02:41:04.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:41:00+00:00, run_after=2024-03-29T02:42:00+00:00 2024-03-29T02:41:04.714668011Z [2024-03-29T02:41:04.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:41:04.729561791Z [2024-03-29T02:41:04.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=-1, run_start_date=2024-03-29 02:41:02.512860+00:00, run_end_date=2024-03-29 02:41:03.814624+00:00, run_duration=1.301764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:41:00.472631+00:00, queued_by_job_id=2, pid=12349 2024-03-29T02:41:05.891933101Z [2024-03-29T02:41:05.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:41:05.901064921Z [2024-03-29T02:41:05.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:40:00+00:00, run_id=scheduled__2024-03-29T02:40:00+00:00, run_start_date=2024-03-29 02:41:00.400351+00:00, run_end_date=2024-03-29 02:41:05.891835+00:00, run_duration=5.491484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:40:00+00:00, data_interval_end=2024-03-29 02:41:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:41:05.931156069Z [2024-03-29T02:41:05.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:41:00+00:00, run_after=2024-03-29T02:42:00+00:00 2024-03-29T02:41:05.977577138Z [2024-03-29T02:41:05.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:41:05.982541114Z [2024-03-29T02:41:05.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=-1, run_start_date=2024-03-29 02:41:02.376508+00:00, run_end_date=2024-03-29 02:41:04.812239+00:00, run_duration=2.435731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:41:00.472631+00:00, queued_by_job_id=2, pid=12348 2024-03-29T02:42:01.043592186Z [2024-03-29T02:42:01.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:42:01.060170359Z [2024-03-29T02:42:01.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:42:00+00:00, run_after=2024-03-29T02:43:00+00:00 2024-03-29T02:42:01.076549454Z [2024-03-29T02:42:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:42:00+00:00, run_after=2024-03-29T02:43:00+00:00 2024-03-29T02:42:01.084874111Z [2024-03-29T02:42:01.084+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:42:01.185959123Z [2024-03-29T02:42:01.185+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:42:01.186006521Z 2024-03-29T02:42:01.186013466Z 2024-03-29T02:42:01.186019085Z 2024-03-29T02:42:01.186023994Z 2024-03-29T02:42:01.186039410Z [2024-03-29T02:42:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:42:01.186376659Z [2024-03-29T02:42:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:42:01.186785923Z [2024-03-29T02:42:01.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:42:01.187134927Z [2024-03-29T02:42:01.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:42:01.187870009Z [2024-03-29T02:42:01.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:42:01.187882960Z 2024-03-29T02:42:01.187886979Z 2024-03-29T02:42:01.187890470Z 2024-03-29T02:42:01.187909942Z 2024-03-29T02:42:01.191636691Z [2024-03-29T02:42:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:42:01.191885373Z [2024-03-29T02:42:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:42:01.192261473Z [2024-03-29T02:42:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:42:01.192611355Z [2024-03-29T02:42:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:42:01.192944293Z [2024-03-29T02:42:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:42:01.193185834Z [2024-03-29T02:42:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:42:01.193513320Z [2024-03-29T02:42:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:42:01.193777622Z [2024-03-29T02:42:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:42:01.719569420Z [2024-03-29T02:42:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:42:01.719711677Z [2024-03-29T02:42:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:41:00+00:00 exited with status queued for try_number 1 2024-03-29T02:42:01.719831853Z [2024-03-29T02:42:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:41:00+00:00 exited with status queued for try_number 1 2024-03-29T02:42:01.719945165Z [2024-03-29T02:42:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:41:00+00:00 exited with status queued for try_number 1 2024-03-29T02:42:01.738193222Z [2024-03-29T02:42:01.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4daedf13-6704-4bba-9eba-1a1fba11a3f5 2024-03-29T02:42:01.738361685Z [2024-03-29T02:42:01.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13ad1b5c-4268-4cb9-ac9d-ceaded08e2ff 2024-03-29T02:42:01.738561598Z [2024-03-29T02:42:01.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06df1fdd-9c64-46f0-b385-b3f9bba923be 2024-03-29T02:42:01.738735026Z [2024-03-29T02:42:01.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff74cc8a-ea54-4581-98a6-9fc9b54f3c31 2024-03-29T02:42:03.009430695Z [2024-03-29T02:42:03.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:42:03.010197669Z [2024-03-29T02:42:03.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:40:00+00:00, run_id=scheduled__2024-03-29T02:40:00+00:00, run_start_date=2024-03-29 02:42:01.099391+00:00, run_end_date=2024-03-29 02:42:03.009342+00:00, run_duration=1.909951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:40:00+00:00, data_interval_end=2024-03-29 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:42:03.020264587Z [2024-03-29T02:42:03.019+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:42:00+00:00, run_after=2024-03-29T02:44:00+00:00 2024-03-29T02:42:03.028902467Z [2024-03-29T02:42:03.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:42:03.029372152Z [2024-03-29T02:42:03.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:41:00+00:00, run_id=scheduled__2024-03-29T02:41:00+00:00, run_start_date=2024-03-29 02:42:01.103478+00:00, run_end_date=2024-03-29 02:42:03.028719+00:00, run_duration=1.925241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:41:00+00:00, data_interval_end=2024-03-29 02:42:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:42:03.047400994Z [2024-03-29T02:42:03.047+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:42:00+00:00, run_after=2024-03-29T02:43:00+00:00 2024-03-29T02:42:03.114744694Z [2024-03-29T02:42:03.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:42:03.114809041Z [2024-03-29T02:42:03.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:41:00+00:00 exited with status success for try_number 1 2024-03-29T02:42:03.125222752Z [2024-03-29T02:42:03.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=-1, run_start_date=2024-03-29 02:42:01.961235+00:00, run_end_date=2024-03-29 02:42:02.336824+00:00, run_duration=0.375589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:42:01.188827+00:00, queued_by_job_id=2, pid=12382 2024-03-29T02:42:03.125338657Z [2024-03-29T02:42:03.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:41:00+00:00, map_index=-1, run_start_date=2024-03-29 02:42:02.161476+00:00, run_end_date=2024-03-29 02:42:02.622080+00:00, run_duration=0.460604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:42:01.188827+00:00, queued_by_job_id=2, pid=12383 2024-03-29T02:42:05.045338140Z [2024-03-29T02:42:05.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:42:05.045369204Z [2024-03-29T02:42:05.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:41:00+00:00, run_id=scheduled__2024-03-29T02:41:00+00:00, run_start_date=2024-03-29 02:42:01.106642+00:00, run_end_date=2024-03-29 02:42:05.044720+00:00, run_duration=3.938078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:41:00+00:00, data_interval_end=2024-03-29 02:42:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:42:05.075366804Z [2024-03-29T02:42:05.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:42:00+00:00, run_after=2024-03-29T02:43:00+00:00 2024-03-29T02:42:05.236817819Z [2024-03-29T02:42:05.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:41:00+00:00 exited with status success for try_number 1 2024-03-29T02:42:05.248357793Z [2024-03-29T02:42:05.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:41:00+00:00, map_index=-1, run_start_date=2024-03-29 02:42:03.401703+00:00, run_end_date=2024-03-29 02:42:04.985075+00:00, run_duration=1.583372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:42:01.188827+00:00, queued_by_job_id=2, pid=12407 2024-03-29T02:42:06.294134412Z [2024-03-29T02:42:06.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:42:06.294265401Z [2024-03-29T02:42:06.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:41:00+00:00, run_id=scheduled__2024-03-29T02:41:00+00:00, run_start_date=2024-03-29 02:42:01.110734+00:00, run_end_date=2024-03-29 02:42:06.294002+00:00, run_duration=5.183268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:41:00+00:00, data_interval_end=2024-03-29 02:42:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:42:06.304329933Z [2024-03-29T02:42:06.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:42:00+00:00, run_after=2024-03-29T02:43:00+00:00 2024-03-29T02:42:06.334323232Z [2024-03-29T02:42:06.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:41:00+00:00 exited with status success for try_number 1 2024-03-29T02:42:06.344532843Z [2024-03-29T02:42:06.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:41:00+00:00, map_index=-1, run_start_date=2024-03-29 02:42:03.257794+00:00, run_end_date=2024-03-29 02:42:05.412035+00:00, run_duration=2.154241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:42:01.188827+00:00, queued_by_job_id=2, pid=12406 2024-03-29T02:43:00.721912542Z [2024-03-29T02:43:00.721+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:43:00+00:00, run_after=2024-03-29T02:44:00+00:00 2024-03-29T02:43:00.735304557Z [2024-03-29T02:43:00.734+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:43:00.756812296Z [2024-03-29T02:43:00.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:43:00+00:00, run_after=2024-03-29T02:44:00+00:00 2024-03-29T02:43:00.881368241Z [2024-03-29T02:43:00.880+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:43:00.881399881Z 2024-03-29T02:43:00.881404571Z 2024-03-29T02:43:00.881409042Z 2024-03-29T02:43:00.881699899Z [2024-03-29T02:43:00.881+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:43:00.881986471Z [2024-03-29T02:43:00.881+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:43:00.882251313Z [2024-03-29T02:43:00.882+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:43:00.883315984Z [2024-03-29T02:43:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:43:00.883334949Z 2024-03-29T02:43:00.883340861Z 2024-03-29T02:43:00.883346272Z 2024-03-29T02:43:00.888807984Z [2024-03-29T02:43:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:43:00.889150729Z [2024-03-29T02:43:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:43:00.889738798Z [2024-03-29T02:43:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:43:00.890225562Z [2024-03-29T02:43:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:43:00.890891967Z [2024-03-29T02:43:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:43:00.891266564Z [2024-03-29T02:43:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:43:01.148034380Z [2024-03-29T02:43:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status queued for try_number 1 2024-03-29T02:43:01.151296673Z [2024-03-29T02:43:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status queued for try_number 1 2024-03-29T02:43:01.151501285Z [2024-03-29T02:43:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status queued for try_number 1 2024-03-29T02:43:01.166115521Z [2024-03-29T02:43:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ab9b4f2-b45e-4178-a6be-109b5f5cbd95 2024-03-29T02:43:01.166436197Z [2024-03-29T02:43:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6db992a7-978a-43ba-8dce-5bd06b8c28c4 2024-03-29T02:43:01.166848258Z [2024-03-29T02:43:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20630ff1-0379-4f2e-8a25-f01bfab6726e 2024-03-29T02:43:02.380660869Z [2024-03-29T02:43:02.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:43:02.381130359Z [2024-03-29T02:43:02.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:42:00+00:00, run_id=scheduled__2024-03-29T02:42:00+00:00, run_start_date=2024-03-29 02:43:00.778722+00:00, run_end_date=2024-03-29 02:43:02.380698+00:00, run_duration=1.601976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:42:00+00:00, data_interval_end=2024-03-29 02:43:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:43:02.392504810Z [2024-03-29T02:43:02.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:43:00+00:00, run_after=2024-03-29T02:44:00+00:00 2024-03-29T02:43:02.455937910Z [2024-03-29T02:43:02.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status success for try_number 1 2024-03-29T02:43:02.462058540Z [2024-03-29T02:43:02.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:42:00+00:00, map_index=-1, run_start_date=2024-03-29 02:43:01.822854+00:00, run_end_date=2024-03-29 02:43:02.217776+00:00, run_duration=0.394922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:43:00.884662+00:00, queued_by_job_id=2, pid=12439 2024-03-29T02:43:04.751542836Z [2024-03-29T02:43:04.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:43:04.751858679Z [2024-03-29T02:43:04.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:42:00+00:00, run_id=scheduled__2024-03-29T02:42:00+00:00, run_start_date=2024-03-29 02:43:00.780143+00:00, run_end_date=2024-03-29 02:43:04.751433+00:00, run_duration=3.97129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:42:00+00:00, data_interval_end=2024-03-29 02:43:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:43:04.762424053Z [2024-03-29T02:43:04.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:43:00+00:00, run_after=2024-03-29T02:44:00+00:00 2024-03-29T02:43:04.804942769Z [2024-03-29T02:43:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status success for try_number 1 2024-03-29T02:43:04.811648287Z [2024-03-29T02:43:04.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:42:00+00:00, map_index=-1, run_start_date=2024-03-29 02:43:02.849691+00:00, run_end_date=2024-03-29 02:43:04.413406+00:00, run_duration=1.563715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:43:00.884662+00:00, queued_by_job_id=2, pid=12458 2024-03-29T02:43:05.918579211Z [2024-03-29T02:43:05.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:43:05.919053527Z [2024-03-29T02:43:05.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:42:00+00:00, run_id=scheduled__2024-03-29T02:42:00+00:00, run_start_date=2024-03-29 02:43:00.782896+00:00, run_end_date=2024-03-29 02:43:05.918370+00:00, run_duration=5.135474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:42:00+00:00, data_interval_end=2024-03-29 02:43:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:43:05.934620929Z [2024-03-29T02:43:05.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:43:00+00:00, run_after=2024-03-29T02:44:00+00:00 2024-03-29T02:43:05.993748819Z [2024-03-29T02:43:05.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status success for try_number 1 2024-03-29T02:43:06.003765235Z [2024-03-29T02:43:06.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:42:00+00:00, map_index=-1, run_start_date=2024-03-29 02:43:02.769435+00:00, run_end_date=2024-03-29 02:43:05.110881+00:00, run_duration=2.341446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:43:00.884662+00:00, queued_by_job_id=2, pid=12457 2024-03-29T02:43:46.427512200Z [2024-03-29T02:43:46.427+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:44:00.527508788Z [2024-03-29T02:44:00.526+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:44:00.549307830Z [2024-03-29T02:44:00.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:44:00+00:00, run_after=2024-03-29T02:45:00+00:00 2024-03-29T02:44:00.560328038Z [2024-03-29T02:44:00.560+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:44:00.578197270Z [2024-03-29T02:44:00.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:44:00+00:00, run_after=2024-03-29T02:45:00+00:00 2024-03-29T02:44:00.674964013Z [2024-03-29T02:44:00.674+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:44:00.675003584Z 2024-03-29T02:44:00.675012941Z 2024-03-29T02:44:00.675019994Z 2024-03-29T02:44:00.675027280Z 2024-03-29T02:44:00.675613631Z [2024-03-29T02:44:00.675+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:44:00.676152967Z [2024-03-29T02:44:00.675+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:44:00.676678124Z [2024-03-29T02:44:00.676+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:44:00.677320590Z [2024-03-29T02:44:00.676+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:44:00.679105615Z [2024-03-29T02:44:00.678+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:44:00.679154072Z 2024-03-29T02:44:00.679161238Z 2024-03-29T02:44:00.679166176Z 2024-03-29T02:44:00.679170939Z 2024-03-29T02:44:00.685785859Z [2024-03-29T02:44:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:44:00.686154385Z [2024-03-29T02:44:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:44:00.686792761Z [2024-03-29T02:44:00.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:44:00.687175857Z [2024-03-29T02:44:00.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:44:00.687669580Z [2024-03-29T02:44:00.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:44:00.687956689Z [2024-03-29T02:44:00.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:44:00.688633297Z [2024-03-29T02:44:00.688+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:44:00.688874518Z [2024-03-29T02:44:00.688+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:44:01.128250034Z [2024-03-29T02:44:01.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status queued for try_number 1 2024-03-29T02:44:01.128508484Z [2024-03-29T02:44:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:43:00+00:00 exited with status queued for try_number 1 2024-03-29T02:44:01.128803709Z [2024-03-29T02:44:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:43:00+00:00 exited with status queued for try_number 1 2024-03-29T02:44:01.128813015Z [2024-03-29T02:44:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:43:00+00:00 exited with status queued for try_number 1 2024-03-29T02:44:01.151832627Z [2024-03-29T02:44:01.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed140e58-9743-478d-a102-59c35cee9350 2024-03-29T02:44:01.154925526Z [2024-03-29T02:44:01.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9934487a-537a-4624-a8be-ba5bbbdc9303 2024-03-29T02:44:01.155304199Z [2024-03-29T02:44:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to a91977f1-b13b-4edf-8ee6-3339905e234f 2024-03-29T02:44:01.155548757Z [2024-03-29T02:44:01.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8aae89f-fc09-477c-9b86-18a58dfdfbb5 2024-03-29T02:44:03.676926634Z [2024-03-29T02:44:03.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:44:03.677682764Z [2024-03-29T02:44:03.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:42:00+00:00, run_id=scheduled__2024-03-29T02:42:00+00:00, run_start_date=2024-03-29 02:44:00.593571+00:00, run_end_date=2024-03-29 02:44:03.677041+00:00, run_duration=3.08347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:42:00+00:00, data_interval_end=2024-03-29 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:44:03.692243886Z [2024-03-29T02:44:03.691+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:44:00+00:00, run_after=2024-03-29T02:46:00+00:00 2024-03-29T02:44:03.704698980Z [2024-03-29T02:44:03.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:44:03.705002105Z [2024-03-29T02:44:03.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:43:00+00:00, run_id=scheduled__2024-03-29T02:43:00+00:00, run_start_date=2024-03-29 02:44:00.594989+00:00, run_end_date=2024-03-29 02:44:03.704505+00:00, run_duration=3.109516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:43:00+00:00, data_interval_end=2024-03-29 02:44:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:44:03.724333817Z [2024-03-29T02:44:03.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:44:00+00:00, run_after=2024-03-29T02:45:00+00:00 2024-03-29T02:44:03.807672733Z [2024-03-29T02:44:03.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:42:00+00:00 exited with status success for try_number 1 2024-03-29T02:44:03.808059862Z [2024-03-29T02:44:03.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:43:00+00:00 exited with status success for try_number 1 2024-03-29T02:44:03.823681230Z [2024-03-29T02:44:03.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:42:00+00:00, map_index=-1, run_start_date=2024-03-29 02:44:01.989551+00:00, run_end_date=2024-03-29 02:44:02.643887+00:00, run_duration=0.654336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:44:00.681223+00:00, queued_by_job_id=2, pid=12493 2024-03-29T02:44:03.824321463Z [2024-03-29T02:44:03.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:43:00+00:00, map_index=-1, run_start_date=2024-03-29 02:44:02.124926+00:00, run_end_date=2024-03-29 02:44:02.750443+00:00, run_duration=0.625517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:44:00.681223+00:00, queued_by_job_id=2, pid=12495 2024-03-29T02:44:04.748449243Z [2024-03-29T02:44:04.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:44:04.748759723Z [2024-03-29T02:44:04.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:43:00+00:00, run_id=scheduled__2024-03-29T02:43:00+00:00, run_start_date=2024-03-29 02:44:00.596264+00:00, run_end_date=2024-03-29 02:44:04.748385+00:00, run_duration=4.152121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:43:00+00:00, data_interval_end=2024-03-29 02:44:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:44:04.758409790Z [2024-03-29T02:44:04.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:44:00+00:00, run_after=2024-03-29T02:45:00+00:00 2024-03-29T02:44:04.805278658Z [2024-03-29T02:44:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:43:00+00:00 exited with status success for try_number 1 2024-03-29T02:44:04.815295259Z [2024-03-29T02:44:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:43:00+00:00, map_index=-1, run_start_date=2024-03-29 02:44:03.235965+00:00, run_end_date=2024-03-29 02:44:04.606685+00:00, run_duration=1.37072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:44:00.681223+00:00, queued_by_job_id=2, pid=12517 2024-03-29T02:44:05.942660980Z [2024-03-29T02:44:05.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:44:05.942981606Z [2024-03-29T02:44:05.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:43:00+00:00, run_id=scheduled__2024-03-29T02:43:00+00:00, run_start_date=2024-03-29 02:44:00.597342+00:00, run_end_date=2024-03-29 02:44:05.942680+00:00, run_duration=5.345338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:43:00+00:00, data_interval_end=2024-03-29 02:44:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:44:05.952077716Z [2024-03-29T02:44:05.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:44:00+00:00, run_after=2024-03-29T02:45:00+00:00 2024-03-29T02:44:06.006518793Z [2024-03-29T02:44:06.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:43:00+00:00 exited with status success for try_number 1 2024-03-29T02:44:06.009689318Z [2024-03-29T02:44:06.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:43:00+00:00, map_index=-1, run_start_date=2024-03-29 02:44:02.969624+00:00, run_end_date=2024-03-29 02:44:05.385455+00:00, run_duration=2.415831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:44:00.681223+00:00, queued_by_job_id=2, pid=12516 2024-03-29T02:45:00.137730823Z [2024-03-29T02:45:00.137+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:45:00.164800292Z [2024-03-29T02:45:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:45:00+00:00, run_after=2024-03-29T02:46:00+00:00 2024-03-29T02:45:00.179660058Z [2024-03-29T02:45:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:45:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:45:00.191729695Z [2024-03-29T02:45:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:45:00+00:00, run_after=2024-03-29T02:46:00+00:00 2024-03-29T02:45:00.295994285Z [2024-03-29T02:45:00.295+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:45:00.296031682Z 2024-03-29T02:45:00.296041684Z 2024-03-29T02:45:00.296046480Z 2024-03-29T02:45:00.296051248Z 2024-03-29T02:45:00.296056727Z [2024-03-29T02:45:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:45:00.296177231Z [2024-03-29T02:45:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:45:00.296432893Z [2024-03-29T02:45:00.296+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:45:00.296748444Z [2024-03-29T02:45:00.296+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:45:00.297598031Z [2024-03-29T02:45:00.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:45:00.297608062Z 2024-03-29T02:45:00.297612876Z 2024-03-29T02:45:00.297618057Z 2024-03-29T02:45:00.297622831Z 2024-03-29T02:45:00.302371020Z [2024-03-29T02:45:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:45:00.302525011Z [2024-03-29T02:45:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:45:00.302905274Z [2024-03-29T02:45:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:45:00.302988080Z [2024-03-29T02:45:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:45:00.303287969Z [2024-03-29T02:45:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:45:00.303474660Z [2024-03-29T02:45:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:45:00.303900109Z [2024-03-29T02:45:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:45:00.304143248Z [2024-03-29T02:45:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:45:00.647293376Z [2024-03-29T02:45:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:45:00.647347773Z [2024-03-29T02:45:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status queued for try_number 1 2024-03-29T02:45:00.647567946Z [2024-03-29T02:45:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status queued for try_number 1 2024-03-29T02:45:00.647574492Z [2024-03-29T02:45:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status queued for try_number 1 2024-03-29T02:45:00.656399790Z [2024-03-29T02:45:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59a559c3-874d-4fac-b34e-48bdf7fd169f 2024-03-29T02:45:00.656608285Z [2024-03-29T02:45:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5504566-2e1b-4aa7-91b8-914de21dfbaa 2024-03-29T02:45:00.656832271Z [2024-03-29T02:45:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5a8aabc-dfdc-4627-b39c-ecec2009ac6c 2024-03-29T02:45:00.657027073Z [2024-03-29T02:45:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5b520c0-d17b-456d-b218-3fa842346589 2024-03-29T02:45:03.274575383Z [2024-03-29T02:45:03.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:45:03.274898096Z [2024-03-29T02:45:03.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:44:00+00:00, run_id=scheduled__2024-03-29T02:44:00+00:00, run_start_date=2024-03-29 02:45:00.204400+00:00, run_end_date=2024-03-29 02:45:03.274389+00:00, run_duration=3.069989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:44:00+00:00, data_interval_end=2024-03-29 02:45:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:45:03.291854175Z [2024-03-29T02:45:03.291+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:45:00+00:00, run_after=2024-03-29T02:46:00+00:00 2024-03-29T02:45:03.394993644Z [2024-03-29T02:45:03.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status success for try_number 1 2024-03-29T02:45:03.413329588Z [2024-03-29T02:45:03.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:44:00+00:00, map_index=-1, run_start_date=2024-03-29 02:45:01.431358+00:00, run_end_date=2024-03-29 02:45:02.299100+00:00, run_duration=0.867742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:45:00.298845+00:00, queued_by_job_id=2, pid=12550 2024-03-29T02:45:05.300730362Z [2024-03-29T02:45:05.300+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:45:05.300758521Z 2024-03-29T02:45:05.303658575Z [2024-03-29T02:45:05.300+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:45:05.304450762Z [2024-03-29T02:45:05.304+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:45:05.304465285Z 2024-03-29T02:45:05.307729248Z [2024-03-29T02:45:05.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:45:05.307960748Z [2024-03-29T02:45:05.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:45:05.473701430Z [2024-03-29T02:45:05.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:45:05.476029767Z [2024-03-29T02:45:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:45:05.486981783Z [2024-03-29T02:45:05.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2410c9d-0896-4604-a748-d2e5140cb4af 2024-03-29T02:45:05.487188968Z [2024-03-29T02:45:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=-1, run_start_date=2024-03-29 02:45:03.918503+00:00, run_end_date=2024-03-29 02:45:04.644416+00:00, run_duration=0.725913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:45:00.298845+00:00, queued_by_job_id=2, pid=12576 2024-03-29T02:45:05.713433716Z [2024-03-29T02:45:05.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:45:05.724527402Z [2024-03-29T02:45:05.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:44:00+00:00, run_id=scheduled__2024-03-29T02:44:00+00:00, run_start_date=2024-03-29 02:45:00.205535+00:00, run_end_date=2024-03-29 02:45:05.719489+00:00, run_duration=5.513954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:44:00+00:00, data_interval_end=2024-03-29 02:45:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:45:05.788503495Z [2024-03-29T02:45:05.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:45:00+00:00, run_after=2024-03-29T02:46:00+00:00 2024-03-29T02:45:05.919065947Z [2024-03-29T02:45:05.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status success for try_number 1 2024-03-29T02:45:05.932676508Z [2024-03-29T02:45:05.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:44:00+00:00, map_index=-1, run_start_date=2024-03-29 02:45:03.530704+00:00, run_end_date=2024-03-29 02:45:05.319603+00:00, run_duration=1.788899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:45:00.298845+00:00, queued_by_job_id=2, pid=12569 2024-03-29T02:45:07.061265253Z [2024-03-29T02:45:07.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:45:07.061645956Z [2024-03-29T02:45:07.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:44:00+00:00, run_id=scheduled__2024-03-29T02:44:00+00:00, run_start_date=2024-03-29 02:45:00.206579+00:00, run_end_date=2024-03-29 02:45:07.061179+00:00, run_duration=6.8546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:44:00+00:00, data_interval_end=2024-03-29 02:45:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:45:07.190699230Z [2024-03-29T02:45:07.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:45:00+00:00, run_after=2024-03-29T02:46:00+00:00 2024-03-29T02:45:07.507145333Z [2024-03-29T02:45:07.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status success for try_number 1 2024-03-29T02:45:07.563800709Z [2024-03-29T02:45:07.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:44:00+00:00, map_index=-1, run_start_date=2024-03-29 02:45:03.792799+00:00, run_end_date=2024-03-29 02:45:06.573650+00:00, run_duration=2.780851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:45:00.298845+00:00, queued_by_job_id=2, pid=12575 2024-03-29T02:45:09.858265185Z [2024-03-29T02:45:09.857+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:45:09.858296757Z 2024-03-29T02:45:09.858301215Z [2024-03-29T02:45:09.858+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:45:09.858847400Z [2024-03-29T02:45:09.858+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:45:09.858921304Z 2024-03-29T02:45:09.861746571Z [2024-03-29T02:45:09.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:45:09.861806000Z [2024-03-29T02:45:09.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:45:09.990213617Z [2024-03-29T02:45:09.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:45:09.990247128Z [2024-03-29T02:45:09.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:45:09.997456373Z [2024-03-29T02:45:09.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78059489-eeed-4060-8f8c-0310aca0b1cb 2024-03-29T02:45:09.997532846Z [2024-03-29T02:45:09.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=-1, run_start_date=2024-03-29 02:45:08.650973+00:00, run_end_date=2024-03-29 02:45:09.319903+00:00, run_duration=0.66893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:45:05.305080+00:00, queued_by_job_id=2, pid=12599 2024-03-29T02:45:12.647709159Z [2024-03-29T02:45:12.646+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:45:12.647741037Z 2024-03-29T02:45:12.647747231Z [2024-03-29T02:45:12.647+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:45:12.648201412Z [2024-03-29T02:45:12.648+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:45:12.648237132Z 2024-03-29T02:45:12.651205989Z [2024-03-29T02:45:12.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:45:12.651423848Z [2024-03-29T02:45:12.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:45:12.723441149Z [2024-03-29T02:45:12.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status queued for try_number 1 2024-03-29T02:45:12.723498711Z [2024-03-29T02:45:12.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:45:12.730233055Z [2024-03-29T02:45:12.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf964754-1e2e-4ed5-adcb-1464e3178d7f 2024-03-29T02:45:12.730368997Z [2024-03-29T02:45:12.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=0, run_start_date=2024-03-29 02:45:11.541995+00:00, run_end_date=2024-03-29 02:45:11.901561+00:00, run_duration=0.359566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:45:09.859178+00:00, queued_by_job_id=2, pid=12607 2024-03-29T02:45:14.996713865Z [2024-03-29T02:45:14.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:45:14.997228866Z [2024-03-29T02:45:14.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:40:00+00:00, run_id=scheduled__2024-03-29T02:40:00+00:00, run_start_date=2024-03-29 02:45:00.203256+00:00, run_end_date=2024-03-29 02:45:14.996699+00:00, run_duration=14.793443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:40:00+00:00, data_interval_end=2024-03-29 02:45:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:45:15.008644906Z [2024-03-29T02:45:15.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:45:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:45:15.609868426Z [2024-03-29T02:45:15.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:40:00+00:00 exited with status success for try_number 1 2024-03-29T02:45:15.616715227Z [2024-03-29T02:45:15.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:40:00+00:00, map_index=-1, run_start_date=2024-03-29 02:45:14.505681+00:00, run_end_date=2024-03-29 02:45:14.925286+00:00, run_duration=0.419605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:45:12.648533+00:00, queued_by_job_id=2, pid=12615 2024-03-29T02:46:00.425717530Z [2024-03-29T02:46:00.425+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:46:00.439718127Z [2024-03-29T02:46:00.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:46:00+00:00, run_after=2024-03-29T02:47:00+00:00 2024-03-29T02:46:00.448215123Z [2024-03-29T02:46:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:46:00.461572540Z [2024-03-29T02:46:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:46:00+00:00, run_after=2024-03-29T02:47:00+00:00 2024-03-29T02:46:00.543550976Z [2024-03-29T02:46:00.543+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:46:00.543593709Z 2024-03-29T02:46:00.543598867Z 2024-03-29T02:46:00.543602627Z 2024-03-29T02:46:00.543606010Z 2024-03-29T02:46:00.543625198Z [2024-03-29T02:46:00.543+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:46:00.543777275Z [2024-03-29T02:46:00.543+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:46:00.543922414Z [2024-03-29T02:46:00.543+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:46:00.544036066Z [2024-03-29T02:46:00.543+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:46:00.544623477Z [2024-03-29T02:46:00.544+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:46:00.544640675Z 2024-03-29T02:46:00.544644794Z 2024-03-29T02:46:00.544648148Z 2024-03-29T02:46:00.544651441Z 2024-03-29T02:46:00.548685963Z [2024-03-29T02:46:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:46:00.548836272Z [2024-03-29T02:46:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:46:00.549148783Z [2024-03-29T02:46:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:46:00.549180656Z [2024-03-29T02:46:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:46:00.549419153Z [2024-03-29T02:46:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:46:00.549476939Z [2024-03-29T02:46:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:46:00.549666575Z [2024-03-29T02:46:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:46:00.549794456Z [2024-03-29T02:46:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:46:01.154702688Z [2024-03-29T02:46:01.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status queued for try_number 1 2024-03-29T02:46:01.154998507Z [2024-03-29T02:46:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status queued for try_number 1 2024-03-29T02:46:01.155260878Z [2024-03-29T02:46:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status queued for try_number 1 2024-03-29T02:46:01.155609404Z [2024-03-29T02:46:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status queued for try_number 1 2024-03-29T02:46:01.206955950Z [2024-03-29T02:46:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51e7aefb-55ee-4b40-ad4a-b177fa8a8d71 2024-03-29T02:46:01.207181345Z [2024-03-29T02:46:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a66c32b-5772-4010-a6d6-c09a3641c421 2024-03-29T02:46:01.209544774Z [2024-03-29T02:46:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5056f114-0e72-433a-80f3-e99f37d466ea 2024-03-29T02:46:01.209852496Z [2024-03-29T02:46:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78b3450e-c18f-4e0b-a251-f2d195abf756 2024-03-29T02:46:02.416683433Z [2024-03-29T02:46:02.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:46:02.417066319Z [2024-03-29T02:46:02.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:44:00+00:00, run_id=scheduled__2024-03-29T02:44:00+00:00, run_start_date=2024-03-29 02:46:00.472472+00:00, run_end_date=2024-03-29 02:46:02.416538+00:00, run_duration=1.944066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:44:00+00:00, data_interval_end=2024-03-29 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:46:02.426613647Z [2024-03-29T02:46:02.426+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:46:00+00:00, run_after=2024-03-29T02:48:00+00:00 2024-03-29T02:46:02.522758326Z [2024-03-29T02:46:02.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:44:00+00:00 exited with status success for try_number 1 2024-03-29T02:46:02.530498042Z [2024-03-29T02:46:02.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:44:00+00:00, map_index=-1, run_start_date=2024-03-29 02:46:01.457201+00:00, run_end_date=2024-03-29 02:46:02.035598+00:00, run_duration=0.578397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:46:00.545584+00:00, queued_by_job_id=2, pid=12634 2024-03-29T02:46:03.383891406Z [2024-03-29T02:46:03.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:46:03.384938299Z [2024-03-29T02:46:03.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:45:00+00:00, run_id=scheduled__2024-03-29T02:45:00+00:00, run_start_date=2024-03-29 02:46:00.474095+00:00, run_end_date=2024-03-29 02:46:03.383970+00:00, run_duration=2.909875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:45:00+00:00, data_interval_end=2024-03-29 02:46:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:46:03.406402779Z [2024-03-29T02:46:03.405+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:46:00+00:00, run_after=2024-03-29T02:47:00+00:00 2024-03-29T02:46:03.497688849Z [2024-03-29T02:46:03.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status success for try_number 1 2024-03-29T02:46:03.509107763Z [2024-03-29T02:46:03.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:45:00+00:00, map_index=-1, run_start_date=2024-03-29 02:46:02.480982+00:00, run_end_date=2024-03-29 02:46:03.034358+00:00, run_duration=0.553376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:46:00.545584+00:00, queued_by_job_id=2, pid=12645 2024-03-29T02:46:05.754310121Z [2024-03-29T02:46:05.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:46:05.759067178Z [2024-03-29T02:46:05.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:45:00+00:00, run_id=scheduled__2024-03-29T02:45:00+00:00, run_start_date=2024-03-29 02:46:00.477000+00:00, run_end_date=2024-03-29 02:46:05.754211+00:00, run_duration=5.277211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:45:00+00:00, data_interval_end=2024-03-29 02:46:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:46:05.787006502Z [2024-03-29T02:46:05.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:46:00+00:00, run_after=2024-03-29T02:47:00+00:00 2024-03-29T02:46:05.800239769Z [2024-03-29T02:46:05.798+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:46:05.800807092Z [2024-03-29T02:46:05.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:45:00+00:00, run_id=scheduled__2024-03-29T02:45:00+00:00, run_start_date=2024-03-29 02:46:00.475636+00:00, run_end_date=2024-03-29 02:46:05.800323+00:00, run_duration=5.324687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:45:00+00:00, data_interval_end=2024-03-29 02:46:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:46:05.814666040Z [2024-03-29T02:46:05.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:46:00+00:00, run_after=2024-03-29T02:47:00+00:00 2024-03-29T02:46:05.897550285Z [2024-03-29T02:46:05.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status success for try_number 1 2024-03-29T02:46:05.906678029Z [2024-03-29T02:46:05.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:45:00+00:00, map_index=-1, run_start_date=2024-03-29 02:46:03.802155+00:00, run_end_date=2024-03-29 02:46:05.406752+00:00, run_duration=1.604597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:46:00.545584+00:00, queued_by_job_id=2, pid=12664 2024-03-29T02:46:07.005365174Z [2024-03-29T02:46:07.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status success for try_number 1 2024-03-29T02:46:07.014020391Z [2024-03-29T02:46:07.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:45:00+00:00, map_index=-1, run_start_date=2024-03-29 02:46:03.593005+00:00, run_end_date=2024-03-29 02:46:05.662771+00:00, run_duration=2.069766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:46:00.545584+00:00, queued_by_job_id=2, pid=12663 2024-03-29T02:47:00.206961523Z [2024-03-29T02:47:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:47:00+00:00, run_after=2024-03-29T02:48:00+00:00 2024-03-29T02:47:00.216244192Z [2024-03-29T02:47:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:47:00.228536732Z [2024-03-29T02:47:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:47:00+00:00, run_after=2024-03-29T02:48:00+00:00 2024-03-29T02:47:00.296313040Z [2024-03-29T02:47:00.295+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:47:00.296355493Z 2024-03-29T02:47:00.296359518Z 2024-03-29T02:47:00.296362616Z 2024-03-29T02:47:00.296474392Z [2024-03-29T02:47:00.296+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:47:00.296788144Z [2024-03-29T02:47:00.296+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:47:00.297201243Z [2024-03-29T02:47:00.296+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:47:00.297878324Z [2024-03-29T02:47:00.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:47:00.297888868Z 2024-03-29T02:47:00.297892197Z 2024-03-29T02:47:00.297895268Z 2024-03-29T02:47:00.302054181Z [2024-03-29T02:47:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:47:00.302436992Z [2024-03-29T02:47:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:47:00.302926547Z [2024-03-29T02:47:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:47:00.303205725Z [2024-03-29T02:47:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:47:00.304773762Z [2024-03-29T02:47:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:47:00.304959406Z [2024-03-29T02:47:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:47:00.638761452Z [2024-03-29T02:47:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status queued for try_number 1 2024-03-29T02:47:00.638944450Z [2024-03-29T02:47:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status queued for try_number 1 2024-03-29T02:47:00.639100605Z [2024-03-29T02:47:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status queued for try_number 1 2024-03-29T02:47:00.648991258Z [2024-03-29T02:47:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc81024c-9c46-4b5a-9e22-d07197077599 2024-03-29T02:47:00.649280879Z [2024-03-29T02:47:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d83518a-b1ed-4552-807b-d40816962ba0 2024-03-29T02:47:00.649558470Z [2024-03-29T02:47:00.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b7e4345-eec5-4c11-af7c-973152df0223 2024-03-29T02:47:01.851968107Z [2024-03-29T02:47:01.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:47:01.852988317Z [2024-03-29T02:47:01.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:46:00+00:00, run_id=scheduled__2024-03-29T02:46:00+00:00, run_start_date=2024-03-29 02:47:00.239927+00:00, run_end_date=2024-03-29 02:47:01.852324+00:00, run_duration=1.612397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:46:00+00:00, data_interval_end=2024-03-29 02:47:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:47:01.872341914Z [2024-03-29T02:47:01.871+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:47:00+00:00, run_after=2024-03-29T02:48:00+00:00 2024-03-29T02:47:01.945720690Z [2024-03-29T02:47:01.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status success for try_number 1 2024-03-29T02:47:01.954299845Z [2024-03-29T02:47:01.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:46:00+00:00, map_index=-1, run_start_date=2024-03-29 02:47:01.266306+00:00, run_end_date=2024-03-29 02:47:01.684150+00:00, run_duration=0.417844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:47:00.298833+00:00, queued_by_job_id=2, pid=12696 2024-03-29T02:47:05.253704023Z [2024-03-29T02:47:05.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:47:05.253887154Z [2024-03-29T02:47:05.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:46:00+00:00, run_id=scheduled__2024-03-29T02:46:00+00:00, run_start_date=2024-03-29 02:47:00.241250+00:00, run_end_date=2024-03-29 02:47:05.253527+00:00, run_duration=5.012277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:46:00+00:00, data_interval_end=2024-03-29 02:47:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:47:05.285441691Z [2024-03-29T02:47:05.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:47:00+00:00, run_after=2024-03-29T02:48:00+00:00 2024-03-29T02:47:05.297988904Z [2024-03-29T02:47:05.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:47:05.299147330Z [2024-03-29T02:47:05.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:46:00+00:00, run_id=scheduled__2024-03-29T02:46:00+00:00, run_start_date=2024-03-29 02:47:00.242314+00:00, run_end_date=2024-03-29 02:47:05.297967+00:00, run_duration=5.055653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:46:00+00:00, data_interval_end=2024-03-29 02:47:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:47:05.315940138Z [2024-03-29T02:47:05.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:47:00+00:00, run_after=2024-03-29T02:48:00+00:00 2024-03-29T02:47:05.361542358Z [2024-03-29T02:47:05.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status success for try_number 1 2024-03-29T02:47:05.361630548Z [2024-03-29T02:47:05.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status success for try_number 1 2024-03-29T02:47:05.372211818Z [2024-03-29T02:47:05.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:46:00+00:00, map_index=-1, run_start_date=2024-03-29 02:47:02.310990+00:00, run_end_date=2024-03-29 02:47:04.755741+00:00, run_duration=2.444751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:47:00.298833+00:00, queued_by_job_id=2, pid=12714 2024-03-29T02:47:05.372557087Z [2024-03-29T02:47:05.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:46:00+00:00, map_index=-1, run_start_date=2024-03-29 02:47:02.409286+00:00, run_end_date=2024-03-29 02:47:04.788536+00:00, run_duration=2.37925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:47:00.298833+00:00, queued_by_job_id=2, pid=12715 2024-03-29T02:48:00.997221613Z [2024-03-29T02:48:00.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:48:00+00:00, run_after=2024-03-29T02:49:00+00:00 2024-03-29T02:48:01.020879656Z [2024-03-29T02:48:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:48:00+00:00, run_after=2024-03-29T02:49:00+00:00 2024-03-29T02:48:01.031528647Z [2024-03-29T02:48:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:48:01.041685357Z [2024-03-29T02:48:01.041+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:48:01.124101426Z [2024-03-29T02:48:01.123+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:48:01.124125789Z 2024-03-29T02:48:01.124129903Z 2024-03-29T02:48:01.124133789Z 2024-03-29T02:48:01.124136938Z 2024-03-29T02:48:01.124147408Z [2024-03-29T02:48:01.123+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:48:01.124240272Z [2024-03-29T02:48:01.124+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:48:01.124340745Z [2024-03-29T02:48:01.124+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:48:01.124453810Z [2024-03-29T02:48:01.124+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:48:01.125198664Z [2024-03-29T02:48:01.124+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:48:01.125206852Z 2024-03-29T02:48:01.125211136Z 2024-03-29T02:48:01.125215581Z 2024-03-29T02:48:01.125219816Z 2024-03-29T02:48:01.129538752Z [2024-03-29T02:48:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:48:01.129758485Z [2024-03-29T02:48:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:48:01.130071215Z [2024-03-29T02:48:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:48:01.130230474Z [2024-03-29T02:48:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:48:01.130472916Z [2024-03-29T02:48:01.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:48:01.130986119Z [2024-03-29T02:48:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:48:01.131345026Z [2024-03-29T02:48:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:48:01.131428014Z [2024-03-29T02:48:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:48:01.691272181Z [2024-03-29T02:48:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status queued for try_number 1 2024-03-29T02:48:01.691566434Z [2024-03-29T02:48:01.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:47:00+00:00 exited with status queued for try_number 1 2024-03-29T02:48:01.691750999Z [2024-03-29T02:48:01.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:47:00+00:00 exited with status queued for try_number 1 2024-03-29T02:48:01.691916634Z [2024-03-29T02:48:01.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:47:00+00:00 exited with status queued for try_number 1 2024-03-29T02:48:01.725666942Z [2024-03-29T02:48:01.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 682845ba-e048-4340-a8dd-a24a0de464e6 2024-03-29T02:48:01.725975592Z [2024-03-29T02:48:01.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5998ffaa-ad96-4abc-ba5e-caf6a5b5fcb3 2024-03-29T02:48:01.726958182Z [2024-03-29T02:48:01.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63089134-1cd5-4dd4-86d3-3650305aa626 2024-03-29T02:48:01.727364628Z [2024-03-29T02:48:01.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6114b33e-8b3e-4728-833e-71a885c01bfb 2024-03-29T02:48:04.342133630Z [2024-03-29T02:48:04.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:48:04.342333951Z [2024-03-29T02:48:04.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:46:00+00:00, run_id=scheduled__2024-03-29T02:46:00+00:00, run_start_date=2024-03-29 02:48:01.055785+00:00, run_end_date=2024-03-29 02:48:04.342008+00:00, run_duration=3.286223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:46:00+00:00, data_interval_end=2024-03-29 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:48:04.352251476Z [2024-03-29T02:48:04.350+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:48:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:48:04.374185473Z [2024-03-29T02:48:04.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:48:04.374194564Z [2024-03-29T02:48:04.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:47:00+00:00, run_id=scheduled__2024-03-29T02:47:00+00:00, run_start_date=2024-03-29 02:48:01.057406+00:00, run_end_date=2024-03-29 02:48:04.370962+00:00, run_duration=3.313556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:47:00+00:00, data_interval_end=2024-03-29 02:48:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:48:04.395106535Z [2024-03-29T02:48:04.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:48:00+00:00, run_after=2024-03-29T02:49:00+00:00 2024-03-29T02:48:04.476858970Z [2024-03-29T02:48:04.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:46:00+00:00 exited with status success for try_number 1 2024-03-29T02:48:04.477120532Z [2024-03-29T02:48:04.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:47:00+00:00 exited with status success for try_number 1 2024-03-29T02:48:04.485305795Z [2024-03-29T02:48:04.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:47:00+00:00, map_index=-1, run_start_date=2024-03-29 02:48:02.909149+00:00, run_end_date=2024-03-29 02:48:03.429084+00:00, run_duration=0.519935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:48:01.126172+00:00, queued_by_job_id=2, pid=12751 2024-03-29T02:48:04.485743315Z [2024-03-29T02:48:04.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:46:00+00:00, map_index=-1, run_start_date=2024-03-29 02:48:02.840090+00:00, run_end_date=2024-03-29 02:48:03.439946+00:00, run_duration=0.599856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:48:01.126172+00:00, queued_by_job_id=2, pid=12749 2024-03-29T02:48:07.681113526Z [2024-03-29T02:48:07.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:48:07.681598645Z [2024-03-29T02:48:07.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:47:00+00:00, run_id=scheduled__2024-03-29T02:47:00+00:00, run_start_date=2024-03-29 02:48:01.058746+00:00, run_end_date=2024-03-29 02:48:07.680948+00:00, run_duration=6.622202, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:47:00+00:00, data_interval_end=2024-03-29 02:48:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:48:07.694730128Z [2024-03-29T02:48:07.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:48:00+00:00, run_after=2024-03-29T02:49:00+00:00 2024-03-29T02:48:07.702826725Z [2024-03-29T02:48:07.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:48:07.703243253Z [2024-03-29T02:48:07.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:47:00+00:00, run_id=scheduled__2024-03-29T02:47:00+00:00, run_start_date=2024-03-29 02:48:01.060007+00:00, run_end_date=2024-03-29 02:48:07.702746+00:00, run_duration=6.642739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:47:00+00:00, data_interval_end=2024-03-29 02:48:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:48:07.715616628Z [2024-03-29T02:48:07.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:48:00+00:00, run_after=2024-03-29T02:49:00+00:00 2024-03-29T02:48:07.747037972Z [2024-03-29T02:48:07.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:47:00+00:00 exited with status success for try_number 1 2024-03-29T02:48:07.747186434Z [2024-03-29T02:48:07.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:47:00+00:00 exited with status success for try_number 1 2024-03-29T02:48:07.759219229Z [2024-03-29T02:48:07.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:47:00+00:00, map_index=-1, run_start_date=2024-03-29 02:48:04.244795+00:00, run_end_date=2024-03-29 02:48:06.699943+00:00, run_duration=2.455148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:48:01.126172+00:00, queued_by_job_id=2, pid=12770 2024-03-29T02:48:07.759749515Z [2024-03-29T02:48:07.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:47:00+00:00, map_index=-1, run_start_date=2024-03-29 02:48:04.602793+00:00, run_end_date=2024-03-29 02:48:07.338562+00:00, run_duration=2.735769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:48:01.126172+00:00, queued_by_job_id=2, pid=12774 2024-03-29T02:48:46.484840632Z [2024-03-29T02:48:46.484+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:49:00.049584610Z [2024-03-29T02:49:00.049+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:49:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:49:00.060096557Z [2024-03-29T02:49:00.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:49:00.076631387Z [2024-03-29T02:49:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:49:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:49:00.147334666Z [2024-03-29T02:49:00.146+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:49:00.147369865Z 2024-03-29T02:49:00.147376562Z 2024-03-29T02:49:00.147382320Z 2024-03-29T02:49:00.147417935Z [2024-03-29T02:49:00.147+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:49:00.147541136Z [2024-03-29T02:49:00.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:49:00.147728297Z [2024-03-29T02:49:00.147+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:49:00.148402513Z [2024-03-29T02:49:00.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:49:00.148421055Z 2024-03-29T02:49:00.148431147Z 2024-03-29T02:49:00.148441543Z 2024-03-29T02:49:00.151800183Z [2024-03-29T02:49:00.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:49:00.152122326Z [2024-03-29T02:49:00.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:49:00.152512171Z [2024-03-29T02:49:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:49:00.152846749Z [2024-03-29T02:49:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:49:00.153331838Z [2024-03-29T02:49:00.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:49:00.153512157Z [2024-03-29T02:49:00.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:49:00.384832532Z [2024-03-29T02:49:00.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status queued for try_number 1 2024-03-29T02:49:00.386908924Z [2024-03-29T02:49:00.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status queued for try_number 1 2024-03-29T02:49:00.387005505Z [2024-03-29T02:49:00.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status queued for try_number 1 2024-03-29T02:49:00.394583787Z [2024-03-29T02:49:00.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5465cb81-4bb5-4689-9820-587b17b41456 2024-03-29T02:49:00.394760538Z [2024-03-29T02:49:00.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 407ffb2e-5e77-4e33-a8ee-62a42bc33f64 2024-03-29T02:49:00.394920372Z [2024-03-29T02:49:00.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 255ea335-14c1-4f13-8d18-63e130480104 2024-03-29T02:49:02.068584180Z [2024-03-29T02:49:02.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:49:02.069563465Z [2024-03-29T02:49:02.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:48:00+00:00, run_id=scheduled__2024-03-29T02:48:00+00:00, run_start_date=2024-03-29 02:49:00.088378+00:00, run_end_date=2024-03-29 02:49:02.068940+00:00, run_duration=1.980562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:48:00+00:00, data_interval_end=2024-03-29 02:49:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:49:02.088013493Z [2024-03-29T02:49:02.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:49:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:49:02.189993010Z [2024-03-29T02:49:02.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status success for try_number 1 2024-03-29T02:49:02.196376310Z [2024-03-29T02:49:02.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:48:00+00:00, map_index=-1, run_start_date=2024-03-29 02:49:00.980500+00:00, run_end_date=2024-03-29 02:49:01.340789+00:00, run_duration=0.360289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:49:00.149083+00:00, queued_by_job_id=2, pid=12806 2024-03-29T02:49:04.398370597Z [2024-03-29T02:49:04.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:49:04.398866528Z [2024-03-29T02:49:04.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:48:00+00:00, run_id=scheduled__2024-03-29T02:48:00+00:00, run_start_date=2024-03-29 02:49:00.091192+00:00, run_end_date=2024-03-29 02:49:04.398293+00:00, run_duration=4.307101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:48:00+00:00, data_interval_end=2024-03-29 02:49:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:49:04.417824452Z [2024-03-29T02:49:04.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:49:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:49:04.476536440Z [2024-03-29T02:49:04.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status success for try_number 1 2024-03-29T02:49:04.483263214Z [2024-03-29T02:49:04.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:48:00+00:00, map_index=-1, run_start_date=2024-03-29 02:49:02.108703+00:00, run_end_date=2024-03-29 02:49:03.859524+00:00, run_duration=1.750821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:49:00.149083+00:00, queued_by_job_id=2, pid=12824 2024-03-29T02:49:05.532373373Z [2024-03-29T02:49:05.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:49:05.532752250Z [2024-03-29T02:49:05.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:48:00+00:00, run_id=scheduled__2024-03-29T02:48:00+00:00, run_start_date=2024-03-29 02:49:00.089827+00:00, run_end_date=2024-03-29 02:49:05.532221+00:00, run_duration=5.442394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:48:00+00:00, data_interval_end=2024-03-29 02:49:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:49:05.542053282Z [2024-03-29T02:49:05.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:49:00+00:00, run_after=2024-03-29T02:50:00+00:00 2024-03-29T02:49:05.575612300Z [2024-03-29T02:49:05.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status success for try_number 1 2024-03-29T02:49:05.582240555Z [2024-03-29T02:49:05.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:48:00+00:00, map_index=-1, run_start_date=2024-03-29 02:49:02.286156+00:00, run_end_date=2024-03-29 02:49:04.424895+00:00, run_duration=2.138739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:49:00.149083+00:00, queued_by_job_id=2, pid=12825 2024-03-29T02:50:00.409349417Z [2024-03-29T02:50:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:55:00+00:00 2024-03-29T02:50:00.427108354Z [2024-03-29T02:50:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:51:00+00:00 2024-03-29T02:50:00.437129771Z [2024-03-29T02:50:00.436+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:50:00.443740693Z [2024-03-29T02:50:00.443+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:50:00.458680042Z [2024-03-29T02:50:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:51:00+00:00 2024-03-29T02:50:00.570726236Z [2024-03-29T02:50:00.570+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T02:50:00.570752379Z 2024-03-29T02:50:00.570756263Z 2024-03-29T02:50:00.570760393Z 2024-03-29T02:50:00.570763935Z 2024-03-29T02:50:00.570767258Z 2024-03-29T02:50:00.570771107Z [2024-03-29T02:50:00.570+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:50:00.570801371Z [2024-03-29T02:50:00.570+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:50:00.570878243Z [2024-03-29T02:50:00.570+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:50:00.570932345Z [2024-03-29T02:50:00.570+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:50:00.571036163Z [2024-03-29T02:50:00.570+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:50:00.571640617Z [2024-03-29T02:50:00.571+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:50:00.571650765Z 2024-03-29T02:50:00.571674070Z 2024-03-29T02:50:00.571678485Z 2024-03-29T02:50:00.571682392Z 2024-03-29T02:50:00.571686126Z 2024-03-29T02:50:00.575619159Z [2024-03-29T02:50:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:50:00.575701524Z [2024-03-29T02:50:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:50:00.575847092Z [2024-03-29T02:50:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:50:00.575956671Z [2024-03-29T02:50:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:50:00.576117613Z [2024-03-29T02:50:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:50:00.576213889Z [2024-03-29T02:50:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:50:00.576393114Z [2024-03-29T02:50:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:50:00.576448549Z [2024-03-29T02:50:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:50:00.576633814Z [2024-03-29T02:50:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:50:00.576710941Z [2024-03-29T02:50:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:50:01.157643378Z [2024-03-29T02:50:01.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:01.158708504Z [2024-03-29T02:50:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:01.159016111Z [2024-03-29T02:50:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:49:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:01.159321471Z [2024-03-29T02:50:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:49:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:01.159630057Z [2024-03-29T02:50:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:49:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:01.180498831Z [2024-03-29T02:50:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94161869-6f7a-4388-ba43-1704bd67932f 2024-03-29T02:50:01.180538220Z [2024-03-29T02:50:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to b36c4349-e593-4917-b151-c09b3d5e248f 2024-03-29T02:50:01.180631522Z [2024-03-29T02:50:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 877d98d3-f094-45ed-9cee-f3a09e224317 2024-03-29T02:50:01.180795890Z [2024-03-29T02:50:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8caa7396-37ea-4f9a-b7cb-44966482bab4 2024-03-29T02:50:01.180970157Z [2024-03-29T02:50:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5b197a8-a7b8-4293-91d4-b755bdf6f4a5 2024-03-29T02:50:03.166229119Z [2024-03-29T02:50:03.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:50:03.168503954Z [2024-03-29T02:50:03.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:49:00+00:00, run_id=scheduled__2024-03-29T02:49:00+00:00, run_start_date=2024-03-29 02:50:00.480935+00:00, run_end_date=2024-03-29 02:50:03.166114+00:00, run_duration=2.685179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:49:00+00:00, data_interval_end=2024-03-29 02:50:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:50:03.184478553Z [2024-03-29T02:50:03.184+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:51:00+00:00 2024-03-29T02:50:03.220090807Z [2024-03-29T02:50:03.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:50:03.220521934Z [2024-03-29T02:50:03.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:48:00+00:00, run_id=scheduled__2024-03-29T02:48:00+00:00, run_start_date=2024-03-29 02:50:00.478027+00:00, run_end_date=2024-03-29 02:50:03.220206+00:00, run_duration=2.742179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:48:00+00:00, data_interval_end=2024-03-29 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:50:03.233908827Z [2024-03-29T02:50:03.233+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:52:00+00:00 2024-03-29T02:50:03.351912722Z [2024-03-29T02:50:03.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:48:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:03.352010284Z [2024-03-29T02:50:03.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:49:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:03.365542422Z [2024-03-29T02:50:03.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:49:00+00:00, map_index=-1, run_start_date=2024-03-29 02:50:01.439216+00:00, run_end_date=2024-03-29 02:50:02.224168+00:00, run_duration=0.784952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:00.572545+00:00, queued_by_job_id=2, pid=12859 2024-03-29T02:50:03.365935655Z [2024-03-29T02:50:03.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:48:00+00:00, map_index=-1, run_start_date=2024-03-29 02:50:01.828679+00:00, run_end_date=2024-03-29 02:50:02.411695+00:00, run_duration=0.583016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:00.572545+00:00, queued_by_job_id=2, pid=12860 2024-03-29T02:50:04.479860994Z [2024-03-29T02:50:04.479+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:50:04.479917194Z 2024-03-29T02:50:04.479963980Z [2024-03-29T02:50:04.479+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:50:04.480891836Z [2024-03-29T02:50:04.480+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:50:04.480901767Z 2024-03-29T02:50:04.485186953Z [2024-03-29T02:50:04.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:50:04.485405277Z [2024-03-29T02:50:04.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:50:04.553306991Z [2024-03-29T02:50:04.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:04.553345895Z [2024-03-29T02:50:04.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:04.561274002Z [2024-03-29T02:50:04.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46c2a3af-a2fb-44af-a2f8-7ec652c9ac2d 2024-03-29T02:50:04.561743493Z [2024-03-29T02:50:04.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:45:00+00:00, map_index=-1, run_start_date=2024-03-29 02:50:03.366364+00:00, run_end_date=2024-03-29 02:50:04.216174+00:00, run_duration=0.84981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:00.572545+00:00, queued_by_job_id=2, pid=12891 2024-03-29T02:50:05.820559676Z [2024-03-29T02:50:05.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:50:05.820904523Z [2024-03-29T02:50:05.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:49:00+00:00, run_id=scheduled__2024-03-29T02:49:00+00:00, run_start_date=2024-03-29 02:50:00.483694+00:00, run_end_date=2024-03-29 02:50:05.820591+00:00, run_duration=5.336897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:49:00+00:00, data_interval_end=2024-03-29 02:50:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:50:05.844210811Z [2024-03-29T02:50:05.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:51:00+00:00 2024-03-29T02:50:05.957957247Z [2024-03-29T02:50:05.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:49:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:05.974209825Z [2024-03-29T02:50:05.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:49:00+00:00, map_index=-1, run_start_date=2024-03-29 02:50:03.315935+00:00, run_end_date=2024-03-29 02:50:05.172415+00:00, run_duration=1.85648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:00.572545+00:00, queued_by_job_id=2, pid=12889 2024-03-29T02:50:07.116775633Z [2024-03-29T02:50:07.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:50:07.117189967Z [2024-03-29T02:50:07.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:49:00+00:00, run_id=scheduled__2024-03-29T02:49:00+00:00, run_start_date=2024-03-29 02:50:00.486581+00:00, run_end_date=2024-03-29 02:50:07.116843+00:00, run_duration=6.630262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:49:00+00:00, data_interval_end=2024-03-29 02:50:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:50:07.137190997Z [2024-03-29T02:50:07.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:51:00+00:00 2024-03-29T02:50:07.312384722Z [2024-03-29T02:50:07.311+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:50:07.312478032Z 2024-03-29T02:50:07.312482577Z [2024-03-29T02:50:07.311+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:50:07.314583557Z [2024-03-29T02:50:07.312+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:50:07.314606705Z 2024-03-29T02:50:07.334655780Z [2024-03-29T02:50:07.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:50:07.335898063Z [2024-03-29T02:50:07.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:50:07.507328594Z [2024-03-29T02:50:07.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:07.511193041Z [2024-03-29T02:50:07.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:49:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:07.538352817Z [2024-03-29T02:50:07.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:49:00+00:00, map_index=-1, run_start_date=2024-03-29 02:50:03.350300+00:00, run_end_date=2024-03-29 02:50:05.615882+00:00, run_duration=2.265582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:00.572545+00:00, queued_by_job_id=2, pid=12890 2024-03-29T02:50:07.540796123Z [2024-03-29T02:50:07.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07283d4b-2b43-472b-a011-134bb6045198 2024-03-29T02:50:07.679549806Z [2024-03-29T02:50:07.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:07.686536970Z [2024-03-29T02:50:07.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:45:00+00:00, map_index=-1, run_start_date=2024-03-29 02:50:06.653066+00:00, run_end_date=2024-03-29 02:50:07.068721+00:00, run_duration=0.415655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:04.481504+00:00, queued_by_job_id=2, pid=12914 2024-03-29T02:50:11.579932478Z [2024-03-29T02:50:11.579+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:50:11.579960112Z 2024-03-29T02:50:11.580037233Z [2024-03-29T02:50:11.579+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:50:11.580634842Z [2024-03-29T02:50:11.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:50:11.580655571Z 2024-03-29T02:50:11.582936729Z [2024-03-29T02:50:11.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:50:11.583147851Z [2024-03-29T02:50:11.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:50:11.638239795Z [2024-03-29T02:50:11.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status queued for try_number 1 2024-03-29T02:50:11.638428662Z [2024-03-29T02:50:11.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:11.646782402Z [2024-03-29T02:50:11.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d16e936-6d45-4219-972b-2bd7fe25e440 2024-03-29T02:50:11.647238252Z [2024-03-29T02:50:11.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:45:00+00:00, map_index=0, run_start_date=2024-03-29 02:50:09.376214+00:00, run_end_date=2024-03-29 02:50:10.797716+00:00, run_duration=1.421502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:07.316417+00:00, queued_by_job_id=2, pid=12922 2024-03-29T02:50:13.733766060Z [2024-03-29T02:50:13.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:50:13.734185257Z [2024-03-29T02:50:13.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:45:00+00:00, run_id=scheduled__2024-03-29T02:45:00+00:00, run_start_date=2024-03-29 02:50:00.476066+00:00, run_end_date=2024-03-29 02:50:13.733651+00:00, run_duration=13.257585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:45:00+00:00, data_interval_end=2024-03-29 02:50:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:50:13.741455486Z [2024-03-29T02:50:13.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:50:00+00:00, run_after=2024-03-29T02:55:00+00:00 2024-03-29T02:50:13.780628277Z [2024-03-29T02:50:13.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:45:00+00:00 exited with status success for try_number 1 2024-03-29T02:50:13.787023281Z [2024-03-29T02:50:13.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:45:00+00:00, map_index=-1, run_start_date=2024-03-29 02:50:13.271729+00:00, run_end_date=2024-03-29 02:50:13.611771+00:00, run_duration=0.340042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:50:11.580983+00:00, queued_by_job_id=2, pid=12935 2024-03-29T02:51:00.332348385Z [2024-03-29T02:51:00.331+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:51:00.348249508Z [2024-03-29T02:51:00.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:51:00+00:00, run_after=2024-03-29T02:52:00+00:00 2024-03-29T02:51:00.373245278Z [2024-03-29T02:51:00.372+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:51:00+00:00, run_after=2024-03-29T02:52:00+00:00 2024-03-29T02:51:00.470091723Z [2024-03-29T02:51:00.469+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:51:00.470142581Z 2024-03-29T02:51:00.470147708Z 2024-03-29T02:51:00.470151970Z 2024-03-29T02:51:00.470656852Z [2024-03-29T02:51:00.470+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:51:00.470997755Z [2024-03-29T02:51:00.470+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:51:00.471260497Z [2024-03-29T02:51:00.471+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:51:00.472077889Z [2024-03-29T02:51:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:51:00.472093858Z 2024-03-29T02:51:00.472098834Z 2024-03-29T02:51:00.472103638Z 2024-03-29T02:51:00.476120207Z [2024-03-29T02:51:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:51:00.476403212Z [2024-03-29T02:51:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:51:00.476717006Z [2024-03-29T02:51:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:51:00.476914557Z [2024-03-29T02:51:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:51:00.477253665Z [2024-03-29T02:51:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:51:00.477423035Z [2024-03-29T02:51:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:51:00.708276253Z [2024-03-29T02:51:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:51:00.710830110Z [2024-03-29T02:51:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:51:00.710919081Z [2024-03-29T02:51:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:51:00.724629901Z [2024-03-29T02:51:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23ccee44-3e03-4356-b6f5-effed9e6b69d 2024-03-29T02:51:00.724792525Z [2024-03-29T02:51:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22b3b179-9c96-4811-bcb2-97994832512f 2024-03-29T02:51:00.725031394Z [2024-03-29T02:51:00.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb2f4485-8106-41c4-bb28-4a6b922a845e 2024-03-29T02:51:03.100400731Z [2024-03-29T02:51:03.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:51:03.100800135Z [2024-03-29T02:51:03.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:50:00+00:00, run_id=scheduled__2024-03-29T02:50:00+00:00, run_start_date=2024-03-29 02:51:00.391415+00:00, run_end_date=2024-03-29 02:51:03.100388+00:00, run_duration=2.708973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:50:00+00:00, data_interval_end=2024-03-29 02:51:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:51:03.112041605Z [2024-03-29T02:51:03.111+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:51:00+00:00, run_after=2024-03-29T02:52:00+00:00 2024-03-29T02:51:03.174804500Z [2024-03-29T02:51:03.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:51:03.181396881Z [2024-03-29T02:51:03.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=-1, run_start_date=2024-03-29 02:51:01.435004+00:00, run_end_date=2024-03-29 02:51:02.034833+00:00, run_duration=0.599829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:51:00.472911+00:00, queued_by_job_id=2, pid=12957 2024-03-29T02:51:04.402296160Z [2024-03-29T02:51:04.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:51:04.403137271Z [2024-03-29T02:51:04.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:50:00+00:00, run_id=scheduled__2024-03-29T02:50:00+00:00, run_start_date=2024-03-29 02:51:00.393252+00:00, run_end_date=2024-03-29 02:51:04.402588+00:00, run_duration=4.009336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:50:00+00:00, data_interval_end=2024-03-29 02:51:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:51:04.419212874Z [2024-03-29T02:51:04.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:51:00+00:00, run_after=2024-03-29T02:52:00+00:00 2024-03-29T02:51:04.430905416Z [2024-03-29T02:51:04.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:51:04.431337542Z [2024-03-29T02:51:04.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:50:00+00:00, run_id=scheduled__2024-03-29T02:50:00+00:00, run_start_date=2024-03-29 02:51:00.394563+00:00, run_end_date=2024-03-29 02:51:04.430988+00:00, run_duration=4.036425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:50:00+00:00, data_interval_end=2024-03-29 02:51:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:51:04.441368471Z [2024-03-29T02:51:04.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:51:00+00:00, run_after=2024-03-29T02:52:00+00:00 2024-03-29T02:51:04.473043029Z [2024-03-29T02:51:04.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:51:04.478834892Z [2024-03-29T02:51:04.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=-1, run_start_date=2024-03-29 02:51:02.547569+00:00, run_end_date=2024-03-29 02:51:03.982085+00:00, run_duration=1.434516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:51:00.472911+00:00, queued_by_job_id=2, pid=12975 2024-03-29T02:51:05.541203952Z [2024-03-29T02:51:05.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:51:05.548913005Z [2024-03-29T02:51:05.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=-1, run_start_date=2024-03-29 02:51:02.654370+00:00, run_end_date=2024-03-29 02:51:04.359612+00:00, run_duration=1.705242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:51:00.472911+00:00, queued_by_job_id=2, pid=12976 2024-03-29T02:52:00.071098555Z [2024-03-29T02:52:00.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:52:00.083686630Z [2024-03-29T02:52:00.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:52:00+00:00, run_after=2024-03-29T02:53:00+00:00 2024-03-29T02:52:00.090683137Z [2024-03-29T02:52:00.090+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:52:00.101939114Z [2024-03-29T02:52:00.101+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:52:00+00:00, run_after=2024-03-29T02:53:00+00:00 2024-03-29T02:52:00.193328628Z [2024-03-29T02:52:00.192+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:52:00.193371259Z 2024-03-29T02:52:00.193377919Z 2024-03-29T02:52:00.193381473Z 2024-03-29T02:52:00.193384575Z 2024-03-29T02:52:00.193831987Z [2024-03-29T02:52:00.193+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:52:00.194092889Z [2024-03-29T02:52:00.193+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:52:00.194335776Z [2024-03-29T02:52:00.194+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:52:00.194597187Z [2024-03-29T02:52:00.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:52:00.195699561Z [2024-03-29T02:52:00.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:52:00.195717922Z 2024-03-29T02:52:00.195740330Z 2024-03-29T02:52:00.195745607Z 2024-03-29T02:52:00.195750110Z 2024-03-29T02:52:00.201261586Z [2024-03-29T02:52:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:52:00.201459403Z [2024-03-29T02:52:00.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:52:00.201817435Z [2024-03-29T02:52:00.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:52:00.201978172Z [2024-03-29T02:52:00.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:52:00.202358742Z [2024-03-29T02:52:00.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:52:00.202632969Z [2024-03-29T02:52:00.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:52:00.203078514Z [2024-03-29T02:52:00.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:52:00.203341620Z [2024-03-29T02:52:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:52:00.684132379Z [2024-03-29T02:52:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:52:00.684363792Z [2024-03-29T02:52:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:51:00+00:00 exited with status queued for try_number 1 2024-03-29T02:52:00.684669346Z [2024-03-29T02:52:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:51:00+00:00 exited with status queued for try_number 1 2024-03-29T02:52:00.684927295Z [2024-03-29T02:52:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:51:00+00:00 exited with status queued for try_number 1 2024-03-29T02:52:00.712478618Z [2024-03-29T02:52:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to e048a884-87fd-4d10-b4d6-f6988822a014 2024-03-29T02:52:00.719213452Z [2024-03-29T02:52:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae0c6241-39d4-415f-ba78-beb6c5d51949 2024-03-29T02:52:00.719637682Z [2024-03-29T02:52:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25a2c88e-fc6b-47ca-86b6-4edbcc59f7b3 2024-03-29T02:52:00.719983335Z [2024-03-29T02:52:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98951f43-9b01-4554-afb1-bc3b4fcdca0b 2024-03-29T02:52:02.020752053Z [2024-03-29T02:52:02.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:52:02.021526359Z [2024-03-29T02:52:02.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:50:00+00:00, run_id=scheduled__2024-03-29T02:50:00+00:00, run_start_date=2024-03-29 02:52:00.112592+00:00, run_end_date=2024-03-29 02:52:02.020661+00:00, run_duration=1.908069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:50:00+00:00, data_interval_end=2024-03-29 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:52:02.039525378Z [2024-03-29T02:52:02.039+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:52:00+00:00, run_after=2024-03-29T02:54:00+00:00 2024-03-29T02:52:02.052233539Z [2024-03-29T02:52:02.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:52:02.052680109Z [2024-03-29T02:52:02.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:51:00+00:00, run_id=scheduled__2024-03-29T02:51:00+00:00, run_start_date=2024-03-29 02:52:00.114725+00:00, run_end_date=2024-03-29 02:52:02.052146+00:00, run_duration=1.937421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:51:00+00:00, data_interval_end=2024-03-29 02:52:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:52:02.072394531Z [2024-03-29T02:52:02.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:52:00+00:00, run_after=2024-03-29T02:53:00+00:00 2024-03-29T02:52:02.141749559Z [2024-03-29T02:52:02.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:52:02.141851892Z [2024-03-29T02:52:02.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:51:00+00:00 exited with status success for try_number 1 2024-03-29T02:52:02.152981477Z [2024-03-29T02:52:02.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=-1, run_start_date=2024-03-29 02:52:01.119781+00:00, run_end_date=2024-03-29 02:52:01.753542+00:00, run_duration=0.633761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:52:00.197555+00:00, queued_by_job_id=2, pid=13010 2024-03-29T02:52:02.153495069Z [2024-03-29T02:52:02.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:51:00+00:00, map_index=-1, run_start_date=2024-03-29 02:52:01.124660+00:00, run_end_date=2024-03-29 02:52:01.624392+00:00, run_duration=0.499732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:52:00.197555+00:00, queued_by_job_id=2, pid=13009 2024-03-29T02:52:04.085420005Z [2024-03-29T02:52:04.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:52:04.085856765Z [2024-03-29T02:52:04.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:51:00+00:00, run_id=scheduled__2024-03-29T02:51:00+00:00, run_start_date=2024-03-29 02:52:00.115758+00:00, run_end_date=2024-03-29 02:52:04.085508+00:00, run_duration=3.96975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:51:00+00:00, data_interval_end=2024-03-29 02:52:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:52:04.096439823Z [2024-03-29T02:52:04.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:52:00+00:00, run_after=2024-03-29T02:53:00+00:00 2024-03-29T02:52:04.136697858Z [2024-03-29T02:52:04.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:51:00+00:00 exited with status success for try_number 1 2024-03-29T02:52:04.142586081Z [2024-03-29T02:52:04.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:51:00+00:00, map_index=-1, run_start_date=2024-03-29 02:52:02.653590+00:00, run_end_date=2024-03-29 02:52:03.979130+00:00, run_duration=1.32554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:52:00.197555+00:00, queued_by_job_id=2, pid=13034 2024-03-29T02:52:05.228860688Z [2024-03-29T02:52:05.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:52:05.229018093Z [2024-03-29T02:52:05.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:51:00+00:00, run_id=scheduled__2024-03-29T02:51:00+00:00, run_start_date=2024-03-29 02:52:00.116766+00:00, run_end_date=2024-03-29 02:52:05.228775+00:00, run_duration=5.112009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:51:00+00:00, data_interval_end=2024-03-29 02:52:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:52:05.239699922Z [2024-03-29T02:52:05.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:52:00+00:00, run_after=2024-03-29T02:53:00+00:00 2024-03-29T02:52:05.271571594Z [2024-03-29T02:52:05.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:51:00+00:00 exited with status success for try_number 1 2024-03-29T02:52:05.278591609Z [2024-03-29T02:52:05.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:51:00+00:00, map_index=-1, run_start_date=2024-03-29 02:52:02.496132+00:00, run_end_date=2024-03-29 02:52:04.407726+00:00, run_duration=1.911594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:52:00.197555+00:00, queued_by_job_id=2, pid=13033 2024-03-29T02:53:00.927944966Z [2024-03-29T02:53:00.926+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:53:00.950817497Z [2024-03-29T02:53:00.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:53:00+00:00, run_after=2024-03-29T02:54:00+00:00 2024-03-29T02:53:00.966012646Z [2024-03-29T02:53:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:53:00+00:00, run_after=2024-03-29T02:54:00+00:00 2024-03-29T02:53:01.034483517Z [2024-03-29T02:53:01.034+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:53:01.034508596Z 2024-03-29T02:53:01.034513035Z 2024-03-29T02:53:01.034558270Z 2024-03-29T02:53:01.034561829Z [2024-03-29T02:53:01.034+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:53:01.034582713Z [2024-03-29T02:53:01.034+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:53:01.034653292Z [2024-03-29T02:53:01.034+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:53:01.035497715Z [2024-03-29T02:53:01.035+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:53:01.035540182Z 2024-03-29T02:53:01.035545932Z 2024-03-29T02:53:01.035550462Z 2024-03-29T02:53:01.039427180Z [2024-03-29T02:53:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:53:01.039521723Z [2024-03-29T02:53:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:53:01.041206169Z [2024-03-29T02:53:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:53:01.041255224Z [2024-03-29T02:53:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:53:01.041262516Z [2024-03-29T02:53:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:53:01.041267801Z [2024-03-29T02:53:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:53:01.282766015Z [2024-03-29T02:53:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status queued for try_number 1 2024-03-29T02:53:01.285183650Z [2024-03-29T02:53:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status queued for try_number 1 2024-03-29T02:53:01.285411319Z [2024-03-29T02:53:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status queued for try_number 1 2024-03-29T02:53:01.293463066Z [2024-03-29T02:53:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa37f8ae-e184-42f1-acf5-2fb4ee5e54be 2024-03-29T02:53:01.293768748Z [2024-03-29T02:53:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b8a6f38-486a-4540-8487-eed78cec4cf6 2024-03-29T02:53:01.294003668Z [2024-03-29T02:53:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33268b27-986a-41d2-b935-828e9755271d 2024-03-29T02:53:03.619296932Z [2024-03-29T02:53:03.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:53:03.619850770Z [2024-03-29T02:53:03.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:52:00+00:00, run_id=scheduled__2024-03-29T02:52:00+00:00, run_start_date=2024-03-29 02:53:00.981865+00:00, run_end_date=2024-03-29 02:53:03.619488+00:00, run_duration=2.637623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:52:00+00:00, data_interval_end=2024-03-29 02:53:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:53:03.632729824Z [2024-03-29T02:53:03.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:53:00+00:00, run_after=2024-03-29T02:54:00+00:00 2024-03-29T02:53:03.710202431Z [2024-03-29T02:53:03.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status success for try_number 1 2024-03-29T02:53:03.717462670Z [2024-03-29T02:53:03.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:52:00+00:00, map_index=-1, run_start_date=2024-03-29 02:53:01.915304+00:00, run_end_date=2024-03-29 02:53:02.465372+00:00, run_duration=0.550068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:53:01.036178+00:00, queued_by_job_id=2, pid=13067 2024-03-29T02:53:04.758267993Z [2024-03-29T02:53:04.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:53:04.758579279Z [2024-03-29T02:53:04.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:52:00+00:00, run_id=scheduled__2024-03-29T02:52:00+00:00, run_start_date=2024-03-29 02:53:00.983349+00:00, run_end_date=2024-03-29 02:53:04.758140+00:00, run_duration=3.774791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:52:00+00:00, data_interval_end=2024-03-29 02:53:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:53:04.768462665Z [2024-03-29T02:53:04.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:53:00+00:00, run_after=2024-03-29T02:54:00+00:00 2024-03-29T02:53:04.815228192Z [2024-03-29T02:53:04.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status success for try_number 1 2024-03-29T02:53:04.823684369Z [2024-03-29T02:53:04.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:52:00+00:00, map_index=-1, run_start_date=2024-03-29 02:53:03.188999+00:00, run_end_date=2024-03-29 02:53:04.506284+00:00, run_duration=1.317285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:53:01.036178+00:00, queued_by_job_id=2, pid=13086 2024-03-29T02:53:06.027218525Z [2024-03-29T02:53:06.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:53:06.027245444Z [2024-03-29T02:53:06.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:52:00+00:00, run_id=scheduled__2024-03-29T02:52:00+00:00, run_start_date=2024-03-29 02:53:00.984612+00:00, run_end_date=2024-03-29 02:53:06.026130+00:00, run_duration=5.041518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:52:00+00:00, data_interval_end=2024-03-29 02:53:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:53:06.037005596Z [2024-03-29T02:53:06.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:53:00+00:00, run_after=2024-03-29T02:54:00+00:00 2024-03-29T02:53:06.079563380Z [2024-03-29T02:53:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status success for try_number 1 2024-03-29T02:53:06.085767362Z [2024-03-29T02:53:06.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:52:00+00:00, map_index=-1, run_start_date=2024-03-29 02:53:03.118980+00:00, run_end_date=2024-03-29 02:53:05.579337+00:00, run_duration=2.460357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:53:01.036178+00:00, queued_by_job_id=2, pid=13085 2024-03-29T02:53:46.532276408Z [2024-03-29T02:53:46.531+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:54:00.652139639Z [2024-03-29T02:54:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:54:00+00:00, run_after=2024-03-29T02:55:00+00:00 2024-03-29T02:54:00.659860654Z [2024-03-29T02:54:00.659+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:54:00.667136318Z [2024-03-29T02:54:00.666+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:54:00.680241549Z [2024-03-29T02:54:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:54:00+00:00, run_after=2024-03-29T02:55:00+00:00 2024-03-29T02:54:00.763824873Z [2024-03-29T02:54:00.763+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:54:00.763866848Z 2024-03-29T02:54:00.763890833Z 2024-03-29T02:54:00.763894816Z 2024-03-29T02:54:00.763897946Z 2024-03-29T02:54:00.763937189Z [2024-03-29T02:54:00.763+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:54:00.764109148Z [2024-03-29T02:54:00.763+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:54:00.764589778Z [2024-03-29T02:54:00.764+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:54:00.764602383Z [2024-03-29T02:54:00.764+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:54:00.765628484Z [2024-03-29T02:54:00.764+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:54:00.765648746Z 2024-03-29T02:54:00.765656951Z 2024-03-29T02:54:00.765664245Z 2024-03-29T02:54:00.765671497Z 2024-03-29T02:54:00.770576074Z [2024-03-29T02:54:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:54:00.771883903Z [2024-03-29T02:54:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:54:00.771919133Z [2024-03-29T02:54:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:54:00.771924585Z [2024-03-29T02:54:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:54:00.771928717Z [2024-03-29T02:54:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:54:00.771938007Z [2024-03-29T02:54:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:54:00.771954961Z [2024-03-29T02:54:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:54:00.771959243Z [2024-03-29T02:54:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:54:01.239516344Z [2024-03-29T02:54:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status queued for try_number 1 2024-03-29T02:54:01.239565211Z [2024-03-29T02:54:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:53:00+00:00 exited with status queued for try_number 1 2024-03-29T02:54:01.239718780Z [2024-03-29T02:54:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:53:00+00:00 exited with status queued for try_number 1 2024-03-29T02:54:01.239842508Z [2024-03-29T02:54:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:53:00+00:00 exited with status queued for try_number 1 2024-03-29T02:54:01.253076970Z [2024-03-29T02:54:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36e1c4df-c561-45ab-b0f4-48f916015029 2024-03-29T02:54:01.253325573Z [2024-03-29T02:54:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b2d1854-b50d-4dca-9a3e-61e66eaded57 2024-03-29T02:54:01.253504302Z [2024-03-29T02:54:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 931c6d9c-5666-4985-8858-86225590411e 2024-03-29T02:54:01.253756584Z [2024-03-29T02:54:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab3dec6f-c431-43cb-9cd7-ba7af5610af2 2024-03-29T02:54:02.450798308Z [2024-03-29T02:54:02.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:54:02.451227609Z [2024-03-29T02:54:02.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:52:00+00:00, run_id=scheduled__2024-03-29T02:52:00+00:00, run_start_date=2024-03-29 02:54:00.692886+00:00, run_end_date=2024-03-29 02:54:02.450704+00:00, run_duration=1.757818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:52:00+00:00, data_interval_end=2024-03-29 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:54:02.470991624Z [2024-03-29T02:54:02.470+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:54:00+00:00, run_after=2024-03-29T02:56:00+00:00 2024-03-29T02:54:02.622488268Z [2024-03-29T02:54:02.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:52:00+00:00 exited with status success for try_number 1 2024-03-29T02:54:02.630332828Z [2024-03-29T02:54:02.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:52:00+00:00, map_index=-1, run_start_date=2024-03-29 02:54:01.758987+00:00, run_end_date=2024-03-29 02:54:02.221340+00:00, run_duration=0.462353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:54:00.766668+00:00, queued_by_job_id=2, pid=13119 2024-03-29T02:54:03.696123969Z [2024-03-29T02:54:03.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:54:03.696891413Z [2024-03-29T02:54:03.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:53:00+00:00, run_id=scheduled__2024-03-29T02:53:00+00:00, run_start_date=2024-03-29 02:54:00.694326+00:00, run_end_date=2024-03-29 02:54:03.696367+00:00, run_duration=3.002041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:53:00+00:00, data_interval_end=2024-03-29 02:54:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:54:03.717756663Z [2024-03-29T02:54:03.717+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:54:00+00:00, run_after=2024-03-29T02:55:00+00:00 2024-03-29T02:54:03.787346532Z [2024-03-29T02:54:03.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:53:00+00:00 exited with status success for try_number 1 2024-03-29T02:54:03.799963870Z [2024-03-29T02:54:03.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:53:00+00:00, map_index=-1, run_start_date=2024-03-29 02:54:02.046040+00:00, run_end_date=2024-03-29 02:54:02.648127+00:00, run_duration=0.602087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:54:00.766668+00:00, queued_by_job_id=2, pid=13121 2024-03-29T02:54:05.975987826Z [2024-03-29T02:54:05.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:54:05.976446416Z [2024-03-29T02:54:05.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:53:00+00:00, run_id=scheduled__2024-03-29T02:53:00+00:00, run_start_date=2024-03-29 02:54:00.695549+00:00, run_end_date=2024-03-29 02:54:05.975902+00:00, run_duration=5.280353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:53:00+00:00, data_interval_end=2024-03-29 02:54:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:54:05.986285215Z [2024-03-29T02:54:05.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:54:00+00:00, run_after=2024-03-29T02:55:00+00:00 2024-03-29T02:54:05.994181191Z [2024-03-29T02:54:05.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:54:05.995196239Z [2024-03-29T02:54:05.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:53:00+00:00, run_id=scheduled__2024-03-29T02:53:00+00:00, run_start_date=2024-03-29 02:54:00.696751+00:00, run_end_date=2024-03-29 02:54:05.994093+00:00, run_duration=5.297342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:53:00+00:00, data_interval_end=2024-03-29 02:54:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:54:06.015448347Z [2024-03-29T02:54:06.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:54:00+00:00, run_after=2024-03-29T02:55:00+00:00 2024-03-29T02:54:06.060572404Z [2024-03-29T02:54:06.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:53:00+00:00 exited with status success for try_number 1 2024-03-29T02:54:06.060594525Z [2024-03-29T02:54:06.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:53:00+00:00 exited with status success for try_number 1 2024-03-29T02:54:06.074580829Z [2024-03-29T02:54:06.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:53:00+00:00, map_index=-1, run_start_date=2024-03-29 02:54:02.970866+00:00, run_end_date=2024-03-29 02:54:05.163572+00:00, run_duration=2.192706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:54:00.766668+00:00, queued_by_job_id=2, pid=13143 2024-03-29T02:54:06.074602064Z [2024-03-29T02:54:06.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:53:00+00:00, map_index=-1, run_start_date=2024-03-29 02:54:03.200309+00:00, run_end_date=2024-03-29 02:54:05.194275+00:00, run_duration=1.993966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:54:00.766668+00:00, queued_by_job_id=2, pid=13144 2024-03-29T02:55:00.262010690Z [2024-03-29T02:55:00.261+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:55:00+00:00, run_after=2024-03-29T02:56:00+00:00 2024-03-29T02:55:00.290403521Z [2024-03-29T02:55:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:55:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:55:00.308125544Z [2024-03-29T02:55:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:55:00+00:00, run_after=2024-03-29T02:56:00+00:00 2024-03-29T02:55:00.315415517Z [2024-03-29T02:55:00.315+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:55:00.409143233Z [2024-03-29T02:55:00.408+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:55:00.409200231Z 2024-03-29T02:55:00.409204760Z 2024-03-29T02:55:00.409207874Z 2024-03-29T02:55:00.409211026Z 2024-03-29T02:55:00.409227522Z [2024-03-29T02:55:00.409+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:55:00.409354989Z [2024-03-29T02:55:00.409+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:55:00.409545451Z [2024-03-29T02:55:00.409+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:55:00.409717254Z [2024-03-29T02:55:00.409+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:55:00.410320873Z [2024-03-29T02:55:00.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:55:00.410332808Z 2024-03-29T02:55:00.410336767Z 2024-03-29T02:55:00.410340001Z 2024-03-29T02:55:00.410343147Z 2024-03-29T02:55:00.414366400Z [2024-03-29T02:55:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T02:55:00.414644949Z [2024-03-29T02:55:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:55:00.414970395Z [2024-03-29T02:55:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:55:00.415115307Z [2024-03-29T02:55:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:55:00.415387944Z [2024-03-29T02:55:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:55:00.415630332Z [2024-03-29T02:55:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:55:00.415895551Z [2024-03-29T02:55:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:55:00.416052216Z [2024-03-29T02:55:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:55:00.960870904Z [2024-03-29T02:55:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:55:00.961097670Z [2024-03-29T02:55:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status queued for try_number 1 2024-03-29T02:55:00.961346104Z [2024-03-29T02:55:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status queued for try_number 1 2024-03-29T02:55:00.961466653Z [2024-03-29T02:55:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status queued for try_number 1 2024-03-29T02:55:00.987808939Z [2024-03-29T02:55:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb0d73f3-f08b-4ae4-97a5-710e754923de 2024-03-29T02:55:00.988066623Z [2024-03-29T02:55:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59631b79-6c9c-4100-9624-713147a4afe1 2024-03-29T02:55:00.989888995Z [2024-03-29T02:55:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e33303f-feb6-4aa8-a72a-5faeedadfbaa 2024-03-29T02:55:00.990298007Z [2024-03-29T02:55:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 524bf807-bb55-49e4-9eeb-42063fbc4bb6 2024-03-29T02:55:03.516341529Z [2024-03-29T02:55:03.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:55:03.517452520Z [2024-03-29T02:55:03.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:54:00+00:00, run_id=scheduled__2024-03-29T02:54:00+00:00, run_start_date=2024-03-29 02:55:00.326381+00:00, run_end_date=2024-03-29 02:55:03.516267+00:00, run_duration=3.189886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:54:00+00:00, data_interval_end=2024-03-29 02:55:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:55:03.542145997Z [2024-03-29T02:55:03.541+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:55:00+00:00, run_after=2024-03-29T02:56:00+00:00 2024-03-29T02:55:03.669192699Z [2024-03-29T02:55:03.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status success for try_number 1 2024-03-29T02:55:03.689951512Z [2024-03-29T02:55:03.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:54:00+00:00, map_index=-1, run_start_date=2024-03-29 02:55:01.347828+00:00, run_end_date=2024-03-29 02:55:02.238096+00:00, run_duration=0.890268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:55:00.411516+00:00, queued_by_job_id=2, pid=13177 2024-03-29T02:55:04.809461355Z [2024-03-29T02:55:04.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:55:04.810066231Z [2024-03-29T02:55:04.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:54:00+00:00, run_id=scheduled__2024-03-29T02:54:00+00:00, run_start_date=2024-03-29 02:55:00.327330+00:00, run_end_date=2024-03-29 02:55:04.809608+00:00, run_duration=4.482278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:54:00+00:00, data_interval_end=2024-03-29 02:55:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:55:04.824369789Z [2024-03-29T02:55:04.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:55:00+00:00, run_after=2024-03-29T02:56:00+00:00 2024-03-29T02:55:04.871923611Z [2024-03-29T02:55:04.871+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:55:04.871955033Z 2024-03-29T02:55:04.872122814Z [2024-03-29T02:55:04.871+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:55:04.872961825Z [2024-03-29T02:55:04.872+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:55:04.872979783Z 2024-03-29T02:55:04.876674259Z [2024-03-29T02:55:04.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T02:55:04.876991443Z [2024-03-29T02:55:04.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:55:04.970600578Z [2024-03-29T02:55:04.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:55:04.970633209Z [2024-03-29T02:55:04.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:55:05.010685026Z [2024-03-29T02:55:05.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to b98a826f-56e5-4cf5-832c-bb5064885691 2024-03-29T02:55:05.010750383Z [2024-03-29T02:55:05.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=-1, run_start_date=2024-03-29 02:55:02.975294+00:00, run_end_date=2024-03-29 02:55:03.543034+00:00, run_duration=0.56774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:55:00.411516+00:00, queued_by_job_id=2, pid=13196 2024-03-29T02:55:05.105013221Z [2024-03-29T02:55:05.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:55:05.105477311Z [2024-03-29T02:55:05.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:54:00+00:00, run_id=scheduled__2024-03-29T02:54:00+00:00, run_start_date=2024-03-29 02:55:00.328234+00:00, run_end_date=2024-03-29 02:55:05.104913+00:00, run_duration=4.776679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:54:00+00:00, data_interval_end=2024-03-29 02:55:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:55:05.123142397Z [2024-03-29T02:55:05.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:55:00+00:00, run_after=2024-03-29T02:56:00+00:00 2024-03-29T02:55:05.294028974Z [2024-03-29T02:55:05.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status success for try_number 1 2024-03-29T02:55:05.294131962Z [2024-03-29T02:55:05.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status success for try_number 1 2024-03-29T02:55:05.335492307Z [2024-03-29T02:55:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:54:00+00:00, map_index=-1, run_start_date=2024-03-29 02:55:03.516196+00:00, run_end_date=2024-03-29 02:55:04.755372+00:00, run_duration=1.239176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:55:00.411516+00:00, queued_by_job_id=2, pid=13213 2024-03-29T02:55:05.335622024Z [2024-03-29T02:55:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:54:00+00:00, map_index=-1, run_start_date=2024-03-29 02:55:03.139661+00:00, run_end_date=2024-03-29 02:55:04.908507+00:00, run_duration=1.768846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:55:00.411516+00:00, queued_by_job_id=2, pid=13197 2024-03-29T02:55:08.731819849Z [2024-03-29T02:55:08.731+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:55:08.731847945Z 2024-03-29T02:55:08.732747183Z [2024-03-29T02:55:08.731+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:55:08.733513543Z [2024-03-29T02:55:08.733+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:55:08.733545357Z 2024-03-29T02:55:08.736334807Z [2024-03-29T02:55:08.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T02:55:08.736512202Z [2024-03-29T02:55:08.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T02:55:08.798094563Z [2024-03-29T02:55:08.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:55:08.798335764Z [2024-03-29T02:55:08.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:55:08.810938416Z [2024-03-29T02:55:08.810+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8bd1c0d-6ef6-41e9-b71a-63477bfe698e 2024-03-29T02:55:08.811172791Z [2024-03-29T02:55:08.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=-1, run_start_date=2024-03-29 02:55:07.163081+00:00, run_end_date=2024-03-29 02:55:07.752094+00:00, run_duration=0.589013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:55:04.873577+00:00, queued_by_job_id=2, pid=13226 2024-03-29T02:55:12.581248860Z [2024-03-29T02:55:12.580+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T02:55:12.581289879Z 2024-03-29T02:55:12.581438216Z [2024-03-29T02:55:12.581+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:55:12.582255966Z [2024-03-29T02:55:12.582+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:55:12.582276973Z 2024-03-29T02:55:12.585126913Z [2024-03-29T02:55:12.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:55:12.585505735Z [2024-03-29T02:55:12.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T02:55:12.644643864Z [2024-03-29T02:55:12.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status queued for try_number 1 2024-03-29T02:55:12.644915395Z [2024-03-29T02:55:12.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:55:12.656007028Z [2024-03-29T02:55:12.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd60091c-b1a3-4d54-a301-310e9a78eb26 2024-03-29T02:55:12.656605791Z [2024-03-29T02:55:12.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=0, run_start_date=2024-03-29 02:55:10.469845+00:00, run_end_date=2024-03-29 02:55:11.745522+00:00, run_duration=1.275677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:55:08.734037+00:00, queued_by_job_id=2, pid=13234 2024-03-29T02:55:14.898252772Z [2024-03-29T02:55:14.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:55:14.899173415Z [2024-03-29T02:55:14.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:50:00+00:00, run_id=scheduled__2024-03-29T02:50:00+00:00, run_start_date=2024-03-29 02:55:00.325290+00:00, run_end_date=2024-03-29 02:55:14.898436+00:00, run_duration=14.573146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:50:00+00:00, data_interval_end=2024-03-29 02:55:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T02:55:14.911353877Z [2024-03-29T02:55:14.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:55:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:55:14.945740021Z [2024-03-29T02:55:14.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:50:00+00:00 exited with status success for try_number 1 2024-03-29T02:55:14.953366891Z [2024-03-29T02:55:14.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:50:00+00:00, map_index=-1, run_start_date=2024-03-29 02:55:14.326914+00:00, run_end_date=2024-03-29 02:55:14.726829+00:00, run_duration=0.399915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:55:12.582793+00:00, queued_by_job_id=2, pid=13247 2024-03-29T02:56:00.728363613Z [2024-03-29T02:56:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:56:00+00:00, run_after=2024-03-29T02:57:00+00:00 2024-03-29T02:56:00.740721599Z [2024-03-29T02:56:00.740+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:56:00.758172255Z [2024-03-29T02:56:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:56:00+00:00, run_after=2024-03-29T02:57:00+00:00 2024-03-29T02:56:00.770231284Z [2024-03-29T02:56:00.769+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:56:00.878013230Z [2024-03-29T02:56:00.877+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:56:00.878063563Z 2024-03-29T02:56:00.878072508Z 2024-03-29T02:56:00.878079241Z 2024-03-29T02:56:00.878085121Z 2024-03-29T02:56:00.878539147Z [2024-03-29T02:56:00.878+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:56:00.879029766Z [2024-03-29T02:56:00.878+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:56:00.879486167Z [2024-03-29T02:56:00.879+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:56:00.879897566Z [2024-03-29T02:56:00.879+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:56:00.881766975Z [2024-03-29T02:56:00.881+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:56:00.881784810Z 2024-03-29T02:56:00.881791698Z 2024-03-29T02:56:00.881798097Z 2024-03-29T02:56:00.881803939Z 2024-03-29T02:56:00.889215726Z [2024-03-29T02:56:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:56:00.889565728Z [2024-03-29T02:56:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:56:00.889975461Z [2024-03-29T02:56:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:56:00.890193258Z [2024-03-29T02:56:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:56:00.890668836Z [2024-03-29T02:56:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:56:00.890833921Z [2024-03-29T02:56:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:56:00.891188762Z [2024-03-29T02:56:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:56:00.891355706Z [2024-03-29T02:56:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:56:01.235090993Z [2024-03-29T02:56:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status queued for try_number 1 2024-03-29T02:56:01.237878648Z [2024-03-29T02:56:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status queued for try_number 1 2024-03-29T02:56:01.238179584Z [2024-03-29T02:56:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status queued for try_number 1 2024-03-29T02:56:01.238383631Z [2024-03-29T02:56:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status queued for try_number 1 2024-03-29T02:56:01.256566927Z [2024-03-29T02:56:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e8e9265-55a0-40b7-b584-e5f162dd831d 2024-03-29T02:56:01.256925907Z [2024-03-29T02:56:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90ab219b-dd75-48d5-9107-85171bdd650e 2024-03-29T02:56:01.257154579Z [2024-03-29T02:56:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4aeab4f3-e09a-487b-9189-5b4dc0537260 2024-03-29T02:56:01.257383003Z [2024-03-29T02:56:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to db84cea2-1f11-4d79-bcfc-773683b85367 2024-03-29T02:56:02.523398144Z [2024-03-29T02:56:02.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:56:02.523911794Z [2024-03-29T02:56:02.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:54:00+00:00, run_id=scheduled__2024-03-29T02:54:00+00:00, run_start_date=2024-03-29 02:56:00.782769+00:00, run_end_date=2024-03-29 02:56:02.523285+00:00, run_duration=1.740516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:54:00+00:00, data_interval_end=2024-03-29 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:56:02.533100312Z [2024-03-29T02:56:02.532+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:56:00+00:00, run_after=2024-03-29T02:58:00+00:00 2024-03-29T02:56:02.546054843Z [2024-03-29T02:56:02.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:56:02.546593513Z [2024-03-29T02:56:02.545+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:55:00+00:00, run_id=scheduled__2024-03-29T02:55:00+00:00, run_start_date=2024-03-29 02:56:00.785784+00:00, run_end_date=2024-03-29 02:56:02.545893+00:00, run_duration=1.760109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:55:00+00:00, data_interval_end=2024-03-29 02:56:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:56:02.575229650Z [2024-03-29T02:56:02.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:56:00+00:00, run_after=2024-03-29T02:57:00+00:00 2024-03-29T02:56:02.686746788Z [2024-03-29T02:56:02.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:54:00+00:00 exited with status success for try_number 1 2024-03-29T02:56:02.709926072Z [2024-03-29T02:56:02.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:54:00+00:00, map_index=-1, run_start_date=2024-03-29 02:56:01.811466+00:00, run_end_date=2024-03-29 02:56:02.344789+00:00, run_duration=0.533323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:56:00.884908+00:00, queued_by_job_id=2, pid=13271 2024-03-29T02:56:03.468853808Z [2024-03-29T02:56:03.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status success for try_number 1 2024-03-29T02:56:03.475399012Z [2024-03-29T02:56:03.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:55:00+00:00, map_index=-1, run_start_date=2024-03-29 02:56:01.943441+00:00, run_end_date=2024-03-29 02:56:02.487242+00:00, run_duration=0.543801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:56:00.884908+00:00, queued_by_job_id=2, pid=13272 2024-03-29T02:56:05.654002990Z [2024-03-29T02:56:05.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:56:05.654281761Z [2024-03-29T02:56:05.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:55:00+00:00, run_id=scheduled__2024-03-29T02:55:00+00:00, run_start_date=2024-03-29 02:56:00.787431+00:00, run_end_date=2024-03-29 02:56:05.653993+00:00, run_duration=4.866562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:55:00+00:00, data_interval_end=2024-03-29 02:56:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:56:05.662704128Z [2024-03-29T02:56:05.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:56:00+00:00, run_after=2024-03-29T02:57:00+00:00 2024-03-29T02:56:05.749681626Z [2024-03-29T02:56:05.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status success for try_number 1 2024-03-29T02:56:05.766607243Z [2024-03-29T02:56:05.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:55:00+00:00, map_index=-1, run_start_date=2024-03-29 02:56:03.481146+00:00, run_end_date=2024-03-29 02:56:05.366165+00:00, run_duration=1.885019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:56:00.884908+00:00, queued_by_job_id=2, pid=13295 2024-03-29T02:56:06.821579768Z [2024-03-29T02:56:06.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:56:06.821891265Z [2024-03-29T02:56:06.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:55:00+00:00, run_id=scheduled__2024-03-29T02:55:00+00:00, run_start_date=2024-03-29 02:56:00.788839+00:00, run_end_date=2024-03-29 02:56:06.821493+00:00, run_duration=6.032654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:55:00+00:00, data_interval_end=2024-03-29 02:56:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:56:06.832021705Z [2024-03-29T02:56:06.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:56:00+00:00, run_after=2024-03-29T02:57:00+00:00 2024-03-29T02:56:06.863727057Z [2024-03-29T02:56:06.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status success for try_number 1 2024-03-29T02:56:06.870831970Z [2024-03-29T02:56:06.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:55:00+00:00, map_index=-1, run_start_date=2024-03-29 02:56:03.663488+00:00, run_end_date=2024-03-29 02:56:06.333104+00:00, run_duration=2.669616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:56:00.884908+00:00, queued_by_job_id=2, pid=13296 2024-03-29T02:57:01.029131875Z [2024-03-29T02:57:01.028+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:57:01.041868664Z [2024-03-29T02:57:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:57:00+00:00, run_after=2024-03-29T02:58:00+00:00 2024-03-29T02:57:01.055344170Z [2024-03-29T02:57:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:57:00+00:00, run_after=2024-03-29T02:58:00+00:00 2024-03-29T02:57:01.133750609Z [2024-03-29T02:57:01.133+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:57:01.133778730Z 2024-03-29T02:57:01.133783672Z 2024-03-29T02:57:01.133789823Z 2024-03-29T02:57:01.134060285Z [2024-03-29T02:57:01.133+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:57:01.134315427Z [2024-03-29T02:57:01.134+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:57:01.134583789Z [2024-03-29T02:57:01.134+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:57:01.135566539Z [2024-03-29T02:57:01.135+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:57:01.135581816Z 2024-03-29T02:57:01.135586577Z 2024-03-29T02:57:01.135590862Z 2024-03-29T02:57:01.140737822Z [2024-03-29T02:57:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:57:01.141111705Z [2024-03-29T02:57:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:57:01.141532840Z [2024-03-29T02:57:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:57:01.141900954Z [2024-03-29T02:57:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:57:01.142323346Z [2024-03-29T02:57:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:57:01.142593491Z [2024-03-29T02:57:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:57:01.461960582Z [2024-03-29T02:57:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status queued for try_number 1 2024-03-29T02:57:01.462163269Z [2024-03-29T02:57:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status queued for try_number 1 2024-03-29T02:57:01.462324284Z [2024-03-29T02:57:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status queued for try_number 1 2024-03-29T02:57:01.475806519Z [2024-03-29T02:57:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to d703a5cc-cd61-4d71-91ed-b1eb2b4ed3eb 2024-03-29T02:57:01.478855709Z [2024-03-29T02:57:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fc989b1-d384-43bf-8a6a-40f9f9b0a0a4 2024-03-29T02:57:01.479013787Z [2024-03-29T02:57:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28315036-d7dc-4321-925c-ffe42d6fa8a5 2024-03-29T02:57:02.638775282Z [2024-03-29T02:57:02.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:57:02.639802058Z [2024-03-29T02:57:02.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:56:00+00:00, run_id=scheduled__2024-03-29T02:56:00+00:00, run_start_date=2024-03-29 02:57:01.068633+00:00, run_end_date=2024-03-29 02:57:02.638910+00:00, run_duration=1.570277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:56:00+00:00, data_interval_end=2024-03-29 02:57:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:57:02.656587962Z [2024-03-29T02:57:02.656+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:57:00+00:00, run_after=2024-03-29T02:58:00+00:00 2024-03-29T02:57:02.732830283Z [2024-03-29T02:57:02.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status success for try_number 1 2024-03-29T02:57:02.745213095Z [2024-03-29T02:57:02.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:56:00+00:00, map_index=-1, run_start_date=2024-03-29 02:57:01.926045+00:00, run_end_date=2024-03-29 02:57:02.300387+00:00, run_duration=0.374342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:57:01.136862+00:00, queued_by_job_id=2, pid=13327 2024-03-29T02:57:05.453597448Z [2024-03-29T02:57:05.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:57:05.453929449Z [2024-03-29T02:57:05.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:56:00+00:00, run_id=scheduled__2024-03-29T02:56:00+00:00, run_start_date=2024-03-29 02:57:01.070251+00:00, run_end_date=2024-03-29 02:57:05.453461+00:00, run_duration=4.38321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:56:00+00:00, data_interval_end=2024-03-29 02:57:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:57:05.465005261Z [2024-03-29T02:57:05.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:57:00+00:00, run_after=2024-03-29T02:58:00+00:00 2024-03-29T02:57:05.507422526Z [2024-03-29T02:57:05.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status success for try_number 1 2024-03-29T02:57:05.513219464Z [2024-03-29T02:57:05.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:56:00+00:00, map_index=-1, run_start_date=2024-03-29 02:57:03.279174+00:00, run_end_date=2024-03-29 02:57:05.058041+00:00, run_duration=1.778867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:57:01.136862+00:00, queued_by_job_id=2, pid=13345 2024-03-29T02:57:06.560007625Z [2024-03-29T02:57:06.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:57:06.561470397Z [2024-03-29T02:57:06.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:56:00+00:00, run_id=scheduled__2024-03-29T02:56:00+00:00, run_start_date=2024-03-29 02:57:01.071612+00:00, run_end_date=2024-03-29 02:57:06.559913+00:00, run_duration=5.488301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:56:00+00:00, data_interval_end=2024-03-29 02:57:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:57:06.573741090Z [2024-03-29T02:57:06.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:57:00+00:00, run_after=2024-03-29T02:58:00+00:00 2024-03-29T02:57:06.656818211Z [2024-03-29T02:57:06.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status success for try_number 1 2024-03-29T02:57:06.665184450Z [2024-03-29T02:57:06.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:56:00+00:00, map_index=-1, run_start_date=2024-03-29 02:57:03.397456+00:00, run_end_date=2024-03-29 02:57:05.775120+00:00, run_duration=2.377664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:57:01.136862+00:00, queued_by_job_id=2, pid=13346 2024-03-29T02:58:00.205047915Z [2024-03-29T02:58:00.204+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:58:00.220118909Z [2024-03-29T02:58:00.219+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:58:00+00:00, run_after=2024-03-29T02:59:00+00:00 2024-03-29T02:58:00.229374066Z [2024-03-29T02:58:00.229+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:58:00.241878135Z [2024-03-29T02:58:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:58:00+00:00, run_after=2024-03-29T02:59:00+00:00 2024-03-29T02:58:00.339093726Z [2024-03-29T02:58:00.338+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T02:58:00.339125537Z 2024-03-29T02:58:00.339133582Z 2024-03-29T02:58:00.339140102Z 2024-03-29T02:58:00.339146021Z 2024-03-29T02:58:00.339561478Z [2024-03-29T02:58:00.339+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T02:58:00.340235180Z [2024-03-29T02:58:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:58:00.340828606Z [2024-03-29T02:58:00.340+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:58:00.341373348Z [2024-03-29T02:58:00.341+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:58:00.342898486Z [2024-03-29T02:58:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:58:00.342931176Z 2024-03-29T02:58:00.342941099Z 2024-03-29T02:58:00.342949913Z 2024-03-29T02:58:00.342986881Z 2024-03-29T02:58:00.351460737Z [2024-03-29T02:58:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:58:00.352135278Z [2024-03-29T02:58:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T02:58:00.353216733Z [2024-03-29T02:58:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:58:00.353717933Z [2024-03-29T02:58:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:58:00.354738627Z [2024-03-29T02:58:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:58:00.355157934Z [2024-03-29T02:58:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:58:00.356063511Z [2024-03-29T02:58:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:58:00.356453188Z [2024-03-29T02:58:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:58:00.954720090Z [2024-03-29T02:58:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status queued for try_number 1 2024-03-29T02:58:00.954838983Z [2024-03-29T02:58:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:57:00+00:00 exited with status queued for try_number 1 2024-03-29T02:58:00.954955485Z [2024-03-29T02:58:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:57:00+00:00 exited with status queued for try_number 1 2024-03-29T02:58:00.955024303Z [2024-03-29T02:58:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:57:00+00:00 exited with status queued for try_number 1 2024-03-29T02:58:00.968108409Z [2024-03-29T02:58:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e87355f-512e-44c4-886b-8c4dd0d12778 2024-03-29T02:58:00.968356310Z [2024-03-29T02:58:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96dc76e1-b1e8-44d2-8818-ba6d096f5ec0 2024-03-29T02:58:00.968550609Z [2024-03-29T02:58:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d46850c-38e2-44df-924d-cba236f9b211 2024-03-29T02:58:00.968823567Z [2024-03-29T02:58:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cefc41d-d724-4024-bfcc-7104e0bb73d3 2024-03-29T02:58:02.269955565Z [2024-03-29T02:58:02.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:58:02.270823185Z [2024-03-29T02:58:02.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:57:00+00:00, run_id=scheduled__2024-03-29T02:57:00+00:00, run_start_date=2024-03-29 02:58:00.256751+00:00, run_end_date=2024-03-29 02:58:02.270102+00:00, run_duration=2.013351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:57:00+00:00, data_interval_end=2024-03-29 02:58:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:58:02.292861934Z [2024-03-29T02:58:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:58:00+00:00, run_after=2024-03-29T02:59:00+00:00 2024-03-29T02:58:02.304663085Z [2024-03-29T02:58:02.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:58:02.305508220Z [2024-03-29T02:58:02.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:56:00+00:00, run_id=scheduled__2024-03-29T02:56:00+00:00, run_start_date=2024-03-29 02:58:00.255226+00:00, run_end_date=2024-03-29 02:58:02.304942+00:00, run_duration=2.049716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:56:00+00:00, data_interval_end=2024-03-29 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T02:58:02.322042003Z [2024-03-29T02:58:02.321+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T02:58:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:58:02.428729926Z [2024-03-29T02:58:02.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:56:00+00:00 exited with status success for try_number 1 2024-03-29T02:58:02.429093316Z [2024-03-29T02:58:02.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:57:00+00:00 exited with status success for try_number 1 2024-03-29T02:58:02.445037240Z [2024-03-29T02:58:02.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:56:00+00:00, map_index=-1, run_start_date=2024-03-29 02:58:01.317999+00:00, run_end_date=2024-03-29 02:58:01.718995+00:00, run_duration=0.400996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:58:00.344766+00:00, queued_by_job_id=2, pid=13380 2024-03-29T02:58:02.446372062Z [2024-03-29T02:58:02.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:57:00+00:00, map_index=-1, run_start_date=2024-03-29 02:58:01.257137+00:00, run_end_date=2024-03-29 02:58:01.672897+00:00, run_duration=0.41576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:58:00.344766+00:00, queued_by_job_id=2, pid=13379 2024-03-29T02:58:04.611319811Z [2024-03-29T02:58:04.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:58:04.611603258Z [2024-03-29T02:58:04.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:57:00+00:00, run_id=scheduled__2024-03-29T02:57:00+00:00, run_start_date=2024-03-29 02:58:00.260335+00:00, run_end_date=2024-03-29 02:58:04.611188+00:00, run_duration=4.350853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:57:00+00:00, data_interval_end=2024-03-29 02:58:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:58:04.621172561Z [2024-03-29T02:58:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:58:00+00:00, run_after=2024-03-29T02:59:00+00:00 2024-03-29T02:58:04.629169420Z [2024-03-29T02:58:04.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:58:04.629549168Z [2024-03-29T02:58:04.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:57:00+00:00, run_id=scheduled__2024-03-29T02:57:00+00:00, run_start_date=2024-03-29 02:58:00.258832+00:00, run_end_date=2024-03-29 02:58:04.629245+00:00, run_duration=4.370413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:57:00+00:00, data_interval_end=2024-03-29 02:58:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:58:04.639936623Z [2024-03-29T02:58:04.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:58:00+00:00, run_after=2024-03-29T02:59:00+00:00 2024-03-29T02:58:04.677199310Z [2024-03-29T02:58:04.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:57:00+00:00 exited with status success for try_number 1 2024-03-29T02:58:04.677545054Z [2024-03-29T02:58:04.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:57:00+00:00 exited with status success for try_number 1 2024-03-29T02:58:04.698421889Z [2024-03-29T02:58:04.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:57:00+00:00, map_index=-1, run_start_date=2024-03-29 02:58:02.623077+00:00, run_end_date=2024-03-29 02:58:03.961841+00:00, run_duration=1.338764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:58:00.344766+00:00, queued_by_job_id=2, pid=13404 2024-03-29T02:58:04.698452816Z [2024-03-29T02:58:04.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:57:00+00:00, map_index=-1, run_start_date=2024-03-29 02:58:02.451886+00:00, run_end_date=2024-03-29 02:58:04.073315+00:00, run_duration=1.621429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:58:00.344766+00:00, queued_by_job_id=2, pid=13403 2024-03-29T02:58:46.638815820Z [2024-03-29T02:58:46.637+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T02:59:00.752477457Z [2024-03-29T02:59:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:59:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:59:00.770991464Z [2024-03-29T02:59:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:59:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:59:00.780365274Z [2024-03-29T02:59:00.780+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T02:59:00.854038724Z [2024-03-29T02:59:00.853+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T02:59:00.854083187Z 2024-03-29T02:59:00.854093222Z 2024-03-29T02:59:00.854101755Z 2024-03-29T02:59:00.854137933Z [2024-03-29T02:59:00.853+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:59:00.854327889Z [2024-03-29T02:59:00.854+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T02:59:00.854599912Z [2024-03-29T02:59:00.854+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T02:59:00.855486943Z [2024-03-29T02:59:00.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T02:59:00.855498179Z 2024-03-29T02:59:00.855501908Z 2024-03-29T02:59:00.855505707Z 2024-03-29T02:59:00.860158568Z [2024-03-29T02:59:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:59:00.860362673Z [2024-03-29T02:59:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T02:59:00.860785949Z [2024-03-29T02:59:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:59:00.860988175Z [2024-03-29T02:59:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T02:59:00.861330981Z [2024-03-29T02:59:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T02:59:00.861523560Z [2024-03-29T02:59:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T02:59:01.139844928Z [2024-03-29T02:59:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status queued for try_number 1 2024-03-29T02:59:01.140232059Z [2024-03-29T02:59:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status queued for try_number 1 2024-03-29T02:59:01.140582208Z [2024-03-29T02:59:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status queued for try_number 1 2024-03-29T02:59:01.150207364Z [2024-03-29T02:59:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7201f75b-5cbc-42d2-943d-e62a790611c7 2024-03-29T02:59:01.150369521Z [2024-03-29T02:59:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ada4b45-7bc1-41f7-bb5c-bf8113c6bf34 2024-03-29T02:59:01.150591366Z [2024-03-29T02:59:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dcb4948-80b2-4c74-9a63-b071faa6d431 2024-03-29T02:59:02.993780589Z [2024-03-29T02:59:02.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:59:02.994410628Z [2024-03-29T02:59:02.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:58:00+00:00, run_id=scheduled__2024-03-29T02:58:00+00:00, run_start_date=2024-03-29 02:59:00.793186+00:00, run_end_date=2024-03-29 02:59:02.993622+00:00, run_duration=2.200436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:58:00+00:00, data_interval_end=2024-03-29 02:59:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T02:59:03.007714705Z [2024-03-29T02:59:03.007+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T02:59:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:59:03.066727774Z [2024-03-29T02:59:03.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status success for try_number 1 2024-03-29T02:59:03.078866593Z [2024-03-29T02:59:03.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:58:00+00:00, map_index=-1, run_start_date=2024-03-29 02:59:01.716258+00:00, run_end_date=2024-03-29 02:59:02.175533+00:00, run_duration=0.459275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:59:00.856640+00:00, queued_by_job_id=2, pid=13435 2024-03-29T02:59:05.234267008Z [2024-03-29T02:59:05.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:59:05.235103059Z [2024-03-29T02:59:05.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:58:00+00:00, run_id=scheduled__2024-03-29T02:58:00+00:00, run_start_date=2024-03-29 02:59:00.794694+00:00, run_end_date=2024-03-29 02:59:05.234372+00:00, run_duration=4.439678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:58:00+00:00, data_interval_end=2024-03-29 02:59:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T02:59:05.262029913Z [2024-03-29T02:59:05.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:59:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:59:05.274114841Z [2024-03-29T02:59:05.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T02:59:05.274913373Z [2024-03-29T02:59:05.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:58:00+00:00, run_id=scheduled__2024-03-29T02:58:00+00:00, run_start_date=2024-03-29 02:59:00.795945+00:00, run_end_date=2024-03-29 02:59:05.274264+00:00, run_duration=4.478319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:58:00+00:00, data_interval_end=2024-03-29 02:59:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T02:59:05.297910514Z [2024-03-29T02:59:05.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T02:59:00+00:00, run_after=2024-03-29T03:00:00+00:00 2024-03-29T02:59:05.338229793Z [2024-03-29T02:59:05.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status success for try_number 1 2024-03-29T02:59:05.338508005Z [2024-03-29T02:59:05.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status success for try_number 1 2024-03-29T02:59:05.347650975Z [2024-03-29T02:59:05.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:58:00+00:00, map_index=-1, run_start_date=2024-03-29 02:59:02.746640+00:00, run_end_date=2024-03-29 02:59:04.018686+00:00, run_duration=1.272046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:59:00.856640+00:00, queued_by_job_id=2, pid=13453 2024-03-29T02:59:05.348274988Z [2024-03-29T02:59:05.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:58:00+00:00, map_index=-1, run_start_date=2024-03-29 02:59:02.904461+00:00, run_end_date=2024-03-29 02:59:04.732299+00:00, run_duration=1.827838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 02:59:00.856640+00:00, queued_by_job_id=2, pid=13454 2024-03-29T03:00:01.022643752Z [2024-03-29T03:00:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:01:00+00:00 2024-03-29T03:00:01.031735302Z [2024-03-29T03:00:01.031+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:00:01.041027785Z [2024-03-29T03:00:01.040+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:00:01.056415947Z [2024-03-29T03:00:01.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:01:00+00:00 2024-03-29T03:00:01.071804629Z [2024-03-29T03:00:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:05:00+00:00 2024-03-29T03:00:01.176315051Z [2024-03-29T03:00:01.175+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T03:00:01.176341693Z 2024-03-29T03:00:01.176345563Z 2024-03-29T03:00:01.176349879Z 2024-03-29T03:00:01.176353236Z 2024-03-29T03:00:01.176356390Z 2024-03-29T03:00:01.176585372Z [2024-03-29T03:00:01.176+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:00:01.176808350Z [2024-03-29T03:00:01.176+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:00:01.177003753Z [2024-03-29T03:00:01.176+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:00:01.177164662Z [2024-03-29T03:00:01.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:00:01.177381494Z [2024-03-29T03:00:01.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:00:01.178090863Z [2024-03-29T03:00:01.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:00:01.178101428Z 2024-03-29T03:00:01.178106499Z 2024-03-29T03:00:01.178110997Z 2024-03-29T03:00:01.178115202Z 2024-03-29T03:00:01.178119521Z 2024-03-29T03:00:01.184170299Z [2024-03-29T03:00:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:00:01.184719218Z [2024-03-29T03:00:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:00:01.185125789Z [2024-03-29T03:00:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:00:01.185417412Z [2024-03-29T03:00:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:00:01.185797328Z [2024-03-29T03:00:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:00:01.186050158Z [2024-03-29T03:00:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:00:01.186493273Z [2024-03-29T03:00:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:00:01.186799920Z [2024-03-29T03:00:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:00:01.187212849Z [2024-03-29T03:00:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:00:01.187457635Z [2024-03-29T03:00:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:00:01.927354170Z [2024-03-29T03:00:01.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:01.927611111Z [2024-03-29T03:00:01.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:01.927955982Z [2024-03-29T03:00:01.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:59:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:01.928236887Z [2024-03-29T03:00:01.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:59:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:01.928487071Z [2024-03-29T03:00:01.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:59:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:01.952265437Z [2024-03-29T03:00:01.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to c403ce4a-1e34-4507-a230-ec82546d0805 2024-03-29T03:00:01.953013705Z [2024-03-29T03:00:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a7c9bca-b0c2-4cd6-93db-28da9a6c7f3d 2024-03-29T03:00:01.953483718Z [2024-03-29T03:00:01.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e0b40a0-07ca-4705-a6a9-692d8f3c9728 2024-03-29T03:00:01.953968846Z [2024-03-29T03:00:01.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0823b61-5154-4965-9a88-cd1ce98b3eee 2024-03-29T03:00:01.954410007Z [2024-03-29T03:00:01.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27413439-45a5-4165-8faa-20a6fd9459c9 2024-03-29T03:00:02.850302706Z [2024-03-29T03:00:02.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:00:02.850798853Z [2024-03-29T03:00:02.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 02:59:00+00:00, run_id=scheduled__2024-03-29T02:59:00+00:00, run_start_date=2024-03-29 03:00:01.088759+00:00, run_end_date=2024-03-29 03:00:02.850394+00:00, run_duration=1.761635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:59:00+00:00, data_interval_end=2024-03-29 03:00:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:00:02.861323012Z [2024-03-29T03:00:02.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:01:00+00:00 2024-03-29T03:00:04.035592425Z [2024-03-29T03:00:04.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:00:04.036210526Z [2024-03-29T03:00:04.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 02:58:00+00:00, run_id=scheduled__2024-03-29T02:58:00+00:00, run_start_date=2024-03-29 03:00:01.087484+00:00, run_end_date=2024-03-29 03:00:04.035593+00:00, run_duration=2.948109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:58:00+00:00, data_interval_end=2024-03-29 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:00:04.049878331Z [2024-03-29T03:00:04.049+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:02:00+00:00 2024-03-29T03:00:04.204148204Z [2024-03-29T03:00:04.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T02:58:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:04.204331811Z [2024-03-29T03:00:04.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:59:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:04.229873308Z [2024-03-29T03:00:04.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:59:00+00:00, map_index=-1, run_start_date=2024-03-29 03:00:02.139489+00:00, run_end_date=2024-03-29 03:00:02.783172+00:00, run_duration=0.643683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:01.180037+00:00, queued_by_job_id=2, pid=13488 2024-03-29T03:00:04.232064566Z [2024-03-29T03:00:04.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T02:58:00+00:00, map_index=-1, run_start_date=2024-03-29 03:00:02.576496+00:00, run_end_date=2024-03-29 03:00:03.117251+00:00, run_duration=0.540755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:01.180037+00:00, queued_by_job_id=2, pid=13489 2024-03-29T03:00:05.354578440Z [2024-03-29T03:00:05.354+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:00:05.354624393Z 2024-03-29T03:00:05.354921232Z [2024-03-29T03:00:05.354+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:00:05.356019914Z [2024-03-29T03:00:05.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:00:05.356057992Z 2024-03-29T03:00:05.361329261Z [2024-03-29T03:00:05.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:00:05.361870030Z [2024-03-29T03:00:05.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:00:05.434893464Z [2024-03-29T03:00:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:05.434933043Z [2024-03-29T03:00:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:05.440881452Z [2024-03-29T03:00:05.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to d404d6b2-e599-49e3-ae94-f650f632b506 2024-03-29T03:00:05.440998200Z [2024-03-29T03:00:05.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T02:55:00+00:00, map_index=-1, run_start_date=2024-03-29 03:00:04.187465+00:00, run_end_date=2024-03-29 03:00:04.631633+00:00, run_duration=0.444168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:01.180037+00:00, queued_by_job_id=2, pid=13519 2024-03-29T03:00:06.642105075Z [2024-03-29T03:00:06.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:00:06.642134826Z [2024-03-29T03:00:06.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:59:00+00:00, run_id=scheduled__2024-03-29T02:59:00+00:00, run_start_date=2024-03-29 03:00:01.089885+00:00, run_end_date=2024-03-29 03:00:06.638066+00:00, run_duration=5.548181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:59:00+00:00, data_interval_end=2024-03-29 03:00:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:00:06.681028684Z [2024-03-29T03:00:06.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:01:00+00:00 2024-03-29T03:00:06.681066748Z [2024-03-29T03:00:06.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:00:06.681085283Z [2024-03-29T03:00:06.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:59:00+00:00, run_id=scheduled__2024-03-29T02:59:00+00:00, run_start_date=2024-03-29 03:00:01.091012+00:00, run_end_date=2024-03-29 03:00:06.680563+00:00, run_duration=5.589551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:59:00+00:00, data_interval_end=2024-03-29 03:00:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:00:06.738639918Z [2024-03-29T03:00:06.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:01:00+00:00 2024-03-29T03:00:06.852569952Z [2024-03-29T03:00:06.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:59:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:06.853318179Z [2024-03-29T03:00:06.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T02:59:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:06.865392156Z [2024-03-29T03:00:06.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:59:00+00:00, map_index=-1, run_start_date=2024-03-29 03:00:04.289712+00:00, run_end_date=2024-03-29 03:00:06.327740+00:00, run_duration=2.038028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:01.180037+00:00, queued_by_job_id=2, pid=13520 2024-03-29T03:00:06.866072888Z [2024-03-29T03:00:06.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T02:59:00+00:00, map_index=-1, run_start_date=2024-03-29 03:00:03.931697+00:00, run_end_date=2024-03-29 03:00:06.224273+00:00, run_duration=2.292576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:01.180037+00:00, queued_by_job_id=2, pid=13510 2024-03-29T03:00:09.076829333Z [2024-03-29T03:00:09.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:00:09.076879340Z 2024-03-29T03:00:09.076976402Z [2024-03-29T03:00:09.076+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:00:09.077626942Z [2024-03-29T03:00:09.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:00:09.077658101Z 2024-03-29T03:00:09.080392190Z [2024-03-29T03:00:09.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:00:09.080489695Z [2024-03-29T03:00:09.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:00:09.132787149Z [2024-03-29T03:00:09.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:09.132863422Z [2024-03-29T03:00:09.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:09.142065586Z [2024-03-29T03:00:09.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to bed2d1fe-b894-403b-877d-38a8e0a32080 2024-03-29T03:00:09.142330925Z [2024-03-29T03:00:09.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T02:55:00+00:00, map_index=-1, run_start_date=2024-03-29 03:00:07.721684+00:00, run_end_date=2024-03-29 03:00:08.138606+00:00, run_duration=0.416922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:05.357077+00:00, queued_by_job_id=2, pid=13543 2024-03-29T03:00:13.085818278Z [2024-03-29T03:00:13.085+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:00:13.085939360Z 2024-03-29T03:00:13.085968762Z [2024-03-29T03:00:13.085+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:00:13.087594617Z [2024-03-29T03:00:13.087+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:00:13.087619776Z 2024-03-29T03:00:13.091290735Z [2024-03-29T03:00:13.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:00:13.091440787Z [2024-03-29T03:00:13.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:00:13.158325499Z [2024-03-29T03:00:13.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status queued for try_number 1 2024-03-29T03:00:13.158605164Z [2024-03-29T03:00:13.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:13.168600457Z [2024-03-29T03:00:13.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a7dff27-6dc1-4b26-b7c7-534eac541b98 2024-03-29T03:00:13.168978684Z [2024-03-29T03:00:13.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T02:55:00+00:00, map_index=0, run_start_date=2024-03-29 03:00:10.865775+00:00, run_end_date=2024-03-29 03:00:12.173141+00:00, run_duration=1.307366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:09.077975+00:00, queued_by_job_id=2, pid=13551 2024-03-29T03:00:16.180363063Z [2024-03-29T03:00:16.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:00:16.180552534Z [2024-03-29T03:00:16.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 02:55:00+00:00, run_id=scheduled__2024-03-29T02:55:00+00:00, run_start_date=2024-03-29 03:00:01.085950+00:00, run_end_date=2024-03-29 03:00:16.180217+00:00, run_duration=15.094267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 02:55:00+00:00, data_interval_end=2024-03-29 03:00:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:00:16.188202343Z [2024-03-29T03:00:16.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:00:00+00:00, run_after=2024-03-29T03:05:00+00:00 2024-03-29T03:00:16.222292531Z [2024-03-29T03:00:16.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T02:55:00+00:00 exited with status success for try_number 1 2024-03-29T03:00:16.228934787Z [2024-03-29T03:00:16.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T02:55:00+00:00, map_index=-1, run_start_date=2024-03-29 03:00:14.912680+00:00, run_end_date=2024-03-29 03:00:15.347356+00:00, run_duration=0.434676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:00:13.088152+00:00, queued_by_job_id=2, pid=13564 2024-03-29T03:01:00.221174356Z [2024-03-29T03:01:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:01:00+00:00, run_after=2024-03-29T03:02:00+00:00 2024-03-29T03:01:00.249843880Z [2024-03-29T03:01:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:01:00+00:00, run_after=2024-03-29T03:02:00+00:00 2024-03-29T03:01:00.263644604Z [2024-03-29T03:01:00.263+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:01:00.355842194Z [2024-03-29T03:01:00.355+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:01:00.355873639Z 2024-03-29T03:01:00.355878552Z 2024-03-29T03:01:00.355883764Z 2024-03-29T03:01:00.356156671Z [2024-03-29T03:01:00.355+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:01:00.356384136Z [2024-03-29T03:01:00.356+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:01:00.356611899Z [2024-03-29T03:01:00.356+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:01:00.357484787Z [2024-03-29T03:01:00.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:01:00.357498671Z 2024-03-29T03:01:00.357502085Z 2024-03-29T03:01:00.357505238Z 2024-03-29T03:01:00.361806525Z [2024-03-29T03:01:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:01:00.362186634Z [2024-03-29T03:01:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:01:00.362964273Z [2024-03-29T03:01:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:01:00.363266357Z [2024-03-29T03:01:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:01:00.363814785Z [2024-03-29T03:01:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:01:00.364242443Z [2024-03-29T03:01:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:01:00.616489235Z [2024-03-29T03:01:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:01:00.616661925Z [2024-03-29T03:01:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:01:00.616897709Z [2024-03-29T03:01:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:01:00.625525970Z [2024-03-29T03:01:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96554769-aa03-4c2e-b034-ca8360613ee8 2024-03-29T03:01:00.625566892Z [2024-03-29T03:01:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ed852b1-8b84-4e1f-9054-fac87700187a 2024-03-29T03:01:00.625762485Z [2024-03-29T03:01:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ac68235-fa69-4e30-abbb-3e56f4ce7363 2024-03-29T03:01:01.802490637Z [2024-03-29T03:01:01.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:01:01.803025916Z [2024-03-29T03:01:01.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:00:00+00:00, run_id=scheduled__2024-03-29T03:00:00+00:00, run_start_date=2024-03-29 03:01:00.279667+00:00, run_end_date=2024-03-29 03:01:01.802382+00:00, run_duration=1.522715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:00:00+00:00, data_interval_end=2024-03-29 03:01:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:01:01.821731698Z [2024-03-29T03:01:01.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:01:00+00:00, run_after=2024-03-29T03:02:00+00:00 2024-03-29T03:01:01.897288675Z [2024-03-29T03:01:01.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:01:01.920872657Z [2024-03-29T03:01:01.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=-1, run_start_date=2024-03-29 03:01:01.190190+00:00, run_end_date=2024-03-29 03:01:01.623018+00:00, run_duration=0.432828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:01:00.358513+00:00, queued_by_job_id=2, pid=13586 2024-03-29T03:01:04.833127424Z [2024-03-29T03:01:04.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:01:04.833495318Z [2024-03-29T03:01:04.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:00:00+00:00, run_id=scheduled__2024-03-29T03:00:00+00:00, run_start_date=2024-03-29 03:01:00.281458+00:00, run_end_date=2024-03-29 03:01:04.833055+00:00, run_duration=4.551597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:00:00+00:00, data_interval_end=2024-03-29 03:01:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:01:04.843033613Z [2024-03-29T03:01:04.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:01:00+00:00, run_after=2024-03-29T03:02:00+00:00 2024-03-29T03:01:04.851012575Z [2024-03-29T03:01:04.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:01:04.851431675Z [2024-03-29T03:01:04.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:00:00+00:00, run_id=scheduled__2024-03-29T03:00:00+00:00, run_start_date=2024-03-29 03:01:00.283114+00:00, run_end_date=2024-03-29 03:01:04.850894+00:00, run_duration=4.56778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:00:00+00:00, data_interval_end=2024-03-29 03:01:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:01:04.862940972Z [2024-03-29T03:01:04.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:01:00+00:00, run_after=2024-03-29T03:02:00+00:00 2024-03-29T03:01:04.915439702Z [2024-03-29T03:01:04.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:01:04.923614843Z [2024-03-29T03:01:04.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=-1, run_start_date=2024-03-29 03:01:02.336164+00:00, run_end_date=2024-03-29 03:01:03.804331+00:00, run_duration=1.468167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:01:00.358513+00:00, queued_by_job_id=2, pid=13605 2024-03-29T03:01:06.004527529Z [2024-03-29T03:01:06.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:01:06.023542560Z [2024-03-29T03:01:06.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=-1, run_start_date=2024-03-29 03:01:02.296161+00:00, run_end_date=2024-03-29 03:01:04.787998+00:00, run_duration=2.491837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:01:00.358513+00:00, queued_by_job_id=2, pid=13604 2024-03-29T03:02:00.507847362Z [2024-03-29T03:02:00.507+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:02:00.519351642Z [2024-03-29T03:02:00.519+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:02:00.535149860Z [2024-03-29T03:02:00.534+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:02:00+00:00, run_after=2024-03-29T03:03:00+00:00 2024-03-29T03:02:00.551740492Z [2024-03-29T03:02:00.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:02:00+00:00, run_after=2024-03-29T03:03:00+00:00 2024-03-29T03:02:00.641538032Z [2024-03-29T03:02:00.641+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:02:00.641561544Z 2024-03-29T03:02:00.641566078Z 2024-03-29T03:02:00.641569555Z 2024-03-29T03:02:00.641572893Z 2024-03-29T03:02:00.641782825Z [2024-03-29T03:02:00.641+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:02:00.642030356Z [2024-03-29T03:02:00.641+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:02:00.642215443Z [2024-03-29T03:02:00.642+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:02:00.642383447Z [2024-03-29T03:02:00.642+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:02:00.643020700Z [2024-03-29T03:02:00.642+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:02:00.643033678Z 2024-03-29T03:02:00.643037557Z 2024-03-29T03:02:00.643041011Z 2024-03-29T03:02:00.643044146Z 2024-03-29T03:02:00.649403526Z [2024-03-29T03:02:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:02:00.649636831Z [2024-03-29T03:02:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:02:00.649952403Z [2024-03-29T03:02:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:02:00.650143767Z [2024-03-29T03:02:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:02:00.650505454Z [2024-03-29T03:02:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:02:00.650715186Z [2024-03-29T03:02:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:02:00.651102716Z [2024-03-29T03:02:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:02:00.651301089Z [2024-03-29T03:02:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:02:01.075394107Z [2024-03-29T03:02:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:02:01.075499955Z [2024-03-29T03:02:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:01:00+00:00 exited with status queued for try_number 1 2024-03-29T03:02:01.075647521Z [2024-03-29T03:02:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:01:00+00:00 exited with status queued for try_number 1 2024-03-29T03:02:01.075752704Z [2024-03-29T03:02:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:01:00+00:00 exited with status queued for try_number 1 2024-03-29T03:02:01.086175722Z [2024-03-29T03:02:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7206a414-4366-483b-be81-596bfb61eceb 2024-03-29T03:02:01.086261095Z [2024-03-29T03:02:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to de9b3eb1-09af-4b03-8676-974056e2870d 2024-03-29T03:02:01.086470185Z [2024-03-29T03:02:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73d69169-8236-4b11-8d04-5e4afda30cec 2024-03-29T03:02:01.086688131Z [2024-03-29T03:02:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f92f679-40b6-4153-a12d-03736399fc56 2024-03-29T03:02:02.434423346Z [2024-03-29T03:02:02.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:02:02.438043647Z [2024-03-29T03:02:02.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:00:00+00:00, run_id=scheduled__2024-03-29T03:00:00+00:00, run_start_date=2024-03-29 03:02:00.563909+00:00, run_end_date=2024-03-29 03:02:02.437109+00:00, run_duration=1.8732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:00:00+00:00, data_interval_end=2024-03-29 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:02:02.472237809Z [2024-03-29T03:02:02.471+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:02:00+00:00, run_after=2024-03-29T03:04:00+00:00 2024-03-29T03:02:02.481600807Z [2024-03-29T03:02:02.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:02:02.482137111Z [2024-03-29T03:02:02.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:01:00+00:00, run_id=scheduled__2024-03-29T03:01:00+00:00, run_start_date=2024-03-29 03:02:00.565353+00:00, run_end_date=2024-03-29 03:02:02.481660+00:00, run_duration=1.916307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:01:00+00:00, data_interval_end=2024-03-29 03:02:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:02:02.495512343Z [2024-03-29T03:02:02.495+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:02:00+00:00, run_after=2024-03-29T03:03:00+00:00 2024-03-29T03:02:02.549448969Z [2024-03-29T03:02:02.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:02:02.559070594Z [2024-03-29T03:02:02.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=-1, run_start_date=2024-03-29 03:02:01.479828+00:00, run_end_date=2024-03-29 03:02:01.973057+00:00, run_duration=0.493229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:02:00.643959+00:00, queued_by_job_id=2, pid=13635 2024-03-29T03:02:02.815879054Z [2024-03-29T03:02:02.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:01:00+00:00 exited with status success for try_number 1 2024-03-29T03:02:02.823359580Z [2024-03-29T03:02:02.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:01:00+00:00, map_index=-1, run_start_date=2024-03-29 03:02:01.902408+00:00, run_end_date=2024-03-29 03:02:02.418638+00:00, run_duration=0.51623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:02:00.643959+00:00, queued_by_job_id=2, pid=13645 2024-03-29T03:02:04.525925153Z [2024-03-29T03:02:04.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:02:04.526208118Z [2024-03-29T03:02:04.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:01:00+00:00, run_id=scheduled__2024-03-29T03:01:00+00:00, run_start_date=2024-03-29 03:02:00.566520+00:00, run_end_date=2024-03-29 03:02:04.525764+00:00, run_duration=3.959244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:01:00+00:00, data_interval_end=2024-03-29 03:02:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:02:04.537775977Z [2024-03-29T03:02:04.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:02:00+00:00, run_after=2024-03-29T03:03:00+00:00 2024-03-29T03:02:04.580463584Z [2024-03-29T03:02:04.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:01:00+00:00 exited with status success for try_number 1 2024-03-29T03:02:04.587702598Z [2024-03-29T03:02:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:01:00+00:00, map_index=-1, run_start_date=2024-03-29 03:02:03.118087+00:00, run_end_date=2024-03-29 03:02:04.419270+00:00, run_duration=1.301183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:02:00.643959+00:00, queued_by_job_id=2, pid=13663 2024-03-29T03:02:05.692122856Z [2024-03-29T03:02:05.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:02:05.692159671Z [2024-03-29T03:02:05.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:01:00+00:00, run_id=scheduled__2024-03-29T03:01:00+00:00, run_start_date=2024-03-29 03:02:00.567614+00:00, run_end_date=2024-03-29 03:02:05.691136+00:00, run_duration=5.123522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:01:00+00:00, data_interval_end=2024-03-29 03:02:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:02:05.703546161Z [2024-03-29T03:02:05.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:02:00+00:00, run_after=2024-03-29T03:03:00+00:00 2024-03-29T03:02:05.742205440Z [2024-03-29T03:02:05.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:01:00+00:00 exited with status success for try_number 1 2024-03-29T03:02:05.749723228Z [2024-03-29T03:02:05.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:01:00+00:00, map_index=-1, run_start_date=2024-03-29 03:02:03.208005+00:00, run_end_date=2024-03-29 03:02:05.204838+00:00, run_duration=1.996833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:02:00.643959+00:00, queued_by_job_id=2, pid=13664 2024-03-29T03:03:00.251673714Z [2024-03-29T03:03:00.249+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:03:00.269806231Z [2024-03-29T03:03:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:03:00+00:00, run_after=2024-03-29T03:04:00+00:00 2024-03-29T03:03:00.282180046Z [2024-03-29T03:03:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:03:00+00:00, run_after=2024-03-29T03:04:00+00:00 2024-03-29T03:03:00.355196562Z [2024-03-29T03:03:00.354+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:03:00.355223214Z 2024-03-29T03:03:00.355226847Z 2024-03-29T03:03:00.355230266Z 2024-03-29T03:03:00.355255954Z [2024-03-29T03:03:00.355+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:03:00.355459983Z [2024-03-29T03:03:00.355+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:03:00.355590717Z [2024-03-29T03:03:00.355+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:03:00.356278754Z [2024-03-29T03:03:00.356+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:03:00.356294770Z 2024-03-29T03:03:00.356299593Z 2024-03-29T03:03:00.356303810Z 2024-03-29T03:03:00.360209681Z [2024-03-29T03:03:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:03:00.360427956Z [2024-03-29T03:03:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:03:00.360690129Z [2024-03-29T03:03:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:03:00.360834608Z [2024-03-29T03:03:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:03:00.361212753Z [2024-03-29T03:03:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:03:00.361399079Z [2024-03-29T03:03:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:03:00.555639438Z [2024-03-29T03:03:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status queued for try_number 1 2024-03-29T03:03:00.555747338Z [2024-03-29T03:03:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status queued for try_number 1 2024-03-29T03:03:00.555912755Z [2024-03-29T03:03:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status queued for try_number 1 2024-03-29T03:03:00.564135860Z [2024-03-29T03:03:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to facc7d53-9283-4564-b301-70c6189e4876 2024-03-29T03:03:00.564317418Z [2024-03-29T03:03:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64abf334-9f75-4de1-9cc9-cc6ee724b29b 2024-03-29T03:03:00.564518655Z [2024-03-29T03:03:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ba86437-2feb-403b-a219-6a30b0c35c5f 2024-03-29T03:03:01.741435835Z [2024-03-29T03:03:01.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:03:01.741623220Z [2024-03-29T03:03:01.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:02:00+00:00, run_id=scheduled__2024-03-29T03:02:00+00:00, run_start_date=2024-03-29 03:03:00.295097+00:00, run_end_date=2024-03-29 03:03:01.741305+00:00, run_duration=1.446208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:02:00+00:00, data_interval_end=2024-03-29 03:03:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:03:01.752687558Z [2024-03-29T03:03:01.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:03:00+00:00, run_after=2024-03-29T03:04:00+00:00 2024-03-29T03:03:01.807923382Z [2024-03-29T03:03:01.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status success for try_number 1 2024-03-29T03:03:01.816754113Z [2024-03-29T03:03:01.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:02:00+00:00, map_index=-1, run_start_date=2024-03-29 03:03:01.162061+00:00, run_end_date=2024-03-29 03:03:01.506709+00:00, run_duration=0.344648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:03:00.357258+00:00, queued_by_job_id=2, pid=13696 2024-03-29T03:03:04.220013026Z [2024-03-29T03:03:04.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:03:04.220609057Z [2024-03-29T03:03:04.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:02:00+00:00, run_id=scheduled__2024-03-29T03:02:00+00:00, run_start_date=2024-03-29 03:03:00.296810+00:00, run_end_date=2024-03-29 03:03:04.219925+00:00, run_duration=3.923115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:02:00+00:00, data_interval_end=2024-03-29 03:03:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:03:04.237619223Z [2024-03-29T03:03:04.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:03:00+00:00, run_after=2024-03-29T03:04:00+00:00 2024-03-29T03:03:04.252423267Z [2024-03-29T03:03:04.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:03:04.252944682Z [2024-03-29T03:03:04.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:02:00+00:00, run_id=scheduled__2024-03-29T03:02:00+00:00, run_start_date=2024-03-29 03:03:00.298283+00:00, run_end_date=2024-03-29 03:03:04.252537+00:00, run_duration=3.954254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:02:00+00:00, data_interval_end=2024-03-29 03:03:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:03:04.264077713Z [2024-03-29T03:03:04.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:03:00+00:00, run_after=2024-03-29T03:04:00+00:00 2024-03-29T03:03:04.294407589Z [2024-03-29T03:03:04.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status success for try_number 1 2024-03-29T03:03:04.294528966Z [2024-03-29T03:03:04.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status success for try_number 1 2024-03-29T03:03:04.301012934Z [2024-03-29T03:03:04.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:02:00+00:00, map_index=-1, run_start_date=2024-03-29 03:03:02.073026+00:00, run_end_date=2024-03-29 03:03:03.340023+00:00, run_duration=1.266997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:03:00.357258+00:00, queued_by_job_id=2, pid=13711 2024-03-29T03:03:04.301760138Z [2024-03-29T03:03:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:02:00+00:00, map_index=-1, run_start_date=2024-03-29 03:03:02.352108+00:00, run_end_date=2024-03-29 03:03:03.968268+00:00, run_duration=1.61616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:03:00.357258+00:00, queued_by_job_id=2, pid=13715 2024-03-29T03:03:46.689797683Z [2024-03-29T03:03:46.689+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:04:00.841780535Z [2024-03-29T03:04:00.841+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:04:00.848615987Z [2024-03-29T03:04:00.848+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:04:00.865519519Z [2024-03-29T03:04:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:04:00+00:00, run_after=2024-03-29T03:05:00+00:00 2024-03-29T03:04:00.879317704Z [2024-03-29T03:04:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:04:00+00:00, run_after=2024-03-29T03:05:00+00:00 2024-03-29T03:04:00.954641436Z [2024-03-29T03:04:00.954+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:04:00.954678323Z 2024-03-29T03:04:00.954682757Z 2024-03-29T03:04:00.954692045Z 2024-03-29T03:04:00.954695429Z 2024-03-29T03:04:00.954705734Z [2024-03-29T03:04:00.954+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:04:00.954782108Z [2024-03-29T03:04:00.954+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:04:00.955043332Z [2024-03-29T03:04:00.954+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:04:00.956034515Z [2024-03-29T03:04:00.955+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:04:00.956629168Z [2024-03-29T03:04:00.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:04:00.956637068Z 2024-03-29T03:04:00.956640758Z 2024-03-29T03:04:00.956643799Z 2024-03-29T03:04:00.956646873Z 2024-03-29T03:04:00.961561530Z [2024-03-29T03:04:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:04:00.961709953Z [2024-03-29T03:04:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:04:00.961963335Z [2024-03-29T03:04:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:04:00.962100077Z [2024-03-29T03:04:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:04:00.962303396Z [2024-03-29T03:04:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:04:00.962424116Z [2024-03-29T03:04:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:04:00.962664449Z [2024-03-29T03:04:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:04:00.962737690Z [2024-03-29T03:04:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:04:01.245790110Z [2024-03-29T03:04:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status queued for try_number 1 2024-03-29T03:04:01.245982998Z [2024-03-29T03:04:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:03:00+00:00 exited with status queued for try_number 1 2024-03-29T03:04:01.246126224Z [2024-03-29T03:04:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:03:00+00:00 exited with status queued for try_number 1 2024-03-29T03:04:01.246277251Z [2024-03-29T03:04:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:03:00+00:00 exited with status queued for try_number 1 2024-03-29T03:04:01.264000052Z [2024-03-29T03:04:01.263+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f5471fd-f4f8-4911-944a-a23628579dbc 2024-03-29T03:04:01.264217949Z [2024-03-29T03:04:01.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22af57fb-b777-49f3-877a-83f59d5a8b69 2024-03-29T03:04:01.264389088Z [2024-03-29T03:04:01.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba2de48d-6674-46b8-8c71-cc8c5ef864e9 2024-03-29T03:04:01.264546995Z [2024-03-29T03:04:01.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7f9dc49-a2d1-4cb4-a7fe-6f66bd529732 2024-03-29T03:04:03.474141835Z [2024-03-29T03:04:03.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:04:03.474516284Z [2024-03-29T03:04:03.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:02:00+00:00, run_id=scheduled__2024-03-29T03:02:00+00:00, run_start_date=2024-03-29 03:04:00.892507+00:00, run_end_date=2024-03-29 03:04:03.474013+00:00, run_duration=2.581506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:02:00+00:00, data_interval_end=2024-03-29 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:04:03.482416683Z [2024-03-29T03:04:03.482+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:04:00+00:00, run_after=2024-03-29T03:06:00+00:00 2024-03-29T03:04:03.489614983Z [2024-03-29T03:04:03.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:04:03.489872854Z [2024-03-29T03:04:03.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:03:00+00:00, run_id=scheduled__2024-03-29T03:03:00+00:00, run_start_date=2024-03-29 03:04:00.893916+00:00, run_end_date=2024-03-29 03:04:03.489545+00:00, run_duration=2.595629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:03:00+00:00, data_interval_end=2024-03-29 03:04:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:04:03.500422538Z [2024-03-29T03:04:03.500+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:04:00+00:00, run_after=2024-03-29T03:05:00+00:00 2024-03-29T03:04:03.556709341Z [2024-03-29T03:04:03.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:02:00+00:00 exited with status success for try_number 1 2024-03-29T03:04:03.556924572Z [2024-03-29T03:04:03.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:03:00+00:00 exited with status success for try_number 1 2024-03-29T03:04:03.564516277Z [2024-03-29T03:04:03.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:02:00+00:00, map_index=-1, run_start_date=2024-03-29 03:04:01.947302+00:00, run_end_date=2024-03-29 03:04:02.453891+00:00, run_duration=0.506589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:04:00.957862+00:00, queued_by_job_id=2, pid=13743 2024-03-29T03:04:03.564691307Z [2024-03-29T03:04:03.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:03:00+00:00, map_index=-1, run_start_date=2024-03-29 03:04:02.336133+00:00, run_end_date=2024-03-29 03:04:02.896299+00:00, run_duration=0.560166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:04:00.957862+00:00, queued_by_job_id=2, pid=13754 2024-03-29T03:04:05.702981961Z [2024-03-29T03:04:05.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:04:05.703451208Z [2024-03-29T03:04:05.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:03:00+00:00, run_id=scheduled__2024-03-29T03:03:00+00:00, run_start_date=2024-03-29 03:04:00.896367+00:00, run_end_date=2024-03-29 03:04:05.702904+00:00, run_duration=4.806537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:03:00+00:00, data_interval_end=2024-03-29 03:04:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:04:05.713663024Z [2024-03-29T03:04:05.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:04:00+00:00, run_after=2024-03-29T03:05:00+00:00 2024-03-29T03:04:05.723665650Z [2024-03-29T03:04:05.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:04:05.724181745Z [2024-03-29T03:04:05.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:03:00+00:00, run_id=scheduled__2024-03-29T03:03:00+00:00, run_start_date=2024-03-29 03:04:00.895295+00:00, run_end_date=2024-03-29 03:04:05.723741+00:00, run_duration=4.828446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:03:00+00:00, data_interval_end=2024-03-29 03:04:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:04:05.738303766Z [2024-03-29T03:04:05.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:04:00+00:00, run_after=2024-03-29T03:05:00+00:00 2024-03-29T03:04:05.774270385Z [2024-03-29T03:04:05.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:03:00+00:00 exited with status success for try_number 1 2024-03-29T03:04:05.774578844Z [2024-03-29T03:04:05.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:03:00+00:00 exited with status success for try_number 1 2024-03-29T03:04:05.785443030Z [2024-03-29T03:04:05.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:03:00+00:00, map_index=-1, run_start_date=2024-03-29 03:04:03.450325+00:00, run_end_date=2024-03-29 03:04:04.809174+00:00, run_duration=1.358849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:04:00.957862+00:00, queued_by_job_id=2, pid=13773 2024-03-29T03:04:05.785858238Z [2024-03-29T03:04:05.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:03:00+00:00, map_index=-1, run_start_date=2024-03-29 03:04:03.145291+00:00, run_end_date=2024-03-29 03:04:04.869956+00:00, run_duration=1.724665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:04:00.957862+00:00, queued_by_job_id=2, pid=13767 2024-03-29T03:05:01.051478352Z [2024-03-29T03:05:01.050+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:05:01.067887049Z [2024-03-29T03:05:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:05:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:05:01.084696770Z [2024-03-29T03:05:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:05:00+00:00, run_after=2024-03-29T03:06:00+00:00 2024-03-29T03:05:01.107032143Z [2024-03-29T03:05:01.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:05:00+00:00, run_after=2024-03-29T03:06:00+00:00 2024-03-29T03:05:01.229860494Z [2024-03-29T03:05:01.229+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:05:01.229905354Z 2024-03-29T03:05:01.229911277Z 2024-03-29T03:05:01.229915377Z 2024-03-29T03:05:01.229919919Z 2024-03-29T03:05:01.230335922Z [2024-03-29T03:05:01.229+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:05:01.230782971Z [2024-03-29T03:05:01.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:05:01.230794391Z [2024-03-29T03:05:01.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:05:01.231233618Z [2024-03-29T03:05:01.230+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:05:01.232118657Z [2024-03-29T03:05:01.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:05:01.232129244Z 2024-03-29T03:05:01.232133544Z 2024-03-29T03:05:01.232137048Z 2024-03-29T03:05:01.232140513Z 2024-03-29T03:05:01.236375232Z [2024-03-29T03:05:01.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:05:01.236725612Z [2024-03-29T03:05:01.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:05:01.237201621Z [2024-03-29T03:05:01.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:05:01.237479509Z [2024-03-29T03:05:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:05:01.237791408Z [2024-03-29T03:05:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:05:01.238014640Z [2024-03-29T03:05:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:05:01.238335012Z [2024-03-29T03:05:01.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:05:01.238620396Z [2024-03-29T03:05:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:05:01.827998409Z [2024-03-29T03:05:01.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:05:01.828037284Z [2024-03-29T03:05:01.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status queued for try_number 1 2024-03-29T03:05:01.828201422Z [2024-03-29T03:05:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status queued for try_number 1 2024-03-29T03:05:01.828334118Z [2024-03-29T03:05:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status queued for try_number 1 2024-03-29T03:05:01.856095311Z [2024-03-29T03:05:01.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to c65f809b-d9bd-45c1-a5b0-28f3f7bad781 2024-03-29T03:05:01.856150454Z [2024-03-29T03:05:01.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6f660a8-77ad-4ef5-946d-514813dd0375 2024-03-29T03:05:01.856289389Z [2024-03-29T03:05:01.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to daec25be-ae8f-4691-aff3-e169f33018be 2024-03-29T03:05:01.856419083Z [2024-03-29T03:05:01.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to b900041e-36b9-4b10-b2cc-a55aa766576f 2024-03-29T03:05:03.158920382Z [2024-03-29T03:05:03.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:05:03.159146924Z [2024-03-29T03:05:03.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:04:00+00:00, run_id=scheduled__2024-03-29T03:04:00+00:00, run_start_date=2024-03-29 03:05:01.129829+00:00, run_end_date=2024-03-29 03:05:03.158751+00:00, run_duration=2.028922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:04:00+00:00, data_interval_end=2024-03-29 03:05:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:05:03.170355655Z [2024-03-29T03:05:03.169+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:05:00+00:00, run_after=2024-03-29T03:06:00+00:00 2024-03-29T03:05:03.225111241Z [2024-03-29T03:05:03.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status success for try_number 1 2024-03-29T03:05:03.232413528Z [2024-03-29T03:05:03.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:04:00+00:00, map_index=-1, run_start_date=2024-03-29 03:05:02.443508+00:00, run_end_date=2024-03-29 03:05:02.987716+00:00, run_duration=0.544208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:05:01.233180+00:00, queued_by_job_id=2, pid=13806 2024-03-29T03:05:05.122870075Z [2024-03-29T03:05:05.122+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:05:05.122908280Z 2024-03-29T03:05:05.123090582Z [2024-03-29T03:05:05.122+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:05:05.123747883Z [2024-03-29T03:05:05.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:05:05.123760874Z 2024-03-29T03:05:05.126538210Z [2024-03-29T03:05:05.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:05:05.126785337Z [2024-03-29T03:05:05.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:05:05.297988583Z [2024-03-29T03:05:05.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:05:05.298369658Z [2024-03-29T03:05:05.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:05:05.311101045Z [2024-03-29T03:05:05.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a531ab6-975f-4891-b2fd-573a6c5eb287 2024-03-29T03:05:05.311656149Z [2024-03-29T03:05:05.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=-1, run_start_date=2024-03-29 03:05:03.696740+00:00, run_end_date=2024-03-29 03:05:04.226973+00:00, run_duration=0.530233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:05:01.233180+00:00, queued_by_job_id=2, pid=13825 2024-03-29T03:05:06.547943138Z [2024-03-29T03:05:06.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:05:06.548291648Z [2024-03-29T03:05:06.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:04:00+00:00, run_id=scheduled__2024-03-29T03:04:00+00:00, run_start_date=2024-03-29 03:05:01.134240+00:00, run_end_date=2024-03-29 03:05:06.547820+00:00, run_duration=5.41358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:04:00+00:00, data_interval_end=2024-03-29 03:05:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:05:06.564635097Z [2024-03-29T03:05:06.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:05:00+00:00, run_after=2024-03-29T03:06:00+00:00 2024-03-29T03:05:06.580776264Z [2024-03-29T03:05:06.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:05:06.580792462Z [2024-03-29T03:05:06.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:04:00+00:00, run_id=scheduled__2024-03-29T03:04:00+00:00, run_start_date=2024-03-29 03:05:01.132106+00:00, run_end_date=2024-03-29 03:05:06.580270+00:00, run_duration=5.448164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:04:00+00:00, data_interval_end=2024-03-29 03:05:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:05:06.634713026Z [2024-03-29T03:05:06.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:05:00+00:00, run_after=2024-03-29T03:06:00+00:00 2024-03-29T03:05:06.783795779Z [2024-03-29T03:05:06.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status success for try_number 1 2024-03-29T03:05:06.783944562Z [2024-03-29T03:05:06.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status success for try_number 1 2024-03-29T03:05:06.795538320Z [2024-03-29T03:05:06.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:04:00+00:00, map_index=-1, run_start_date=2024-03-29 03:05:03.840099+00:00, run_end_date=2024-03-29 03:05:05.731992+00:00, run_duration=1.891893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:05:01.233180+00:00, queued_by_job_id=2, pid=13826 2024-03-29T03:05:06.795854459Z [2024-03-29T03:05:06.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:04:00+00:00, map_index=-1, run_start_date=2024-03-29 03:05:04.234644+00:00, run_end_date=2024-03-29 03:05:05.930872+00:00, run_duration=1.696228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:05:01.233180+00:00, queued_by_job_id=2, pid=13842 2024-03-29T03:05:08.382821743Z [2024-03-29T03:05:08.382+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:05:08.382881457Z 2024-03-29T03:05:08.383308939Z [2024-03-29T03:05:08.383+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:05:08.384063154Z [2024-03-29T03:05:08.383+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:05:08.384084471Z 2024-03-29T03:05:08.386970496Z [2024-03-29T03:05:08.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:05:08.387180494Z [2024-03-29T03:05:08.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:05:08.489521485Z [2024-03-29T03:05:08.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:05:08.494078524Z [2024-03-29T03:05:08.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:05:08.504414100Z [2024-03-29T03:05:08.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1baf5676-c2b2-4ffc-9c2d-cde497f61867 2024-03-29T03:05:08.504739180Z [2024-03-29T03:05:08.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=-1, run_start_date=2024-03-29 03:05:07.609209+00:00, run_end_date=2024-03-29 03:05:08.065608+00:00, run_duration=0.456399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:05:05.124177+00:00, queued_by_job_id=2, pid=13855 2024-03-29T03:05:11.864660316Z [2024-03-29T03:05:11.863+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:05:11.864724095Z 2024-03-29T03:05:11.864898186Z [2024-03-29T03:05:11.864+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:05:11.866057943Z [2024-03-29T03:05:11.865+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:05:11.866094193Z 2024-03-29T03:05:11.870553232Z [2024-03-29T03:05:11.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:05:11.870920358Z [2024-03-29T03:05:11.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:05:11.917974495Z [2024-03-29T03:05:11.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status queued for try_number 1 2024-03-29T03:05:11.918793326Z [2024-03-29T03:05:11.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:05:11.929638712Z [2024-03-29T03:05:11.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f6db97f-dafa-44b4-a22c-f5200d8fae20 2024-03-29T03:05:11.929688509Z [2024-03-29T03:05:11.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=0, run_start_date=2024-03-29 03:05:10.094179+00:00, run_end_date=2024-03-29 03:05:11.306932+00:00, run_duration=1.212753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:05:08.384633+00:00, queued_by_job_id=2, pid=13863 2024-03-29T03:05:14.081463206Z [2024-03-29T03:05:14.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:05:14.081971499Z [2024-03-29T03:05:14.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:00:00+00:00, run_id=scheduled__2024-03-29T03:00:00+00:00, run_start_date=2024-03-29 03:05:01.127542+00:00, run_end_date=2024-03-29 03:05:14.081530+00:00, run_duration=12.953988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:00:00+00:00, data_interval_end=2024-03-29 03:05:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:05:14.090418726Z [2024-03-29T03:05:14.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:05:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:05:14.122026710Z [2024-03-29T03:05:14.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:00:00+00:00 exited with status success for try_number 1 2024-03-29T03:05:14.128250392Z [2024-03-29T03:05:14.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:00:00+00:00, map_index=-1, run_start_date=2024-03-29 03:05:13.605091+00:00, run_end_date=2024-03-29 03:05:13.935324+00:00, run_duration=0.330233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:05:11.866805+00:00, queued_by_job_id=2, pid=13876 2024-03-29T03:06:00.048453924Z [2024-03-29T03:06:00.048+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:06:00.066519903Z [2024-03-29T03:06:00.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:06:00+00:00, run_after=2024-03-29T03:07:00+00:00 2024-03-29T03:06:00.079915009Z [2024-03-29T03:06:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:06:00+00:00, run_after=2024-03-29T03:07:00+00:00 2024-03-29T03:06:00.142259141Z [2024-03-29T03:06:00.141+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:06:00.142280567Z 2024-03-29T03:06:00.142284671Z 2024-03-29T03:06:00.142287946Z 2024-03-29T03:06:00.142415849Z [2024-03-29T03:06:00.142+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:06:00.142705040Z [2024-03-29T03:06:00.142+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:06:00.142925812Z [2024-03-29T03:06:00.142+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:06:00.143619933Z [2024-03-29T03:06:00.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:06:00.143633467Z 2024-03-29T03:06:00.143637382Z 2024-03-29T03:06:00.143640744Z 2024-03-29T03:06:00.147407530Z [2024-03-29T03:06:00.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:06:00.147587213Z [2024-03-29T03:06:00.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:06:00.147877272Z [2024-03-29T03:06:00.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:06:00.148031493Z [2024-03-29T03:06:00.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:06:00.148268335Z [2024-03-29T03:06:00.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:06:00.148390411Z [2024-03-29T03:06:00.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:06:00.482213130Z [2024-03-29T03:06:00.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status queued for try_number 1 2024-03-29T03:06:00.482471168Z [2024-03-29T03:06:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status queued for try_number 1 2024-03-29T03:06:00.482704619Z [2024-03-29T03:06:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status queued for try_number 1 2024-03-29T03:06:00.493163035Z [2024-03-29T03:06:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69308a48-7854-4941-880e-9e9d3893c184 2024-03-29T03:06:00.493458557Z [2024-03-29T03:06:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 676db413-a898-4b4d-a5d0-514d582ec638 2024-03-29T03:06:00.493649203Z [2024-03-29T03:06:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cfe8c91-b193-45cc-b8c0-ea5d0ba2226b 2024-03-29T03:06:00.527790038Z [2024-03-29T03:06:00.527+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:06:00.621138799Z [2024-03-29T03:06:00.620+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:06:00.621165954Z 2024-03-29T03:06:00.621388679Z [2024-03-29T03:06:00.621+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:06:00.622076197Z [2024-03-29T03:06:00.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:06:00.622088956Z 2024-03-29T03:06:00.625055768Z [2024-03-29T03:06:00.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:06:00.625400482Z [2024-03-29T03:06:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:06:00.729503084Z [2024-03-29T03:06:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status queued for try_number 1 2024-03-29T03:06:00.735865347Z [2024-03-29T03:06:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64e47150-1d73-4dbd-b95d-0971f1f8dbe8 2024-03-29T03:06:01.973272958Z [2024-03-29T03:06:01.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:06:01.973933173Z [2024-03-29T03:06:01.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:04:00+00:00, run_id=scheduled__2024-03-29T03:04:00+00:00, run_start_date=2024-03-29 03:06:00.090966+00:00, run_end_date=2024-03-29 03:06:01.973436+00:00, run_duration=1.88247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:04:00+00:00, data_interval_end=2024-03-29 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:06:01.989750310Z [2024-03-29T03:06:01.989+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:06:00+00:00, run_after=2024-03-29T03:08:00+00:00 2024-03-29T03:06:02.006224551Z [2024-03-29T03:06:02.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:06:02.006592647Z [2024-03-29T03:06:02.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:05:00+00:00, run_id=scheduled__2024-03-29T03:05:00+00:00, run_start_date=2024-03-29 03:06:00.093244+00:00, run_end_date=2024-03-29 03:06:02.006238+00:00, run_duration=1.912994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:05:00+00:00, data_interval_end=2024-03-29 03:06:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:06:02.038615035Z [2024-03-29T03:06:02.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:06:00+00:00, run_after=2024-03-29T03:07:00+00:00 2024-03-29T03:06:02.165807777Z [2024-03-29T03:06:02.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:04:00+00:00 exited with status success for try_number 1 2024-03-29T03:06:02.165900178Z [2024-03-29T03:06:02.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status success for try_number 1 2024-03-29T03:06:02.165937277Z [2024-03-29T03:06:02.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:05:00+00:00, map_index=-1, run_start_date=2024-03-29 03:06:01.214227+00:00, run_end_date=2024-03-29 03:06:01.678434+00:00, run_duration=0.464207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:06:00.144596+00:00, queued_by_job_id=2, pid=13899 2024-03-29T03:06:02.165946686Z [2024-03-29T03:06:02.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:04:00+00:00, map_index=-1, run_start_date=2024-03-29 03:06:01.209178+00:00, run_end_date=2024-03-29 03:06:01.699367+00:00, run_duration=0.490189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:06:00.144596+00:00, queued_by_job_id=2, pid=13900 2024-03-29T03:06:04.138798419Z [2024-03-29T03:06:04.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:06:04.138875060Z [2024-03-29T03:06:04.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:05:00+00:00, run_id=scheduled__2024-03-29T03:05:00+00:00, run_start_date=2024-03-29 03:06:00.094313+00:00, run_end_date=2024-03-29 03:06:04.138630+00:00, run_duration=4.044317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:05:00+00:00, data_interval_end=2024-03-29 03:06:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:06:04.148766021Z [2024-03-29T03:06:04.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:06:00+00:00, run_after=2024-03-29T03:07:00+00:00 2024-03-29T03:06:04.193592963Z [2024-03-29T03:06:04.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status success for try_number 1 2024-03-29T03:06:04.199293179Z [2024-03-29T03:06:04.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:05:00+00:00, map_index=-1, run_start_date=2024-03-29 03:06:02.557752+00:00, run_end_date=2024-03-29 03:06:03.939985+00:00, run_duration=1.382233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:06:00.144596+00:00, queued_by_job_id=2, pid=13923 2024-03-29T03:06:05.514766432Z [2024-03-29T03:06:05.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:06:05.515426025Z [2024-03-29T03:06:05.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:05:00+00:00, run_id=scheduled__2024-03-29T03:05:00+00:00, run_start_date=2024-03-29 03:06:00.539851+00:00, run_end_date=2024-03-29 03:06:05.515018+00:00, run_duration=4.975167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:05:00+00:00, data_interval_end=2024-03-29 03:06:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:06:05.526046640Z [2024-03-29T03:06:05.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:06:00+00:00, run_after=2024-03-29T03:07:00+00:00 2024-03-29T03:06:05.573215283Z [2024-03-29T03:06:05.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status success for try_number 1 2024-03-29T03:06:05.579511102Z [2024-03-29T03:06:05.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:05:00+00:00, map_index=-1, run_start_date=2024-03-29 03:06:02.711279+00:00, run_end_date=2024-03-29 03:06:04.722654+00:00, run_duration=2.011375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:06:00.622771+00:00, queued_by_job_id=2, pid=13924 2024-03-29T03:07:00.691476988Z [2024-03-29T03:07:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:07:00+00:00, run_after=2024-03-29T03:08:00+00:00 2024-03-29T03:07:00.700182493Z [2024-03-29T03:07:00.699+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:07:00.714933188Z [2024-03-29T03:07:00.714+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:07:00+00:00, run_after=2024-03-29T03:08:00+00:00 2024-03-29T03:07:00.797518091Z [2024-03-29T03:07:00.797+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:07:00.797546735Z 2024-03-29T03:07:00.797550732Z 2024-03-29T03:07:00.797554466Z 2024-03-29T03:07:00.797742756Z [2024-03-29T03:07:00.797+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:07:00.797924681Z [2024-03-29T03:07:00.797+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:07:00.798166026Z [2024-03-29T03:07:00.797+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:07:00.799152708Z [2024-03-29T03:07:00.798+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:07:00.799174295Z 2024-03-29T03:07:00.799199513Z 2024-03-29T03:07:00.799204680Z 2024-03-29T03:07:00.804824688Z [2024-03-29T03:07:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:07:00.805024118Z [2024-03-29T03:07:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:07:00.805318938Z [2024-03-29T03:07:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:07:00.805507965Z [2024-03-29T03:07:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:07:00.805740240Z [2024-03-29T03:07:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:07:00.805837796Z [2024-03-29T03:07:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:07:01.077880483Z [2024-03-29T03:07:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status queued for try_number 1 2024-03-29T03:07:01.077990525Z [2024-03-29T03:07:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status queued for try_number 1 2024-03-29T03:07:01.078119579Z [2024-03-29T03:07:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status queued for try_number 1 2024-03-29T03:07:01.088055831Z [2024-03-29T03:07:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to da10cdfb-ba73-40fc-837a-acadbe4cc041 2024-03-29T03:07:01.088102222Z [2024-03-29T03:07:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32969edb-4a44-4eeb-aa03-aa075079cf5d 2024-03-29T03:07:01.088342469Z [2024-03-29T03:07:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 712a68a7-8c0e-4a77-86f7-50773574bc11 2024-03-29T03:07:02.734807156Z [2024-03-29T03:07:02.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:07:02.735360246Z [2024-03-29T03:07:02.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:06:00+00:00, run_id=scheduled__2024-03-29T03:06:00+00:00, run_start_date=2024-03-29 03:07:00.731603+00:00, run_end_date=2024-03-29 03:07:02.734987+00:00, run_duration=2.003384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:06:00+00:00, data_interval_end=2024-03-29 03:07:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:07:02.749021700Z [2024-03-29T03:07:02.748+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:07:00+00:00, run_after=2024-03-29T03:08:00+00:00 2024-03-29T03:07:03.882228441Z [2024-03-29T03:07:03.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status success for try_number 1 2024-03-29T03:07:03.889675454Z [2024-03-29T03:07:03.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:06:00+00:00, map_index=-1, run_start_date=2024-03-29 03:07:01.767708+00:00, run_end_date=2024-03-29 03:07:02.299212+00:00, run_duration=0.531504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:07:00.800837+00:00, queued_by_job_id=2, pid=13957 2024-03-29T03:07:05.902354811Z [2024-03-29T03:07:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:07:05.902493231Z [2024-03-29T03:07:05.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:06:00+00:00, run_id=scheduled__2024-03-29T03:06:00+00:00, run_start_date=2024-03-29 03:07:00.734144+00:00, run_end_date=2024-03-29 03:07:05.902232+00:00, run_duration=5.168088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:06:00+00:00, data_interval_end=2024-03-29 03:07:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:07:05.930772650Z [2024-03-29T03:07:05.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:07:00+00:00, run_after=2024-03-29T03:08:00+00:00 2024-03-29T03:07:05.944013026Z [2024-03-29T03:07:05.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:07:05.944557107Z [2024-03-29T03:07:05.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:06:00+00:00, run_id=scheduled__2024-03-29T03:06:00+00:00, run_start_date=2024-03-29 03:07:00.736784+00:00, run_end_date=2024-03-29 03:07:05.943922+00:00, run_duration=5.207138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:06:00+00:00, data_interval_end=2024-03-29 03:07:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:07:05.971017641Z [2024-03-29T03:07:05.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:07:00+00:00, run_after=2024-03-29T03:08:00+00:00 2024-03-29T03:07:06.013499714Z [2024-03-29T03:07:06.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status success for try_number 1 2024-03-29T03:07:06.013941200Z [2024-03-29T03:07:06.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status success for try_number 1 2024-03-29T03:07:06.023537744Z [2024-03-29T03:07:06.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:06:00+00:00, map_index=-1, run_start_date=2024-03-29 03:07:03.606313+00:00, run_end_date=2024-03-29 03:07:05.104508+00:00, run_duration=1.498195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:07:00.800837+00:00, queued_by_job_id=2, pid=13976 2024-03-29T03:07:06.023943753Z [2024-03-29T03:07:06.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:06:00+00:00, map_index=-1, run_start_date=2024-03-29 03:07:03.338723+00:00, run_end_date=2024-03-29 03:07:05.222431+00:00, run_duration=1.883708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:07:00.800837+00:00, queued_by_job_id=2, pid=13970 2024-03-29T03:08:00.600724458Z [2024-03-29T03:08:00.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:08:00+00:00, run_after=2024-03-29T03:09:00+00:00 2024-03-29T03:08:00.613268075Z [2024-03-29T03:08:00.612+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:08:00.623590588Z [2024-03-29T03:08:00.623+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:08:00.644673904Z [2024-03-29T03:08:00.644+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:08:00+00:00, run_after=2024-03-29T03:09:00+00:00 2024-03-29T03:08:00.733359163Z [2024-03-29T03:08:00.732+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:08:00.733399088Z 2024-03-29T03:08:00.733405227Z 2024-03-29T03:08:00.733408979Z 2024-03-29T03:08:00.733449206Z 2024-03-29T03:08:00.733634113Z [2024-03-29T03:08:00.733+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:08:00.733802217Z [2024-03-29T03:08:00.733+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:08:00.734049164Z [2024-03-29T03:08:00.733+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:08:00.734234374Z [2024-03-29T03:08:00.734+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:08:00.735244761Z [2024-03-29T03:08:00.734+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:08:00.735257250Z 2024-03-29T03:08:00.735260985Z 2024-03-29T03:08:00.735264415Z 2024-03-29T03:08:00.735267630Z 2024-03-29T03:08:00.739970455Z [2024-03-29T03:08:00.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:08:00.740317022Z [2024-03-29T03:08:00.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:08:00.740819060Z [2024-03-29T03:08:00.740+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:08:00.741142751Z [2024-03-29T03:08:00.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:08:00.741503405Z [2024-03-29T03:08:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:08:00.741666932Z [2024-03-29T03:08:00.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:08:00.742061047Z [2024-03-29T03:08:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:08:00.742199381Z [2024-03-29T03:08:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:08:01.300039033Z [2024-03-29T03:08:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status queued for try_number 1 2024-03-29T03:08:01.300139682Z [2024-03-29T03:08:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:07:00+00:00 exited with status queued for try_number 1 2024-03-29T03:08:01.300263279Z [2024-03-29T03:08:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:07:00+00:00 exited with status queued for try_number 1 2024-03-29T03:08:01.300349559Z [2024-03-29T03:08:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:07:00+00:00 exited with status queued for try_number 1 2024-03-29T03:08:01.327448837Z [2024-03-29T03:08:01.326+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3704562e-7baf-4b5e-bb33-dffe27463f20 2024-03-29T03:08:01.327751059Z [2024-03-29T03:08:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6373e69c-60c1-425b-ac0c-bc62fa097737 2024-03-29T03:08:01.327978208Z [2024-03-29T03:08:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79821d7b-f1d2-413e-bbe6-4fcc314c6f72 2024-03-29T03:08:01.328203478Z [2024-03-29T03:08:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24d4a07f-6942-4396-8b2d-603dd0482cfa 2024-03-29T03:08:02.667500620Z [2024-03-29T03:08:02.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:08:02.668241775Z [2024-03-29T03:08:02.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:06:00+00:00, run_id=scheduled__2024-03-29T03:06:00+00:00, run_start_date=2024-03-29 03:08:00.658322+00:00, run_end_date=2024-03-29 03:08:02.667399+00:00, run_duration=2.009077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:06:00+00:00, data_interval_end=2024-03-29 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:08:02.678541917Z [2024-03-29T03:08:02.678+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:08:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:08:02.688508876Z [2024-03-29T03:08:02.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:08:02.688807618Z [2024-03-29T03:08:02.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:07:00+00:00, run_id=scheduled__2024-03-29T03:07:00+00:00, run_start_date=2024-03-29 03:08:00.659739+00:00, run_end_date=2024-03-29 03:08:02.688302+00:00, run_duration=2.028563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:07:00+00:00, data_interval_end=2024-03-29 03:08:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:08:02.700949015Z [2024-03-29T03:08:02.700+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:08:00+00:00, run_after=2024-03-29T03:09:00+00:00 2024-03-29T03:08:02.775765160Z [2024-03-29T03:08:02.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:06:00+00:00 exited with status success for try_number 1 2024-03-29T03:08:02.776235963Z [2024-03-29T03:08:02.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:07:00+00:00 exited with status success for try_number 1 2024-03-29T03:08:02.787923415Z [2024-03-29T03:08:02.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:07:00+00:00, map_index=-1, run_start_date=2024-03-29 03:08:01.860762+00:00, run_end_date=2024-03-29 03:08:02.475598+00:00, run_duration=0.614836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:08:00.736393+00:00, queued_by_job_id=2, pid=14011 2024-03-29T03:08:02.788711033Z [2024-03-29T03:08:02.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:06:00+00:00, map_index=-1, run_start_date=2024-03-29 03:08:01.627095+00:00, run_end_date=2024-03-29 03:08:02.280025+00:00, run_duration=0.65293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:08:00.736393+00:00, queued_by_job_id=2, pid=14010 2024-03-29T03:08:06.340726930Z [2024-03-29T03:08:06.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:08:06.340975293Z [2024-03-29T03:08:06.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:07:00+00:00, run_id=scheduled__2024-03-29T03:07:00+00:00, run_start_date=2024-03-29 03:08:00.660866+00:00, run_end_date=2024-03-29 03:08:06.340645+00:00, run_duration=5.679779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:07:00+00:00, data_interval_end=2024-03-29 03:08:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:08:06.350559805Z [2024-03-29T03:08:06.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:08:00+00:00, run_after=2024-03-29T03:09:00+00:00 2024-03-29T03:08:06.369425442Z [2024-03-29T03:08:06.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:08:06.369588433Z [2024-03-29T03:08:06.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:07:00+00:00, run_id=scheduled__2024-03-29T03:07:00+00:00, run_start_date=2024-03-29 03:08:00.662732+00:00, run_end_date=2024-03-29 03:08:06.369332+00:00, run_duration=5.7066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:07:00+00:00, data_interval_end=2024-03-29 03:08:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:08:06.387802568Z [2024-03-29T03:08:06.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:08:00+00:00, run_after=2024-03-29T03:09:00+00:00 2024-03-29T03:08:06.423195469Z [2024-03-29T03:08:06.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:07:00+00:00 exited with status success for try_number 1 2024-03-29T03:08:06.423496463Z [2024-03-29T03:08:06.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:07:00+00:00 exited with status success for try_number 1 2024-03-29T03:08:06.435334672Z [2024-03-29T03:08:06.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:07:00+00:00, map_index=-1, run_start_date=2024-03-29 03:08:03.382990+00:00, run_end_date=2024-03-29 03:08:05.399051+00:00, run_duration=2.016061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:08:00.736393+00:00, queued_by_job_id=2, pid=14035 2024-03-29T03:08:06.435674984Z [2024-03-29T03:08:06.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:07:00+00:00, map_index=-1, run_start_date=2024-03-29 03:08:03.218603+00:00, run_end_date=2024-03-29 03:08:05.416946+00:00, run_duration=2.198343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:08:00.736393+00:00, queued_by_job_id=2, pid=14034 2024-03-29T03:08:46.737752243Z [2024-03-29T03:08:46.737+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:09:00.387616442Z [2024-03-29T03:09:00.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:09:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:09:00.397580163Z [2024-03-29T03:09:00.397+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:09:00.416734746Z [2024-03-29T03:09:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:09:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:09:00.492623206Z [2024-03-29T03:09:00.492+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:09:00.492658135Z 2024-03-29T03:09:00.492663429Z 2024-03-29T03:09:00.492668058Z 2024-03-29T03:09:00.493000851Z [2024-03-29T03:09:00.492+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:09:00.493218393Z [2024-03-29T03:09:00.493+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:09:00.493412500Z [2024-03-29T03:09:00.493+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:09:00.494289851Z [2024-03-29T03:09:00.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:09:00.494298641Z 2024-03-29T03:09:00.494302039Z 2024-03-29T03:09:00.494305241Z 2024-03-29T03:09:00.500129658Z [2024-03-29T03:09:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:09:00.500359632Z [2024-03-29T03:09:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:09:00.500886887Z [2024-03-29T03:09:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:09:00.501083623Z [2024-03-29T03:09:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:09:00.501430558Z [2024-03-29T03:09:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:09:00.501585545Z [2024-03-29T03:09:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:09:00.833180960Z [2024-03-29T03:09:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status queued for try_number 1 2024-03-29T03:09:00.833388859Z [2024-03-29T03:09:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status queued for try_number 1 2024-03-29T03:09:00.833542144Z [2024-03-29T03:09:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status queued for try_number 1 2024-03-29T03:09:00.849461536Z [2024-03-29T03:09:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06fbe195-c98a-4c30-a19b-c788cc20f79a 2024-03-29T03:09:00.849671816Z [2024-03-29T03:09:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15365aa2-958a-4a2c-957c-9286d76ac130 2024-03-29T03:09:00.849931003Z [2024-03-29T03:09:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddfe7471-ee52-4c48-a67f-6d4ae0c9566f 2024-03-29T03:09:02.782540021Z [2024-03-29T03:09:02.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:09:02.784981181Z [2024-03-29T03:09:02.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:08:00+00:00, run_id=scheduled__2024-03-29T03:08:00+00:00, run_start_date=2024-03-29 03:09:00.429657+00:00, run_end_date=2024-03-29 03:09:02.782334+00:00, run_duration=2.352677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:08:00+00:00, data_interval_end=2024-03-29 03:09:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:09:02.804223275Z [2024-03-29T03:09:02.803+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:09:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:09:02.921709095Z [2024-03-29T03:09:02.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status success for try_number 1 2024-03-29T03:09:02.942158236Z [2024-03-29T03:09:02.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:08:00+00:00, map_index=-1, run_start_date=2024-03-29 03:09:01.525211+00:00, run_end_date=2024-03-29 03:09:01.995096+00:00, run_duration=0.469885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:09:00.495472+00:00, queued_by_job_id=2, pid=14066 2024-03-29T03:09:05.075014579Z [2024-03-29T03:09:05.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:09:05.075175524Z [2024-03-29T03:09:05.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:08:00+00:00, run_id=scheduled__2024-03-29T03:08:00+00:00, run_start_date=2024-03-29 03:09:00.430910+00:00, run_end_date=2024-03-29 03:09:05.074908+00:00, run_duration=4.643998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:08:00+00:00, data_interval_end=2024-03-29 03:09:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:09:05.084390995Z [2024-03-29T03:09:05.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:09:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:09:05.092301680Z [2024-03-29T03:09:05.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:09:05.092484485Z [2024-03-29T03:09:05.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:08:00+00:00, run_id=scheduled__2024-03-29T03:08:00+00:00, run_start_date=2024-03-29 03:09:00.431950+00:00, run_end_date=2024-03-29 03:09:05.092218+00:00, run_duration=4.660268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:08:00+00:00, data_interval_end=2024-03-29 03:09:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:09:05.101785916Z [2024-03-29T03:09:05.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:09:00+00:00, run_after=2024-03-29T03:10:00+00:00 2024-03-29T03:09:05.133655411Z [2024-03-29T03:09:05.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status success for try_number 1 2024-03-29T03:09:05.133696542Z [2024-03-29T03:09:05.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status success for try_number 1 2024-03-29T03:09:05.143929576Z [2024-03-29T03:09:05.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:08:00+00:00, map_index=-1, run_start_date=2024-03-29 03:09:02.959143+00:00, run_end_date=2024-03-29 03:09:04.397230+00:00, run_duration=1.438087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:09:00.495472+00:00, queued_by_job_id=2, pid=14085 2024-03-29T03:09:05.143952255Z [2024-03-29T03:09:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:08:00+00:00, map_index=-1, run_start_date=2024-03-29 03:09:02.784464+00:00, run_end_date=2024-03-29 03:09:04.592583+00:00, run_duration=1.808119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:09:00.495472+00:00, queued_by_job_id=2, pid=14084 2024-03-29T03:10:00.714358362Z [2024-03-29T03:10:00.713+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:10:00.726524925Z [2024-03-29T03:10:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:11:00+00:00 2024-03-29T03:10:00.742171619Z [2024-03-29T03:10:00.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:11:00+00:00 2024-03-29T03:10:00.755998469Z [2024-03-29T03:10:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:15:00+00:00 2024-03-29T03:10:00.763456133Z [2024-03-29T03:10:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:10:00.864673394Z [2024-03-29T03:10:00.864+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T03:10:00.864698842Z 2024-03-29T03:10:00.864703104Z 2024-03-29T03:10:00.864707068Z 2024-03-29T03:10:00.864715665Z 2024-03-29T03:10:00.864719123Z 2024-03-29T03:10:00.865095467Z [2024-03-29T03:10:00.864+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:10:00.865396862Z [2024-03-29T03:10:00.865+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:10:00.865662896Z [2024-03-29T03:10:00.865+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:10:00.865871451Z [2024-03-29T03:10:00.865+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:10:00.866202415Z [2024-03-29T03:10:00.865+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:10:00.866932294Z [2024-03-29T03:10:00.866+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:10:00.866947253Z 2024-03-29T03:10:00.866951256Z 2024-03-29T03:10:00.866954658Z 2024-03-29T03:10:00.866957948Z 2024-03-29T03:10:00.866960939Z 2024-03-29T03:10:00.872028500Z [2024-03-29T03:10:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:10:00.872321805Z [2024-03-29T03:10:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:10:00.872672409Z [2024-03-29T03:10:00.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:10:00.872946562Z [2024-03-29T03:10:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:10:00.873284876Z [2024-03-29T03:10:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:10:00.873503014Z [2024-03-29T03:10:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:10:00.873821855Z [2024-03-29T03:10:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:10:00.874038142Z [2024-03-29T03:10:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:10:00.874363307Z [2024-03-29T03:10:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:10:00.874584191Z [2024-03-29T03:10:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:10:01.203950779Z [2024-03-29T03:10:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:01.206853567Z [2024-03-29T03:10:01.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:01.207069848Z [2024-03-29T03:10:01.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:09:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:01.207254818Z [2024-03-29T03:10:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:09:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:01.207424667Z [2024-03-29T03:10:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:09:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:01.220436931Z [2024-03-29T03:10:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6843cd1-0e2a-43c1-a98a-398fe92c5f9d 2024-03-29T03:10:01.220767763Z [2024-03-29T03:10:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to efd8dabb-0526-4bb4-aeab-b943f13e24e0 2024-03-29T03:10:01.221117734Z [2024-03-29T03:10:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 577dc35a-6b95-410f-98c5-82dc4e2c9ac2 2024-03-29T03:10:01.221436690Z [2024-03-29T03:10:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 262859ae-b490-4c50-aaa9-9d4d80215bdb 2024-03-29T03:10:01.221653247Z [2024-03-29T03:10:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce105f59-6a39-405c-bdc8-51419b7f4fef 2024-03-29T03:10:03.273998049Z [2024-03-29T03:10:03.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:10:03.274613648Z [2024-03-29T03:10:03.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:08:00+00:00, run_id=scheduled__2024-03-29T03:08:00+00:00, run_start_date=2024-03-29 03:10:00.775156+00:00, run_end_date=2024-03-29 03:10:03.274104+00:00, run_duration=2.498948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:08:00+00:00, data_interval_end=2024-03-29 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:10:03.290659162Z [2024-03-29T03:10:03.290+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:12:00+00:00 2024-03-29T03:10:03.300778554Z [2024-03-29T03:10:03.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:10:03.301115699Z [2024-03-29T03:10:03.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:09:00+00:00, run_id=scheduled__2024-03-29T03:09:00+00:00, run_start_date=2024-03-29 03:10:00.776852+00:00, run_end_date=2024-03-29 03:10:03.300680+00:00, run_duration=2.523828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:09:00+00:00, data_interval_end=2024-03-29 03:10:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:10:03.315193987Z [2024-03-29T03:10:03.314+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:11:00+00:00 2024-03-29T03:10:03.368999142Z [2024-03-29T03:10:03.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:08:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:03.369134568Z [2024-03-29T03:10:03.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:09:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:03.376565951Z [2024-03-29T03:10:03.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:09:00+00:00, map_index=-1, run_start_date=2024-03-29 03:10:01.940776+00:00, run_end_date=2024-03-29 03:10:02.515526+00:00, run_duration=0.57475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:00.868720+00:00, queued_by_job_id=2, pid=14119 2024-03-29T03:10:03.377986849Z [2024-03-29T03:10:03.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:08:00+00:00, map_index=-1, run_start_date=2024-03-29 03:10:02.222258+00:00, run_end_date=2024-03-29 03:10:02.750756+00:00, run_duration=0.528498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:00.868720+00:00, queued_by_job_id=2, pid=14120 2024-03-29T03:10:04.530786851Z [2024-03-29T03:10:04.530+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:10:04.530830205Z 2024-03-29T03:10:04.531218481Z [2024-03-29T03:10:04.530+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:10:04.532271226Z [2024-03-29T03:10:04.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:10:04.532311133Z 2024-03-29T03:10:04.544721426Z [2024-03-29T03:10:04.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:10:04.545344186Z [2024-03-29T03:10:04.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:10:04.638397430Z [2024-03-29T03:10:04.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:04.638872446Z [2024-03-29T03:10:04.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:04.647390448Z [2024-03-29T03:10:04.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7a0fb24-701a-44bf-9043-8d99765f9d32 2024-03-29T03:10:04.647867859Z [2024-03-29T03:10:04.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:05:00+00:00, map_index=-1, run_start_date=2024-03-29 03:10:03.971021+00:00, run_end_date=2024-03-29 03:10:04.405481+00:00, run_duration=0.43446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:00.868720+00:00, queued_by_job_id=2, pid=14145 2024-03-29T03:10:05.877466150Z [2024-03-29T03:10:05.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:10:05.878210179Z [2024-03-29T03:10:05.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:09:00+00:00, run_id=scheduled__2024-03-29T03:09:00+00:00, run_start_date=2024-03-29 03:10:00.777971+00:00, run_end_date=2024-03-29 03:10:05.877402+00:00, run_duration=5.099431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:09:00+00:00, data_interval_end=2024-03-29 03:10:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:10:05.929010058Z [2024-03-29T03:10:05.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:11:00+00:00 2024-03-29T03:10:05.963214417Z [2024-03-29T03:10:05.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:10:05.963582282Z [2024-03-29T03:10:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:09:00+00:00, run_id=scheduled__2024-03-29T03:09:00+00:00, run_start_date=2024-03-29 03:10:00.779047+00:00, run_end_date=2024-03-29 03:10:05.963113+00:00, run_duration=5.184066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:09:00+00:00, data_interval_end=2024-03-29 03:10:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:10:05.992152198Z [2024-03-29T03:10:05.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:11:00+00:00 2024-03-29T03:10:06.926532482Z [2024-03-29T03:10:06.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:09:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:06.926753123Z [2024-03-29T03:10:06.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:09:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:06.936124293Z [2024-03-29T03:10:06.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:09:00+00:00, map_index=-1, run_start_date=2024-03-29 03:10:04.274246+00:00, run_end_date=2024-03-29 03:10:05.750902+00:00, run_duration=1.476656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:00.868720+00:00, queued_by_job_id=2, pid=14156 2024-03-29T03:10:06.936456603Z [2024-03-29T03:10:06.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:09:00+00:00, map_index=-1, run_start_date=2024-03-29 03:10:03.817333+00:00, run_end_date=2024-03-29 03:10:05.728162+00:00, run_duration=1.910829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:00.868720+00:00, queued_by_job_id=2, pid=14144 2024-03-29T03:10:08.024429133Z [2024-03-29T03:10:08.024+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:10:08.024460957Z 2024-03-29T03:10:08.024665070Z [2024-03-29T03:10:08.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:10:08.025356262Z [2024-03-29T03:10:08.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:10:08.025374365Z 2024-03-29T03:10:08.027860007Z [2024-03-29T03:10:08.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:10:08.028046923Z [2024-03-29T03:10:08.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:10:08.085785582Z [2024-03-29T03:10:08.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:08.085975221Z [2024-03-29T03:10:08.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:08.091584159Z [2024-03-29T03:10:08.091+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea127c3f-b97b-48ee-972b-d72d9cf0a3b3 2024-03-29T03:10:08.092032739Z [2024-03-29T03:10:08.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:05:00+00:00, map_index=-1, run_start_date=2024-03-29 03:10:07.037082+00:00, run_end_date=2024-03-29 03:10:07.578064+00:00, run_duration=0.540982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:04.535478+00:00, queued_by_job_id=2, pid=14174 2024-03-29T03:10:11.390863402Z [2024-03-29T03:10:11.390+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:10:11.390890425Z 2024-03-29T03:10:11.390927273Z [2024-03-29T03:10:11.390+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:10:11.391701244Z [2024-03-29T03:10:11.391+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:10:11.391719449Z 2024-03-29T03:10:11.394057110Z [2024-03-29T03:10:11.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:10:11.394176670Z [2024-03-29T03:10:11.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:10:11.440657542Z [2024-03-29T03:10:11.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status queued for try_number 1 2024-03-29T03:10:11.440897587Z [2024-03-29T03:10:11.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:11.447465806Z [2024-03-29T03:10:11.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca2a377e-36c8-4a86-b7af-e3c4412d6073 2024-03-29T03:10:11.449114059Z [2024-03-29T03:10:11.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:05:00+00:00, map_index=0, run_start_date=2024-03-29 03:10:09.849373+00:00, run_end_date=2024-03-29 03:10:11.032450+00:00, run_duration=1.183077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:08.025825+00:00, queued_by_job_id=2, pid=14182 2024-03-29T03:10:14.203118889Z [2024-03-29T03:10:14.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:10:14.203614665Z [2024-03-29T03:10:14.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:05:00+00:00, run_id=scheduled__2024-03-29T03:05:00+00:00, run_start_date=2024-03-29 03:10:00.773846+00:00, run_end_date=2024-03-29 03:10:14.203036+00:00, run_duration=13.42919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:05:00+00:00, data_interval_end=2024-03-29 03:10:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:10:14.220931283Z [2024-03-29T03:10:14.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:10:00+00:00, run_after=2024-03-29T03:15:00+00:00 2024-03-29T03:10:14.267661665Z [2024-03-29T03:10:14.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:05:00+00:00 exited with status success for try_number 1 2024-03-29T03:10:14.275580406Z [2024-03-29T03:10:14.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:05:00+00:00, map_index=-1, run_start_date=2024-03-29 03:10:12.999127+00:00, run_end_date=2024-03-29 03:10:13.387943+00:00, run_duration=0.388816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:10:11.392014+00:00, queued_by_job_id=2, pid=14195 2024-03-29T03:11:00.808280814Z [2024-03-29T03:11:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:11:00+00:00, run_after=2024-03-29T03:12:00+00:00 2024-03-29T03:11:00.821697162Z [2024-03-29T03:11:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:11:00+00:00, run_after=2024-03-29T03:12:00+00:00 2024-03-29T03:11:00.829363238Z [2024-03-29T03:11:00.828+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:11:00.905687413Z [2024-03-29T03:11:00.905+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:11:00.905724279Z 2024-03-29T03:11:00.905729857Z 2024-03-29T03:11:00.905734620Z 2024-03-29T03:11:00.905821017Z [2024-03-29T03:11:00.905+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:11:00.905995112Z [2024-03-29T03:11:00.905+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:11:00.906105423Z [2024-03-29T03:11:00.905+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:11:00.906954068Z [2024-03-29T03:11:00.906+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:11:00.906970677Z 2024-03-29T03:11:00.906977683Z 2024-03-29T03:11:00.906983796Z 2024-03-29T03:11:00.910758930Z [2024-03-29T03:11:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:11:00.910958731Z [2024-03-29T03:11:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:11:00.911270698Z [2024-03-29T03:11:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:11:00.911561240Z [2024-03-29T03:11:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:11:00.911759000Z [2024-03-29T03:11:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:11:00.912154225Z [2024-03-29T03:11:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:11:01.219317725Z [2024-03-29T03:11:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:11:01.219577107Z [2024-03-29T03:11:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:11:01.219722575Z [2024-03-29T03:11:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:11:01.227934544Z [2024-03-29T03:11:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to da032306-4774-4493-b875-2d9b41ed417a 2024-03-29T03:11:01.228071388Z [2024-03-29T03:11:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc95c699-074f-454f-a217-5bbc7d41fa89 2024-03-29T03:11:01.228246222Z [2024-03-29T03:11:01.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80b145eb-efc6-4d29-9704-3432857f19fc 2024-03-29T03:11:02.408736707Z [2024-03-29T03:11:02.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:11:02.413636257Z [2024-03-29T03:11:02.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:10:00+00:00, run_id=scheduled__2024-03-29T03:10:00+00:00, run_start_date=2024-03-29 03:11:00.847956+00:00, run_end_date=2024-03-29 03:11:02.408584+00:00, run_duration=1.560628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:10:00+00:00, data_interval_end=2024-03-29 03:11:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:11:02.429934397Z [2024-03-29T03:11:02.429+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:11:00+00:00, run_after=2024-03-29T03:12:00+00:00 2024-03-29T03:11:02.743621717Z [2024-03-29T03:11:02.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:11:02.755444128Z [2024-03-29T03:11:02.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=-1, run_start_date=2024-03-29 03:11:01.879857+00:00, run_end_date=2024-03-29 03:11:02.383503+00:00, run_duration=0.503646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:11:00.907680+00:00, queued_by_job_id=2, pid=14217 2024-03-29T03:11:06.042042879Z [2024-03-29T03:11:06.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:11:06.042670660Z [2024-03-29T03:11:06.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:10:00+00:00, run_id=scheduled__2024-03-29T03:10:00+00:00, run_start_date=2024-03-29 03:11:00.849878+00:00, run_end_date=2024-03-29 03:11:06.041947+00:00, run_duration=5.192069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:10:00+00:00, data_interval_end=2024-03-29 03:11:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:11:06.061840658Z [2024-03-29T03:11:06.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:11:00+00:00, run_after=2024-03-29T03:12:00+00:00 2024-03-29T03:11:06.070091725Z [2024-03-29T03:11:06.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:11:06.070524195Z [2024-03-29T03:11:06.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:10:00+00:00, run_id=scheduled__2024-03-29T03:10:00+00:00, run_start_date=2024-03-29 03:11:00.851257+00:00, run_end_date=2024-03-29 03:11:06.069977+00:00, run_duration=5.21872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:10:00+00:00, data_interval_end=2024-03-29 03:11:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:11:06.081773107Z [2024-03-29T03:11:06.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:11:00+00:00, run_after=2024-03-29T03:12:00+00:00 2024-03-29T03:11:06.117356676Z [2024-03-29T03:11:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:11:06.117381215Z [2024-03-29T03:11:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:11:06.123761614Z [2024-03-29T03:11:06.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=-1, run_start_date=2024-03-29 03:11:02.904728+00:00, run_end_date=2024-03-29 03:11:05.199443+00:00, run_duration=2.294715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:11:00.907680+00:00, queued_by_job_id=2, pid=14235 2024-03-29T03:11:06.124017635Z [2024-03-29T03:11:06.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=-1, run_start_date=2024-03-29 03:11:02.906385+00:00, run_end_date=2024-03-29 03:11:05.677103+00:00, run_duration=2.770718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:11:00.907680+00:00, queued_by_job_id=2, pid=14236 2024-03-29T03:11:54.494229710Z [2024-03-29T03:11:54.493+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:11:54.494268707Z 2024-03-29T03:11:54.494410307Z [2024-03-29T03:11:54.494+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-03-29T03:11:54.495186569Z [2024-03-29T03:11:54.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:11:54.495201820Z 2024-03-29T03:11:54.497692437Z [2024-03-29T03:11:54.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240329031153_387322', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:11:54.497935815Z [2024-03-29T03:11:54.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240329031153_387322', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-29T03:11:54.542686513Z [2024-03-29T03:11:54.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240329031153_387322 exited with status queued for try_number 1 2024-03-29T03:11:54.548474626Z [2024-03-29T03:11:54.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26d18ce6-44c8-4b89-98de-b2a32c8439de 2024-03-29T03:11:55.674978744Z [2024-03-29T03:11:55.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:11:55.675261440Z [2024-03-29T03:11:55.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-03-29 03:11:53.980047+00:00, run_id=scaleout_vdu_20240329031153_387322, run_start_date=2024-03-29 03:11:54.449005+00:00, run_end_date=2024-03-29 03:11:55.674901+00:00, run_duration=1.225896, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-29 03:11:53.980047+00:00, data_interval_end=2024-03-29 03:11:53.980047+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-03-29T03:11:55.678933563Z [2024-03-29T03:11:55.678+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-03-29T03:11:56.640648518Z [2024-03-29T03:11:56.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240329031153_387322 exited with status success for try_number 1 2024-03-29T03:11:56.650838142Z [2024-03-29T03:11:56.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240329031153_387322, map_index=-1, run_start_date=2024-03-29 03:11:55.287729+00:00, run_end_date=2024-03-29 03:11:55.628265+00:00, run_duration=0.340536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:11:54.495526+00:00, queued_by_job_id=2, pid=14262 2024-03-29T03:12:00.582175182Z [2024-03-29T03:12:00.581+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:12:00+00:00, run_after=2024-03-29T03:13:00+00:00 2024-03-29T03:12:00.591698910Z [2024-03-29T03:12:00.591+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:12:00.606530587Z [2024-03-29T03:12:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:12:00+00:00, run_after=2024-03-29T03:13:00+00:00 2024-03-29T03:12:00.617303664Z [2024-03-29T03:12:00.616+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:12:00.735856773Z [2024-03-29T03:12:00.735+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:12:00.735886977Z 2024-03-29T03:12:00.735891376Z 2024-03-29T03:12:00.735894860Z 2024-03-29T03:12:00.735898373Z 2024-03-29T03:12:00.735929398Z [2024-03-29T03:12:00.735+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:12:00.736087952Z [2024-03-29T03:12:00.735+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:12:00.736390913Z [2024-03-29T03:12:00.736+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:12:00.736678160Z [2024-03-29T03:12:00.736+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:12:00.737667891Z [2024-03-29T03:12:00.737+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:12:00.737682334Z 2024-03-29T03:12:00.737685988Z 2024-03-29T03:12:00.737689389Z 2024-03-29T03:12:00.737692860Z 2024-03-29T03:12:00.741908143Z [2024-03-29T03:12:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:12:00.742092482Z [2024-03-29T03:12:00.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:12:00.742358659Z [2024-03-29T03:12:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:12:00.742561434Z [2024-03-29T03:12:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:12:00.742807178Z [2024-03-29T03:12:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:12:00.742913779Z [2024-03-29T03:12:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:12:00.743144477Z [2024-03-29T03:12:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:12:00.743402033Z [2024-03-29T03:12:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:12:01.188378286Z [2024-03-29T03:12:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:12:01.188661223Z [2024-03-29T03:12:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:11:00+00:00 exited with status queued for try_number 1 2024-03-29T03:12:01.188876276Z [2024-03-29T03:12:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:11:00+00:00 exited with status queued for try_number 1 2024-03-29T03:12:01.189064436Z [2024-03-29T03:12:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:11:00+00:00 exited with status queued for try_number 1 2024-03-29T03:12:01.203219415Z [2024-03-29T03:12:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88861309-88d8-418c-aeff-313a8be806c1 2024-03-29T03:12:01.203551926Z [2024-03-29T03:12:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac764b69-cbb6-424b-b2a6-2ba2ca6ad2cf 2024-03-29T03:12:01.203787737Z [2024-03-29T03:12:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to d697812e-cb5c-4014-9de0-45150c96d097 2024-03-29T03:12:01.204044132Z [2024-03-29T03:12:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to b860fd05-6e1b-48e0-b6c6-6982556e8d35 2024-03-29T03:12:02.565476044Z [2024-03-29T03:12:02.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:12:02.565512411Z [2024-03-29T03:12:02.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:10:00+00:00, run_id=scheduled__2024-03-29T03:10:00+00:00, run_start_date=2024-03-29 03:12:00.632273+00:00, run_end_date=2024-03-29 03:12:02.565092+00:00, run_duration=1.932819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:10:00+00:00, data_interval_end=2024-03-29 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:12:02.575984186Z [2024-03-29T03:12:02.575+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:12:00+00:00, run_after=2024-03-29T03:14:00+00:00 2024-03-29T03:12:02.586139872Z [2024-03-29T03:12:02.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:12:02.586290067Z [2024-03-29T03:12:02.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:11:00+00:00, run_id=scheduled__2024-03-29T03:11:00+00:00, run_start_date=2024-03-29 03:12:00.634152+00:00, run_end_date=2024-03-29 03:12:02.586014+00:00, run_duration=1.951862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:11:00+00:00, data_interval_end=2024-03-29 03:12:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:12:02.598069071Z [2024-03-29T03:12:02.597+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:12:00+00:00, run_after=2024-03-29T03:13:00+00:00 2024-03-29T03:12:02.652056853Z [2024-03-29T03:12:02.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:12:02.663831359Z [2024-03-29T03:12:02.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=-1, run_start_date=2024-03-29 03:12:01.671637+00:00, run_end_date=2024-03-29 03:12:02.378871+00:00, run_duration=0.707234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:12:00.738727+00:00, queued_by_job_id=2, pid=14278 2024-03-29T03:12:02.771083815Z [2024-03-29T03:12:02.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:11:00+00:00 exited with status success for try_number 1 2024-03-29T03:12:02.776173911Z [2024-03-29T03:12:02.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:11:00+00:00, map_index=-1, run_start_date=2024-03-29 03:12:01.876517+00:00, run_end_date=2024-03-29 03:12:02.503947+00:00, run_duration=0.62743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:12:00.738727+00:00, queued_by_job_id=2, pid=14279 2024-03-29T03:12:06.787894830Z [2024-03-29T03:12:06.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:12:06.788043128Z [2024-03-29T03:12:06.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:11:00+00:00, run_id=scheduled__2024-03-29T03:11:00+00:00, run_start_date=2024-03-29 03:12:00.635872+00:00, run_end_date=2024-03-29 03:12:06.787780+00:00, run_duration=6.151908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:11:00+00:00, data_interval_end=2024-03-29 03:12:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:12:06.801356180Z [2024-03-29T03:12:06.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:12:00+00:00, run_after=2024-03-29T03:13:00+00:00 2024-03-29T03:12:06.853570239Z [2024-03-29T03:12:06.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:11:00+00:00 exited with status success for try_number 1 2024-03-29T03:12:06.859831437Z [2024-03-29T03:12:06.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:11:00+00:00, map_index=-1, run_start_date=2024-03-29 03:12:03.184548+00:00, run_end_date=2024-03-29 03:12:05.847693+00:00, run_duration=2.663145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:12:00.738727+00:00, queued_by_job_id=2, pid=14302 2024-03-29T03:12:07.943852531Z [2024-03-29T03:12:07.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:12:07.943925745Z [2024-03-29T03:12:07.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:11:00+00:00, run_id=scheduled__2024-03-29T03:11:00+00:00, run_start_date=2024-03-29 03:12:00.637517+00:00, run_end_date=2024-03-29 03:12:07.942731+00:00, run_duration=7.305214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:11:00+00:00, data_interval_end=2024-03-29 03:12:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:12:07.970040115Z [2024-03-29T03:12:07.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:12:00+00:00, run_after=2024-03-29T03:13:00+00:00 2024-03-29T03:12:07.984100856Z [2024-03-29T03:12:07.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:11:00+00:00 exited with status success for try_number 1 2024-03-29T03:12:07.990024736Z [2024-03-29T03:12:07.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:11:00+00:00, map_index=-1, run_start_date=2024-03-29 03:12:03.459923+00:00, run_end_date=2024-03-29 03:12:06.586288+00:00, run_duration=3.126365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:12:00.738727+00:00, queued_by_job_id=2, pid=14303 2024-03-29T03:13:00.410324984Z [2024-03-29T03:13:00.409+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:13:00.439861371Z [2024-03-29T03:13:00.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:13:00+00:00, run_after=2024-03-29T03:14:00+00:00 2024-03-29T03:13:00.465786623Z [2024-03-29T03:13:00.465+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:13:00+00:00, run_after=2024-03-29T03:14:00+00:00 2024-03-29T03:13:00.557025255Z [2024-03-29T03:13:00.556+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:13:00.557057051Z 2024-03-29T03:13:00.557062247Z 2024-03-29T03:13:00.557066559Z 2024-03-29T03:13:00.557627263Z [2024-03-29T03:13:00.557+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:13:00.558000569Z [2024-03-29T03:13:00.557+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:13:00.558328567Z [2024-03-29T03:13:00.558+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:13:00.559588526Z [2024-03-29T03:13:00.559+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:13:00.559619595Z 2024-03-29T03:13:00.559632200Z 2024-03-29T03:13:00.559642989Z 2024-03-29T03:13:00.564424966Z [2024-03-29T03:13:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:13:00.564649403Z [2024-03-29T03:13:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:13:00.564995565Z [2024-03-29T03:13:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:13:00.565175346Z [2024-03-29T03:13:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:13:00.565483202Z [2024-03-29T03:13:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:13:00.565734443Z [2024-03-29T03:13:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:13:00.853996205Z [2024-03-29T03:13:00.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status queued for try_number 1 2024-03-29T03:13:00.854097437Z [2024-03-29T03:13:00.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status queued for try_number 1 2024-03-29T03:13:00.854240859Z [2024-03-29T03:13:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status queued for try_number 1 2024-03-29T03:13:00.868544148Z [2024-03-29T03:13:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23dfd90e-3ff3-40ef-b76f-c079a69066dd 2024-03-29T03:13:00.868637008Z [2024-03-29T03:13:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9400d0b-c329-45d1-badd-235698cfce1e 2024-03-29T03:13:00.868805817Z [2024-03-29T03:13:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90ab472b-0e55-457e-b0a1-7edc2d672e97 2024-03-29T03:13:02.052742058Z [2024-03-29T03:13:02.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:13:02.053014699Z [2024-03-29T03:13:02.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:12:00+00:00, run_id=scheduled__2024-03-29T03:12:00+00:00, run_start_date=2024-03-29 03:13:00.486777+00:00, run_end_date=2024-03-29 03:13:02.052659+00:00, run_duration=1.565882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:12:00+00:00, data_interval_end=2024-03-29 03:13:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:13:02.064537932Z [2024-03-29T03:13:02.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:13:00+00:00, run_after=2024-03-29T03:14:00+00:00 2024-03-29T03:13:02.120422865Z [2024-03-29T03:13:02.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status success for try_number 1 2024-03-29T03:13:02.127997577Z [2024-03-29T03:13:02.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:12:00+00:00, map_index=-1, run_start_date=2024-03-29 03:13:01.467456+00:00, run_end_date=2024-03-29 03:13:01.938672+00:00, run_duration=0.471216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:13:00.560973+00:00, queued_by_job_id=2, pid=14336 2024-03-29T03:13:04.438248271Z [2024-03-29T03:13:04.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:13:04.438602762Z [2024-03-29T03:13:04.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:12:00+00:00, run_id=scheduled__2024-03-29T03:12:00+00:00, run_start_date=2024-03-29 03:13:00.488454+00:00, run_end_date=2024-03-29 03:13:04.438156+00:00, run_duration=3.949702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:12:00+00:00, data_interval_end=2024-03-29 03:13:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:13:04.448587470Z [2024-03-29T03:13:04.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:13:00+00:00, run_after=2024-03-29T03:14:00+00:00 2024-03-29T03:13:05.569659040Z [2024-03-29T03:13:05.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:13:05.570886989Z [2024-03-29T03:13:05.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:12:00+00:00, run_id=scheduled__2024-03-29T03:12:00+00:00, run_start_date=2024-03-29 03:13:00.490110+00:00, run_end_date=2024-03-29 03:13:05.570104+00:00, run_duration=5.079994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:12:00+00:00, data_interval_end=2024-03-29 03:13:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:13:05.585674973Z [2024-03-29T03:13:05.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:13:00+00:00, run_after=2024-03-29T03:14:00+00:00 2024-03-29T03:13:05.714676987Z [2024-03-29T03:13:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status success for try_number 1 2024-03-29T03:13:05.714708108Z [2024-03-29T03:13:05.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status success for try_number 1 2024-03-29T03:13:05.760511936Z [2024-03-29T03:13:05.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:12:00+00:00, map_index=-1, run_start_date=2024-03-29 03:13:02.748870+00:00, run_end_date=2024-03-29 03:13:04.340562+00:00, run_duration=1.591692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:13:00.560973+00:00, queued_by_job_id=2, pid=14355 2024-03-29T03:13:05.760786139Z [2024-03-29T03:13:05.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:12:00+00:00, map_index=-1, run_start_date=2024-03-29 03:13:02.642315+00:00, run_end_date=2024-03-29 03:13:04.691988+00:00, run_duration=2.049673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:13:00.560973+00:00, queued_by_job_id=2, pid=14354 2024-03-29T03:13:46.796682290Z [2024-03-29T03:13:46.796+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:14:00.282879299Z [2024-03-29T03:14:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:14:00+00:00, run_after=2024-03-29T03:15:00+00:00 2024-03-29T03:14:00.301817867Z [2024-03-29T03:14:00.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:14:00+00:00, run_after=2024-03-29T03:15:00+00:00 2024-03-29T03:14:00.311290144Z [2024-03-29T03:14:00.310+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:14:00.318645754Z [2024-03-29T03:14:00.318+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:14:00.425979787Z [2024-03-29T03:14:00.425+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:14:00.426016537Z 2024-03-29T03:14:00.426023510Z 2024-03-29T03:14:00.426029568Z 2024-03-29T03:14:00.426035396Z 2024-03-29T03:14:00.426317452Z [2024-03-29T03:14:00.425+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:14:00.426646687Z [2024-03-29T03:14:00.426+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:14:00.426959344Z [2024-03-29T03:14:00.426+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:14:00.427204958Z [2024-03-29T03:14:00.426+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:14:00.428456324Z [2024-03-29T03:14:00.428+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:14:00.428489481Z 2024-03-29T03:14:00.428495818Z 2024-03-29T03:14:00.428502198Z 2024-03-29T03:14:00.428531072Z 2024-03-29T03:14:00.436723241Z [2024-03-29T03:14:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:14:00.436868463Z [2024-03-29T03:14:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:14:00.437256644Z [2024-03-29T03:14:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:14:00.437490184Z [2024-03-29T03:14:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:14:00.437896927Z [2024-03-29T03:14:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:14:00.438154341Z [2024-03-29T03:14:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:14:00.438590429Z [2024-03-29T03:14:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:14:00.438800050Z [2024-03-29T03:14:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:14:00.752404958Z [2024-03-29T03:14:00.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status queued for try_number 1 2024-03-29T03:14:00.752513606Z [2024-03-29T03:14:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:13:00+00:00 exited with status queued for try_number 1 2024-03-29T03:14:00.752866723Z [2024-03-29T03:14:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:13:00+00:00 exited with status queued for try_number 1 2024-03-29T03:14:00.753076275Z [2024-03-29T03:14:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:13:00+00:00 exited with status queued for try_number 1 2024-03-29T03:14:00.772140728Z [2024-03-29T03:14:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8bb8e65-a62f-42d9-b35c-8388940b4b96 2024-03-29T03:14:00.772895859Z [2024-03-29T03:14:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 991bbb77-c9bd-425c-b8b7-db7be6bd11cb 2024-03-29T03:14:00.773245753Z [2024-03-29T03:14:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa4abeb4-ce2d-4077-81fb-7c97a4c45434 2024-03-29T03:14:00.773650014Z [2024-03-29T03:14:00.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20d968c1-9906-4feb-88ee-408d6998be09 2024-03-29T03:14:02.153700381Z [2024-03-29T03:14:02.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:14:02.154413180Z [2024-03-29T03:14:02.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:12:00+00:00, run_id=scheduled__2024-03-29T03:12:00+00:00, run_start_date=2024-03-29 03:14:00.333267+00:00, run_end_date=2024-03-29 03:14:02.153605+00:00, run_duration=1.820338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:12:00+00:00, data_interval_end=2024-03-29 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:14:02.167226144Z [2024-03-29T03:14:02.166+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:14:00+00:00, run_after=2024-03-29T03:16:00+00:00 2024-03-29T03:14:02.179092328Z [2024-03-29T03:14:02.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:14:02.179732153Z [2024-03-29T03:14:02.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:13:00+00:00, run_id=scheduled__2024-03-29T03:13:00+00:00, run_start_date=2024-03-29 03:14:00.336267+00:00, run_end_date=2024-03-29 03:14:02.179181+00:00, run_duration=1.842914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:13:00+00:00, data_interval_end=2024-03-29 03:14:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:14:02.193350894Z [2024-03-29T03:14:02.192+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:14:00+00:00, run_after=2024-03-29T03:15:00+00:00 2024-03-29T03:14:02.258549956Z [2024-03-29T03:14:02.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:12:00+00:00 exited with status success for try_number 1 2024-03-29T03:14:02.265410855Z [2024-03-29T03:14:02.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:12:00+00:00, map_index=-1, run_start_date=2024-03-29 03:14:01.283530+00:00, run_end_date=2024-03-29 03:14:01.731680+00:00, run_duration=0.44815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:14:00.431817+00:00, queued_by_job_id=2, pid=14388 2024-03-29T03:14:03.315723397Z [2024-03-29T03:14:03.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:13:00+00:00 exited with status success for try_number 1 2024-03-29T03:14:03.321666695Z [2024-03-29T03:14:03.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:13:00+00:00, map_index=-1, run_start_date=2024-03-29 03:14:01.564616+00:00, run_end_date=2024-03-29 03:14:02.079748+00:00, run_duration=0.515132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:14:00.431817+00:00, queued_by_job_id=2, pid=14389 2024-03-29T03:14:05.472271142Z [2024-03-29T03:14:05.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:14:05.472686369Z [2024-03-29T03:14:05.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:13:00+00:00, run_id=scheduled__2024-03-29T03:13:00+00:00, run_start_date=2024-03-29 03:14:00.338697+00:00, run_end_date=2024-03-29 03:14:05.472351+00:00, run_duration=5.133654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:13:00+00:00, data_interval_end=2024-03-29 03:14:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:14:05.482635666Z [2024-03-29T03:14:05.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:14:00+00:00, run_after=2024-03-29T03:15:00+00:00 2024-03-29T03:14:05.552981085Z [2024-03-29T03:14:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:13:00+00:00 exited with status success for try_number 1 2024-03-29T03:14:05.559298011Z [2024-03-29T03:14:05.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:13:00+00:00, map_index=-1, run_start_date=2024-03-29 03:14:02.770227+00:00, run_end_date=2024-03-29 03:14:04.534002+00:00, run_duration=1.763775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:14:00.431817+00:00, queued_by_job_id=2, pid=14412 2024-03-29T03:14:05.861473607Z [2024-03-29T03:14:05.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:14:05.861497036Z [2024-03-29T03:14:05.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:13:00+00:00, run_id=scheduled__2024-03-29T03:13:00+00:00, run_start_date=2024-03-29 03:14:00.340940+00:00, run_end_date=2024-03-29 03:14:05.860850+00:00, run_duration=5.51991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:13:00+00:00, data_interval_end=2024-03-29 03:14:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:14:05.870030094Z [2024-03-29T03:14:05.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:14:00+00:00, run_after=2024-03-29T03:15:00+00:00 2024-03-29T03:14:05.898765320Z [2024-03-29T03:14:05.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:13:00+00:00 exited with status success for try_number 1 2024-03-29T03:14:05.903501896Z [2024-03-29T03:14:05.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:13:00+00:00, map_index=-1, run_start_date=2024-03-29 03:14:02.795126+00:00, run_end_date=2024-03-29 03:14:05.504855+00:00, run_duration=2.709729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:14:00.431817+00:00, queued_by_job_id=2, pid=14413 2024-03-29T03:15:00.099914901Z [2024-03-29T03:15:00.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:15:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:15:00.112476393Z [2024-03-29T03:15:00.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:15:00+00:00, run_after=2024-03-29T03:16:00+00:00 2024-03-29T03:15:00.125625373Z [2024-03-29T03:15:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:15:00+00:00, run_after=2024-03-29T03:16:00+00:00 2024-03-29T03:15:00.133010039Z [2024-03-29T03:15:00.132+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:15:00.231135760Z [2024-03-29T03:15:00.230+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:15:00.231195619Z 2024-03-29T03:15:00.231203145Z 2024-03-29T03:15:00.231208486Z 2024-03-29T03:15:00.231218360Z 2024-03-29T03:15:00.231264813Z [2024-03-29T03:15:00.230+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:15:00.231458966Z [2024-03-29T03:15:00.231+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:15:00.231601395Z [2024-03-29T03:15:00.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:15:00.231745828Z [2024-03-29T03:15:00.231+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:15:00.232364923Z [2024-03-29T03:15:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:15:00.232375990Z 2024-03-29T03:15:00.232380130Z 2024-03-29T03:15:00.232399090Z 2024-03-29T03:15:00.232402368Z 2024-03-29T03:15:00.236390855Z [2024-03-29T03:15:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:15:00.236528434Z [2024-03-29T03:15:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:15:00.236788280Z [2024-03-29T03:15:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:15:00.236961541Z [2024-03-29T03:15:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:15:00.237200165Z [2024-03-29T03:15:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:15:00.237376003Z [2024-03-29T03:15:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:15:00.237826338Z [2024-03-29T03:15:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:15:00.238022065Z [2024-03-29T03:15:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:15:00.672113113Z [2024-03-29T03:15:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:15:00.672389409Z [2024-03-29T03:15:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status queued for try_number 1 2024-03-29T03:15:00.672615758Z [2024-03-29T03:15:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status queued for try_number 1 2024-03-29T03:15:00.672872192Z [2024-03-29T03:15:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status queued for try_number 1 2024-03-29T03:15:00.697850801Z [2024-03-29T03:15:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6a451ff-3669-4dc8-b5f9-b571e8743d93 2024-03-29T03:15:00.698027887Z [2024-03-29T03:15:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to f91e2baa-70c7-41ae-a78e-edd6ec1a995a 2024-03-29T03:15:00.698193507Z [2024-03-29T03:15:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d43432c-9bca-481e-9cd1-c48c990d92f6 2024-03-29T03:15:00.698354373Z [2024-03-29T03:15:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c1cafd0-2c0a-4ca5-8fb3-a4504a444abb 2024-03-29T03:15:03.016228601Z [2024-03-29T03:15:03.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:15:03.016678517Z [2024-03-29T03:15:03.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:14:00+00:00, run_id=scheduled__2024-03-29T03:14:00+00:00, run_start_date=2024-03-29 03:15:00.144393+00:00, run_end_date=2024-03-29 03:15:03.016171+00:00, run_duration=2.871778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:14:00+00:00, data_interval_end=2024-03-29 03:15:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:15:03.028454448Z [2024-03-29T03:15:03.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:15:00+00:00, run_after=2024-03-29T03:16:00+00:00 2024-03-29T03:15:03.131020786Z [2024-03-29T03:15:03.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status success for try_number 1 2024-03-29T03:15:03.141932047Z [2024-03-29T03:15:03.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:14:00+00:00, map_index=-1, run_start_date=2024-03-29 03:15:01.957390+00:00, run_end_date=2024-03-29 03:15:02.632798+00:00, run_duration=0.675408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:15:00.233262+00:00, queued_by_job_id=2, pid=14448 2024-03-29T03:15:03.726014485Z [2024-03-29T03:15:03.725+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:15:03.726046599Z 2024-03-29T03:15:03.726254900Z [2024-03-29T03:15:03.726+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:15:03.727374937Z [2024-03-29T03:15:03.726+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:15:03.727391496Z 2024-03-29T03:15:03.730418075Z [2024-03-29T03:15:03.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:15:03.730769804Z [2024-03-29T03:15:03.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:15:03.817956693Z [2024-03-29T03:15:03.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:15:03.818171341Z [2024-03-29T03:15:03.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:15:03.829555611Z [2024-03-29T03:15:03.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3adf23a-e269-4870-9170-50dc4f8b665e 2024-03-29T03:15:03.830201638Z [2024-03-29T03:15:03.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=-1, run_start_date=2024-03-29 03:15:03.106879+00:00, run_end_date=2024-03-29 03:15:03.552729+00:00, run_duration=0.44585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:15:00.233262+00:00, queued_by_job_id=2, pid=14461 2024-03-29T03:15:06.229218716Z [2024-03-29T03:15:06.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:15:06.229589794Z [2024-03-29T03:15:06.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:14:00+00:00, run_id=scheduled__2024-03-29T03:14:00+00:00, run_start_date=2024-03-29 03:15:00.147213+00:00, run_end_date=2024-03-29 03:15:06.229094+00:00, run_duration=6.081881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:14:00+00:00, data_interval_end=2024-03-29 03:15:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:15:06.239739227Z [2024-03-29T03:15:06.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:15:00+00:00, run_after=2024-03-29T03:16:00+00:00 2024-03-29T03:15:06.387562874Z [2024-03-29T03:15:06.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:15:06.387595010Z 2024-03-29T03:15:06.388106427Z [2024-03-29T03:15:06.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:15:06.389128241Z [2024-03-29T03:15:06.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:15:06.389144096Z 2024-03-29T03:15:06.393308361Z [2024-03-29T03:15:06.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:15:06.395928434Z [2024-03-29T03:15:06.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:15:06.583303709Z [2024-03-29T03:15:06.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:15:06.583539166Z [2024-03-29T03:15:06.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status success for try_number 1 2024-03-29T03:15:06.583713578Z [2024-03-29T03:15:06.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:15:06.599365248Z [2024-03-29T03:15:06.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=-1, run_start_date=2024-03-29 03:15:05.649609+00:00, run_end_date=2024-03-29 03:15:06.207878+00:00, run_duration=0.558269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:15:03.727876+00:00, queued_by_job_id=2, pid=14496 2024-03-29T03:15:06.599393284Z [2024-03-29T03:15:06.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to f823c17d-a06c-480d-a841-e1de9b523177 2024-03-29T03:15:06.599397717Z [2024-03-29T03:15:06.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:14:00+00:00, map_index=-1, run_start_date=2024-03-29 03:15:03.535131+00:00, run_end_date=2024-03-29 03:15:05.627655+00:00, run_duration=2.092524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:15:00.233262+00:00, queued_by_job_id=2, pid=14477 2024-03-29T03:15:06.702871884Z [2024-03-29T03:15:06.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:15:06.705142750Z [2024-03-29T03:15:06.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:14:00+00:00, run_id=scheduled__2024-03-29T03:14:00+00:00, run_start_date=2024-03-29 03:15:00.149372+00:00, run_end_date=2024-03-29 03:15:06.704405+00:00, run_duration=6.555033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:14:00+00:00, data_interval_end=2024-03-29 03:15:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:15:06.739036507Z [2024-03-29T03:15:06.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:15:00+00:00, run_after=2024-03-29T03:16:00+00:00 2024-03-29T03:15:06.831238890Z [2024-03-29T03:15:06.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status success for try_number 1 2024-03-29T03:15:06.839726038Z [2024-03-29T03:15:06.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:14:00+00:00, map_index=-1, run_start_date=2024-03-29 03:15:03.625201+00:00, run_end_date=2024-03-29 03:15:06.308268+00:00, run_duration=2.683067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:15:00.233262+00:00, queued_by_job_id=2, pid=14478 2024-03-29T03:15:09.324353231Z [2024-03-29T03:15:09.323+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:15:09.324385123Z 2024-03-29T03:15:09.324400530Z [2024-03-29T03:15:09.324+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:15:09.324946418Z [2024-03-29T03:15:09.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:15:09.324963869Z 2024-03-29T03:15:09.329925702Z [2024-03-29T03:15:09.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:15:09.330813513Z [2024-03-29T03:15:09.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:15:09.400507933Z [2024-03-29T03:15:09.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status queued for try_number 1 2024-03-29T03:15:09.401046752Z [2024-03-29T03:15:09.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:15:09.409501995Z [2024-03-29T03:15:09.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c9c72a5-c037-472a-8fcc-46ef51628ab2 2024-03-29T03:15:09.409973874Z [2024-03-29T03:15:09.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=0, run_start_date=2024-03-29 03:15:08.520850+00:00, run_end_date=2024-03-29 03:15:08.887221+00:00, run_duration=0.366371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:15:06.390028+00:00, queued_by_job_id=2, pid=14504 2024-03-29T03:15:11.620541812Z [2024-03-29T03:15:11.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:15:11.620972521Z [2024-03-29T03:15:11.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:10:00+00:00, run_id=scheduled__2024-03-29T03:10:00+00:00, run_start_date=2024-03-29 03:15:00.143157+00:00, run_end_date=2024-03-29 03:15:11.620595+00:00, run_duration=11.477438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:10:00+00:00, data_interval_end=2024-03-29 03:15:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:15:11.628685180Z [2024-03-29T03:15:11.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:15:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:15:11.663775310Z [2024-03-29T03:15:11.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:10:00+00:00 exited with status success for try_number 1 2024-03-29T03:15:11.670512538Z [2024-03-29T03:15:11.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:10:00+00:00, map_index=-1, run_start_date=2024-03-29 03:15:11.022602+00:00, run_end_date=2024-03-29 03:15:11.378730+00:00, run_duration=0.356128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:15:09.325284+00:00, queued_by_job_id=2, pid=14512 2024-03-29T03:16:00.591262547Z [2024-03-29T03:16:00.590+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:16:00+00:00, run_after=2024-03-29T03:17:00+00:00 2024-03-29T03:16:00.605525079Z [2024-03-29T03:16:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:16:00+00:00, run_after=2024-03-29T03:17:00+00:00 2024-03-29T03:16:00.615061219Z [2024-03-29T03:16:00.614+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:16:00.623093180Z [2024-03-29T03:16:00.622+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:16:00.696518180Z [2024-03-29T03:16:00.696+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:16:00.696557735Z 2024-03-29T03:16:00.696567355Z 2024-03-29T03:16:00.696575085Z 2024-03-29T03:16:00.696582826Z 2024-03-29T03:16:00.696622846Z [2024-03-29T03:16:00.696+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:16:00.696761229Z [2024-03-29T03:16:00.696+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:16:00.697031804Z [2024-03-29T03:16:00.696+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:16:00.697242569Z [2024-03-29T03:16:00.697+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:16:00.698067259Z [2024-03-29T03:16:00.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:16:00.698081127Z 2024-03-29T03:16:00.698085902Z 2024-03-29T03:16:00.698089141Z 2024-03-29T03:16:00.698092835Z 2024-03-29T03:16:00.701906338Z [2024-03-29T03:16:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:16:00.702208106Z [2024-03-29T03:16:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:16:00.702717684Z [2024-03-29T03:16:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:16:00.702961813Z [2024-03-29T03:16:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:16:00.703404884Z [2024-03-29T03:16:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:16:00.703649973Z [2024-03-29T03:16:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:16:00.704034903Z [2024-03-29T03:16:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:16:00.704275141Z [2024-03-29T03:16:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:16:01.196310387Z [2024-03-29T03:16:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status queued for try_number 1 2024-03-29T03:16:01.196738989Z [2024-03-29T03:16:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status queued for try_number 1 2024-03-29T03:16:01.197109054Z [2024-03-29T03:16:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status queued for try_number 1 2024-03-29T03:16:01.197375873Z [2024-03-29T03:16:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status queued for try_number 1 2024-03-29T03:16:01.210985965Z [2024-03-29T03:16:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to a57b70ed-efce-4b92-abf7-53871cf56d1a 2024-03-29T03:16:01.211430890Z [2024-03-29T03:16:01.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0759e413-d55c-4074-a362-f926050954d2 2024-03-29T03:16:01.211787734Z [2024-03-29T03:16:01.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46dda6e4-c7cc-49a0-ac60-73ba64c1fe5f 2024-03-29T03:16:01.212068817Z [2024-03-29T03:16:01.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b2344c8-d394-4c8e-b6ff-955d68200eeb 2024-03-29T03:16:02.489460549Z [2024-03-29T03:16:02.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:16:02.490210669Z [2024-03-29T03:16:02.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:14:00+00:00, run_id=scheduled__2024-03-29T03:14:00+00:00, run_start_date=2024-03-29 03:16:00.634589+00:00, run_end_date=2024-03-29 03:16:02.489402+00:00, run_duration=1.854813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:14:00+00:00, data_interval_end=2024-03-29 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:16:02.503189241Z [2024-03-29T03:16:02.502+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:16:00+00:00, run_after=2024-03-29T03:18:00+00:00 2024-03-29T03:16:02.512355689Z [2024-03-29T03:16:02.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:16:02.513180770Z [2024-03-29T03:16:02.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:15:00+00:00, run_id=scheduled__2024-03-29T03:15:00+00:00, run_start_date=2024-03-29 03:16:00.635998+00:00, run_end_date=2024-03-29 03:16:02.512797+00:00, run_duration=1.876799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:15:00+00:00, data_interval_end=2024-03-29 03:16:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:16:02.525007875Z [2024-03-29T03:16:02.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:16:00+00:00, run_after=2024-03-29T03:17:00+00:00 2024-03-29T03:16:02.595380517Z [2024-03-29T03:16:02.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status success for try_number 1 2024-03-29T03:16:02.602128490Z [2024-03-29T03:16:02.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:15:00+00:00, map_index=-1, run_start_date=2024-03-29 03:16:01.733430+00:00, run_end_date=2024-03-29 03:16:02.308043+00:00, run_duration=0.574613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:16:00.699083+00:00, queued_by_job_id=2, pid=14535 2024-03-29T03:16:02.750359508Z [2024-03-29T03:16:02.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:14:00+00:00 exited with status success for try_number 1 2024-03-29T03:16:02.761342763Z [2024-03-29T03:16:02.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:14:00+00:00, map_index=-1, run_start_date=2024-03-29 03:16:01.896458+00:00, run_end_date=2024-03-29 03:16:02.449481+00:00, run_duration=0.553023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:16:00.699083+00:00, queued_by_job_id=2, pid=14536 2024-03-29T03:16:06.283896992Z [2024-03-29T03:16:06.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:16:06.284390013Z [2024-03-29T03:16:06.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:15:00+00:00, run_id=scheduled__2024-03-29T03:15:00+00:00, run_start_date=2024-03-29 03:16:00.637950+00:00, run_end_date=2024-03-29 03:16:06.283830+00:00, run_duration=5.64588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:15:00+00:00, data_interval_end=2024-03-29 03:16:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:16:06.295213793Z [2024-03-29T03:16:06.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:16:00+00:00, run_after=2024-03-29T03:17:00+00:00 2024-03-29T03:16:06.303419857Z [2024-03-29T03:16:06.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:16:06.303884458Z [2024-03-29T03:16:06.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:15:00+00:00, run_id=scheduled__2024-03-29T03:15:00+00:00, run_start_date=2024-03-29 03:16:00.637015+00:00, run_end_date=2024-03-29 03:16:06.303323+00:00, run_duration=5.666308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:15:00+00:00, data_interval_end=2024-03-29 03:16:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:16:06.316222174Z [2024-03-29T03:16:06.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:16:00+00:00, run_after=2024-03-29T03:17:00+00:00 2024-03-29T03:16:06.349782722Z [2024-03-29T03:16:06.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status success for try_number 1 2024-03-29T03:16:06.349813061Z [2024-03-29T03:16:06.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status success for try_number 1 2024-03-29T03:16:06.358360790Z [2024-03-29T03:16:06.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:15:00+00:00, map_index=-1, run_start_date=2024-03-29 03:16:03.409301+00:00, run_end_date=2024-03-29 03:16:05.763073+00:00, run_duration=2.353772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:16:00.699083+00:00, queued_by_job_id=2, pid=14554 2024-03-29T03:16:06.358736858Z [2024-03-29T03:16:06.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:15:00+00:00, map_index=-1, run_start_date=2024-03-29 03:16:03.732813+00:00, run_end_date=2024-03-29 03:16:05.295754+00:00, run_duration=1.562941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:16:00.699083+00:00, queued_by_job_id=2, pid=14565 2024-03-29T03:17:00.939375105Z [2024-03-29T03:17:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:17:00+00:00, run_after=2024-03-29T03:18:00+00:00 2024-03-29T03:17:00.946908199Z [2024-03-29T03:17:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:17:00.960368695Z [2024-03-29T03:17:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:17:00+00:00, run_after=2024-03-29T03:18:00+00:00 2024-03-29T03:17:01.043436666Z [2024-03-29T03:17:01.042+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:17:01.043474421Z 2024-03-29T03:17:01.043482624Z 2024-03-29T03:17:01.043490319Z 2024-03-29T03:17:01.043953911Z [2024-03-29T03:17:01.043+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:17:01.044303420Z [2024-03-29T03:17:01.044+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:17:01.046586377Z [2024-03-29T03:17:01.046+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:17:01.048181742Z [2024-03-29T03:17:01.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:17:01.048200254Z 2024-03-29T03:17:01.048205908Z 2024-03-29T03:17:01.048211041Z 2024-03-29T03:17:01.056334334Z [2024-03-29T03:17:01.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:17:01.057190286Z [2024-03-29T03:17:01.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:17:01.057946250Z [2024-03-29T03:17:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:17:01.058960967Z [2024-03-29T03:17:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:17:01.060211713Z [2024-03-29T03:17:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:17:01.060699834Z [2024-03-29T03:17:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:17:01.372257315Z [2024-03-29T03:17:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status queued for try_number 1 2024-03-29T03:17:01.372308388Z [2024-03-29T03:17:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status queued for try_number 1 2024-03-29T03:17:01.372448868Z [2024-03-29T03:17:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status queued for try_number 1 2024-03-29T03:17:01.384002917Z [2024-03-29T03:17:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to 639c240a-3849-4c4f-b635-b4abd7edc896 2024-03-29T03:17:01.384291885Z [2024-03-29T03:17:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15ee7986-22a4-45c7-987d-50a952f920ce 2024-03-29T03:17:01.384501195Z [2024-03-29T03:17:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b411dff-ebc2-41ff-a830-4fe7eb4235c0 2024-03-29T03:17:02.545823655Z [2024-03-29T03:17:02.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:17:02.546620025Z [2024-03-29T03:17:02.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:16:00+00:00, run_id=scheduled__2024-03-29T03:16:00+00:00, run_start_date=2024-03-29 03:17:00.972843+00:00, run_end_date=2024-03-29 03:17:02.545704+00:00, run_duration=1.572861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:16:00+00:00, data_interval_end=2024-03-29 03:17:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:17:02.563041846Z [2024-03-29T03:17:02.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:17:00+00:00, run_after=2024-03-29T03:18:00+00:00 2024-03-29T03:17:02.629727686Z [2024-03-29T03:17:02.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status success for try_number 1 2024-03-29T03:17:02.636485981Z [2024-03-29T03:17:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:16:00+00:00, map_index=-1, run_start_date=2024-03-29 03:17:01.953314+00:00, run_end_date=2024-03-29 03:17:02.364406+00:00, run_duration=0.411092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:17:01.050117+00:00, queued_by_job_id=2, pid=14593 2024-03-29T03:17:05.390974616Z [2024-03-29T03:17:05.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:17:05.391562789Z [2024-03-29T03:17:05.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:16:00+00:00, run_id=scheduled__2024-03-29T03:16:00+00:00, run_start_date=2024-03-29 03:17:00.975031+00:00, run_end_date=2024-03-29 03:17:05.390879+00:00, run_duration=4.415848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:16:00+00:00, data_interval_end=2024-03-29 03:17:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:17:05.403472661Z [2024-03-29T03:17:05.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:17:00+00:00, run_after=2024-03-29T03:18:00+00:00 2024-03-29T03:17:05.410976289Z [2024-03-29T03:17:05.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:17:05.411367777Z [2024-03-29T03:17:05.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:16:00+00:00, run_id=scheduled__2024-03-29T03:16:00+00:00, run_start_date=2024-03-29 03:17:00.976918+00:00, run_end_date=2024-03-29 03:17:05.410891+00:00, run_duration=4.433973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:16:00+00:00, data_interval_end=2024-03-29 03:17:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:17:05.421360630Z [2024-03-29T03:17:05.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:17:00+00:00, run_after=2024-03-29T03:18:00+00:00 2024-03-29T03:17:05.456859958Z [2024-03-29T03:17:05.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status success for try_number 1 2024-03-29T03:17:05.457100490Z [2024-03-29T03:17:05.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status success for try_number 1 2024-03-29T03:17:05.464576130Z [2024-03-29T03:17:05.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:16:00+00:00, map_index=-1, run_start_date=2024-03-29 03:17:03.133803+00:00, run_end_date=2024-03-29 03:17:04.551369+00:00, run_duration=1.417566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:17:01.050117+00:00, queued_by_job_id=2, pid=14611 2024-03-29T03:17:05.464930609Z [2024-03-29T03:17:05.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:16:00+00:00, map_index=-1, run_start_date=2024-03-29 03:17:03.263672+00:00, run_end_date=2024-03-29 03:17:04.864460+00:00, run_duration=1.600788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:17:01.050117+00:00, queued_by_job_id=2, pid=14612 2024-03-29T03:17:54.108189935Z [2024-03-29T03:17:54.107+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:17:54.108231756Z 2024-03-29T03:17:54.108501751Z [2024-03-29T03:17:54.108+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-03-29T03:17:54.109314120Z [2024-03-29T03:17:54.109+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:17:54.109328209Z 2024-03-29T03:17:54.113103646Z [2024-03-29T03:17:54.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240329031753_538328', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:17:54.113310637Z [2024-03-29T03:17:54.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240329031753_538328', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-29T03:17:54.168096073Z [2024-03-29T03:17:54.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240329031753_538328 exited with status queued for try_number 1 2024-03-29T03:17:54.175365781Z [2024-03-29T03:17:54.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22322a7c-d5a3-42cf-a927-07bbcf210f4b 2024-03-29T03:17:55.303572112Z [2024-03-29T03:17:55.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:17:55.304099009Z [2024-03-29T03:17:55.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-03-29 03:17:53.977957+00:00, run_id=scaleout_vdu_20240329031753_538328, run_start_date=2024-03-29 03:17:54.071782+00:00, run_end_date=2024-03-29 03:17:55.303478+00:00, run_duration=1.231696, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-29 03:17:53.977957+00:00, data_interval_end=2024-03-29 03:17:53.977957+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-03-29T03:17:55.308362250Z [2024-03-29T03:17:55.308+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-03-29T03:17:56.405139209Z [2024-03-29T03:17:56.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240329031753_538328 exited with status success for try_number 1 2024-03-29T03:17:56.411502535Z [2024-03-29T03:17:56.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240329031753_538328, map_index=-1, run_start_date=2024-03-29 03:17:54.880256+00:00, run_end_date=2024-03-29 03:17:55.260566+00:00, run_duration=0.38031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:17:54.109948+00:00, queued_by_job_id=2, pid=14637 2024-03-29T03:18:00.288019536Z [2024-03-29T03:18:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:18:00+00:00, run_after=2024-03-29T03:19:00+00:00 2024-03-29T03:18:00.295347284Z [2024-03-29T03:18:00.295+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:18:00.307749302Z [2024-03-29T03:18:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:18:00+00:00, run_after=2024-03-29T03:19:00+00:00 2024-03-29T03:18:00.315803777Z [2024-03-29T03:18:00.315+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:18:00.395917335Z [2024-03-29T03:18:00.395+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:18:00.395947612Z 2024-03-29T03:18:00.395952181Z 2024-03-29T03:18:00.395955501Z 2024-03-29T03:18:00.395979884Z 2024-03-29T03:18:00.396326038Z [2024-03-29T03:18:00.396+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:18:00.396630110Z [2024-03-29T03:18:00.396+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:18:00.396820986Z [2024-03-29T03:18:00.396+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:18:00.397006277Z [2024-03-29T03:18:00.396+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:18:00.397632826Z [2024-03-29T03:18:00.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:18:00.397639878Z 2024-03-29T03:18:00.397643489Z 2024-03-29T03:18:00.397646689Z 2024-03-29T03:18:00.397650203Z 2024-03-29T03:18:00.401371520Z [2024-03-29T03:18:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:18:00.401638266Z [2024-03-29T03:18:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:18:00.401992911Z [2024-03-29T03:18:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:18:00.402204285Z [2024-03-29T03:18:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:18:00.402585465Z [2024-03-29T03:18:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:18:00.402934155Z [2024-03-29T03:18:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:18:00.403292506Z [2024-03-29T03:18:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:18:00.403617797Z [2024-03-29T03:18:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:18:00.839862511Z [2024-03-29T03:18:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status queued for try_number 1 2024-03-29T03:18:00.840043487Z [2024-03-29T03:18:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:17:00+00:00 exited with status queued for try_number 1 2024-03-29T03:18:00.840255184Z [2024-03-29T03:18:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:17:00+00:00 exited with status queued for try_number 1 2024-03-29T03:18:00.840458357Z [2024-03-29T03:18:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:17:00+00:00 exited with status queued for try_number 1 2024-03-29T03:18:00.865861762Z [2024-03-29T03:18:00.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8929f365-7ca3-4260-8a45-5520ce97e874 2024-03-29T03:18:00.869728373Z [2024-03-29T03:18:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2eaa726a-7d31-4fe4-9bb4-97f2473d0006 2024-03-29T03:18:00.870304430Z [2024-03-29T03:18:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02564f20-3e63-4a13-ab77-0775a68ba0d7 2024-03-29T03:18:00.870687648Z [2024-03-29T03:18:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5727469f-54b7-4ebe-8c8f-c633ce6d79f3 2024-03-29T03:18:02.210766038Z [2024-03-29T03:18:02.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:18:02.211653874Z [2024-03-29T03:18:02.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:16:00+00:00, run_id=scheduled__2024-03-29T03:16:00+00:00, run_start_date=2024-03-29 03:18:00.325901+00:00, run_end_date=2024-03-29 03:18:02.210970+00:00, run_duration=1.885069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:16:00+00:00, data_interval_end=2024-03-29 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:18:02.228473842Z [2024-03-29T03:18:02.228+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:18:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:18:02.354178498Z [2024-03-29T03:18:02.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:16:00+00:00 exited with status success for try_number 1 2024-03-29T03:18:02.373202909Z [2024-03-29T03:18:02.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:16:00+00:00, map_index=-1, run_start_date=2024-03-29 03:18:01.353771+00:00, run_end_date=2024-03-29 03:18:01.944285+00:00, run_duration=0.590514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:18:00.398609+00:00, queued_by_job_id=2, pid=14647 2024-03-29T03:18:03.438069128Z [2024-03-29T03:18:03.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:18:03.438605178Z [2024-03-29T03:18:03.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:17:00+00:00, run_id=scheduled__2024-03-29T03:17:00+00:00, run_start_date=2024-03-29 03:18:00.327164+00:00, run_end_date=2024-03-29 03:18:03.438100+00:00, run_duration=3.110936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:17:00+00:00, data_interval_end=2024-03-29 03:18:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:18:03.455712008Z [2024-03-29T03:18:03.455+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:18:00+00:00, run_after=2024-03-29T03:19:00+00:00 2024-03-29T03:18:03.550716011Z [2024-03-29T03:18:03.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:17:00+00:00 exited with status success for try_number 1 2024-03-29T03:18:03.561295108Z [2024-03-29T03:18:03.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:17:00+00:00, map_index=-1, run_start_date=2024-03-29 03:18:01.891267+00:00, run_end_date=2024-03-29 03:18:02.383645+00:00, run_duration=0.492378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:18:00.398609+00:00, queued_by_job_id=2, pid=14660 2024-03-29T03:18:04.290608936Z [2024-03-29T03:18:04.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:18:04.290961893Z [2024-03-29T03:18:04.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:17:00+00:00, run_id=scheduled__2024-03-29T03:17:00+00:00, run_start_date=2024-03-29 03:18:00.328311+00:00, run_end_date=2024-03-29 03:18:04.290561+00:00, run_duration=3.96225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:17:00+00:00, data_interval_end=2024-03-29 03:18:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:18:04.301564610Z [2024-03-29T03:18:04.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:18:00+00:00, run_after=2024-03-29T03:19:00+00:00 2024-03-29T03:18:04.338575154Z [2024-03-29T03:18:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:17:00+00:00 exited with status success for try_number 1 2024-03-29T03:18:04.345228550Z [2024-03-29T03:18:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:17:00+00:00, map_index=-1, run_start_date=2024-03-29 03:18:02.679133+00:00, run_end_date=2024-03-29 03:18:04.065458+00:00, run_duration=1.386325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:18:00.398609+00:00, queued_by_job_id=2, pid=14676 2024-03-29T03:18:05.615841417Z [2024-03-29T03:18:05.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:18:05.616126511Z [2024-03-29T03:18:05.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:17:00+00:00, run_id=scheduled__2024-03-29T03:17:00+00:00, run_start_date=2024-03-29 03:18:00.329456+00:00, run_end_date=2024-03-29 03:18:05.615771+00:00, run_duration=5.286315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:17:00+00:00, data_interval_end=2024-03-29 03:18:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:18:05.629510409Z [2024-03-29T03:18:05.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:18:00+00:00, run_after=2024-03-29T03:19:00+00:00 2024-03-29T03:18:05.684970809Z [2024-03-29T03:18:05.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:17:00+00:00 exited with status success for try_number 1 2024-03-29T03:18:05.690778466Z [2024-03-29T03:18:05.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:17:00+00:00, map_index=-1, run_start_date=2024-03-29 03:18:02.780852+00:00, run_end_date=2024-03-29 03:18:04.463945+00:00, run_duration=1.683093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:18:00.398609+00:00, queued_by_job_id=2, pid=14677 2024-03-29T03:18:46.859387756Z [2024-03-29T03:18:46.858+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:19:01.060405616Z [2024-03-29T03:19:01.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:19:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:19:01.071077058Z [2024-03-29T03:19:01.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:19:01.089751607Z [2024-03-29T03:19:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:19:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:19:01.173187397Z [2024-03-29T03:19:01.172+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:19:01.173223520Z 2024-03-29T03:19:01.173228645Z 2024-03-29T03:19:01.173233464Z 2024-03-29T03:19:01.173588461Z [2024-03-29T03:19:01.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:19:01.173910927Z [2024-03-29T03:19:01.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:19:01.174126453Z [2024-03-29T03:19:01.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:19:01.175146821Z [2024-03-29T03:19:01.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:19:01.175167505Z 2024-03-29T03:19:01.175172317Z 2024-03-29T03:19:01.175176408Z 2024-03-29T03:19:01.179043370Z [2024-03-29T03:19:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:19:01.179184165Z [2024-03-29T03:19:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:19:01.179439780Z [2024-03-29T03:19:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:19:01.179570485Z [2024-03-29T03:19:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:19:01.179785255Z [2024-03-29T03:19:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:19:01.179915862Z [2024-03-29T03:19:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:19:01.421416903Z [2024-03-29T03:19:01.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status queued for try_number 1 2024-03-29T03:19:01.423931063Z [2024-03-29T03:19:01.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status queued for try_number 1 2024-03-29T03:19:01.424199036Z [2024-03-29T03:19:01.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status queued for try_number 1 2024-03-29T03:19:01.435623135Z [2024-03-29T03:19:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c2b89f0-241e-4b61-b013-43470e6236c7 2024-03-29T03:19:01.435965319Z [2024-03-29T03:19:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ca23f41-8cb1-4297-b3fa-15b6e1f46eb3 2024-03-29T03:19:01.436223881Z [2024-03-29T03:19:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to a40361b3-2b33-418d-9738-381a37af5b72 2024-03-29T03:19:02.585777814Z [2024-03-29T03:19:02.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:19:02.586414463Z [2024-03-29T03:19:02.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:18:00+00:00, run_id=scheduled__2024-03-29T03:18:00+00:00, run_start_date=2024-03-29 03:19:01.102079+00:00, run_end_date=2024-03-29 03:19:02.585688+00:00, run_duration=1.483609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:18:00+00:00, data_interval_end=2024-03-29 03:19:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:19:02.601982324Z [2024-03-29T03:19:02.601+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:19:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:19:02.673344081Z [2024-03-29T03:19:02.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status success for try_number 1 2024-03-29T03:19:02.682010173Z [2024-03-29T03:19:02.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:18:00+00:00, map_index=-1, run_start_date=2024-03-29 03:19:01.983917+00:00, run_end_date=2024-03-29 03:19:02.387201+00:00, run_duration=0.403284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:19:01.176182+00:00, queued_by_job_id=2, pid=14709 2024-03-29T03:19:04.761336104Z [2024-03-29T03:19:04.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:19:04.761912187Z [2024-03-29T03:19:04.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:18:00+00:00, run_id=scheduled__2024-03-29T03:18:00+00:00, run_start_date=2024-03-29 03:19:01.104101+00:00, run_end_date=2024-03-29 03:19:04.761593+00:00, run_duration=3.657492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:18:00+00:00, data_interval_end=2024-03-29 03:19:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:19:04.772574637Z [2024-03-29T03:19:04.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:19:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:19:05.075179959Z [2024-03-29T03:19:05.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:19:05.075913969Z [2024-03-29T03:19:05.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:18:00+00:00, run_id=scheduled__2024-03-29T03:18:00+00:00, run_start_date=2024-03-29 03:19:01.105675+00:00, run_end_date=2024-03-29 03:19:05.075534+00:00, run_duration=3.969859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:18:00+00:00, data_interval_end=2024-03-29 03:19:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:19:05.086559848Z [2024-03-29T03:19:05.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:19:00+00:00, run_after=2024-03-29T03:20:00+00:00 2024-03-29T03:19:05.142543358Z [2024-03-29T03:19:05.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status success for try_number 1 2024-03-29T03:19:05.158643782Z [2024-03-29T03:19:05.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:18:00+00:00, map_index=-1, run_start_date=2024-03-29 03:19:03.145573+00:00, run_end_date=2024-03-29 03:19:04.677516+00:00, run_duration=1.531943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:19:01.176182+00:00, queued_by_job_id=2, pid=14728 2024-03-29T03:19:06.246789777Z [2024-03-29T03:19:06.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status success for try_number 1 2024-03-29T03:19:06.251929761Z [2024-03-29T03:19:06.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:18:00+00:00, map_index=-1, run_start_date=2024-03-29 03:19:02.976254+00:00, run_end_date=2024-03-29 03:19:05.022794+00:00, run_duration=2.04654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:19:01.176182+00:00, queued_by_job_id=2, pid=14727 2024-03-29T03:19:54.901260331Z [2024-03-29T03:19:54.900+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:19:54.901289151Z 2024-03-29T03:19:54.901489131Z [2024-03-29T03:19:54.901+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-03-29T03:19:54.902154265Z [2024-03-29T03:19:54.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:19:54.902163544Z 2024-03-29T03:19:54.904353158Z [2024-03-29T03:19:54.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240329031953_407350', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:19:54.904632223Z [2024-03-29T03:19:54.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240329031953_407350', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-29T03:19:54.999064543Z [2024-03-29T03:19:54.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240329031953_407350 exited with status queued for try_number 1 2024-03-29T03:19:55.005557902Z [2024-03-29T03:19:55.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 664d20b5-a826-424e-bc25-d3d438cccee9 2024-03-29T03:19:56.855573153Z [2024-03-29T03:19:56.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:19:56.855732889Z [2024-03-29T03:19:56.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-03-29 03:19:53.983766+00:00, run_id=scaleout_vdu_20240329031953_407350, run_start_date=2024-03-29 03:19:54.863970+00:00, run_end_date=2024-03-29 03:19:56.855433+00:00, run_duration=1.991463, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-29 03:19:53.983766+00:00, data_interval_end=2024-03-29 03:19:53.983766+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-03-29T03:19:56.859157739Z [2024-03-29T03:19:56.858+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-03-29T03:19:56.889612048Z [2024-03-29T03:19:56.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240329031953_407350 exited with status success for try_number 1 2024-03-29T03:19:56.894884012Z [2024-03-29T03:19:56.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240329031953_407350, map_index=-1, run_start_date=2024-03-29 03:19:55.803808+00:00, run_end_date=2024-03-29 03:19:56.210806+00:00, run_duration=0.406998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:19:54.902510+00:00, queued_by_job_id=2, pid=14753 2024-03-29T03:20:00.856858914Z [2024-03-29T03:20:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:21:00+00:00 2024-03-29T03:20:00.868294313Z [2024-03-29T03:20:00.867+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:20:00.888876687Z [2024-03-29T03:20:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:21:00+00:00 2024-03-29T03:20:00.900147007Z [2024-03-29T03:20:00.899+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:20:00.917679001Z [2024-03-29T03:20:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:25:00+00:00 2024-03-29T03:20:01.035138984Z [2024-03-29T03:20:01.034+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T03:20:01.035183986Z 2024-03-29T03:20:01.035187905Z 2024-03-29T03:20:01.035191681Z 2024-03-29T03:20:01.035195017Z 2024-03-29T03:20:01.035199636Z 2024-03-29T03:20:01.035371486Z [2024-03-29T03:20:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:20:01.035505079Z [2024-03-29T03:20:01.035+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:20:01.035678647Z [2024-03-29T03:20:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:20:01.035904935Z [2024-03-29T03:20:01.035+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:20:01.036086424Z [2024-03-29T03:20:01.035+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:20:01.037131117Z [2024-03-29T03:20:01.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:20:01.037149368Z 2024-03-29T03:20:01.037157197Z 2024-03-29T03:20:01.037164804Z 2024-03-29T03:20:01.037168212Z 2024-03-29T03:20:01.037171384Z 2024-03-29T03:20:01.043459864Z [2024-03-29T03:20:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:20:01.043636225Z [2024-03-29T03:20:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:20:01.044160026Z [2024-03-29T03:20:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:20:01.044466624Z [2024-03-29T03:20:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:20:01.044997865Z [2024-03-29T03:20:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:20:01.045321870Z [2024-03-29T03:20:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:20:01.045749460Z [2024-03-29T03:20:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:20:01.045921017Z [2024-03-29T03:20:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:20:01.046252759Z [2024-03-29T03:20:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:20:01.046464913Z [2024-03-29T03:20:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:20:01.479639141Z [2024-03-29T03:20:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:01.479670302Z [2024-03-29T03:20:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:01.479791958Z [2024-03-29T03:20:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:19:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:01.479959698Z [2024-03-29T03:20:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:19:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:01.480117965Z [2024-03-29T03:20:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:19:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:01.496845674Z [2024-03-29T03:20:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb91eb3a-cc7d-4e9b-9087-d15a657f7e02 2024-03-29T03:20:01.496888933Z [2024-03-29T03:20:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3f818a2-2600-4aea-9a6f-79093cfab011 2024-03-29T03:20:01.497276367Z [2024-03-29T03:20:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to f568920d-23e0-4f21-bcec-c6803de21c1f 2024-03-29T03:20:01.503011518Z [2024-03-29T03:20:01.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 228b1905-135f-448d-b319-13e1cf94f121 2024-03-29T03:20:01.503140535Z [2024-03-29T03:20:01.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1ba4816-9b88-470e-81ac-c89560306785 2024-03-29T03:20:02.960638003Z [2024-03-29T03:20:02.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:20:02.962034292Z [2024-03-29T03:20:02.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:18:00+00:00, run_id=scheduled__2024-03-29T03:18:00+00:00, run_start_date=2024-03-29 03:20:00.934518+00:00, run_end_date=2024-03-29 03:20:02.961099+00:00, run_duration=2.026581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:18:00+00:00, data_interval_end=2024-03-29 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:20:02.976407402Z [2024-03-29T03:20:02.976+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:22:00+00:00 2024-03-29T03:20:03.062905214Z [2024-03-29T03:20:03.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:18:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:03.074060252Z [2024-03-29T03:20:03.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:18:00+00:00, map_index=-1, run_start_date=2024-03-29 03:20:02.145088+00:00, run_end_date=2024-03-29 03:20:02.777725+00:00, run_duration=0.632637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:01.038984+00:00, queued_by_job_id=2, pid=14769 2024-03-29T03:20:04.142832800Z [2024-03-29T03:20:04.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:20:04.143653256Z [2024-03-29T03:20:04.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:19:00+00:00, run_id=scheduled__2024-03-29T03:19:00+00:00, run_start_date=2024-03-29 03:20:00.936050+00:00, run_end_date=2024-03-29 03:20:04.142717+00:00, run_duration=3.206667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:19:00+00:00, data_interval_end=2024-03-29 03:20:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:20:04.162268166Z [2024-03-29T03:20:04.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:21:00+00:00 2024-03-29T03:20:04.212483735Z [2024-03-29T03:20:04.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:20:04.212536319Z 2024-03-29T03:20:04.212576493Z [2024-03-29T03:20:04.212+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:20:04.213254179Z [2024-03-29T03:20:04.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:20:04.213270680Z 2024-03-29T03:20:04.216817243Z [2024-03-29T03:20:04.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:20:04.217108665Z [2024-03-29T03:20:04.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:20:04.313421208Z [2024-03-29T03:20:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:04.313743890Z [2024-03-29T03:20:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:19:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:04.324570730Z [2024-03-29T03:20:04.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:19:00+00:00, map_index=-1, run_start_date=2024-03-29 03:20:02.504476+00:00, run_end_date=2024-03-29 03:20:03.066159+00:00, run_duration=0.561683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:01.038984+00:00, queued_by_job_id=2, pid=14770 2024-03-29T03:20:04.324913132Z [2024-03-29T03:20:04.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5110de59-c1e3-44be-a661-37aa95004379 2024-03-29T03:20:04.505178943Z [2024-03-29T03:20:04.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:04.519187772Z [2024-03-29T03:20:04.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:15:00+00:00, map_index=-1, run_start_date=2024-03-29 03:20:03.622577+00:00, run_end_date=2024-03-29 03:20:04.119908+00:00, run_duration=0.497331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:01.038984+00:00, queued_by_job_id=2, pid=14789 2024-03-29T03:20:06.259227550Z [2024-03-29T03:20:06.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:20:06.259460581Z [2024-03-29T03:20:06.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:19:00+00:00, run_id=scheduled__2024-03-29T03:19:00+00:00, run_start_date=2024-03-29 03:20:00.937572+00:00, run_end_date=2024-03-29 03:20:06.259106+00:00, run_duration=5.321534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:19:00+00:00, data_interval_end=2024-03-29 03:20:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:20:06.271568165Z [2024-03-29T03:20:06.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:21:00+00:00 2024-03-29T03:20:06.367732592Z [2024-03-29T03:20:06.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:19:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:06.377712396Z [2024-03-29T03:20:06.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:19:00+00:00, map_index=-1, run_start_date=2024-03-29 03:20:04.008783+00:00, run_end_date=2024-03-29 03:20:05.846906+00:00, run_duration=1.838123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:01.038984+00:00, queued_by_job_id=2, pid=14804 2024-03-29T03:20:06.730609555Z [2024-03-29T03:20:06.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:20:06.730639747Z [2024-03-29T03:20:06.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:19:00+00:00, run_id=scheduled__2024-03-29T03:19:00+00:00, run_start_date=2024-03-29 03:20:00.939071+00:00, run_end_date=2024-03-29 03:20:06.727288+00:00, run_duration=5.788217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:19:00+00:00, data_interval_end=2024-03-29 03:20:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:20:06.796618637Z [2024-03-29T03:20:06.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:21:00+00:00 2024-03-29T03:20:06.901884154Z [2024-03-29T03:20:06.901+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:20:06.901906503Z 2024-03-29T03:20:06.902153474Z [2024-03-29T03:20:06.901+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:20:06.905101546Z [2024-03-29T03:20:06.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:20:06.905123750Z 2024-03-29T03:20:06.908787437Z [2024-03-29T03:20:06.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:20:06.909171138Z [2024-03-29T03:20:06.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:20:06.992860765Z [2024-03-29T03:20:06.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:06.993171464Z [2024-03-29T03:20:06.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:06.999669955Z [2024-03-29T03:20:06.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39d2bec5-0615-4392-8295-f731baf24eeb 2024-03-29T03:20:07.000054485Z [2024-03-29T03:20:06.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:15:00+00:00, map_index=-1, run_start_date=2024-03-29 03:20:06.237235+00:00, run_end_date=2024-03-29 03:20:06.731425+00:00, run_duration=0.49419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:04.213672+00:00, queued_by_job_id=2, pid=14824 2024-03-29T03:20:07.104728304Z [2024-03-29T03:20:07.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:19:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:07.111550647Z [2024-03-29T03:20:07.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:19:00+00:00, map_index=-1, run_start_date=2024-03-29 03:20:04.105305+00:00, run_end_date=2024-03-29 03:20:06.627840+00:00, run_duration=2.522535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:01.038984+00:00, queued_by_job_id=2, pid=14806 2024-03-29T03:20:11.011112182Z [2024-03-29T03:20:11.010+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:20:11.011147815Z 2024-03-29T03:20:11.011194135Z [2024-03-29T03:20:11.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:20:11.011781011Z [2024-03-29T03:20:11.011+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:20:11.011801182Z 2024-03-29T03:20:11.014075680Z [2024-03-29T03:20:11.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:20:11.014255072Z [2024-03-29T03:20:11.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:20:11.068668467Z [2024-03-29T03:20:11.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status queued for try_number 1 2024-03-29T03:20:11.069048484Z [2024-03-29T03:20:11.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:11.076313763Z [2024-03-29T03:20:11.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 208a9ca0-6cc7-4794-a266-58cb6185db79 2024-03-29T03:20:11.076817295Z [2024-03-29T03:20:11.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:15:00+00:00, map_index=0, run_start_date=2024-03-29 03:20:08.856156+00:00, run_end_date=2024-03-29 03:20:09.903504+00:00, run_duration=1.047348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:06.905807+00:00, queued_by_job_id=2, pid=14832 2024-03-29T03:20:13.167171279Z [2024-03-29T03:20:13.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:20:13.167831587Z [2024-03-29T03:20:13.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:15:00+00:00, run_id=scheduled__2024-03-29T03:15:00+00:00, run_start_date=2024-03-29 03:20:00.932692+00:00, run_end_date=2024-03-29 03:20:13.167147+00:00, run_duration=12.234455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:15:00+00:00, data_interval_end=2024-03-29 03:20:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:20:13.178810536Z [2024-03-29T03:20:13.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:20:00+00:00, run_after=2024-03-29T03:25:00+00:00 2024-03-29T03:20:13.223611944Z [2024-03-29T03:20:13.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:15:00+00:00 exited with status success for try_number 1 2024-03-29T03:20:13.232646229Z [2024-03-29T03:20:13.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:15:00+00:00, map_index=-1, run_start_date=2024-03-29 03:20:12.724810+00:00, run_end_date=2024-03-29 03:20:13.055361+00:00, run_duration=0.330551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:20:11.012165+00:00, queued_by_job_id=2, pid=14845 2024-03-29T03:21:00.187438646Z [2024-03-29T03:21:00.186+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:21:00.206622459Z [2024-03-29T03:21:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:21:00+00:00, run_after=2024-03-29T03:22:00+00:00 2024-03-29T03:21:00.220586931Z [2024-03-29T03:21:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:21:00+00:00, run_after=2024-03-29T03:22:00+00:00 2024-03-29T03:21:00.301389273Z [2024-03-29T03:21:00.300+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:21:00.301416556Z 2024-03-29T03:21:00.301420223Z 2024-03-29T03:21:00.301423503Z 2024-03-29T03:21:00.301652344Z [2024-03-29T03:21:00.301+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:21:00.302052059Z [2024-03-29T03:21:00.301+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:21:00.302470643Z [2024-03-29T03:21:00.302+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:21:00.303951894Z [2024-03-29T03:21:00.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:21:00.303965097Z 2024-03-29T03:21:00.303968745Z 2024-03-29T03:21:00.303972253Z 2024-03-29T03:21:00.311599615Z [2024-03-29T03:21:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:21:00.311986111Z [2024-03-29T03:21:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:21:00.312498446Z [2024-03-29T03:21:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:21:00.312708245Z [2024-03-29T03:21:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:21:00.313110183Z [2024-03-29T03:21:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:21:00.313301232Z [2024-03-29T03:21:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:21:00.523358511Z [2024-03-29T03:21:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:21:00.523686783Z [2024-03-29T03:21:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:21:00.523860099Z [2024-03-29T03:21:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:21:00.535314130Z [2024-03-29T03:21:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b764b6e-8f67-4aac-9003-24d39469bc5a 2024-03-29T03:21:00.535782982Z [2024-03-29T03:21:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to b54d030e-fc55-4096-ad3a-a31e0f93fa35 2024-03-29T03:21:00.536229924Z [2024-03-29T03:21:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1271e27-8047-4976-b085-bb6658b72e33 2024-03-29T03:21:01.695094829Z [2024-03-29T03:21:01.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:21:01.695493234Z [2024-03-29T03:21:01.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:20:00+00:00, run_id=scheduled__2024-03-29T03:20:00+00:00, run_start_date=2024-03-29 03:21:00.233695+00:00, run_end_date=2024-03-29 03:21:01.695034+00:00, run_duration=1.461339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:20:00+00:00, data_interval_end=2024-03-29 03:21:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:21:01.706952846Z [2024-03-29T03:21:01.706+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:21:00+00:00, run_after=2024-03-29T03:22:00+00:00 2024-03-29T03:21:01.758744845Z [2024-03-29T03:21:01.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:21:01.765824106Z [2024-03-29T03:21:01.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=-1, run_start_date=2024-03-29 03:21:01.199220+00:00, run_end_date=2024-03-29 03:21:01.569090+00:00, run_duration=0.36987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:21:00.306796+00:00, queued_by_job_id=2, pid=14867 2024-03-29T03:21:03.816664433Z [2024-03-29T03:21:03.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:21:03.816897412Z [2024-03-29T03:21:03.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:20:00+00:00, run_id=scheduled__2024-03-29T03:20:00+00:00, run_start_date=2024-03-29 03:21:00.235030+00:00, run_end_date=2024-03-29 03:21:03.816538+00:00, run_duration=3.581508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:20:00+00:00, data_interval_end=2024-03-29 03:21:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:21:03.830783523Z [2024-03-29T03:21:03.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:21:00+00:00, run_after=2024-03-29T03:22:00+00:00 2024-03-29T03:21:04.953408087Z [2024-03-29T03:21:04.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:21:04.962797571Z [2024-03-29T03:21:04.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=-1, run_start_date=2024-03-29 03:21:02.367834+00:00, run_end_date=2024-03-29 03:21:03.786812+00:00, run_duration=1.418978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:21:00.306796+00:00, queued_by_job_id=2, pid=14886 2024-03-29T03:21:05.429444619Z [2024-03-29T03:21:05.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:21:05.429678052Z [2024-03-29T03:21:05.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:20:00+00:00, run_id=scheduled__2024-03-29T03:20:00+00:00, run_start_date=2024-03-29 03:21:00.236095+00:00, run_end_date=2024-03-29 03:21:05.429342+00:00, run_duration=5.193247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:20:00+00:00, data_interval_end=2024-03-29 03:21:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:21:05.439141990Z [2024-03-29T03:21:05.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:21:00+00:00, run_after=2024-03-29T03:22:00+00:00 2024-03-29T03:21:05.467091704Z [2024-03-29T03:21:05.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:21:05.472218426Z [2024-03-29T03:21:05.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=-1, run_start_date=2024-03-29 03:21:02.316702+00:00, run_end_date=2024-03-29 03:21:05.106370+00:00, run_duration=2.789668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:21:00.306796+00:00, queued_by_job_id=2, pid=14885 2024-03-29T03:22:00.542465986Z [2024-03-29T03:22:00.541+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:22:00.564150611Z [2024-03-29T03:22:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:22:00+00:00, run_after=2024-03-29T03:23:00+00:00 2024-03-29T03:22:00.574247922Z [2024-03-29T03:22:00.573+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:22:00.587895744Z [2024-03-29T03:22:00.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:22:00+00:00, run_after=2024-03-29T03:23:00+00:00 2024-03-29T03:22:00.685340334Z [2024-03-29T03:22:00.684+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:22:00.685366243Z 2024-03-29T03:22:00.685371327Z 2024-03-29T03:22:00.685375215Z 2024-03-29T03:22:00.685378594Z 2024-03-29T03:22:00.685539447Z [2024-03-29T03:22:00.685+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:22:00.685725566Z [2024-03-29T03:22:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:22:00.685921764Z [2024-03-29T03:22:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:22:00.686086202Z [2024-03-29T03:22:00.685+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:22:00.686788340Z [2024-03-29T03:22:00.686+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:22:00.686801214Z 2024-03-29T03:22:00.686805479Z 2024-03-29T03:22:00.686808683Z 2024-03-29T03:22:00.686812377Z 2024-03-29T03:22:00.691801573Z [2024-03-29T03:22:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:22:00.691832301Z [2024-03-29T03:22:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:22:00.692004403Z [2024-03-29T03:22:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:22:00.692245915Z [2024-03-29T03:22:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:22:00.692518188Z [2024-03-29T03:22:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:22:00.692683383Z [2024-03-29T03:22:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:22:00.692983309Z [2024-03-29T03:22:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:22:00.693139794Z [2024-03-29T03:22:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:22:01.016961063Z [2024-03-29T03:22:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:22:01.018939419Z [2024-03-29T03:22:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:21:00+00:00 exited with status queued for try_number 1 2024-03-29T03:22:01.019252909Z [2024-03-29T03:22:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:21:00+00:00 exited with status queued for try_number 1 2024-03-29T03:22:01.019484233Z [2024-03-29T03:22:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:21:00+00:00 exited with status queued for try_number 1 2024-03-29T03:22:01.041086145Z [2024-03-29T03:22:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb484b0f-f76e-4535-90eb-fef1269a0694 2024-03-29T03:22:01.045759744Z [2024-03-29T03:22:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to d066621a-9392-4eae-97e7-5a2f6f36286a 2024-03-29T03:22:01.046188565Z [2024-03-29T03:22:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 264f497d-136a-44e7-85cf-339d22c3f526 2024-03-29T03:22:01.046587603Z [2024-03-29T03:22:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72411abf-3efd-42c9-a45e-88c2c2cedffb 2024-03-29T03:22:03.500720887Z [2024-03-29T03:22:03.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:22:03.501306131Z [2024-03-29T03:22:03.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:20:00+00:00, run_id=scheduled__2024-03-29T03:20:00+00:00, run_start_date=2024-03-29 03:22:00.602557+00:00, run_end_date=2024-03-29 03:22:03.500816+00:00, run_duration=2.898259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:20:00+00:00, data_interval_end=2024-03-29 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:22:03.509207623Z [2024-03-29T03:22:03.508+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:22:00+00:00, run_after=2024-03-29T03:24:00+00:00 2024-03-29T03:22:03.516941890Z [2024-03-29T03:22:03.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:22:03.519543588Z [2024-03-29T03:22:03.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:21:00+00:00, run_id=scheduled__2024-03-29T03:21:00+00:00, run_start_date=2024-03-29 03:22:00.604696+00:00, run_end_date=2024-03-29 03:22:03.519096+00:00, run_duration=2.9144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:21:00+00:00, data_interval_end=2024-03-29 03:22:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:22:03.530852531Z [2024-03-29T03:22:03.530+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:22:00+00:00, run_after=2024-03-29T03:23:00+00:00 2024-03-29T03:22:03.596281560Z [2024-03-29T03:22:03.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:22:03.596371918Z [2024-03-29T03:22:03.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:21:00+00:00 exited with status success for try_number 1 2024-03-29T03:22:03.608499042Z [2024-03-29T03:22:03.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=-1, run_start_date=2024-03-29 03:22:01.889284+00:00, run_end_date=2024-03-29 03:22:02.561395+00:00, run_duration=0.672111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:22:00.687701+00:00, queued_by_job_id=2, pid=14919 2024-03-29T03:22:03.608970270Z [2024-03-29T03:22:03.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:21:00+00:00, map_index=-1, run_start_date=2024-03-29 03:22:02.092816+00:00, run_end_date=2024-03-29 03:22:02.697938+00:00, run_duration=0.605122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:22:00.687701+00:00, queued_by_job_id=2, pid=14921 2024-03-29T03:22:05.644690261Z [2024-03-29T03:22:05.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:22:05.645473308Z [2024-03-29T03:22:05.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:21:00+00:00, run_id=scheduled__2024-03-29T03:21:00+00:00, run_start_date=2024-03-29 03:22:00.606726+00:00, run_end_date=2024-03-29 03:22:05.644581+00:00, run_duration=5.037855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:21:00+00:00, data_interval_end=2024-03-29 03:22:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:22:05.660867859Z [2024-03-29T03:22:05.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:22:00+00:00, run_after=2024-03-29T03:23:00+00:00 2024-03-29T03:22:05.667401075Z [2024-03-29T03:22:05.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:22:05.667572454Z [2024-03-29T03:22:05.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:21:00+00:00, run_id=scheduled__2024-03-29T03:21:00+00:00, run_start_date=2024-03-29 03:22:00.608324+00:00, run_end_date=2024-03-29 03:22:05.667328+00:00, run_duration=5.059004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:21:00+00:00, data_interval_end=2024-03-29 03:22:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:22:05.676321539Z [2024-03-29T03:22:05.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:22:00+00:00, run_after=2024-03-29T03:23:00+00:00 2024-03-29T03:22:05.739098608Z [2024-03-29T03:22:05.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:21:00+00:00 exited with status success for try_number 1 2024-03-29T03:22:05.739351078Z [2024-03-29T03:22:05.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:21:00+00:00 exited with status success for try_number 1 2024-03-29T03:22:05.748796630Z [2024-03-29T03:22:05.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:21:00+00:00, map_index=-1, run_start_date=2024-03-29 03:22:03.256312+00:00, run_end_date=2024-03-29 03:22:04.877021+00:00, run_duration=1.620709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:22:00.687701+00:00, queued_by_job_id=2, pid=14938 2024-03-29T03:22:05.749137836Z [2024-03-29T03:22:05.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:21:00+00:00, map_index=-1, run_start_date=2024-03-29 03:22:03.589923+00:00, run_end_date=2024-03-29 03:22:04.936325+00:00, run_duration=1.346402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:22:00.687701+00:00, queued_by_job_id=2, pid=14949 2024-03-29T03:23:00.296078384Z [2024-03-29T03:23:00.295+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:23:00.307617575Z [2024-03-29T03:23:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:23:00+00:00, run_after=2024-03-29T03:24:00+00:00 2024-03-29T03:23:00.320489684Z [2024-03-29T03:23:00.320+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:23:00+00:00, run_after=2024-03-29T03:24:00+00:00 2024-03-29T03:23:00.374231889Z [2024-03-29T03:23:00.373+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:23:00.374253696Z 2024-03-29T03:23:00.374257204Z 2024-03-29T03:23:00.374260822Z 2024-03-29T03:23:00.374570208Z [2024-03-29T03:23:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:23:00.374801662Z [2024-03-29T03:23:00.374+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:23:00.374991206Z [2024-03-29T03:23:00.374+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:23:00.375647580Z [2024-03-29T03:23:00.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:23:00.375672552Z 2024-03-29T03:23:00.375678129Z 2024-03-29T03:23:00.375682795Z 2024-03-29T03:23:00.378485855Z [2024-03-29T03:23:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:23:00.378686773Z [2024-03-29T03:23:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:23:00.378981393Z [2024-03-29T03:23:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:23:00.379161381Z [2024-03-29T03:23:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:23:00.379435647Z [2024-03-29T03:23:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:23:00.379604774Z [2024-03-29T03:23:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:23:00.603201047Z [2024-03-29T03:23:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status queued for try_number 1 2024-03-29T03:23:00.605467320Z [2024-03-29T03:23:00.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status queued for try_number 1 2024-03-29T03:23:00.606018138Z [2024-03-29T03:23:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status queued for try_number 1 2024-03-29T03:23:00.613420867Z [2024-03-29T03:23:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02916681-8600-40d6-a094-dba852ed60eb 2024-03-29T03:23:00.613679396Z [2024-03-29T03:23:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6681123-a0e9-4bb3-8b79-6c14df55b3fd 2024-03-29T03:23:00.613920316Z [2024-03-29T03:23:00.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 943a461d-3255-42a1-9fda-83fd610e9b02 2024-03-29T03:23:02.528328916Z [2024-03-29T03:23:02.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:23:02.528583458Z [2024-03-29T03:23:02.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:22:00+00:00, run_id=scheduled__2024-03-29T03:22:00+00:00, run_start_date=2024-03-29 03:23:00.329106+00:00, run_end_date=2024-03-29 03:23:02.528228+00:00, run_duration=2.199122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:22:00+00:00, data_interval_end=2024-03-29 03:23:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:23:02.542811376Z [2024-03-29T03:23:02.538+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:23:00+00:00, run_after=2024-03-29T03:24:00+00:00 2024-03-29T03:23:02.647042092Z [2024-03-29T03:23:02.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status success for try_number 1 2024-03-29T03:23:02.655709378Z [2024-03-29T03:23:02.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:22:00+00:00, map_index=-1, run_start_date=2024-03-29 03:23:01.290077+00:00, run_end_date=2024-03-29 03:23:01.746361+00:00, run_duration=0.456284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:23:00.376343+00:00, queued_by_job_id=2, pid=14976 2024-03-29T03:23:04.303675029Z [2024-03-29T03:23:04.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:23:04.303979357Z [2024-03-29T03:23:04.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:22:00+00:00, run_id=scheduled__2024-03-29T03:22:00+00:00, run_start_date=2024-03-29 03:23:00.331128+00:00, run_end_date=2024-03-29 03:23:04.303554+00:00, run_duration=3.972426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:22:00+00:00, data_interval_end=2024-03-29 03:23:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:23:04.313858633Z [2024-03-29T03:23:04.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:23:00+00:00, run_after=2024-03-29T03:24:00+00:00 2024-03-29T03:23:04.321459949Z [2024-03-29T03:23:04.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:23:04.321734408Z [2024-03-29T03:23:04.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:22:00+00:00, run_id=scheduled__2024-03-29T03:22:00+00:00, run_start_date=2024-03-29 03:23:00.330176+00:00, run_end_date=2024-03-29 03:23:04.321326+00:00, run_duration=3.99115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:22:00+00:00, data_interval_end=2024-03-29 03:23:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:23:04.332929147Z [2024-03-29T03:23:04.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:23:00+00:00, run_after=2024-03-29T03:24:00+00:00 2024-03-29T03:23:04.373718385Z [2024-03-29T03:23:04.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status success for try_number 1 2024-03-29T03:23:04.374181628Z [2024-03-29T03:23:04.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status success for try_number 1 2024-03-29T03:23:04.384402248Z [2024-03-29T03:23:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:22:00+00:00, map_index=-1, run_start_date=2024-03-29 03:23:02.151630+00:00, run_end_date=2024-03-29 03:23:03.831292+00:00, run_duration=1.679662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:23:00.376343+00:00, queued_by_job_id=2, pid=14989 2024-03-29T03:23:04.384852967Z [2024-03-29T03:23:04.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:22:00+00:00, map_index=-1, run_start_date=2024-03-29 03:23:02.495228+00:00, run_end_date=2024-03-29 03:23:04.085691+00:00, run_duration=1.590463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:23:00.376343+00:00, queued_by_job_id=2, pid=15000 2024-03-29T03:23:46.913251790Z [2024-03-29T03:23:46.912+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:24:00.065664447Z [2024-03-29T03:24:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:24:00+00:00, run_after=2024-03-29T03:25:00+00:00 2024-03-29T03:24:00.085702117Z [2024-03-29T03:24:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:24:00+00:00, run_after=2024-03-29T03:25:00+00:00 2024-03-29T03:24:00.095015727Z [2024-03-29T03:24:00.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:24:00.104581962Z [2024-03-29T03:24:00.103+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:24:00.191806737Z [2024-03-29T03:24:00.191+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:24:00.191843361Z 2024-03-29T03:24:00.191848369Z 2024-03-29T03:24:00.191858889Z 2024-03-29T03:24:00.191862835Z 2024-03-29T03:24:00.191866829Z [2024-03-29T03:24:00.191+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:24:00.191876673Z [2024-03-29T03:24:00.191+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:24:00.192187244Z [2024-03-29T03:24:00.191+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:24:00.192200952Z [2024-03-29T03:24:00.192+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:24:00.192821386Z [2024-03-29T03:24:00.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:24:00.192832280Z 2024-03-29T03:24:00.192836321Z 2024-03-29T03:24:00.192839601Z 2024-03-29T03:24:00.192882306Z 2024-03-29T03:24:00.198751348Z [2024-03-29T03:24:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:24:00.198803095Z [2024-03-29T03:24:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:24:00.198991579Z [2024-03-29T03:24:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:24:00.199064033Z [2024-03-29T03:24:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:24:00.199228524Z [2024-03-29T03:24:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:24:00.199300671Z [2024-03-29T03:24:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:24:00.199488860Z [2024-03-29T03:24:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:24:00.199494743Z [2024-03-29T03:24:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:24:00.759698507Z [2024-03-29T03:24:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status queued for try_number 1 2024-03-29T03:24:00.760865477Z [2024-03-29T03:24:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:23:00+00:00 exited with status queued for try_number 1 2024-03-29T03:24:00.761347208Z [2024-03-29T03:24:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:23:00+00:00 exited with status queued for try_number 1 2024-03-29T03:24:00.761593281Z [2024-03-29T03:24:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:23:00+00:00 exited with status queued for try_number 1 2024-03-29T03:24:00.779320653Z [2024-03-29T03:24:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46028929-02b4-42ba-bcd3-e97ec40cc4e1 2024-03-29T03:24:00.779783696Z [2024-03-29T03:24:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11ba1f69-63c7-4c5b-9e5f-9bb5737591a9 2024-03-29T03:24:00.780053841Z [2024-03-29T03:24:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceb37b56-9288-41a3-9d24-c249cfdbc539 2024-03-29T03:24:00.780309899Z [2024-03-29T03:24:00.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1461d36-5005-4a0f-b99e-2eda096eb8cf 2024-03-29T03:24:01.822143458Z [2024-03-29T03:24:01.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:24:01.822704399Z [2024-03-29T03:24:01.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:22:00+00:00, run_id=scheduled__2024-03-29T03:22:00+00:00, run_start_date=2024-03-29 03:24:00.117632+00:00, run_end_date=2024-03-29 03:24:01.821996+00:00, run_duration=1.704364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:22:00+00:00, data_interval_end=2024-03-29 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:24:01.833937232Z [2024-03-29T03:24:01.833+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:24:00+00:00, run_after=2024-03-29T03:26:00+00:00 2024-03-29T03:24:01.842672769Z [2024-03-29T03:24:01.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:24:01.843148259Z [2024-03-29T03:24:01.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:23:00+00:00, run_id=scheduled__2024-03-29T03:23:00+00:00, run_start_date=2024-03-29 03:24:00.118863+00:00, run_end_date=2024-03-29 03:24:01.842753+00:00, run_duration=1.72389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:23:00+00:00, data_interval_end=2024-03-29 03:24:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:24:01.854509847Z [2024-03-29T03:24:01.854+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:24:00+00:00, run_after=2024-03-29T03:25:00+00:00 2024-03-29T03:24:01.944047583Z [2024-03-29T03:24:01.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:22:00+00:00 exited with status success for try_number 1 2024-03-29T03:24:01.944527129Z [2024-03-29T03:24:01.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:23:00+00:00 exited with status success for try_number 1 2024-03-29T03:24:01.955630608Z [2024-03-29T03:24:01.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:22:00+00:00, map_index=-1, run_start_date=2024-03-29 03:24:00.992494+00:00, run_end_date=2024-03-29 03:24:01.482852+00:00, run_duration=0.490358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:24:00.193731+00:00, queued_by_job_id=2, pid=15028 2024-03-29T03:24:01.956521759Z [2024-03-29T03:24:01.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:23:00+00:00, map_index=-1, run_start_date=2024-03-29 03:24:01.121251+00:00, run_end_date=2024-03-29 03:24:01.672603+00:00, run_duration=0.551352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:24:00.193731+00:00, queued_by_job_id=2, pid=15029 2024-03-29T03:24:04.138734299Z [2024-03-29T03:24:04.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:24:04.139042926Z [2024-03-29T03:24:04.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:23:00+00:00, run_id=scheduled__2024-03-29T03:23:00+00:00, run_start_date=2024-03-29 03:24:00.119856+00:00, run_end_date=2024-03-29 03:24:04.138605+00:00, run_duration=4.018749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:23:00+00:00, data_interval_end=2024-03-29 03:24:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:24:04.151478692Z [2024-03-29T03:24:04.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:24:00+00:00, run_after=2024-03-29T03:25:00+00:00 2024-03-29T03:24:04.160816690Z [2024-03-29T03:24:04.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:24:04.161085416Z [2024-03-29T03:24:04.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:23:00+00:00, run_id=scheduled__2024-03-29T03:23:00+00:00, run_start_date=2024-03-29 03:24:00.122068+00:00, run_end_date=2024-03-29 03:24:04.160692+00:00, run_duration=4.038624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:23:00+00:00, data_interval_end=2024-03-29 03:24:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:24:04.174735034Z [2024-03-29T03:24:04.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:24:00+00:00, run_after=2024-03-29T03:25:00+00:00 2024-03-29T03:24:04.210892812Z [2024-03-29T03:24:04.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:23:00+00:00 exited with status success for try_number 1 2024-03-29T03:24:04.220082528Z [2024-03-29T03:24:04.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:23:00+00:00, map_index=-1, run_start_date=2024-03-29 03:24:02.506648+00:00, run_end_date=2024-03-29 03:24:03.979895+00:00, run_duration=1.473247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:24:00.193731+00:00, queued_by_job_id=2, pid=15053 2024-03-29T03:24:05.298567779Z [2024-03-29T03:24:05.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:23:00+00:00 exited with status success for try_number 1 2024-03-29T03:24:05.304397343Z [2024-03-29T03:24:05.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:23:00+00:00, map_index=-1, run_start_date=2024-03-29 03:24:02.401115+00:00, run_end_date=2024-03-29 03:24:04.092673+00:00, run_duration=1.691558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:24:00.193731+00:00, queued_by_job_id=2, pid=15052 2024-03-29T03:25:00.608256114Z [2024-03-29T03:25:00.607+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:25:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:25:00.624041563Z [2024-03-29T03:25:00.623+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:25:00+00:00, run_after=2024-03-29T03:26:00+00:00 2024-03-29T03:25:00.632612395Z [2024-03-29T03:25:00.632+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:25:00.645268870Z [2024-03-29T03:25:00.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:25:00+00:00, run_after=2024-03-29T03:26:00+00:00 2024-03-29T03:25:00.729914149Z [2024-03-29T03:25:00.729+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:25:00.729939682Z 2024-03-29T03:25:00.729944220Z 2024-03-29T03:25:00.729947632Z 2024-03-29T03:25:00.729951000Z 2024-03-29T03:25:00.729954498Z [2024-03-29T03:25:00.729+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:25:00.730110437Z [2024-03-29T03:25:00.729+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:25:00.730402702Z [2024-03-29T03:25:00.730+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:25:00.730619726Z [2024-03-29T03:25:00.730+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:25:00.731485875Z [2024-03-29T03:25:00.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:25:00.731514403Z 2024-03-29T03:25:00.731543829Z 2024-03-29T03:25:00.731562134Z 2024-03-29T03:25:00.731567143Z 2024-03-29T03:25:00.735805184Z [2024-03-29T03:25:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:25:00.735996066Z [2024-03-29T03:25:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:25:00.736385747Z [2024-03-29T03:25:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:25:00.736492752Z [2024-03-29T03:25:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:25:00.737260756Z [2024-03-29T03:25:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:25:00.737526041Z [2024-03-29T03:25:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:25:00.737900918Z [2024-03-29T03:25:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:25:00.738115059Z [2024-03-29T03:25:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:25:01.064922479Z [2024-03-29T03:25:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:25:01.064966623Z [2024-03-29T03:25:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status queued for try_number 1 2024-03-29T03:25:01.065245486Z [2024-03-29T03:25:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status queued for try_number 1 2024-03-29T03:25:01.065454078Z [2024-03-29T03:25:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status queued for try_number 1 2024-03-29T03:25:01.077763102Z [2024-03-29T03:25:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4bfe99a-1856-4680-b5b4-7c790442ae56 2024-03-29T03:25:01.078103939Z [2024-03-29T03:25:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to da6a2e3d-95d2-4a13-93a3-7539b4f099c8 2024-03-29T03:25:01.078272049Z [2024-03-29T03:25:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa0513cd-a912-47f9-8de7-fbe1512c2bd7 2024-03-29T03:25:01.078655244Z [2024-03-29T03:25:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29f91376-3d1d-4b29-9f3b-67b962453f71 2024-03-29T03:25:03.613249555Z [2024-03-29T03:25:03.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:25:03.613925661Z [2024-03-29T03:25:03.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:24:00+00:00, run_id=scheduled__2024-03-29T03:24:00+00:00, run_start_date=2024-03-29 03:25:00.658239+00:00, run_end_date=2024-03-29 03:25:03.613153+00:00, run_duration=2.954914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:24:00+00:00, data_interval_end=2024-03-29 03:25:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:25:03.628904689Z [2024-03-29T03:25:03.628+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:25:00+00:00, run_after=2024-03-29T03:26:00+00:00 2024-03-29T03:25:03.688603115Z [2024-03-29T03:25:03.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status success for try_number 1 2024-03-29T03:25:03.695356941Z [2024-03-29T03:25:03.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:24:00+00:00, map_index=-1, run_start_date=2024-03-29 03:25:01.835612+00:00, run_end_date=2024-03-29 03:25:02.329651+00:00, run_duration=0.494039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:25:00.732913+00:00, queued_by_job_id=2, pid=15086 2024-03-29T03:25:04.750142366Z [2024-03-29T03:25:04.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:25:04.750926444Z [2024-03-29T03:25:04.750+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:24:00+00:00, run_id=scheduled__2024-03-29T03:24:00+00:00, run_start_date=2024-03-29 03:25:00.659668+00:00, run_end_date=2024-03-29 03:25:04.750049+00:00, run_duration=4.090381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:24:00+00:00, data_interval_end=2024-03-29 03:25:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:25:04.763380692Z [2024-03-29T03:25:04.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:25:00+00:00, run_after=2024-03-29T03:26:00+00:00 2024-03-29T03:25:04.788711809Z [2024-03-29T03:25:04.788+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:25:04.788735543Z 2024-03-29T03:25:04.788746505Z [2024-03-29T03:25:04.788+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:25:04.789350475Z [2024-03-29T03:25:04.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:25:04.789365213Z 2024-03-29T03:25:04.791878650Z [2024-03-29T03:25:04.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:25:04.791980886Z [2024-03-29T03:25:04.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:25:04.847224178Z [2024-03-29T03:25:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:25:04.847347429Z [2024-03-29T03:25:04.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:25:04.847552044Z [2024-03-29T03:25:04.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status success for try_number 1 2024-03-29T03:25:04.859172414Z [2024-03-29T03:25:04.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=-1, run_start_date=2024-03-29 03:25:03.446411+00:00, run_end_date=2024-03-29 03:25:03.888914+00:00, run_duration=0.442503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:25:00.732913+00:00, queued_by_job_id=2, pid=15111 2024-03-29T03:25:04.859486757Z [2024-03-29T03:25:04.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cdd68e7-60e3-429f-bd3a-4aef5ec790f9 2024-03-29T03:25:04.859888221Z [2024-03-29T03:25:04.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:24:00+00:00, map_index=-1, run_start_date=2024-03-29 03:25:03.238072+00:00, run_end_date=2024-03-29 03:25:04.592719+00:00, run_duration=1.354647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:25:00.732913+00:00, queued_by_job_id=2, pid=15109 2024-03-29T03:25:06.172566500Z [2024-03-29T03:25:06.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:25:06.172598078Z [2024-03-29T03:25:06.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:24:00+00:00, run_id=scheduled__2024-03-29T03:24:00+00:00, run_start_date=2024-03-29 03:25:00.660882+00:00, run_end_date=2024-03-29 03:25:06.169862+00:00, run_duration=5.50898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:24:00+00:00, data_interval_end=2024-03-29 03:25:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:25:06.203178004Z [2024-03-29T03:25:06.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:25:00+00:00, run_after=2024-03-29T03:26:00+00:00 2024-03-29T03:25:06.313981338Z [2024-03-29T03:25:06.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status success for try_number 1 2024-03-29T03:25:06.320056806Z [2024-03-29T03:25:06.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:24:00+00:00, map_index=-1, run_start_date=2024-03-29 03:25:03.471059+00:00, run_end_date=2024-03-29 03:25:05.875892+00:00, run_duration=2.404833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:25:00.732913+00:00, queued_by_job_id=2, pid=15112 2024-03-29T03:25:07.920760464Z [2024-03-29T03:25:07.920+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:25:07.920805071Z 2024-03-29T03:25:07.920810904Z [2024-03-29T03:25:07.920+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:25:07.921397235Z [2024-03-29T03:25:07.921+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:25:07.921414598Z 2024-03-29T03:25:07.923993845Z [2024-03-29T03:25:07.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:25:07.924217705Z [2024-03-29T03:25:07.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:25:07.971174746Z [2024-03-29T03:25:07.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:25:07.971362328Z [2024-03-29T03:25:07.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:25:07.976720436Z [2024-03-29T03:25:07.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to c70d1b76-74d6-4db1-9f70-3ff8a8a20d35 2024-03-29T03:25:07.976976905Z [2024-03-29T03:25:07.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=-1, run_start_date=2024-03-29 03:25:06.794631+00:00, run_end_date=2024-03-29 03:25:07.345563+00:00, run_duration=0.550932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:25:04.789666+00:00, queued_by_job_id=2, pid=15135 2024-03-29T03:25:11.316203058Z [2024-03-29T03:25:11.315+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:25:11.316244267Z 2024-03-29T03:25:11.316253356Z [2024-03-29T03:25:11.315+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:25:11.316840893Z [2024-03-29T03:25:11.316+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:25:11.316860326Z 2024-03-29T03:25:11.321037858Z [2024-03-29T03:25:11.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:25:11.321082742Z [2024-03-29T03:25:11.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:25:11.396811980Z [2024-03-29T03:25:11.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status queued for try_number 1 2024-03-29T03:25:11.397223615Z [2024-03-29T03:25:11.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:25:11.406689464Z [2024-03-29T03:25:11.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0ed974f-a029-4006-bca0-504f3998dc71 2024-03-29T03:25:11.407096456Z [2024-03-29T03:25:11.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=0, run_start_date=2024-03-29 03:25:09.767338+00:00, run_end_date=2024-03-29 03:25:10.898591+00:00, run_duration=1.131253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:25:07.921834+00:00, queued_by_job_id=2, pid=15143 2024-03-29T03:25:13.671485467Z [2024-03-29T03:25:13.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:25:13.671865417Z [2024-03-29T03:25:13.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:20:00+00:00, run_id=scheduled__2024-03-29T03:20:00+00:00, run_start_date=2024-03-29 03:25:00.656942+00:00, run_end_date=2024-03-29 03:25:13.671417+00:00, run_duration=13.014475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:20:00+00:00, data_interval_end=2024-03-29 03:25:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:25:13.679360236Z [2024-03-29T03:25:13.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:25:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:25:13.712891259Z [2024-03-29T03:25:13.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:20:00+00:00 exited with status success for try_number 1 2024-03-29T03:25:13.719614806Z [2024-03-29T03:25:13.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:20:00+00:00, map_index=-1, run_start_date=2024-03-29 03:25:12.986622+00:00, run_end_date=2024-03-29 03:25:13.366110+00:00, run_duration=0.379488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:25:11.317160+00:00, queued_by_job_id=2, pid=15156 2024-03-29T03:26:00.705971360Z [2024-03-29T03:26:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:26:00+00:00, run_after=2024-03-29T03:27:00+00:00 2024-03-29T03:26:00.725402188Z [2024-03-29T03:26:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:26:00+00:00, run_after=2024-03-29T03:27:00+00:00 2024-03-29T03:26:00.735120494Z [2024-03-29T03:26:00.734+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:26:00.743422822Z [2024-03-29T03:26:00.743+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:26:00.868380269Z [2024-03-29T03:26:00.868+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:26:00.868405640Z 2024-03-29T03:26:00.868409783Z 2024-03-29T03:26:00.868413188Z 2024-03-29T03:26:00.868429094Z 2024-03-29T03:26:00.868696190Z [2024-03-29T03:26:00.868+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:26:00.868919983Z [2024-03-29T03:26:00.868+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:26:00.869122827Z [2024-03-29T03:26:00.868+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:26:00.869330550Z [2024-03-29T03:26:00.869+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:26:00.871240024Z [2024-03-29T03:26:00.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:26:00.871256048Z 2024-03-29T03:26:00.871259895Z 2024-03-29T03:26:00.871263077Z 2024-03-29T03:26:00.871266309Z 2024-03-29T03:26:00.881152155Z [2024-03-29T03:26:00.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:26:00.882005746Z [2024-03-29T03:26:00.881+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:26:00.882903279Z [2024-03-29T03:26:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:26:00.883430406Z [2024-03-29T03:26:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:26:00.884376762Z [2024-03-29T03:26:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:26:00.885064588Z [2024-03-29T03:26:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:26:00.885480342Z [2024-03-29T03:26:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:26:00.885808519Z [2024-03-29T03:26:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:26:01.460220320Z [2024-03-29T03:26:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status queued for try_number 1 2024-03-29T03:26:01.460511990Z [2024-03-29T03:26:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status queued for try_number 1 2024-03-29T03:26:01.460751715Z [2024-03-29T03:26:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status queued for try_number 1 2024-03-29T03:26:01.461006444Z [2024-03-29T03:26:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status queued for try_number 1 2024-03-29T03:26:01.478507805Z [2024-03-29T03:26:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to d426c2da-1722-4523-a47e-9c2ffd1b74ba 2024-03-29T03:26:01.478878613Z [2024-03-29T03:26:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35820b1d-4b1c-4dee-8c79-5d6d2d8c6518 2024-03-29T03:26:01.479165476Z [2024-03-29T03:26:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd8b0401-c667-42b2-98b1-6048be356044 2024-03-29T03:26:01.479474647Z [2024-03-29T03:26:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65936ffc-c96c-44b4-b6b8-e6d29b64cdf8 2024-03-29T03:26:02.601872154Z [2024-03-29T03:26:02.601+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:26:02.602505517Z [2024-03-29T03:26:02.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:24:00+00:00, run_id=scheduled__2024-03-29T03:24:00+00:00, run_start_date=2024-03-29 03:26:00.757723+00:00, run_end_date=2024-03-29 03:26:02.602009+00:00, run_duration=1.844286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:24:00+00:00, data_interval_end=2024-03-29 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:26:02.625811585Z [2024-03-29T03:26:02.625+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:26:00+00:00, run_after=2024-03-29T03:28:00+00:00 2024-03-29T03:26:02.766596675Z [2024-03-29T03:26:02.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:24:00+00:00 exited with status success for try_number 1 2024-03-29T03:26:02.779593210Z [2024-03-29T03:26:02.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:24:00+00:00, map_index=-1, run_start_date=2024-03-29 03:26:01.938433+00:00, run_end_date=2024-03-29 03:26:02.341453+00:00, run_duration=0.40302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:26:00.872350+00:00, queued_by_job_id=2, pid=15179 2024-03-29T03:26:03.881042519Z [2024-03-29T03:26:03.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:26:03.881527857Z [2024-03-29T03:26:03.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:25:00+00:00, run_id=scheduled__2024-03-29T03:25:00+00:00, run_start_date=2024-03-29 03:26:00.759238+00:00, run_end_date=2024-03-29 03:26:03.880879+00:00, run_duration=3.121641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:25:00+00:00, data_interval_end=2024-03-29 03:26:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:26:03.890693617Z [2024-03-29T03:26:03.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:26:00+00:00, run_after=2024-03-29T03:27:00+00:00 2024-03-29T03:26:03.938526544Z [2024-03-29T03:26:03.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status success for try_number 1 2024-03-29T03:26:03.944730867Z [2024-03-29T03:26:03.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:25:00+00:00, map_index=-1, run_start_date=2024-03-29 03:26:02.183450+00:00, run_end_date=2024-03-29 03:26:02.701741+00:00, run_duration=0.518291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:26:00.872350+00:00, queued_by_job_id=2, pid=15180 2024-03-29T03:26:05.029443024Z [2024-03-29T03:26:05.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:26:05.029477254Z [2024-03-29T03:26:05.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:25:00+00:00, run_id=scheduled__2024-03-29T03:25:00+00:00, run_start_date=2024-03-29 03:26:00.763044+00:00, run_end_date=2024-03-29 03:26:05.027563+00:00, run_duration=4.264519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:25:00+00:00, data_interval_end=2024-03-29 03:26:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:26:05.040042904Z [2024-03-29T03:26:05.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:26:00+00:00, run_after=2024-03-29T03:27:00+00:00 2024-03-29T03:26:05.077332035Z [2024-03-29T03:26:05.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status success for try_number 1 2024-03-29T03:26:05.083208472Z [2024-03-29T03:26:05.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:25:00+00:00, map_index=-1, run_start_date=2024-03-29 03:26:03.151171+00:00, run_end_date=2024-03-29 03:26:04.825374+00:00, run_duration=1.674203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:26:00.872350+00:00, queued_by_job_id=2, pid=15203 2024-03-29T03:26:06.135310641Z [2024-03-29T03:26:06.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:26:06.135910677Z [2024-03-29T03:26:06.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:25:00+00:00, run_id=scheduled__2024-03-29T03:25:00+00:00, run_start_date=2024-03-29 03:26:00.765588+00:00, run_end_date=2024-03-29 03:26:06.135157+00:00, run_duration=5.369569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:25:00+00:00, data_interval_end=2024-03-29 03:26:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:26:06.146742353Z [2024-03-29T03:26:06.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:26:00+00:00, run_after=2024-03-29T03:27:00+00:00 2024-03-29T03:26:06.185579744Z [2024-03-29T03:26:06.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status success for try_number 1 2024-03-29T03:26:06.196267340Z [2024-03-29T03:26:06.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:25:00+00:00, map_index=-1, run_start_date=2024-03-29 03:26:03.255733+00:00, run_end_date=2024-03-29 03:26:05.377926+00:00, run_duration=2.122193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:26:00.872350+00:00, queued_by_job_id=2, pid=15204 2024-03-29T03:26:57.604904513Z [2024-03-29T03:26:57.604+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:26:57.604946019Z 2024-03-29T03:26:57.604963290Z [2024-03-29T03:26:57.604+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-03-29T03:26:57.605703509Z [2024-03-29T03:26:57.605+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:26:57.605745472Z 2024-03-29T03:26:57.608760575Z [2024-03-29T03:26:57.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240329032657_255056', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:26:57.608883972Z [2024-03-29T03:26:57.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240329032657_255056', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-29T03:26:57.664730222Z [2024-03-29T03:26:57.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240329032657_255056 exited with status queued for try_number 1 2024-03-29T03:26:57.671705905Z [2024-03-29T03:26:57.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9009d02-1b17-4aa8-93f7-16f72f2d7a99 2024-03-29T03:26:59.516136520Z [2024-03-29T03:26:59.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:26:59.516299293Z [2024-03-29T03:26:59.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-03-29 03:26:57.337615+00:00, run_id=vdu_alarm_20240329032657_255056, run_start_date=2024-03-29 03:26:57.563328+00:00, run_end_date=2024-03-29 03:26:59.515915+00:00, run_duration=1.952587, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-29 03:26:57.337615+00:00, data_interval_end=2024-03-29 03:26:57.337615+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-03-29T03:26:59.519523398Z [2024-03-29T03:26:59.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-03-29T03:26:59.545842024Z [2024-03-29T03:26:59.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240329032657_255056 exited with status success for try_number 1 2024-03-29T03:26:59.550871760Z [2024-03-29T03:26:59.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240329032657_255056, map_index=-1, run_start_date=2024-03-29 03:26:58.223449+00:00, run_end_date=2024-03-29 03:26:58.549281+00:00, run_duration=0.325832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:26:57.606030+00:00, queued_by_job_id=2, pid=15229 2024-03-29T03:27:00.581452223Z [2024-03-29T03:27:00.580+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:27:00.600303464Z [2024-03-29T03:27:00.599+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:27:00+00:00, run_after=2024-03-29T03:28:00+00:00 2024-03-29T03:27:00.618549597Z [2024-03-29T03:27:00.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:27:00+00:00, run_after=2024-03-29T03:28:00+00:00 2024-03-29T03:27:00.698328926Z [2024-03-29T03:27:00.697+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:27:00.698358732Z 2024-03-29T03:27:00.698413509Z 2024-03-29T03:27:00.698425983Z 2024-03-29T03:27:00.698491328Z [2024-03-29T03:27:00.698+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:27:00.698659084Z [2024-03-29T03:27:00.698+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:27:00.698893331Z [2024-03-29T03:27:00.698+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:27:00.699538469Z [2024-03-29T03:27:00.699+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:27:00.699584313Z 2024-03-29T03:27:00.699589034Z 2024-03-29T03:27:00.699592243Z 2024-03-29T03:27:00.703983497Z [2024-03-29T03:27:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:27:00.704227842Z [2024-03-29T03:27:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:27:00.704577325Z [2024-03-29T03:27:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:27:00.704952641Z [2024-03-29T03:27:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:27:00.705421646Z [2024-03-29T03:27:00.705+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:27:00.705686278Z [2024-03-29T03:27:00.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:27:00.943350387Z [2024-03-29T03:27:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status queued for try_number 1 2024-03-29T03:27:00.943609743Z [2024-03-29T03:27:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status queued for try_number 1 2024-03-29T03:27:00.943793082Z [2024-03-29T03:27:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status queued for try_number 1 2024-03-29T03:27:00.952394915Z [2024-03-29T03:27:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99be7a8f-5f4e-4f0f-a8b6-51d9973af7c0 2024-03-29T03:27:00.952614365Z [2024-03-29T03:27:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to bea57e20-0208-4a3d-92d6-5337cbdfb50b 2024-03-29T03:27:00.952807649Z [2024-03-29T03:27:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4e7d10f-861e-4a9c-9595-8758cbbbe31d 2024-03-29T03:27:02.123210524Z [2024-03-29T03:27:02.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:27:02.123621833Z [2024-03-29T03:27:02.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:26:00+00:00, run_id=scheduled__2024-03-29T03:26:00+00:00, run_start_date=2024-03-29 03:27:00.631857+00:00, run_end_date=2024-03-29 03:27:02.123119+00:00, run_duration=1.491262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:26:00+00:00, data_interval_end=2024-03-29 03:27:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:27:02.133039593Z [2024-03-29T03:27:02.132+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:27:00+00:00, run_after=2024-03-29T03:28:00+00:00 2024-03-29T03:27:02.181968739Z [2024-03-29T03:27:02.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status success for try_number 1 2024-03-29T03:27:02.187785203Z [2024-03-29T03:27:02.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:26:00+00:00, map_index=-1, run_start_date=2024-03-29 03:27:01.506047+00:00, run_end_date=2024-03-29 03:27:01.991039+00:00, run_duration=0.484992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:27:00.700478+00:00, queued_by_job_id=2, pid=15243 2024-03-29T03:27:04.629365825Z [2024-03-29T03:27:04.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:27:04.629462818Z [2024-03-29T03:27:04.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:26:00+00:00, run_id=scheduled__2024-03-29T03:26:00+00:00, run_start_date=2024-03-29 03:27:00.633383+00:00, run_end_date=2024-03-29 03:27:04.629198+00:00, run_duration=3.995815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:26:00+00:00, data_interval_end=2024-03-29 03:27:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:27:04.637838747Z [2024-03-29T03:27:04.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:27:00+00:00, run_after=2024-03-29T03:28:00+00:00 2024-03-29T03:27:04.675241723Z [2024-03-29T03:27:04.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status success for try_number 1 2024-03-29T03:27:04.684308622Z [2024-03-29T03:27:04.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:26:00+00:00, map_index=-1, run_start_date=2024-03-29 03:27:02.605958+00:00, run_end_date=2024-03-29 03:27:04.054602+00:00, run_duration=1.448644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:27:00.700478+00:00, queued_by_job_id=2, pid=15262 2024-03-29T03:27:05.741225779Z [2024-03-29T03:27:05.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:27:05.741702718Z [2024-03-29T03:27:05.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:26:00+00:00, run_id=scheduled__2024-03-29T03:26:00+00:00, run_start_date=2024-03-29 03:27:00.635894+00:00, run_end_date=2024-03-29 03:27:05.741198+00:00, run_duration=5.105304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:26:00+00:00, data_interval_end=2024-03-29 03:27:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:27:05.751911491Z [2024-03-29T03:27:05.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:27:00+00:00, run_after=2024-03-29T03:28:00+00:00 2024-03-29T03:27:05.784979586Z [2024-03-29T03:27:05.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status success for try_number 1 2024-03-29T03:27:05.789910162Z [2024-03-29T03:27:05.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:26:00+00:00, map_index=-1, run_start_date=2024-03-29 03:27:02.541465+00:00, run_end_date=2024-03-29 03:27:05.077077+00:00, run_duration=2.535612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:27:00.700478+00:00, queued_by_job_id=2, pid=15261 2024-03-29T03:28:00.373482904Z [2024-03-29T03:28:00.372+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:28:00.382252839Z [2024-03-29T03:28:00.381+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:28:00.398842494Z [2024-03-29T03:28:00.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:28:00+00:00, run_after=2024-03-29T03:29:00+00:00 2024-03-29T03:28:00.413383958Z [2024-03-29T03:28:00.412+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:28:00+00:00, run_after=2024-03-29T03:29:00+00:00 2024-03-29T03:28:00.528237202Z [2024-03-29T03:28:00.527+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:28:00.528281647Z 2024-03-29T03:28:00.528287393Z 2024-03-29T03:28:00.528291170Z 2024-03-29T03:28:00.528310371Z 2024-03-29T03:28:00.528424898Z [2024-03-29T03:28:00.528+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:28:00.528641062Z [2024-03-29T03:28:00.528+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:28:00.528835039Z [2024-03-29T03:28:00.528+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:28:00.529047055Z [2024-03-29T03:28:00.528+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:28:00.530160243Z [2024-03-29T03:28:00.529+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:28:00.530176820Z 2024-03-29T03:28:00.530182451Z 2024-03-29T03:28:00.530187164Z 2024-03-29T03:28:00.530191807Z 2024-03-29T03:28:00.536244672Z [2024-03-29T03:28:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:28:00.536494467Z [2024-03-29T03:28:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:28:00.536944259Z [2024-03-29T03:28:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:28:00.537084022Z [2024-03-29T03:28:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:28:00.537615152Z [2024-03-29T03:28:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:28:00.537848629Z [2024-03-29T03:28:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:28:00.538173715Z [2024-03-29T03:28:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:28:00.538329322Z [2024-03-29T03:28:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:28:00.879660535Z [2024-03-29T03:28:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status queued for try_number 1 2024-03-29T03:28:00.879692340Z [2024-03-29T03:28:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:27:00+00:00 exited with status queued for try_number 1 2024-03-29T03:28:00.879808558Z [2024-03-29T03:28:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:27:00+00:00 exited with status queued for try_number 1 2024-03-29T03:28:00.879869649Z [2024-03-29T03:28:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:27:00+00:00 exited with status queued for try_number 1 2024-03-29T03:28:00.900287357Z [2024-03-29T03:28:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8a078c1-8aae-4098-ab3f-71544ce6f10e 2024-03-29T03:28:00.900355596Z [2024-03-29T03:28:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6298694-6b6c-42be-8f36-ae96999e4cf5 2024-03-29T03:28:00.900488937Z [2024-03-29T03:28:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21533ecb-ccbc-4443-af4d-86b61372dd9a 2024-03-29T03:28:00.900581746Z [2024-03-29T03:28:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07db8359-33a8-43ff-b533-240cc0cb6a04 2024-03-29T03:28:02.225396402Z [2024-03-29T03:28:02.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:28:02.225807145Z [2024-03-29T03:28:02.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:27:00+00:00, run_id=scheduled__2024-03-29T03:27:00+00:00, run_start_date=2024-03-29 03:28:00.426593+00:00, run_end_date=2024-03-29 03:28:02.225326+00:00, run_duration=1.798733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:27:00+00:00, data_interval_end=2024-03-29 03:28:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:28:02.261282530Z [2024-03-29T03:28:02.260+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:28:00+00:00, run_after=2024-03-29T03:29:00+00:00 2024-03-29T03:28:02.338047638Z [2024-03-29T03:28:02.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:27:00+00:00 exited with status success for try_number 1 2024-03-29T03:28:02.346521931Z [2024-03-29T03:28:02.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:27:00+00:00, map_index=-1, run_start_date=2024-03-29 03:28:01.494013+00:00, run_end_date=2024-03-29 03:28:01.949132+00:00, run_duration=0.455119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:28:00.531894+00:00, queued_by_job_id=2, pid=15295 2024-03-29T03:28:03.396224213Z [2024-03-29T03:28:03.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:28:03.396804460Z [2024-03-29T03:28:03.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:26:00+00:00, run_id=scheduled__2024-03-29T03:26:00+00:00, run_start_date=2024-03-29 03:28:00.424958+00:00, run_end_date=2024-03-29 03:28:03.396360+00:00, run_duration=2.971402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:26:00+00:00, data_interval_end=2024-03-29 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:28:03.411165285Z [2024-03-29T03:28:03.410+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:28:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:28:03.486601175Z [2024-03-29T03:28:03.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:26:00+00:00 exited with status success for try_number 1 2024-03-29T03:28:03.494340646Z [2024-03-29T03:28:03.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:26:00+00:00, map_index=-1, run_start_date=2024-03-29 03:28:01.803288+00:00, run_end_date=2024-03-29 03:28:02.313897+00:00, run_duration=0.510609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:28:00.531894+00:00, queued_by_job_id=2, pid=15302 2024-03-29T03:28:05.534811395Z [2024-03-29T03:28:05.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:28:05.535381469Z [2024-03-29T03:28:05.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:27:00+00:00, run_id=scheduled__2024-03-29T03:27:00+00:00, run_start_date=2024-03-29 03:28:00.427730+00:00, run_end_date=2024-03-29 03:28:05.534731+00:00, run_duration=5.107001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:27:00+00:00, data_interval_end=2024-03-29 03:28:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:28:05.549084331Z [2024-03-29T03:28:05.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:28:00+00:00, run_after=2024-03-29T03:29:00+00:00 2024-03-29T03:28:05.566383384Z [2024-03-29T03:28:05.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:28:05.566988279Z [2024-03-29T03:28:05.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:27:00+00:00, run_id=scheduled__2024-03-29T03:27:00+00:00, run_start_date=2024-03-29 03:28:00.428816+00:00, run_end_date=2024-03-29 03:28:05.566627+00:00, run_duration=5.137811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:27:00+00:00, data_interval_end=2024-03-29 03:28:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:28:05.577971057Z [2024-03-29T03:28:05.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:28:00+00:00, run_after=2024-03-29T03:29:00+00:00 2024-03-29T03:28:05.632584394Z [2024-03-29T03:28:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:27:00+00:00 exited with status success for try_number 1 2024-03-29T03:28:05.640947905Z [2024-03-29T03:28:05.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:27:00+00:00, map_index=-1, run_start_date=2024-03-29 03:28:02.771155+00:00, run_end_date=2024-03-29 03:28:04.469096+00:00, run_duration=1.697941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:28:00.531894+00:00, queued_by_job_id=2, pid=15319 2024-03-29T03:28:06.727770388Z [2024-03-29T03:28:06.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:27:00+00:00 exited with status success for try_number 1 2024-03-29T03:28:06.736188190Z [2024-03-29T03:28:06.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:27:00+00:00, map_index=-1, run_start_date=2024-03-29 03:28:02.977267+00:00, run_end_date=2024-03-29 03:28:05.471222+00:00, run_duration=2.493955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:28:00.531894+00:00, queued_by_job_id=2, pid=15320 2024-03-29T03:28:46.957866109Z [2024-03-29T03:28:46.957+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:29:00.235076338Z [2024-03-29T03:29:00.234+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:29:00.253759935Z [2024-03-29T03:29:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:29:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:29:00.265696311Z [2024-03-29T03:29:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:29:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:29:00.316661944Z [2024-03-29T03:29:00.316+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:29:00.316685272Z 2024-03-29T03:29:00.316688916Z 2024-03-29T03:29:00.316705940Z 2024-03-29T03:29:00.316888624Z [2024-03-29T03:29:00.316+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:29:00.317049176Z [2024-03-29T03:29:00.316+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:29:00.317194719Z [2024-03-29T03:29:00.317+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:29:00.317814744Z [2024-03-29T03:29:00.317+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:29:00.317826048Z 2024-03-29T03:29:00.317829453Z 2024-03-29T03:29:00.317832481Z 2024-03-29T03:29:00.320618516Z [2024-03-29T03:29:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:29:00.320656107Z [2024-03-29T03:29:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:29:00.320872926Z [2024-03-29T03:29:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:29:00.320904750Z [2024-03-29T03:29:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:29:00.321114863Z [2024-03-29T03:29:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:29:00.321169538Z [2024-03-29T03:29:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:29:00.801768113Z [2024-03-29T03:29:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status queued for try_number 1 2024-03-29T03:29:00.801887423Z [2024-03-29T03:29:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status queued for try_number 1 2024-03-29T03:29:00.802065820Z [2024-03-29T03:29:00.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status queued for try_number 1 2024-03-29T03:29:00.833504894Z [2024-03-29T03:29:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to c719f149-50ff-4df4-bb9e-ad4db78fd158 2024-03-29T03:29:00.833646549Z [2024-03-29T03:29:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19aa5b61-4550-41dd-9df8-f53c62e63bbc 2024-03-29T03:29:00.833807403Z [2024-03-29T03:29:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b62a5dd-dd23-4440-8ef0-426c39aea4e7 2024-03-29T03:29:02.015240489Z [2024-03-29T03:29:02.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:29:02.015534414Z [2024-03-29T03:29:02.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:28:00+00:00, run_id=scheduled__2024-03-29T03:28:00+00:00, run_start_date=2024-03-29 03:29:00.274222+00:00, run_end_date=2024-03-29 03:29:02.015197+00:00, run_duration=1.740975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:28:00+00:00, data_interval_end=2024-03-29 03:29:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:29:02.025427936Z [2024-03-29T03:29:02.025+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:29:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:29:02.073680682Z [2024-03-29T03:29:02.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status success for try_number 1 2024-03-29T03:29:02.081813311Z [2024-03-29T03:29:02.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:28:00+00:00, map_index=-1, run_start_date=2024-03-29 03:29:01.361865+00:00, run_end_date=2024-03-29 03:29:01.772289+00:00, run_duration=0.410424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:29:00.318388+00:00, queued_by_job_id=2, pid=15352 2024-03-29T03:29:04.989138686Z [2024-03-29T03:29:04.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:29:04.989167361Z [2024-03-29T03:29:04.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:28:00+00:00, run_id=scheduled__2024-03-29T03:28:00+00:00, run_start_date=2024-03-29 03:29:00.275397+00:00, run_end_date=2024-03-29 03:29:04.984643+00:00, run_duration=4.709246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:28:00+00:00, data_interval_end=2024-03-29 03:29:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:29:05.029700175Z [2024-03-29T03:29:05.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:29:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:29:05.088072835Z [2024-03-29T03:29:05.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status success for try_number 1 2024-03-29T03:29:05.101298430Z [2024-03-29T03:29:05.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:28:00+00:00, map_index=-1, run_start_date=2024-03-29 03:29:02.461216+00:00, run_end_date=2024-03-29 03:29:04.638631+00:00, run_duration=2.177415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:29:00.318388+00:00, queued_by_job_id=2, pid=15367 2024-03-29T03:29:06.052145537Z [2024-03-29T03:29:06.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:29:06.052568444Z [2024-03-29T03:29:06.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:28:00+00:00, run_id=scheduled__2024-03-29T03:28:00+00:00, run_start_date=2024-03-29 03:29:00.276363+00:00, run_end_date=2024-03-29 03:29:06.052028+00:00, run_duration=5.775665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:28:00+00:00, data_interval_end=2024-03-29 03:29:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:29:06.068416808Z [2024-03-29T03:29:06.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:29:00+00:00, run_after=2024-03-29T03:30:00+00:00 2024-03-29T03:29:06.114505334Z [2024-03-29T03:29:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status success for try_number 1 2024-03-29T03:29:06.118096808Z [2024-03-29T03:29:06.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:28:00+00:00, map_index=-1, run_start_date=2024-03-29 03:29:02.717891+00:00, run_end_date=2024-03-29 03:29:05.787695+00:00, run_duration=3.069804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:29:00.318388+00:00, queued_by_job_id=2, pid=15371 2024-03-29T03:30:00.045755742Z [2024-03-29T03:30:00.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:35:00+00:00 2024-03-29T03:30:00.054763976Z [2024-03-29T03:30:00.054+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:30:00.071407090Z [2024-03-29T03:30:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:31:00+00:00 2024-03-29T03:30:00.081371072Z [2024-03-29T03:30:00.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:30:00.096445998Z [2024-03-29T03:30:00.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:31:00+00:00 2024-03-29T03:30:00.231920927Z [2024-03-29T03:30:00.231+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T03:30:00.231944035Z 2024-03-29T03:30:00.231967495Z 2024-03-29T03:30:00.231987845Z 2024-03-29T03:30:00.231992161Z 2024-03-29T03:30:00.231995784Z 2024-03-29T03:30:00.232048725Z [2024-03-29T03:30:00.231+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:30:00.232065112Z [2024-03-29T03:30:00.231+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:30:00.232320568Z [2024-03-29T03:30:00.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:30:00.232440382Z [2024-03-29T03:30:00.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:30:00.232559111Z [2024-03-29T03:30:00.232+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:30:00.233180357Z [2024-03-29T03:30:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:30:00.233191213Z 2024-03-29T03:30:00.233197096Z 2024-03-29T03:30:00.233202308Z 2024-03-29T03:30:00.233207578Z 2024-03-29T03:30:00.233237502Z 2024-03-29T03:30:00.238502429Z [2024-03-29T03:30:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:30:00.238633215Z [2024-03-29T03:30:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:30:00.238933768Z [2024-03-29T03:30:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:30:00.239013836Z [2024-03-29T03:30:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:30:00.239281178Z [2024-03-29T03:30:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:30:00.239424273Z [2024-03-29T03:30:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:30:00.239667285Z [2024-03-29T03:30:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:30:00.239758854Z [2024-03-29T03:30:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:30:00.239975115Z [2024-03-29T03:30:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:30:00.240158806Z [2024-03-29T03:30:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:30:00.925376442Z [2024-03-29T03:30:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:00.925655125Z [2024-03-29T03:30:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:00.925979419Z [2024-03-29T03:30:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:29:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:00.926197245Z [2024-03-29T03:30:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:29:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:00.926414981Z [2024-03-29T03:30:00.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:29:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:00.944725178Z [2024-03-29T03:30:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d813126-8a3a-4b30-a649-b2124d8d2cb2 2024-03-29T03:30:00.945154777Z [2024-03-29T03:30:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a0f91ce-d8bb-4ea6-9f8d-395161735672 2024-03-29T03:30:00.945447012Z [2024-03-29T03:30:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to b34e668b-43e4-4633-98a3-f330732025ec 2024-03-29T03:30:00.946256705Z [2024-03-29T03:30:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ff3c99b-0716-4234-a899-74bb8b20bb42 2024-03-29T03:30:00.947061888Z [2024-03-29T03:30:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cadabff-b999-426a-8fd9-1b477964e078 2024-03-29T03:30:03.409365555Z [2024-03-29T03:30:03.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:30:03.412580866Z [2024-03-29T03:30:03.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:28:00+00:00, run_id=scheduled__2024-03-29T03:28:00+00:00, run_start_date=2024-03-29 03:30:00.118860+00:00, run_end_date=2024-03-29 03:30:03.411905+00:00, run_duration=3.293045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:28:00+00:00, data_interval_end=2024-03-29 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:30:03.431667063Z [2024-03-29T03:30:03.431+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:32:00+00:00 2024-03-29T03:30:03.443605053Z [2024-03-29T03:30:03.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:30:03.444223297Z [2024-03-29T03:30:03.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:29:00+00:00, run_id=scheduled__2024-03-29T03:29:00+00:00, run_start_date=2024-03-29 03:30:00.120715+00:00, run_end_date=2024-03-29 03:30:03.443830+00:00, run_duration=3.323115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:29:00+00:00, data_interval_end=2024-03-29 03:30:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:30:03.463464672Z [2024-03-29T03:30:03.463+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:31:00+00:00 2024-03-29T03:30:03.585403003Z [2024-03-29T03:30:03.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:28:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:03.585787441Z [2024-03-29T03:30:03.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:29:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:03.596950235Z [2024-03-29T03:30:03.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:28:00+00:00, map_index=-1, run_start_date=2024-03-29 03:30:01.742308+00:00, run_end_date=2024-03-29 03:30:02.774975+00:00, run_duration=1.032667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:00.234326+00:00, queued_by_job_id=2, pid=15407 2024-03-29T03:30:03.602147996Z [2024-03-29T03:30:03.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:29:00+00:00, map_index=-1, run_start_date=2024-03-29 03:30:01.645245+00:00, run_end_date=2024-03-29 03:30:02.665645+00:00, run_duration=1.0204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:00.234326+00:00, queued_by_job_id=2, pid=15406 2024-03-29T03:30:05.503441209Z [2024-03-29T03:30:05.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:30:05.503775110Z [2024-03-29T03:30:05.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:29:00+00:00, run_id=scheduled__2024-03-29T03:29:00+00:00, run_start_date=2024-03-29 03:30:00.122359+00:00, run_end_date=2024-03-29 03:30:05.503324+00:00, run_duration=5.380965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:29:00+00:00, data_interval_end=2024-03-29 03:30:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:30:05.522395014Z [2024-03-29T03:30:05.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:31:00+00:00 2024-03-29T03:30:05.583315303Z [2024-03-29T03:30:05.582+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:30:05.583348736Z 2024-03-29T03:30:05.583430002Z [2024-03-29T03:30:05.583+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:30:05.584323178Z [2024-03-29T03:30:05.584+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:30:05.584356115Z 2024-03-29T03:30:05.588995258Z [2024-03-29T03:30:05.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:30:05.589155028Z [2024-03-29T03:30:05.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:30:05.759366205Z [2024-03-29T03:30:05.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:05.760821717Z [2024-03-29T03:30:05.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:05.764131252Z [2024-03-29T03:30:05.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:29:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:05.784326010Z [2024-03-29T03:30:05.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:29:00+00:00, map_index=-1, run_start_date=2024-03-29 03:30:03.581084+00:00, run_end_date=2024-03-29 03:30:05.200574+00:00, run_duration=1.61949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:00.234326+00:00, queued_by_job_id=2, pid=15431 2024-03-29T03:30:05.791155460Z [2024-03-29T03:30:05.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:25:00+00:00, map_index=-1, run_start_date=2024-03-29 03:30:04.330192+00:00, run_end_date=2024-03-29 03:30:04.821638+00:00, run_duration=0.491446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:00.234326+00:00, queued_by_job_id=2, pid=15447 2024-03-29T03:30:05.791460595Z [2024-03-29T03:30:05.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to d193d6be-8383-4cbb-8600-f8c72554c710 2024-03-29T03:30:05.886041599Z [2024-03-29T03:30:05.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:30:05.890102514Z [2024-03-29T03:30:05.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:29:00+00:00, run_id=scheduled__2024-03-29T03:29:00+00:00, run_start_date=2024-03-29 03:30:00.124443+00:00, run_end_date=2024-03-29 03:30:05.885914+00:00, run_duration=5.761471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:29:00+00:00, data_interval_end=2024-03-29 03:30:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:30:05.909462680Z [2024-03-29T03:30:05.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:31:00+00:00 2024-03-29T03:30:07.451606201Z [2024-03-29T03:30:07.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:29:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:07.467976900Z [2024-03-29T03:30:07.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:29:00+00:00, map_index=-1, run_start_date=2024-03-29 03:30:03.454106+00:00, run_end_date=2024-03-29 03:30:05.788536+00:00, run_duration=2.33443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:00.234326+00:00, queued_by_job_id=2, pid=15430 2024-03-29T03:30:09.095418580Z [2024-03-29T03:30:09.095+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:30:09.095450383Z 2024-03-29T03:30:09.096446370Z [2024-03-29T03:30:09.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:30:09.096910065Z [2024-03-29T03:30:09.096+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:30:09.096925789Z 2024-03-29T03:30:09.101116362Z [2024-03-29T03:30:09.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:30:09.101313206Z [2024-03-29T03:30:09.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:30:09.195031603Z [2024-03-29T03:30:09.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:09.198548569Z [2024-03-29T03:30:09.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:09.204421413Z [2024-03-29T03:30:09.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to fac01c15-7dff-45d0-94af-e980b1847faa 2024-03-29T03:30:09.204758035Z [2024-03-29T03:30:09.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:25:00+00:00, map_index=-1, run_start_date=2024-03-29 03:30:07.998378+00:00, run_end_date=2024-03-29 03:30:08.490358+00:00, run_duration=0.49198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:05.584802+00:00, queued_by_job_id=2, pid=15460 2024-03-29T03:30:12.564418532Z [2024-03-29T03:30:12.563+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:30:12.564456828Z 2024-03-29T03:30:12.564757049Z [2024-03-29T03:30:12.564+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:30:12.565926549Z [2024-03-29T03:30:12.565+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:30:12.566003288Z 2024-03-29T03:30:12.570331702Z [2024-03-29T03:30:12.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:30:12.570652567Z [2024-03-29T03:30:12.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:30:12.632047879Z [2024-03-29T03:30:12.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status queued for try_number 1 2024-03-29T03:30:12.632262343Z [2024-03-29T03:30:12.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:12.640572889Z [2024-03-29T03:30:12.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a3c0928-f0ea-413f-9e1d-edc3eb447339 2024-03-29T03:30:12.640888393Z [2024-03-29T03:30:12.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:25:00+00:00, map_index=0, run_start_date=2024-03-29 03:30:11.256273+00:00, run_end_date=2024-03-29 03:30:11.603665+00:00, run_duration=0.347392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:09.097406+00:00, queued_by_job_id=2, pid=15468 2024-03-29T03:30:15.590683755Z [2024-03-29T03:30:15.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:30:15.590924343Z [2024-03-29T03:30:15.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:25:00+00:00, run_id=scheduled__2024-03-29T03:25:00+00:00, run_start_date=2024-03-29 03:30:00.116848+00:00, run_end_date=2024-03-29 03:30:15.590575+00:00, run_duration=15.473727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:25:00+00:00, data_interval_end=2024-03-29 03:30:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:30:15.597479709Z [2024-03-29T03:30:15.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:30:00+00:00, run_after=2024-03-29T03:35:00+00:00 2024-03-29T03:30:15.646389726Z [2024-03-29T03:30:15.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:25:00+00:00 exited with status success for try_number 1 2024-03-29T03:30:15.659366547Z [2024-03-29T03:30:15.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:25:00+00:00, map_index=-1, run_start_date=2024-03-29 03:30:14.283676+00:00, run_end_date=2024-03-29 03:30:14.633334+00:00, run_duration=0.349658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:12.566945+00:00, queued_by_job_id=2, pid=15476 2024-03-29T03:30:57.917218456Z [2024-03-29T03:30:57.916+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:30:57.917246427Z 2024-03-29T03:30:57.917325247Z [2024-03-29T03:30:57.917+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-03-29T03:30:57.917894976Z [2024-03-29T03:30:57.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:30:57.917901190Z 2024-03-29T03:30:57.919975628Z [2024-03-29T03:30:57.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240329033057_908042', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:30:57.920085906Z [2024-03-29T03:30:57.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240329033057_908042', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-29T03:30:57.967143014Z [2024-03-29T03:30:57.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240329033057_908042 exited with status queued for try_number 1 2024-03-29T03:30:57.975755563Z [2024-03-29T03:30:57.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04e3f28c-6cee-4735-abcf-413c45dfb625 2024-03-29T03:30:59.291122171Z [2024-03-29T03:30:59.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:30:59.291154711Z [2024-03-29T03:30:59.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-03-29 03:30:57.406873+00:00, run_id=vdu_alarm_20240329033057_908042, run_start_date=2024-03-29 03:30:57.888702+00:00, run_end_date=2024-03-29 03:30:59.289727+00:00, run_duration=1.401025, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-29 03:30:57.406873+00:00, data_interval_end=2024-03-29 03:30:57.406873+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-03-29T03:30:59.293848915Z [2024-03-29T03:30:59.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-03-29T03:30:59.337020843Z [2024-03-29T03:30:59.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240329033057_908042 exited with status success for try_number 1 2024-03-29T03:30:59.343448473Z [2024-03-29T03:30:59.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240329033057_908042, map_index=-1, run_start_date=2024-03-29 03:30:58.541384+00:00, run_end_date=2024-03-29 03:30:58.819202+00:00, run_duration=0.277818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:30:57.918219+00:00, queued_by_job_id=2, pid=15491 2024-03-29T03:31:00.377340870Z [2024-03-29T03:31:00.376+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:31:00.394627305Z [2024-03-29T03:31:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:31:00+00:00, run_after=2024-03-29T03:32:00+00:00 2024-03-29T03:31:00.411483280Z [2024-03-29T03:31:00.411+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:31:00+00:00, run_after=2024-03-29T03:32:00+00:00 2024-03-29T03:31:00.482244189Z [2024-03-29T03:31:00.481+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:31:00.482293630Z 2024-03-29T03:31:00.482297771Z 2024-03-29T03:31:00.482301531Z 2024-03-29T03:31:00.482472855Z [2024-03-29T03:31:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:31:00.482739273Z [2024-03-29T03:31:00.482+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:31:00.482950071Z [2024-03-29T03:31:00.482+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:31:00.483751610Z [2024-03-29T03:31:00.483+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:31:00.483765408Z 2024-03-29T03:31:00.483769359Z 2024-03-29T03:31:00.483773257Z 2024-03-29T03:31:00.487977353Z [2024-03-29T03:31:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:31:00.488258488Z [2024-03-29T03:31:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:31:00.488609675Z [2024-03-29T03:31:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:31:00.488896155Z [2024-03-29T03:31:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:31:00.489358575Z [2024-03-29T03:31:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:31:00.489480573Z [2024-03-29T03:31:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:31:00.807766211Z [2024-03-29T03:31:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:31:00.807829943Z [2024-03-29T03:31:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:31:00.808057243Z [2024-03-29T03:31:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:31:00.818088050Z [2024-03-29T03:31:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75e10068-bea1-471e-a4f1-71ab87385e58 2024-03-29T03:31:00.818246243Z [2024-03-29T03:31:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to aecaf611-eec5-4b64-8b20-832e74777b5d 2024-03-29T03:31:00.818539860Z [2024-03-29T03:31:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 712d3377-82f2-4e51-8aee-438af9ccf374 2024-03-29T03:31:01.982657637Z [2024-03-29T03:31:01.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:31:01.983121997Z [2024-03-29T03:31:01.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:30:00+00:00, run_id=scheduled__2024-03-29T03:30:00+00:00, run_start_date=2024-03-29 03:31:00.422544+00:00, run_end_date=2024-03-29 03:31:01.982523+00:00, run_duration=1.559979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:30:00+00:00, data_interval_end=2024-03-29 03:31:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:31:01.993046170Z [2024-03-29T03:31:01.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:31:00+00:00, run_after=2024-03-29T03:32:00+00:00 2024-03-29T03:31:02.049008474Z [2024-03-29T03:31:02.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:31:02.055095423Z [2024-03-29T03:31:02.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=-1, run_start_date=2024-03-29 03:31:01.437126+00:00, run_end_date=2024-03-29 03:31:01.815656+00:00, run_duration=0.37853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:31:00.485186+00:00, queued_by_job_id=2, pid=15505 2024-03-29T03:31:04.434347935Z [2024-03-29T03:31:04.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:31:04.434917530Z [2024-03-29T03:31:04.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:30:00+00:00, run_id=scheduled__2024-03-29T03:30:00+00:00, run_start_date=2024-03-29 03:31:00.424098+00:00, run_end_date=2024-03-29 03:31:04.434166+00:00, run_duration=4.010068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:30:00+00:00, data_interval_end=2024-03-29 03:31:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:31:04.453671068Z [2024-03-29T03:31:04.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:31:00+00:00, run_after=2024-03-29T03:32:00+00:00 2024-03-29T03:31:04.554625454Z [2024-03-29T03:31:04.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:31:04.561123082Z [2024-03-29T03:31:04.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=-1, run_start_date=2024-03-29 03:31:02.630122+00:00, run_end_date=2024-03-29 03:31:04.119301+00:00, run_duration=1.489179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:31:00.485186+00:00, queued_by_job_id=2, pid=15523 2024-03-29T03:31:05.898778375Z [2024-03-29T03:31:05.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:31:05.898847805Z [2024-03-29T03:31:05.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:30:00+00:00, run_id=scheduled__2024-03-29T03:30:00+00:00, run_start_date=2024-03-29 03:31:00.425930+00:00, run_end_date=2024-03-29 03:31:05.894332+00:00, run_duration=5.468402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:30:00+00:00, data_interval_end=2024-03-29 03:31:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:31:05.906025668Z [2024-03-29T03:31:05.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:31:00+00:00, run_after=2024-03-29T03:32:00+00:00 2024-03-29T03:31:05.951273402Z [2024-03-29T03:31:05.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:31:05.961486417Z [2024-03-29T03:31:05.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=-1, run_start_date=2024-03-29 03:31:02.676845+00:00, run_end_date=2024-03-29 03:31:04.849091+00:00, run_duration=2.172246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:31:00.485186+00:00, queued_by_job_id=2, pid=15524 2024-03-29T03:32:00.144316076Z [2024-03-29T03:32:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:32:00+00:00, run_after=2024-03-29T03:33:00+00:00 2024-03-29T03:32:00.172928527Z [2024-03-29T03:32:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:32:00+00:00, run_after=2024-03-29T03:33:00+00:00 2024-03-29T03:32:00.183762039Z [2024-03-29T03:32:00.183+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:32:00.193820627Z [2024-03-29T03:32:00.193+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:32:00.297772630Z [2024-03-29T03:32:00.297+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:32:00.297813335Z 2024-03-29T03:32:00.297821387Z 2024-03-29T03:32:00.297826367Z 2024-03-29T03:32:00.297831824Z 2024-03-29T03:32:00.298123958Z [2024-03-29T03:32:00.297+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:32:00.298296555Z [2024-03-29T03:32:00.298+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:32:00.298513269Z [2024-03-29T03:32:00.298+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:32:00.298710242Z [2024-03-29T03:32:00.298+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:32:00.299504726Z [2024-03-29T03:32:00.299+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:32:00.299522267Z 2024-03-29T03:32:00.299528109Z 2024-03-29T03:32:00.299533240Z 2024-03-29T03:32:00.299538549Z 2024-03-29T03:32:00.304218083Z [2024-03-29T03:32:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:32:00.304318805Z [2024-03-29T03:32:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:32:00.304631982Z [2024-03-29T03:32:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:32:00.304892274Z [2024-03-29T03:32:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:32:00.305283588Z [2024-03-29T03:32:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:32:00.305537657Z [2024-03-29T03:32:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:32:00.305900346Z [2024-03-29T03:32:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:32:00.306097560Z [2024-03-29T03:32:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:32:00.744243449Z [2024-03-29T03:32:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:32:00.744482570Z [2024-03-29T03:32:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:31:00+00:00 exited with status queued for try_number 1 2024-03-29T03:32:00.744537841Z [2024-03-29T03:32:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:31:00+00:00 exited with status queued for try_number 1 2024-03-29T03:32:00.744618996Z [2024-03-29T03:32:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:31:00+00:00 exited with status queued for try_number 1 2024-03-29T03:32:00.755755464Z [2024-03-29T03:32:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d013bf7-0b9c-4325-b094-1363baa75eb1 2024-03-29T03:32:00.755807140Z [2024-03-29T03:32:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b302ff2-1c69-479c-94e6-40648bbe9934 2024-03-29T03:32:00.756046069Z [2024-03-29T03:32:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6c468f3-b6ba-48df-bee8-793f6398ebdb 2024-03-29T03:32:00.756283434Z [2024-03-29T03:32:00.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1944317-4e14-48e2-9444-640540372c72 2024-03-29T03:32:03.179821600Z [2024-03-29T03:32:03.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:32:03.180118222Z [2024-03-29T03:32:03.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:31:00+00:00, run_id=scheduled__2024-03-29T03:31:00+00:00, run_start_date=2024-03-29 03:32:00.212201+00:00, run_end_date=2024-03-29 03:32:03.179688+00:00, run_duration=2.967487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:31:00+00:00, data_interval_end=2024-03-29 03:32:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:32:03.190143156Z [2024-03-29T03:32:03.189+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:32:00+00:00, run_after=2024-03-29T03:33:00+00:00 2024-03-29T03:32:03.198228524Z [2024-03-29T03:32:03.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:32:03.198395860Z [2024-03-29T03:32:03.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:30:00+00:00, run_id=scheduled__2024-03-29T03:30:00+00:00, run_start_date=2024-03-29 03:32:00.210358+00:00, run_end_date=2024-03-29 03:32:03.198119+00:00, run_duration=2.987761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:30:00+00:00, data_interval_end=2024-03-29 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:32:03.208904656Z [2024-03-29T03:32:03.208+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:32:00+00:00, run_after=2024-03-29T03:34:00+00:00 2024-03-29T03:32:03.282854696Z [2024-03-29T03:32:03.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:32:03.283154652Z [2024-03-29T03:32:03.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:31:00+00:00 exited with status success for try_number 1 2024-03-29T03:32:03.298264017Z [2024-03-29T03:32:03.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=-1, run_start_date=2024-03-29 03:32:01.547956+00:00, run_end_date=2024-03-29 03:32:02.014118+00:00, run_duration=0.466162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:32:00.300757+00:00, queued_by_job_id=2, pid=15557 2024-03-29T03:32:03.299164049Z [2024-03-29T03:32:03.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:31:00+00:00, map_index=-1, run_start_date=2024-03-29 03:32:01.745065+00:00, run_end_date=2024-03-29 03:32:02.353714+00:00, run_duration=0.608649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:32:00.300757+00:00, queued_by_job_id=2, pid=15558 2024-03-29T03:32:05.271282970Z [2024-03-29T03:32:05.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:32:05.271925258Z [2024-03-29T03:32:05.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:31:00+00:00, run_id=scheduled__2024-03-29T03:31:00+00:00, run_start_date=2024-03-29 03:32:00.213703+00:00, run_end_date=2024-03-29 03:32:05.271194+00:00, run_duration=5.057491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:31:00+00:00, data_interval_end=2024-03-29 03:32:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:32:05.290014621Z [2024-03-29T03:32:05.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:32:00+00:00, run_after=2024-03-29T03:33:00+00:00 2024-03-29T03:32:05.298735642Z [2024-03-29T03:32:05.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:32:05.299016084Z [2024-03-29T03:32:05.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:31:00+00:00, run_id=scheduled__2024-03-29T03:31:00+00:00, run_start_date=2024-03-29 03:32:00.214946+00:00, run_end_date=2024-03-29 03:32:05.298715+00:00, run_duration=5.083769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:31:00+00:00, data_interval_end=2024-03-29 03:32:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:32:05.309231945Z [2024-03-29T03:32:05.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:32:00+00:00, run_after=2024-03-29T03:33:00+00:00 2024-03-29T03:32:05.340728019Z [2024-03-29T03:32:05.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:31:00+00:00 exited with status success for try_number 1 2024-03-29T03:32:05.340910359Z [2024-03-29T03:32:05.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:31:00+00:00 exited with status success for try_number 1 2024-03-29T03:32:05.347796750Z [2024-03-29T03:32:05.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:31:00+00:00, map_index=-1, run_start_date=2024-03-29 03:32:03.072054+00:00, run_end_date=2024-03-29 03:32:04.423936+00:00, run_duration=1.351882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:32:00.300757+00:00, queued_by_job_id=2, pid=15581 2024-03-29T03:32:05.348217815Z [2024-03-29T03:32:05.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:31:00+00:00, map_index=-1, run_start_date=2024-03-29 03:32:03.213463+00:00, run_end_date=2024-03-29 03:32:05.046632+00:00, run_duration=1.833169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:32:00.300757+00:00, queued_by_job_id=2, pid=15582 2024-03-29T03:33:00.921041007Z [2024-03-29T03:33:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:33:00+00:00, run_after=2024-03-29T03:34:00+00:00 2024-03-29T03:33:00.934867717Z [2024-03-29T03:33:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:33:00+00:00, run_after=2024-03-29T03:34:00+00:00 2024-03-29T03:33:00.944372928Z [2024-03-29T03:33:00.944+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:33:01.025884970Z [2024-03-29T03:33:01.025+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:33:01.025915768Z 2024-03-29T03:33:01.025920852Z 2024-03-29T03:33:01.025925312Z 2024-03-29T03:33:01.026157964Z [2024-03-29T03:33:01.025+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:33:01.026494907Z [2024-03-29T03:33:01.026+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:33:01.026755430Z [2024-03-29T03:33:01.026+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:33:01.027463714Z [2024-03-29T03:33:01.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:33:01.027479563Z 2024-03-29T03:33:01.027492496Z 2024-03-29T03:33:01.027499886Z 2024-03-29T03:33:01.032286944Z [2024-03-29T03:33:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:33:01.032757485Z [2024-03-29T03:33:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:33:01.033366464Z [2024-03-29T03:33:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:33:01.033770990Z [2024-03-29T03:33:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:33:01.034343776Z [2024-03-29T03:33:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:33:01.034790717Z [2024-03-29T03:33:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:33:01.288483265Z [2024-03-29T03:33:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status queued for try_number 1 2024-03-29T03:33:01.288623362Z [2024-03-29T03:33:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status queued for try_number 1 2024-03-29T03:33:01.288777113Z [2024-03-29T03:33:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status queued for try_number 1 2024-03-29T03:33:01.301063663Z [2024-03-29T03:33:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6a8ed89-e0df-4fa3-8c16-29e8efecb3aa 2024-03-29T03:33:01.301208043Z [2024-03-29T03:33:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21027c78-76b4-4946-80af-cd16f5b4ca4c 2024-03-29T03:33:01.301376061Z [2024-03-29T03:33:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cc74f1a-2c12-45d0-b68d-87c20db1439b 2024-03-29T03:33:02.486024256Z [2024-03-29T03:33:02.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:33:02.486738894Z [2024-03-29T03:33:02.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:32:00+00:00, run_id=scheduled__2024-03-29T03:32:00+00:00, run_start_date=2024-03-29 03:33:00.958134+00:00, run_end_date=2024-03-29 03:33:02.485929+00:00, run_duration=1.527795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:32:00+00:00, data_interval_end=2024-03-29 03:33:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:33:02.499138693Z [2024-03-29T03:33:02.498+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:33:00+00:00, run_after=2024-03-29T03:34:00+00:00 2024-03-29T03:33:02.589764148Z [2024-03-29T03:33:02.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status success for try_number 1 2024-03-29T03:33:02.596749611Z [2024-03-29T03:33:02.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:32:00+00:00, map_index=-1, run_start_date=2024-03-29 03:33:01.903273+00:00, run_end_date=2024-03-29 03:33:02.343362+00:00, run_duration=0.440089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:33:01.028295+00:00, queued_by_job_id=2, pid=15614 2024-03-29T03:33:05.677289640Z [2024-03-29T03:33:05.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:33:05.677471752Z [2024-03-29T03:33:05.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:32:00+00:00, run_id=scheduled__2024-03-29T03:32:00+00:00, run_start_date=2024-03-29 03:33:00.959991+00:00, run_end_date=2024-03-29 03:33:05.677195+00:00, run_duration=4.717204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:32:00+00:00, data_interval_end=2024-03-29 03:33:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:33:05.687220092Z [2024-03-29T03:33:05.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:33:00+00:00, run_after=2024-03-29T03:34:00+00:00 2024-03-29T03:33:05.696900421Z [2024-03-29T03:33:05.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:33:05.697291419Z [2024-03-29T03:33:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:32:00+00:00, run_id=scheduled__2024-03-29T03:32:00+00:00, run_start_date=2024-03-29 03:33:00.961580+00:00, run_end_date=2024-03-29 03:33:05.696837+00:00, run_duration=4.735257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:32:00+00:00, data_interval_end=2024-03-29 03:33:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:33:05.709153001Z [2024-03-29T03:33:05.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:33:00+00:00, run_after=2024-03-29T03:34:00+00:00 2024-03-29T03:33:05.765021892Z [2024-03-29T03:33:05.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status success for try_number 1 2024-03-29T03:33:05.765341191Z [2024-03-29T03:33:05.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status success for try_number 1 2024-03-29T03:33:05.781028144Z [2024-03-29T03:33:05.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:32:00+00:00, map_index=-1, run_start_date=2024-03-29 03:33:03.089139+00:00, run_end_date=2024-03-29 03:33:05.213414+00:00, run_duration=2.124275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:33:01.028295+00:00, queued_by_job_id=2, pid=15633 2024-03-29T03:33:05.781071040Z [2024-03-29T03:33:05.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:32:00+00:00, map_index=-1, run_start_date=2024-03-29 03:33:03.053517+00:00, run_end_date=2024-03-29 03:33:05.334161+00:00, run_duration=2.280644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:33:01.028295+00:00, queued_by_job_id=2, pid=15632 2024-03-29T03:33:47.004947796Z [2024-03-29T03:33:47.004+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:34:00.268769334Z [2024-03-29T03:34:00.268+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:34:00.289506815Z [2024-03-29T03:34:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:34:00+00:00, run_after=2024-03-29T03:35:00+00:00 2024-03-29T03:34:00.298472199Z [2024-03-29T03:34:00.297+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:34:00.315846831Z [2024-03-29T03:34:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:34:00+00:00, run_after=2024-03-29T03:35:00+00:00 2024-03-29T03:34:00.399837294Z [2024-03-29T03:34:00.399+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:34:00.399868574Z 2024-03-29T03:34:00.399874721Z 2024-03-29T03:34:00.399879361Z 2024-03-29T03:34:00.399883901Z 2024-03-29T03:34:00.400148057Z [2024-03-29T03:34:00.399+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:34:00.400431112Z [2024-03-29T03:34:00.400+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:34:00.400777942Z [2024-03-29T03:34:00.400+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:34:00.401059137Z [2024-03-29T03:34:00.400+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:34:00.402059154Z [2024-03-29T03:34:00.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:34:00.402073700Z 2024-03-29T03:34:00.402078976Z 2024-03-29T03:34:00.402083675Z 2024-03-29T03:34:00.402107528Z 2024-03-29T03:34:00.407887378Z [2024-03-29T03:34:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:34:00.408294960Z [2024-03-29T03:34:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:34:00.408845675Z [2024-03-29T03:34:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:34:00.409172733Z [2024-03-29T03:34:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:34:00.409611830Z [2024-03-29T03:34:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:34:00.409965049Z [2024-03-29T03:34:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:34:00.410431706Z [2024-03-29T03:34:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:34:00.410744075Z [2024-03-29T03:34:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:34:00.938760997Z [2024-03-29T03:34:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status queued for try_number 1 2024-03-29T03:34:00.938915820Z [2024-03-29T03:34:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:33:00+00:00 exited with status queued for try_number 1 2024-03-29T03:34:00.939087594Z [2024-03-29T03:34:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:33:00+00:00 exited with status queued for try_number 1 2024-03-29T03:34:00.939884449Z [2024-03-29T03:34:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:33:00+00:00 exited with status queued for try_number 1 2024-03-29T03:34:00.951585050Z [2024-03-29T03:34:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60b92229-f795-4066-aa2a-a9c5e97005c8 2024-03-29T03:34:00.951764157Z [2024-03-29T03:34:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b431cf9-6515-45e5-aded-391dc6b27dba 2024-03-29T03:34:00.955914272Z [2024-03-29T03:34:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc3fd277-29e8-44ea-b0dd-13f2c5e9f6e1 2024-03-29T03:34:00.957187568Z [2024-03-29T03:34:00.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to 811b6798-d173-4e4b-9e4f-13ae449d587a 2024-03-29T03:34:02.318329197Z [2024-03-29T03:34:02.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:34:02.318753510Z [2024-03-29T03:34:02.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:32:00+00:00, run_id=scheduled__2024-03-29T03:32:00+00:00, run_start_date=2024-03-29 03:34:00.328362+00:00, run_end_date=2024-03-29 03:34:02.318253+00:00, run_duration=1.989891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:32:00+00:00, data_interval_end=2024-03-29 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:34:02.327430297Z [2024-03-29T03:34:02.327+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:34:00+00:00, run_after=2024-03-29T03:36:00+00:00 2024-03-29T03:34:02.335681976Z [2024-03-29T03:34:02.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:34:02.336085523Z [2024-03-29T03:34:02.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:33:00+00:00, run_id=scheduled__2024-03-29T03:33:00+00:00, run_start_date=2024-03-29 03:34:00.329769+00:00, run_end_date=2024-03-29 03:34:02.335528+00:00, run_duration=2.005759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:33:00+00:00, data_interval_end=2024-03-29 03:34:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:34:02.348478064Z [2024-03-29T03:34:02.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:34:00+00:00, run_after=2024-03-29T03:35:00+00:00 2024-03-29T03:34:02.402837693Z [2024-03-29T03:34:02.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:32:00+00:00 exited with status success for try_number 1 2024-03-29T03:34:02.402986439Z [2024-03-29T03:34:02.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:33:00+00:00 exited with status success for try_number 1 2024-03-29T03:34:02.412317236Z [2024-03-29T03:34:02.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:33:00+00:00, map_index=-1, run_start_date=2024-03-29 03:34:01.578151+00:00, run_end_date=2024-03-29 03:34:02.096706+00:00, run_duration=0.518555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:34:00.403935+00:00, queued_by_job_id=2, pid=15673 2024-03-29T03:34:02.412547115Z [2024-03-29T03:34:02.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:32:00+00:00, map_index=-1, run_start_date=2024-03-29 03:34:01.224261+00:00, run_end_date=2024-03-29 03:34:01.646004+00:00, run_duration=0.421743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:34:00.403935+00:00, queued_by_job_id=2, pid=15662 2024-03-29T03:34:04.560389531Z [2024-03-29T03:34:04.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:34:04.560814510Z [2024-03-29T03:34:04.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:33:00+00:00, run_id=scheduled__2024-03-29T03:33:00+00:00, run_start_date=2024-03-29 03:34:00.332143+00:00, run_end_date=2024-03-29 03:34:04.560499+00:00, run_duration=4.228356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:33:00+00:00, data_interval_end=2024-03-29 03:34:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:34:04.570807623Z [2024-03-29T03:34:04.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:34:00+00:00, run_after=2024-03-29T03:35:00+00:00 2024-03-29T03:34:04.580382418Z [2024-03-29T03:34:04.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:34:04.580687737Z [2024-03-29T03:34:04.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:33:00+00:00, run_id=scheduled__2024-03-29T03:33:00+00:00, run_start_date=2024-03-29 03:34:00.331006+00:00, run_end_date=2024-03-29 03:34:04.580335+00:00, run_duration=4.249329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:33:00+00:00, data_interval_end=2024-03-29 03:34:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:34:04.591757042Z [2024-03-29T03:34:04.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:34:00+00:00, run_after=2024-03-29T03:35:00+00:00 2024-03-29T03:34:04.626478649Z [2024-03-29T03:34:04.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:33:00+00:00 exited with status success for try_number 1 2024-03-29T03:34:04.626821436Z [2024-03-29T03:34:04.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:33:00+00:00 exited with status success for try_number 1 2024-03-29T03:34:04.634765446Z [2024-03-29T03:34:04.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:33:00+00:00, map_index=-1, run_start_date=2024-03-29 03:34:02.718139+00:00, run_end_date=2024-03-29 03:34:04.168929+00:00, run_duration=1.45079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:34:00.403935+00:00, queued_by_job_id=2, pid=15691 2024-03-29T03:34:04.635146156Z [2024-03-29T03:34:04.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:33:00+00:00, map_index=-1, run_start_date=2024-03-29 03:34:02.504128+00:00, run_end_date=2024-03-29 03:34:04.201373+00:00, run_duration=1.697245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:34:00.403935+00:00, queued_by_job_id=2, pid=15690 2024-03-29T03:35:00.282140042Z [2024-03-29T03:35:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:35:00+00:00, run_after=2024-03-29T03:36:00+00:00 2024-03-29T03:35:00.294417481Z [2024-03-29T03:35:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:35:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:35:00.301738912Z [2024-03-29T03:35:00.301+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:35:00.315502748Z [2024-03-29T03:35:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:35:00+00:00, run_after=2024-03-29T03:36:00+00:00 2024-03-29T03:35:00.398567312Z [2024-03-29T03:35:00.398+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:35:00.398607176Z 2024-03-29T03:35:00.398613005Z 2024-03-29T03:35:00.398616196Z 2024-03-29T03:35:00.398619728Z 2024-03-29T03:35:00.398667966Z [2024-03-29T03:35:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:35:00.399541916Z [2024-03-29T03:35:00.399+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:35:00.399740721Z [2024-03-29T03:35:00.399+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:35:00.400133287Z [2024-03-29T03:35:00.399+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:35:00.402064288Z [2024-03-29T03:35:00.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:35:00.402085769Z 2024-03-29T03:35:00.402129828Z 2024-03-29T03:35:00.402135909Z 2024-03-29T03:35:00.402141528Z 2024-03-29T03:35:00.407145080Z [2024-03-29T03:35:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:35:00.407276748Z [2024-03-29T03:35:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:35:00.407471207Z [2024-03-29T03:35:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:35:00.407556850Z [2024-03-29T03:35:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:35:00.407798332Z [2024-03-29T03:35:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:35:00.407929826Z [2024-03-29T03:35:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:35:00.408172662Z [2024-03-29T03:35:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:35:00.408302886Z [2024-03-29T03:35:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:35:00.967644754Z [2024-03-29T03:35:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:35:00.967995761Z [2024-03-29T03:35:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status queued for try_number 1 2024-03-29T03:35:00.968291725Z [2024-03-29T03:35:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status queued for try_number 1 2024-03-29T03:35:00.968534698Z [2024-03-29T03:35:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status queued for try_number 1 2024-03-29T03:35:00.977357152Z [2024-03-29T03:35:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3089672f-6144-4182-9b7f-550aae98f58c 2024-03-29T03:35:00.977613049Z [2024-03-29T03:35:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3779d768-0d45-4cf2-b929-44b89d9c8b27 2024-03-29T03:35:00.977901116Z [2024-03-29T03:35:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to a84fef65-f142-4e2a-adde-156d8c6e96b5 2024-03-29T03:35:00.978178267Z [2024-03-29T03:35:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 637fc434-16f9-401b-8550-6bff463a89a7 2024-03-29T03:35:02.902515468Z [2024-03-29T03:35:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:35:02.903088157Z [2024-03-29T03:35:02.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:34:00+00:00, run_id=scheduled__2024-03-29T03:34:00+00:00, run_start_date=2024-03-29 03:35:00.331034+00:00, run_end_date=2024-03-29 03:35:02.902622+00:00, run_duration=2.571588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:34:00+00:00, data_interval_end=2024-03-29 03:35:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:35:02.919928119Z [2024-03-29T03:35:02.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:35:00+00:00, run_after=2024-03-29T03:36:00+00:00 2024-03-29T03:35:03.047526359Z [2024-03-29T03:35:03.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status success for try_number 1 2024-03-29T03:35:03.057068233Z [2024-03-29T03:35:03.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:34:00+00:00, map_index=-1, run_start_date=2024-03-29 03:35:01.303743+00:00, run_end_date=2024-03-29 03:35:01.814308+00:00, run_duration=0.510565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:35:00.403756+00:00, queued_by_job_id=2, pid=15724 2024-03-29T03:35:04.130762859Z [2024-03-29T03:35:04.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:35:04.131064986Z [2024-03-29T03:35:04.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:34:00+00:00, run_id=scheduled__2024-03-29T03:34:00+00:00, run_start_date=2024-03-29 03:35:00.332334+00:00, run_end_date=2024-03-29 03:35:04.130539+00:00, run_duration=3.798205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:34:00+00:00, data_interval_end=2024-03-29 03:35:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:35:04.145248836Z [2024-03-29T03:35:04.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:35:00+00:00, run_after=2024-03-29T03:36:00+00:00 2024-03-29T03:35:04.172581745Z [2024-03-29T03:35:04.172+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:35:04.172618301Z 2024-03-29T03:35:04.172626037Z [2024-03-29T03:35:04.172+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:35:04.173266369Z [2024-03-29T03:35:04.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:35:04.173295689Z 2024-03-29T03:35:04.176348050Z [2024-03-29T03:35:04.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:35:04.176530709Z [2024-03-29T03:35:04.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:35:04.246048331Z [2024-03-29T03:35:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:35:04.246160993Z [2024-03-29T03:35:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:35:04.246174942Z [2024-03-29T03:35:04.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status success for try_number 1 2024-03-29T03:35:04.259526276Z [2024-03-29T03:35:04.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:34:00+00:00, map_index=-1, run_start_date=2024-03-29 03:35:02.532619+00:00, run_end_date=2024-03-29 03:35:03.880265+00:00, run_duration=1.347646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:35:00.403756+00:00, queued_by_job_id=2, pid=15748 2024-03-29T03:35:04.259923269Z [2024-03-29T03:35:04.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2070d301-b8ad-4365-8896-73c580c09da4 2024-03-29T03:35:04.260303795Z [2024-03-29T03:35:04.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=-1, run_start_date=2024-03-29 03:35:02.635030+00:00, run_end_date=2024-03-29 03:35:03.131315+00:00, run_duration=0.496285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:35:00.403756+00:00, queued_by_job_id=2, pid=15749 2024-03-29T03:35:05.457512592Z [2024-03-29T03:35:05.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:35:05.458069401Z [2024-03-29T03:35:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:34:00+00:00, run_id=scheduled__2024-03-29T03:34:00+00:00, run_start_date=2024-03-29 03:35:00.333511+00:00, run_end_date=2024-03-29 03:35:05.457425+00:00, run_duration=5.123914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:34:00+00:00, data_interval_end=2024-03-29 03:35:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:35:05.478270499Z [2024-03-29T03:35:05.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:35:00+00:00, run_after=2024-03-29T03:36:00+00:00 2024-03-29T03:35:05.578315156Z [2024-03-29T03:35:05.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status success for try_number 1 2024-03-29T03:35:05.588711861Z [2024-03-29T03:35:05.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:34:00+00:00, map_index=-1, run_start_date=2024-03-29 03:35:02.661237+00:00, run_end_date=2024-03-29 03:35:04.500925+00:00, run_duration=1.839688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:35:00.403756+00:00, queued_by_job_id=2, pid=15750 2024-03-29T03:35:06.908417648Z [2024-03-29T03:35:06.907+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:35:06.908454273Z 2024-03-29T03:35:06.908667725Z [2024-03-29T03:35:06.908+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:35:06.909660039Z [2024-03-29T03:35:06.909+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:35:06.909696472Z 2024-03-29T03:35:06.913437579Z [2024-03-29T03:35:06.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:35:06.913650390Z [2024-03-29T03:35:06.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:35:06.975926037Z [2024-03-29T03:35:06.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:35:06.976044666Z [2024-03-29T03:35:06.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:35:06.982201806Z [2024-03-29T03:35:06.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b075b35-a9ac-40e1-9981-50d5960b31dc 2024-03-29T03:35:06.982408810Z [2024-03-29T03:35:06.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=-1, run_start_date=2024-03-29 03:35:06.225678+00:00, run_end_date=2024-03-29 03:35:06.609520+00:00, run_duration=0.383842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:35:04.173590+00:00, queued_by_job_id=2, pid=15773 2024-03-29T03:35:09.960255940Z [2024-03-29T03:35:09.959+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:35:09.960284377Z 2024-03-29T03:35:09.960440935Z [2024-03-29T03:35:09.960+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:35:09.961666487Z [2024-03-29T03:35:09.961+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:35:09.961687715Z 2024-03-29T03:35:09.963981861Z [2024-03-29T03:35:09.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:35:09.964038557Z [2024-03-29T03:35:09.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:35:10.015980453Z [2024-03-29T03:35:10.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status queued for try_number 1 2024-03-29T03:35:10.016022121Z [2024-03-29T03:35:10.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:35:10.023883464Z [2024-03-29T03:35:10.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef7918af-e79b-43fd-89a5-d25a83c54b6e 2024-03-29T03:35:10.024070191Z [2024-03-29T03:35:10.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=0, run_start_date=2024-03-29 03:35:08.878733+00:00, run_end_date=2024-03-29 03:35:09.174259+00:00, run_duration=0.295526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:35:06.910253+00:00, queued_by_job_id=2, pid=15781 2024-03-29T03:35:13.140645824Z [2024-03-29T03:35:13.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:35:13.141369339Z [2024-03-29T03:35:13.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:30:00+00:00, run_id=scheduled__2024-03-29T03:30:00+00:00, run_start_date=2024-03-29 03:35:00.329594+00:00, run_end_date=2024-03-29 03:35:13.140532+00:00, run_duration=12.810938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:30:00+00:00, data_interval_end=2024-03-29 03:35:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:35:13.148963815Z [2024-03-29T03:35:13.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:35:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:35:13.180344624Z [2024-03-29T03:35:13.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:30:00+00:00 exited with status success for try_number 1 2024-03-29T03:35:13.186347361Z [2024-03-29T03:35:13.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:30:00+00:00, map_index=-1, run_start_date=2024-03-29 03:35:11.686821+00:00, run_end_date=2024-03-29 03:35:12.063459+00:00, run_duration=0.376638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:35:09.961993+00:00, queued_by_job_id=2, pid=15789 2024-03-29T03:36:00.334999063Z [2024-03-29T03:36:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:36:00+00:00, run_after=2024-03-29T03:37:00+00:00 2024-03-29T03:36:00.341841956Z [2024-03-29T03:36:00.341+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:36:00.347936025Z [2024-03-29T03:36:00.347+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:36:00.359890234Z [2024-03-29T03:36:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:36:00+00:00, run_after=2024-03-29T03:37:00+00:00 2024-03-29T03:36:00.442035773Z [2024-03-29T03:36:00.441+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:36:00.442065907Z 2024-03-29T03:36:00.442072026Z 2024-03-29T03:36:00.442077010Z 2024-03-29T03:36:00.442103314Z 2024-03-29T03:36:00.442390137Z [2024-03-29T03:36:00.442+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:36:00.442745731Z [2024-03-29T03:36:00.442+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:36:00.442958847Z [2024-03-29T03:36:00.442+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:36:00.443171982Z [2024-03-29T03:36:00.442+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:36:00.444078982Z [2024-03-29T03:36:00.443+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:36:00.444091976Z 2024-03-29T03:36:00.444098480Z 2024-03-29T03:36:00.444103251Z 2024-03-29T03:36:00.444107933Z 2024-03-29T03:36:00.448263954Z [2024-03-29T03:36:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:36:00.448608341Z [2024-03-29T03:36:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:36:00.449019552Z [2024-03-29T03:36:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:36:00.449229479Z [2024-03-29T03:36:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:36:00.449601163Z [2024-03-29T03:36:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:36:00.449828536Z [2024-03-29T03:36:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:36:00.450249207Z [2024-03-29T03:36:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:36:00.450555806Z [2024-03-29T03:36:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:36:00.875807288Z [2024-03-29T03:36:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status queued for try_number 1 2024-03-29T03:36:00.875870730Z [2024-03-29T03:36:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status queued for try_number 1 2024-03-29T03:36:00.875887016Z [2024-03-29T03:36:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status queued for try_number 1 2024-03-29T03:36:00.875945152Z [2024-03-29T03:36:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status queued for try_number 1 2024-03-29T03:36:00.885131308Z [2024-03-29T03:36:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1455ba3-f5bd-4f83-bcfa-ded7b7176435 2024-03-29T03:36:00.885165557Z [2024-03-29T03:36:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f13b9a0-828b-47c4-9a32-fb95978aeaa2 2024-03-29T03:36:00.885272015Z [2024-03-29T03:36:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85bd9038-bb34-4cb0-84a7-d3d2963bdb74 2024-03-29T03:36:00.885426605Z [2024-03-29T03:36:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to b62badde-9a0f-4d32-81dc-e81552985957 2024-03-29T03:36:02.052304562Z [2024-03-29T03:36:02.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:36:02.052616143Z [2024-03-29T03:36:02.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:34:00+00:00, run_id=scheduled__2024-03-29T03:34:00+00:00, run_start_date=2024-03-29 03:36:00.370907+00:00, run_end_date=2024-03-29 03:36:02.052180+00:00, run_duration=1.681273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:34:00+00:00, data_interval_end=2024-03-29 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:36:02.063303545Z [2024-03-29T03:36:02.062+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:36:00+00:00, run_after=2024-03-29T03:38:00+00:00 2024-03-29T03:36:02.072482589Z [2024-03-29T03:36:02.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:36:02.072776213Z [2024-03-29T03:36:02.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:35:00+00:00, run_id=scheduled__2024-03-29T03:35:00+00:00, run_start_date=2024-03-29 03:36:00.372172+00:00, run_end_date=2024-03-29 03:36:02.072358+00:00, run_duration=1.700186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:35:00+00:00, data_interval_end=2024-03-29 03:36:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:36:02.084378248Z [2024-03-29T03:36:02.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:36:00+00:00, run_after=2024-03-29T03:37:00+00:00 2024-03-29T03:36:02.165682969Z [2024-03-29T03:36:02.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:34:00+00:00 exited with status success for try_number 1 2024-03-29T03:36:02.165926812Z [2024-03-29T03:36:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status success for try_number 1 2024-03-29T03:36:02.175345450Z [2024-03-29T03:36:02.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:35:00+00:00, map_index=-1, run_start_date=2024-03-29 03:36:01.445627+00:00, run_end_date=2024-03-29 03:36:01.878867+00:00, run_duration=0.43324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:36:00.445234+00:00, queued_by_job_id=2, pid=15813 2024-03-29T03:36:02.175741085Z [2024-03-29T03:36:02.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:34:00+00:00, map_index=-1, run_start_date=2024-03-29 03:36:01.387253+00:00, run_end_date=2024-03-29 03:36:01.896361+00:00, run_duration=0.509108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:36:00.445234+00:00, queued_by_job_id=2, pid=15812 2024-03-29T03:36:04.913876320Z [2024-03-29T03:36:04.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:36:04.914289731Z [2024-03-29T03:36:04.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:35:00+00:00, run_id=scheduled__2024-03-29T03:35:00+00:00, run_start_date=2024-03-29 03:36:00.373301+00:00, run_end_date=2024-03-29 03:36:04.913766+00:00, run_duration=4.540465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:35:00+00:00, data_interval_end=2024-03-29 03:36:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:36:04.924536246Z [2024-03-29T03:36:04.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:36:00+00:00, run_after=2024-03-29T03:37:00+00:00 2024-03-29T03:36:04.932301787Z [2024-03-29T03:36:04.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:36:04.932471339Z [2024-03-29T03:36:04.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:35:00+00:00, run_id=scheduled__2024-03-29T03:35:00+00:00, run_start_date=2024-03-29 03:36:00.374353+00:00, run_end_date=2024-03-29 03:36:04.932083+00:00, run_duration=4.55773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:35:00+00:00, data_interval_end=2024-03-29 03:36:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:36:04.942346774Z [2024-03-29T03:36:04.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:36:00+00:00, run_after=2024-03-29T03:37:00+00:00 2024-03-29T03:36:04.996992271Z [2024-03-29T03:36:04.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status success for try_number 1 2024-03-29T03:36:04.997023311Z [2024-03-29T03:36:04.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status success for try_number 1 2024-03-29T03:36:05.009436841Z [2024-03-29T03:36:05.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:35:00+00:00, map_index=-1, run_start_date=2024-03-29 03:36:02.695802+00:00, run_end_date=2024-03-29 03:36:04.512946+00:00, run_duration=1.817144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:36:00.445234+00:00, queued_by_job_id=2, pid=15837 2024-03-29T03:36:05.009981982Z [2024-03-29T03:36:05.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:35:00+00:00, map_index=-1, run_start_date=2024-03-29 03:36:02.611321+00:00, run_end_date=2024-03-29 03:36:04.802019+00:00, run_duration=2.190698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:36:00.445234+00:00, queued_by_job_id=2, pid=15836 2024-03-29T03:37:00.538109635Z [2024-03-29T03:37:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:37:00+00:00, run_after=2024-03-29T03:38:00+00:00 2024-03-29T03:37:00.551532613Z [2024-03-29T03:37:00.551+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:37:00+00:00, run_after=2024-03-29T03:38:00+00:00 2024-03-29T03:37:00.559543572Z [2024-03-29T03:37:00.559+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:37:00.628716663Z [2024-03-29T03:37:00.628+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:37:00.628747367Z 2024-03-29T03:37:00.628752208Z 2024-03-29T03:37:00.628756873Z 2024-03-29T03:37:00.628988675Z [2024-03-29T03:37:00.628+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:37:00.629636850Z [2024-03-29T03:37:00.629+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:37:00.629880691Z [2024-03-29T03:37:00.629+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:37:00.631047689Z [2024-03-29T03:37:00.630+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:37:00.631063905Z 2024-03-29T03:37:00.631068897Z 2024-03-29T03:37:00.631072984Z 2024-03-29T03:37:00.635987854Z [2024-03-29T03:37:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:37:00.636317001Z [2024-03-29T03:37:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:37:00.636689448Z [2024-03-29T03:37:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:37:00.636935348Z [2024-03-29T03:37:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:37:00.637313947Z [2024-03-29T03:37:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:37:00.637776879Z [2024-03-29T03:37:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:37:00.871896897Z [2024-03-29T03:37:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status queued for try_number 1 2024-03-29T03:37:00.872072237Z [2024-03-29T03:37:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status queued for try_number 1 2024-03-29T03:37:00.872232070Z [2024-03-29T03:37:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status queued for try_number 1 2024-03-29T03:37:00.881232737Z [2024-03-29T03:37:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to dda43cac-1cbf-4a2e-bf0a-5743cf828b2e 2024-03-29T03:37:00.881482341Z [2024-03-29T03:37:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3de9d1b8-22d2-4191-aa73-f8e2c30832e2 2024-03-29T03:37:00.881698377Z [2024-03-29T03:37:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56261779-28b5-41e1-89cb-a204ce98c388 2024-03-29T03:37:02.084208518Z [2024-03-29T03:37:02.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:37:02.084470033Z [2024-03-29T03:37:02.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:36:00+00:00, run_id=scheduled__2024-03-29T03:36:00+00:00, run_start_date=2024-03-29 03:37:00.571412+00:00, run_end_date=2024-03-29 03:37:02.084136+00:00, run_duration=1.512724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:36:00+00:00, data_interval_end=2024-03-29 03:37:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:37:02.096288724Z [2024-03-29T03:37:02.095+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:37:00+00:00, run_after=2024-03-29T03:38:00+00:00 2024-03-29T03:37:03.299552718Z [2024-03-29T03:37:03.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status success for try_number 1 2024-03-29T03:37:03.305892214Z [2024-03-29T03:37:03.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:36:00+00:00, map_index=-1, run_start_date=2024-03-29 03:37:01.626698+00:00, run_end_date=2024-03-29 03:37:02.056444+00:00, run_duration=0.429746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:37:00.632481+00:00, queued_by_job_id=2, pid=15869 2024-03-29T03:37:04.622184819Z [2024-03-29T03:37:04.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:37:04.622665317Z [2024-03-29T03:37:04.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:36:00+00:00, run_id=scheduled__2024-03-29T03:36:00+00:00, run_start_date=2024-03-29 03:37:00.572782+00:00, run_end_date=2024-03-29 03:37:04.622029+00:00, run_duration=4.049247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:36:00+00:00, data_interval_end=2024-03-29 03:37:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:37:04.636821245Z [2024-03-29T03:37:04.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:37:00+00:00, run_after=2024-03-29T03:38:00+00:00 2024-03-29T03:37:04.682580883Z [2024-03-29T03:37:04.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status success for try_number 1 2024-03-29T03:37:04.693184749Z [2024-03-29T03:37:04.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:36:00+00:00, map_index=-1, run_start_date=2024-03-29 03:37:02.778852+00:00, run_end_date=2024-03-29 03:37:04.309296+00:00, run_duration=1.530444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:37:00.632481+00:00, queued_by_job_id=2, pid=15888 2024-03-29T03:37:05.753412242Z [2024-03-29T03:37:05.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:37:05.753770002Z [2024-03-29T03:37:05.753+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:36:00+00:00, run_id=scheduled__2024-03-29T03:36:00+00:00, run_start_date=2024-03-29 03:37:00.573878+00:00, run_end_date=2024-03-29 03:37:05.753459+00:00, run_duration=5.179581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:36:00+00:00, data_interval_end=2024-03-29 03:37:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:37:05.765349961Z [2024-03-29T03:37:05.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:37:00+00:00, run_after=2024-03-29T03:38:00+00:00 2024-03-29T03:37:05.809144371Z [2024-03-29T03:37:05.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status success for try_number 1 2024-03-29T03:37:05.818835973Z [2024-03-29T03:37:05.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:36:00+00:00, map_index=-1, run_start_date=2024-03-29 03:37:02.762759+00:00, run_end_date=2024-03-29 03:37:04.761040+00:00, run_duration=1.998281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:37:00.632481+00:00, queued_by_job_id=2, pid=15887 2024-03-29T03:38:00.249852503Z [2024-03-29T03:38:00.249+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:38:00.273980685Z [2024-03-29T03:38:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:38:00+00:00, run_after=2024-03-29T03:39:00+00:00 2024-03-29T03:38:00.290195539Z [2024-03-29T03:38:00.289+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:38:00.304461462Z [2024-03-29T03:38:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:38:00+00:00, run_after=2024-03-29T03:39:00+00:00 2024-03-29T03:38:00.389360390Z [2024-03-29T03:38:00.388+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:38:00.389389100Z 2024-03-29T03:38:00.389394679Z 2024-03-29T03:38:00.389399301Z 2024-03-29T03:38:00.389403946Z 2024-03-29T03:38:00.389417271Z [2024-03-29T03:38:00.389+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:38:00.389587953Z [2024-03-29T03:38:00.389+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:38:00.389728791Z [2024-03-29T03:38:00.389+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:38:00.389899753Z [2024-03-29T03:38:00.389+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:38:00.390561306Z [2024-03-29T03:38:00.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:38:00.390574601Z 2024-03-29T03:38:00.390579185Z 2024-03-29T03:38:00.390583561Z 2024-03-29T03:38:00.390587962Z 2024-03-29T03:38:00.393843576Z [2024-03-29T03:38:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:38:00.394112549Z [2024-03-29T03:38:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:38:00.394370448Z [2024-03-29T03:38:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:38:00.394563545Z [2024-03-29T03:38:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:38:00.394843720Z [2024-03-29T03:38:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:38:00.395047724Z [2024-03-29T03:38:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:38:00.395373634Z [2024-03-29T03:38:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:38:00.395584560Z [2024-03-29T03:38:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:38:00.907489324Z [2024-03-29T03:38:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status queued for try_number 1 2024-03-29T03:38:00.907563417Z [2024-03-29T03:38:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:37:00+00:00 exited with status queued for try_number 1 2024-03-29T03:38:00.907582421Z [2024-03-29T03:38:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:37:00+00:00 exited with status queued for try_number 1 2024-03-29T03:38:00.907595649Z [2024-03-29T03:38:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:37:00+00:00 exited with status queued for try_number 1 2024-03-29T03:38:00.927821264Z [2024-03-29T03:38:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2d7107d-53f4-4bf0-8aa2-c27606610376 2024-03-29T03:38:00.927864381Z [2024-03-29T03:38:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef6bcb2a-ae5a-47f9-a5d2-dba7baa5c23f 2024-03-29T03:38:00.927997504Z [2024-03-29T03:38:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb6da522-4d15-4594-8b88-a34350f696c3 2024-03-29T03:38:00.928087420Z [2024-03-29T03:38:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6a9f51e-9fd8-4991-aefc-27bea0f1bf32 2024-03-29T03:38:02.254626214Z [2024-03-29T03:38:02.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:38:02.254674441Z [2024-03-29T03:38:02.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:36:00+00:00, run_id=scheduled__2024-03-29T03:36:00+00:00, run_start_date=2024-03-29 03:38:00.314760+00:00, run_end_date=2024-03-29 03:38:02.249516+00:00, run_duration=1.934756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:36:00+00:00, data_interval_end=2024-03-29 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:38:02.261542238Z [2024-03-29T03:38:02.261+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:38:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:38:02.269683806Z [2024-03-29T03:38:02.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:38:02.270083092Z [2024-03-29T03:38:02.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:37:00+00:00, run_id=scheduled__2024-03-29T03:37:00+00:00, run_start_date=2024-03-29 03:38:00.315935+00:00, run_end_date=2024-03-29 03:38:02.269575+00:00, run_duration=1.95364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:37:00+00:00, data_interval_end=2024-03-29 03:38:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:38:02.281630212Z [2024-03-29T03:38:02.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:38:00+00:00, run_after=2024-03-29T03:39:00+00:00 2024-03-29T03:38:02.350596372Z [2024-03-29T03:38:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:36:00+00:00 exited with status success for try_number 1 2024-03-29T03:38:02.350786968Z [2024-03-29T03:38:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:37:00+00:00 exited with status success for try_number 1 2024-03-29T03:38:02.360128561Z [2024-03-29T03:38:02.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:36:00+00:00, map_index=-1, run_start_date=2024-03-29 03:38:01.172599+00:00, run_end_date=2024-03-29 03:38:01.553617+00:00, run_duration=0.381018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:38:00.391333+00:00, queued_by_job_id=2, pid=15921 2024-03-29T03:38:02.360384713Z [2024-03-29T03:38:02.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:37:00+00:00, map_index=-1, run_start_date=2024-03-29 03:38:01.435030+00:00, run_end_date=2024-03-29 03:38:01.919722+00:00, run_duration=0.484692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:38:00.391333+00:00, queued_by_job_id=2, pid=15922 2024-03-29T03:38:05.406598706Z [2024-03-29T03:38:05.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:38:05.406889906Z [2024-03-29T03:38:05.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:37:00+00:00, run_id=scheduled__2024-03-29T03:37:00+00:00, run_start_date=2024-03-29 03:38:00.316994+00:00, run_end_date=2024-03-29 03:38:05.406572+00:00, run_duration=5.089578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:37:00+00:00, data_interval_end=2024-03-29 03:38:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:38:05.416253119Z [2024-03-29T03:38:05.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:38:00+00:00, run_after=2024-03-29T03:39:00+00:00 2024-03-29T03:38:05.424264833Z [2024-03-29T03:38:05.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:38:05.424536757Z [2024-03-29T03:38:05.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:37:00+00:00, run_id=scheduled__2024-03-29T03:37:00+00:00, run_start_date=2024-03-29 03:38:00.318017+00:00, run_end_date=2024-03-29 03:38:05.424236+00:00, run_duration=5.106219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:37:00+00:00, data_interval_end=2024-03-29 03:38:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:38:05.434280248Z [2024-03-29T03:38:05.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:38:00+00:00, run_after=2024-03-29T03:39:00+00:00 2024-03-29T03:38:05.465201817Z [2024-03-29T03:38:05.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:37:00+00:00 exited with status success for try_number 1 2024-03-29T03:38:05.465424006Z [2024-03-29T03:38:05.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:37:00+00:00 exited with status success for try_number 1 2024-03-29T03:38:05.472874061Z [2024-03-29T03:38:05.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:37:00+00:00, map_index=-1, run_start_date=2024-03-29 03:38:02.961672+00:00, run_end_date=2024-03-29 03:38:04.297317+00:00, run_duration=1.335645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:38:00.391333+00:00, queued_by_job_id=2, pid=15948 2024-03-29T03:38:05.473211022Z [2024-03-29T03:38:05.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:37:00+00:00, map_index=-1, run_start_date=2024-03-29 03:38:02.623833+00:00, run_end_date=2024-03-29 03:38:04.535752+00:00, run_duration=1.911919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:38:00.391333+00:00, queued_by_job_id=2, pid=15940 2024-03-29T03:38:47.053029330Z [2024-03-29T03:38:47.052+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:39:01.035579597Z [2024-03-29T03:39:01.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:39:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:39:01.060939611Z [2024-03-29T03:39:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:39:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:39:01.071672997Z [2024-03-29T03:39:01.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:39:01.143225739Z [2024-03-29T03:39:01.142+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:39:01.143263865Z 2024-03-29T03:39:01.143270120Z 2024-03-29T03:39:01.143276172Z 2024-03-29T03:39:01.143445104Z [2024-03-29T03:39:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:39:01.143694377Z [2024-03-29T03:39:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:39:01.143948860Z [2024-03-29T03:39:01.143+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:39:01.145073530Z [2024-03-29T03:39:01.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:39:01.145086085Z 2024-03-29T03:39:01.145090170Z 2024-03-29T03:39:01.145093855Z 2024-03-29T03:39:01.150390873Z [2024-03-29T03:39:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:39:01.150621239Z [2024-03-29T03:39:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:39:01.151023304Z [2024-03-29T03:39:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:39:01.151200952Z [2024-03-29T03:39:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:39:01.151569511Z [2024-03-29T03:39:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:39:01.151754035Z [2024-03-29T03:39:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:39:01.388237784Z [2024-03-29T03:39:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status queued for try_number 1 2024-03-29T03:39:01.388278392Z [2024-03-29T03:39:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status queued for try_number 1 2024-03-29T03:39:01.388294815Z [2024-03-29T03:39:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status queued for try_number 1 2024-03-29T03:39:01.397559763Z [2024-03-29T03:39:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a9cfdba-cd27-4967-969f-52b5a32575d7 2024-03-29T03:39:01.397605552Z [2024-03-29T03:39:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf38d66c-b91f-4d0f-8519-15428f95c9e9 2024-03-29T03:39:01.397713889Z [2024-03-29T03:39:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39e5e5f5-dd90-41dd-855d-a714dd4ce9f9 2024-03-29T03:39:02.586833382Z [2024-03-29T03:39:02.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:39:02.587156206Z [2024-03-29T03:39:02.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:38:00+00:00, run_id=scheduled__2024-03-29T03:38:00+00:00, run_start_date=2024-03-29 03:39:01.088670+00:00, run_end_date=2024-03-29 03:39:02.586708+00:00, run_duration=1.498038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:38:00+00:00, data_interval_end=2024-03-29 03:39:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:39:02.610622369Z [2024-03-29T03:39:02.610+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:39:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:39:03.859402019Z [2024-03-29T03:39:03.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status success for try_number 1 2024-03-29T03:39:03.872089859Z [2024-03-29T03:39:03.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:38:00+00:00, map_index=-1, run_start_date=2024-03-29 03:39:01.999809+00:00, run_end_date=2024-03-29 03:39:02.553265+00:00, run_duration=0.553456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:39:01.146536+00:00, queued_by_job_id=2, pid=15978 2024-03-29T03:39:06.142171034Z [2024-03-29T03:39:06.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:39:06.142358324Z [2024-03-29T03:39:06.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:38:00+00:00, run_id=scheduled__2024-03-29T03:38:00+00:00, run_start_date=2024-03-29 03:39:01.090344+00:00, run_end_date=2024-03-29 03:39:06.141934+00:00, run_duration=5.05159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:38:00+00:00, data_interval_end=2024-03-29 03:39:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:39:06.155318656Z [2024-03-29T03:39:06.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:39:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:39:06.200248689Z [2024-03-29T03:39:06.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status success for try_number 1 2024-03-29T03:39:06.205030901Z [2024-03-29T03:39:06.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:38:00+00:00, map_index=-1, run_start_date=2024-03-29 03:39:03.629722+00:00, run_end_date=2024-03-29 03:39:05.742716+00:00, run_duration=2.112994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:39:01.146536+00:00, queued_by_job_id=2, pid=15997 2024-03-29T03:39:07.286289414Z [2024-03-29T03:39:07.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:39:07.286786278Z [2024-03-29T03:39:07.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:38:00+00:00, run_id=scheduled__2024-03-29T03:38:00+00:00, run_start_date=2024-03-29 03:39:01.091636+00:00, run_end_date=2024-03-29 03:39:07.286464+00:00, run_duration=6.194828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:38:00+00:00, data_interval_end=2024-03-29 03:39:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:39:07.295285083Z [2024-03-29T03:39:07.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:39:00+00:00, run_after=2024-03-29T03:40:00+00:00 2024-03-29T03:39:07.348730376Z [2024-03-29T03:39:07.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status success for try_number 1 2024-03-29T03:39:07.358791021Z [2024-03-29T03:39:07.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:38:00+00:00, map_index=-1, run_start_date=2024-03-29 03:39:03.593198+00:00, run_end_date=2024-03-29 03:39:06.749532+00:00, run_duration=3.156334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:39:01.146536+00:00, queued_by_job_id=2, pid=15996 2024-03-29T03:40:00.581762182Z [2024-03-29T03:40:00.581+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:45:00+00:00 2024-03-29T03:40:00.594382781Z [2024-03-29T03:40:00.593+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:40:00.609629701Z [2024-03-29T03:40:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:41:00+00:00 2024-03-29T03:40:00.623183957Z [2024-03-29T03:40:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:41:00+00:00 2024-03-29T03:40:00.632329122Z [2024-03-29T03:40:00.631+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:40:00.758619388Z [2024-03-29T03:40:00.757+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-29T03:40:00.758655412Z 2024-03-29T03:40:00.758662133Z 2024-03-29T03:40:00.758674279Z 2024-03-29T03:40:00.758680283Z 2024-03-29T03:40:00.758686448Z 2024-03-29T03:40:00.759030421Z [2024-03-29T03:40:00.758+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:40:00.759220821Z [2024-03-29T03:40:00.758+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:40:00.759424536Z [2024-03-29T03:40:00.759+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:40:00.759647005Z [2024-03-29T03:40:00.759+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:40:00.759819374Z [2024-03-29T03:40:00.759+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:40:00.761331339Z [2024-03-29T03:40:00.760+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:40:00.761347239Z 2024-03-29T03:40:00.761352709Z 2024-03-29T03:40:00.761357180Z 2024-03-29T03:40:00.761361331Z 2024-03-29T03:40:00.761365871Z 2024-03-29T03:40:00.768062743Z [2024-03-29T03:40:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:40:00.768232668Z [2024-03-29T03:40:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:40:00.768547526Z [2024-03-29T03:40:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:40:00.768710231Z [2024-03-29T03:40:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:40:00.769032665Z [2024-03-29T03:40:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:40:00.769190520Z [2024-03-29T03:40:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:40:00.769473488Z [2024-03-29T03:40:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:40:00.769619104Z [2024-03-29T03:40:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:40:00.769919205Z [2024-03-29T03:40:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:40:00.770042516Z [2024-03-29T03:40:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:40:01.380194462Z [2024-03-29T03:40:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:01.380774048Z [2024-03-29T03:40:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:01.380894522Z [2024-03-29T03:40:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:39:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:01.381085473Z [2024-03-29T03:40:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:39:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:01.381296065Z [2024-03-29T03:40:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:39:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:01.400436458Z [2024-03-29T03:40:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to e699307d-72e8-4560-b8c6-95a6cfb2443b 2024-03-29T03:40:01.400893925Z [2024-03-29T03:40:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc8cd39e-3e33-4252-92fd-7d4c906e0890 2024-03-29T03:40:01.401159081Z [2024-03-29T03:40:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d4821c9-0a81-4017-82f2-312484f6678c 2024-03-29T03:40:01.401380248Z [2024-03-29T03:40:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36be2a94-d4e4-43bc-ba7a-8616f7cf01e5 2024-03-29T03:40:01.401580329Z [2024-03-29T03:40:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb000bc8-5e7d-4fa1-9846-e69a6d5b08e6 2024-03-29T03:40:02.652606795Z [2024-03-29T03:40:02.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:40:02.654067154Z [2024-03-29T03:40:02.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:38:00+00:00, run_id=scheduled__2024-03-29T03:38:00+00:00, run_start_date=2024-03-29 03:40:00.649306+00:00, run_end_date=2024-03-29 03:40:02.652545+00:00, run_duration=2.003239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:38:00+00:00, data_interval_end=2024-03-29 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:40:02.673599115Z [2024-03-29T03:40:02.673+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:42:00+00:00 2024-03-29T03:40:02.686681496Z [2024-03-29T03:40:02.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:40:02.687184191Z [2024-03-29T03:40:02.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:39:00+00:00, run_id=scheduled__2024-03-29T03:39:00+00:00, run_start_date=2024-03-29 03:40:00.650553+00:00, run_end_date=2024-03-29 03:40:02.686599+00:00, run_duration=2.036046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:39:00+00:00, data_interval_end=2024-03-29 03:40:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:40:02.706494086Z [2024-03-29T03:40:02.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:41:00+00:00 2024-03-29T03:40:03.913126851Z [2024-03-29T03:40:03.912+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:40:03.913150860Z 2024-03-29T03:40:03.913487703Z [2024-03-29T03:40:03.913+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:40:03.914632020Z [2024-03-29T03:40:03.914+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:40:03.914644272Z 2024-03-29T03:40:03.919135270Z [2024-03-29T03:40:03.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:40:03.919729079Z [2024-03-29T03:40:03.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:40:04.034763012Z [2024-03-29T03:40:04.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:04.034783055Z [2024-03-29T03:40:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:04.034788245Z [2024-03-29T03:40:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:38:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:04.034791856Z [2024-03-29T03:40:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:39:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:04.072371206Z [2024-03-29T03:40:04.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:38:00+00:00, map_index=-1, run_start_date=2024-03-29 03:40:01.871540+00:00, run_end_date=2024-03-29 03:40:02.515202+00:00, run_duration=0.643662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:00.763720+00:00, queued_by_job_id=2, pid=16031 2024-03-29T03:40:04.072773533Z [2024-03-29T03:40:04.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to e666eae9-bad7-4ed0-942b-ab9cceaeaa25 2024-03-29T03:40:04.072784060Z [2024-03-29T03:40:04.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:39:00+00:00, map_index=-1, run_start_date=2024-03-29 03:40:02.033482+00:00, run_end_date=2024-03-29 03:40:02.607213+00:00, run_duration=0.573731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:00.763720+00:00, queued_by_job_id=2, pid=16033 2024-03-29T03:40:04.072801420Z [2024-03-29T03:40:04.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:35:00+00:00, map_index=-1, run_start_date=2024-03-29 03:40:03.156063+00:00, run_end_date=2024-03-29 03:40:03.634001+00:00, run_duration=0.477938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:00.763720+00:00, queued_by_job_id=2, pid=16051 2024-03-29T03:40:06.386806568Z [2024-03-29T03:40:06.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:40:06.387162925Z [2024-03-29T03:40:06.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:39:00+00:00, run_id=scheduled__2024-03-29T03:39:00+00:00, run_start_date=2024-03-29 03:40:00.651753+00:00, run_end_date=2024-03-29 03:40:06.386713+00:00, run_duration=5.73496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:39:00+00:00, data_interval_end=2024-03-29 03:40:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:40:06.402769071Z [2024-03-29T03:40:06.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:41:00+00:00 2024-03-29T03:40:06.416710860Z [2024-03-29T03:40:06.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:40:06.420086131Z [2024-03-29T03:40:06.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:39:00+00:00, run_id=scheduled__2024-03-29T03:39:00+00:00, run_start_date=2024-03-29 03:40:00.652910+00:00, run_end_date=2024-03-29 03:40:06.416598+00:00, run_duration=5.763688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:39:00+00:00, data_interval_end=2024-03-29 03:40:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:40:06.447826663Z [2024-03-29T03:40:06.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:41:00+00:00 2024-03-29T03:40:06.535216783Z [2024-03-29T03:40:06.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:39:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:06.535466968Z [2024-03-29T03:40:06.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:39:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:06.552593504Z [2024-03-29T03:40:06.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:39:00+00:00, map_index=-1, run_start_date=2024-03-29 03:40:03.764097+00:00, run_end_date=2024-03-29 03:40:05.682383+00:00, run_duration=1.918286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:00.763720+00:00, queued_by_job_id=2, pid=16067 2024-03-29T03:40:06.552853105Z [2024-03-29T03:40:06.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:39:00+00:00, map_index=-1, run_start_date=2024-03-29 03:40:04.051737+00:00, run_end_date=2024-03-29 03:40:05.556257+00:00, run_duration=1.50452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:00.763720+00:00, queued_by_job_id=2, pid=16069 2024-03-29T03:40:07.647217883Z [2024-03-29T03:40:07.646+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:40:07.647248441Z 2024-03-29T03:40:07.659740263Z [2024-03-29T03:40:07.647+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:40:07.659763745Z [2024-03-29T03:40:07.658+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:40:07.659767312Z 2024-03-29T03:40:07.664174764Z [2024-03-29T03:40:07.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:40:07.664581309Z [2024-03-29T03:40:07.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:40:07.731394980Z [2024-03-29T03:40:07.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:07.731868578Z [2024-03-29T03:40:07.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:07.740208690Z [2024-03-29T03:40:07.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to eec75324-c513-4866-800e-3e4eff68a25e 2024-03-29T03:40:07.740843547Z [2024-03-29T03:40:07.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:35:00+00:00, map_index=-1, run_start_date=2024-03-29 03:40:06.233514+00:00, run_end_date=2024-03-29 03:40:06.619805+00:00, run_duration=0.386291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:03.915435+00:00, queued_by_job_id=2, pid=16086 2024-03-29T03:40:09.935131713Z [2024-03-29T03:40:09.934+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:40:09.935167661Z 2024-03-29T03:40:09.935182611Z [2024-03-29T03:40:09.935+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:40:09.935696745Z [2024-03-29T03:40:09.935+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:40:09.935709803Z 2024-03-29T03:40:09.938188150Z [2024-03-29T03:40:09.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:40:09.938266143Z [2024-03-29T03:40:09.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:40:10.007595772Z [2024-03-29T03:40:10.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status queued for try_number 1 2024-03-29T03:40:10.007680537Z [2024-03-29T03:40:10.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:10.018370472Z [2024-03-29T03:40:10.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe4e8a07-aa28-4283-ae0c-4f0911758ef1 2024-03-29T03:40:10.018705404Z [2024-03-29T03:40:10.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:35:00+00:00, map_index=0, run_start_date=2024-03-29 03:40:09.401192+00:00, run_end_date=2024-03-29 03:40:09.765115+00:00, run_duration=0.363923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:07.659144+00:00, queued_by_job_id=2, pid=16094 2024-03-29T03:40:12.731864288Z [2024-03-29T03:40:12.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:40:12.732506882Z [2024-03-29T03:40:12.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:35:00+00:00, run_id=scheduled__2024-03-29T03:35:00+00:00, run_start_date=2024-03-29 03:40:00.647730+00:00, run_end_date=2024-03-29 03:40:12.731730+00:00, run_duration=12.084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:35:00+00:00, data_interval_end=2024-03-29 03:40:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:40:12.742701445Z [2024-03-29T03:40:12.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:40:00+00:00, run_after=2024-03-29T03:45:00+00:00 2024-03-29T03:40:12.781825638Z [2024-03-29T03:40:12.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:35:00+00:00 exited with status success for try_number 1 2024-03-29T03:40:12.788270950Z [2024-03-29T03:40:12.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:35:00+00:00, map_index=-1, run_start_date=2024-03-29 03:40:11.521063+00:00, run_end_date=2024-03-29 03:40:11.874862+00:00, run_duration=0.353799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:40:09.936108+00:00, queued_by_job_id=2, pid=16102 2024-03-29T03:41:00.624552212Z [2024-03-29T03:41:00.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:41:00+00:00, run_after=2024-03-29T03:42:00+00:00 2024-03-29T03:41:00.638973544Z [2024-03-29T03:41:00.638+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:41:00+00:00, run_after=2024-03-29T03:42:00+00:00 2024-03-29T03:41:00.647609045Z [2024-03-29T03:41:00.647+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:41:00.715164856Z [2024-03-29T03:41:00.714+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:41:00.715192466Z 2024-03-29T03:41:00.715196287Z 2024-03-29T03:41:00.715199702Z 2024-03-29T03:41:00.715413296Z [2024-03-29T03:41:00.715+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:41:00.715688280Z [2024-03-29T03:41:00.715+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:41:00.715930300Z [2024-03-29T03:41:00.715+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:41:00.716972118Z [2024-03-29T03:41:00.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:41:00.716986299Z 2024-03-29T03:41:00.716991353Z 2024-03-29T03:41:00.716996427Z 2024-03-29T03:41:00.721316473Z [2024-03-29T03:41:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:41:00.721820965Z [2024-03-29T03:41:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:41:00.722382359Z [2024-03-29T03:41:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:41:00.722764948Z [2024-03-29T03:41:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:41:00.723208969Z [2024-03-29T03:41:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:41:00.723453772Z [2024-03-29T03:41:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:41:01.009680705Z [2024-03-29T03:41:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:41:01.010009194Z [2024-03-29T03:41:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:41:01.010166688Z [2024-03-29T03:41:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:41:01.023602188Z [2024-03-29T03:41:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ad7f2fd-ac0f-41cf-9ed9-abbf759596d1 2024-03-29T03:41:01.023774207Z [2024-03-29T03:41:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67028319-7fc7-4eca-bf78-479fd1c21e27 2024-03-29T03:41:01.024170272Z [2024-03-29T03:41:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb63da3e-c5f8-48a9-a1b9-81674e51e150 2024-03-29T03:41:02.354042801Z [2024-03-29T03:41:02.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:41:02.354994983Z [2024-03-29T03:41:02.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:40:00+00:00, run_id=scheduled__2024-03-29T03:40:00+00:00, run_start_date=2024-03-29 03:41:00.660371+00:00, run_end_date=2024-03-29 03:41:02.353985+00:00, run_duration=1.693614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:40:00+00:00, data_interval_end=2024-03-29 03:41:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:41:02.370900083Z [2024-03-29T03:41:02.370+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:41:00+00:00, run_after=2024-03-29T03:42:00+00:00 2024-03-29T03:41:03.582881250Z [2024-03-29T03:41:03.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:41:03.589409828Z [2024-03-29T03:41:03.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=-1, run_start_date=2024-03-29 03:41:01.830302+00:00, run_end_date=2024-03-29 03:41:02.285359+00:00, run_duration=0.455057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:41:00.717897+00:00, queued_by_job_id=2, pid=16125 2024-03-29T03:41:05.723453721Z [2024-03-29T03:41:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:41:05.730113374Z [2024-03-29T03:41:05.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:40:00+00:00, run_id=scheduled__2024-03-29T03:40:00+00:00, run_start_date=2024-03-29 03:41:00.661613+00:00, run_end_date=2024-03-29 03:41:05.723573+00:00, run_duration=5.06196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:40:00+00:00, data_interval_end=2024-03-29 03:41:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:41:05.733967453Z [2024-03-29T03:41:05.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:41:00+00:00, run_after=2024-03-29T03:42:00+00:00 2024-03-29T03:41:05.741580553Z [2024-03-29T03:41:05.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:41:05.741931115Z [2024-03-29T03:41:05.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:40:00+00:00, run_id=scheduled__2024-03-29T03:40:00+00:00, run_start_date=2024-03-29 03:41:00.662731+00:00, run_end_date=2024-03-29 03:41:05.741614+00:00, run_duration=5.078883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:40:00+00:00, data_interval_end=2024-03-29 03:41:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:41:05.752566762Z [2024-03-29T03:41:05.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:41:00+00:00, run_after=2024-03-29T03:42:00+00:00 2024-03-29T03:41:05.788489784Z [2024-03-29T03:41:05.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:41:05.788744764Z [2024-03-29T03:41:05.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:41:05.794533097Z [2024-03-29T03:41:05.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=-1, run_start_date=2024-03-29 03:41:02.715017+00:00, run_end_date=2024-03-29 03:41:04.810865+00:00, run_duration=2.095848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:41:00.717897+00:00, queued_by_job_id=2, pid=16142 2024-03-29T03:41:05.794803744Z [2024-03-29T03:41:05.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=-1, run_start_date=2024-03-29 03:41:02.752898+00:00, run_end_date=2024-03-29 03:41:04.627203+00:00, run_duration=1.874305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:41:00.717897+00:00, queued_by_job_id=2, pid=16143 2024-03-29T03:42:00.986837523Z [2024-03-29T03:42:00.986+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:42:01.000646511Z [2024-03-29T03:42:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:42:00+00:00, run_after=2024-03-29T03:43:00+00:00 2024-03-29T03:42:01.016260644Z [2024-03-29T03:42:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:42:00+00:00, run_after=2024-03-29T03:43:00+00:00 2024-03-29T03:42:01.026040654Z [2024-03-29T03:42:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:42:01.097078753Z [2024-03-29T03:42:01.096+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:42:01.097104421Z 2024-03-29T03:42:01.097108720Z 2024-03-29T03:42:01.097111999Z 2024-03-29T03:42:01.097115155Z 2024-03-29T03:42:01.097471447Z [2024-03-29T03:42:01.097+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:42:01.097779787Z [2024-03-29T03:42:01.097+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:42:01.098075476Z [2024-03-29T03:42:01.097+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:42:01.098392209Z [2024-03-29T03:42:01.098+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:42:01.099615231Z [2024-03-29T03:42:01.099+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:42:01.099669393Z 2024-03-29T03:42:01.099676491Z 2024-03-29T03:42:01.099682242Z 2024-03-29T03:42:01.099688301Z 2024-03-29T03:42:01.105647345Z [2024-03-29T03:42:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:42:01.105914001Z [2024-03-29T03:42:01.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:42:01.106285619Z [2024-03-29T03:42:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:42:01.106475661Z [2024-03-29T03:42:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:42:01.106786884Z [2024-03-29T03:42:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:42:01.106945328Z [2024-03-29T03:42:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:42:01.107229554Z [2024-03-29T03:42:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:42:01.107379052Z [2024-03-29T03:42:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:42:01.567846024Z [2024-03-29T03:42:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:42:01.568163696Z [2024-03-29T03:42:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:41:00+00:00 exited with status queued for try_number 1 2024-03-29T03:42:01.568330501Z [2024-03-29T03:42:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:41:00+00:00 exited with status queued for try_number 1 2024-03-29T03:42:01.568507227Z [2024-03-29T03:42:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:41:00+00:00 exited with status queued for try_number 1 2024-03-29T03:42:01.596274597Z [2024-03-29T03:42:01.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebc7b4f7-a8a0-4095-8abe-919ab4e4c1d0 2024-03-29T03:42:01.596589241Z [2024-03-29T03:42:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00c6900f-0c97-4e95-ac94-35959948e569 2024-03-29T03:42:01.596906457Z [2024-03-29T03:42:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73c230e4-f390-41b9-8e97-9b95aa5d6680 2024-03-29T03:42:01.597133157Z [2024-03-29T03:42:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c2efb84-1c80-4ec1-89ac-9bef75d744c6 2024-03-29T03:42:02.970793728Z [2024-03-29T03:42:02.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:42:02.971735695Z [2024-03-29T03:42:02.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:40:00+00:00, run_id=scheduled__2024-03-29T03:40:00+00:00, run_start_date=2024-03-29 03:42:01.037521+00:00, run_end_date=2024-03-29 03:42:02.971119+00:00, run_duration=1.933598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:40:00+00:00, data_interval_end=2024-03-29 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:42:02.986916390Z [2024-03-29T03:42:02.986+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:42:00+00:00, run_after=2024-03-29T03:44:00+00:00 2024-03-29T03:42:02.999790670Z [2024-03-29T03:42:02.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:42:03.000553330Z [2024-03-29T03:42:03.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:41:00+00:00, run_id=scheduled__2024-03-29T03:41:00+00:00, run_start_date=2024-03-29 03:42:01.038895+00:00, run_end_date=2024-03-29 03:42:02.999913+00:00, run_duration=1.961018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:41:00+00:00, data_interval_end=2024-03-29 03:42:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:42:03.019880701Z [2024-03-29T03:42:03.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:42:00+00:00, run_after=2024-03-29T03:43:00+00:00 2024-03-29T03:42:03.129204781Z [2024-03-29T03:42:03.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:41:00+00:00 exited with status success for try_number 1 2024-03-29T03:42:03.145751543Z [2024-03-29T03:42:03.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:41:00+00:00, map_index=-1, run_start_date=2024-03-29 03:42:01.980885+00:00, run_end_date=2024-03-29 03:42:02.488571+00:00, run_duration=0.507686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:42:01.101749+00:00, queued_by_job_id=2, pid=16176 2024-03-29T03:42:03.348371834Z [2024-03-29T03:42:03.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:42:03.356497024Z [2024-03-29T03:42:03.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=-1, run_start_date=2024-03-29 03:42:02.432617+00:00, run_end_date=2024-03-29 03:42:02.938745+00:00, run_duration=0.506128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:42:01.101749+00:00, queued_by_job_id=2, pid=16182 2024-03-29T03:42:06.628645062Z [2024-03-29T03:42:06.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:42:06.628943074Z [2024-03-29T03:42:06.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:41:00+00:00, run_id=scheduled__2024-03-29T03:41:00+00:00, run_start_date=2024-03-29 03:42:01.040041+00:00, run_end_date=2024-03-29 03:42:06.628471+00:00, run_duration=5.58843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:41:00+00:00, data_interval_end=2024-03-29 03:42:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:42:06.641803231Z [2024-03-29T03:42:06.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:42:00+00:00, run_after=2024-03-29T03:43:00+00:00 2024-03-29T03:42:06.649613680Z [2024-03-29T03:42:06.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:42:06.649940252Z [2024-03-29T03:42:06.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:41:00+00:00, run_id=scheduled__2024-03-29T03:41:00+00:00, run_start_date=2024-03-29 03:42:01.041058+00:00, run_end_date=2024-03-29 03:42:06.649559+00:00, run_duration=5.608501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:41:00+00:00, data_interval_end=2024-03-29 03:42:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:42:06.663506878Z [2024-03-29T03:42:06.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:42:00+00:00, run_after=2024-03-29T03:43:00+00:00 2024-03-29T03:42:06.705130927Z [2024-03-29T03:42:06.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:41:00+00:00 exited with status success for try_number 1 2024-03-29T03:42:06.705168318Z [2024-03-29T03:42:06.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:41:00+00:00 exited with status success for try_number 1 2024-03-29T03:42:06.712931732Z [2024-03-29T03:42:06.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:41:00+00:00, map_index=-1, run_start_date=2024-03-29 03:42:03.977035+00:00, run_end_date=2024-03-29 03:42:05.785913+00:00, run_duration=1.808878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:42:01.101749+00:00, queued_by_job_id=2, pid=16201 2024-03-29T03:42:06.713026064Z [2024-03-29T03:42:06.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:41:00+00:00, map_index=-1, run_start_date=2024-03-29 03:42:03.701353+00:00, run_end_date=2024-03-29 03:42:05.919674+00:00, run_duration=2.218321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:42:01.101749+00:00, queued_by_job_id=2, pid=16200 2024-03-29T03:43:00.344887185Z [2024-03-29T03:43:00.344+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:43:00+00:00, run_after=2024-03-29T03:44:00+00:00 2024-03-29T03:43:00.358925824Z [2024-03-29T03:43:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:43:00+00:00, run_after=2024-03-29T03:44:00+00:00 2024-03-29T03:43:00.368687769Z [2024-03-29T03:43:00.368+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:43:00.476303154Z [2024-03-29T03:43:00.475+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:43:00.476369233Z 2024-03-29T03:43:00.476380236Z 2024-03-29T03:43:00.476388947Z 2024-03-29T03:43:00.476441703Z [2024-03-29T03:43:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:43:00.476791233Z [2024-03-29T03:43:00.476+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:43:00.476952700Z [2024-03-29T03:43:00.476+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:43:00.477930887Z [2024-03-29T03:43:00.477+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:43:00.477979779Z 2024-03-29T03:43:00.477990181Z 2024-03-29T03:43:00.478016776Z 2024-03-29T03:43:00.485221861Z [2024-03-29T03:43:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:43:00.485631458Z [2024-03-29T03:43:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:43:00.486122212Z [2024-03-29T03:43:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:43:00.486355291Z [2024-03-29T03:43:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:43:00.487382482Z [2024-03-29T03:43:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:43:00.487773822Z [2024-03-29T03:43:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:43:00.736723829Z [2024-03-29T03:43:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status queued for try_number 1 2024-03-29T03:43:00.736753883Z [2024-03-29T03:43:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status queued for try_number 1 2024-03-29T03:43:00.736839715Z [2024-03-29T03:43:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status queued for try_number 1 2024-03-29T03:43:00.749976317Z [2024-03-29T03:43:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81cd83a7-2c41-475a-9f7b-2f5f044dba4d 2024-03-29T03:43:00.750277131Z [2024-03-29T03:43:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91be5a7f-3062-4c4f-a7d0-ba6764a6038c 2024-03-29T03:43:00.750575503Z [2024-03-29T03:43:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 127bc355-a22f-4199-965b-30426b1e0be4 2024-03-29T03:43:03.032552905Z [2024-03-29T03:43:03.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:43:03.032987860Z [2024-03-29T03:43:03.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:42:00+00:00, run_id=scheduled__2024-03-29T03:42:00+00:00, run_start_date=2024-03-29 03:43:00.385416+00:00, run_end_date=2024-03-29 03:43:03.032423+00:00, run_duration=2.647007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:42:00+00:00, data_interval_end=2024-03-29 03:43:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:43:03.050578859Z [2024-03-29T03:43:03.049+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:43:00+00:00, run_after=2024-03-29T03:44:00+00:00 2024-03-29T03:43:03.116320269Z [2024-03-29T03:43:03.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status success for try_number 1 2024-03-29T03:43:03.125791189Z [2024-03-29T03:43:03.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:42:00+00:00, map_index=-1, run_start_date=2024-03-29 03:43:01.486414+00:00, run_end_date=2024-03-29 03:43:01.944533+00:00, run_duration=0.458119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:43:00.479542+00:00, queued_by_job_id=2, pid=16233 2024-03-29T03:43:04.177572625Z [2024-03-29T03:43:04.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:43:04.177717066Z [2024-03-29T03:43:04.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:42:00+00:00, run_id=scheduled__2024-03-29T03:42:00+00:00, run_start_date=2024-03-29 03:43:00.387326+00:00, run_end_date=2024-03-29 03:43:04.177234+00:00, run_duration=3.789908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:42:00+00:00, data_interval_end=2024-03-29 03:43:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:43:04.188658703Z [2024-03-29T03:43:04.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:43:00+00:00, run_after=2024-03-29T03:44:00+00:00 2024-03-29T03:43:04.224313763Z [2024-03-29T03:43:04.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status success for try_number 1 2024-03-29T03:43:04.231451486Z [2024-03-29T03:43:04.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:42:00+00:00, map_index=-1, run_start_date=2024-03-29 03:43:02.453664+00:00, run_end_date=2024-03-29 03:43:03.715749+00:00, run_duration=1.262085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:43:00.479542+00:00, queued_by_job_id=2, pid=16252 2024-03-29T03:43:05.297835718Z [2024-03-29T03:43:05.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:43:05.298208445Z [2024-03-29T03:43:05.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:42:00+00:00, run_id=scheduled__2024-03-29T03:42:00+00:00, run_start_date=2024-03-29 03:43:00.388595+00:00, run_end_date=2024-03-29 03:43:05.297732+00:00, run_duration=4.909137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:42:00+00:00, data_interval_end=2024-03-29 03:43:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:43:05.310666486Z [2024-03-29T03:43:05.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:43:00+00:00, run_after=2024-03-29T03:44:00+00:00 2024-03-29T03:43:05.350378476Z [2024-03-29T03:43:05.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status success for try_number 1 2024-03-29T03:43:05.357823422Z [2024-03-29T03:43:05.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:42:00+00:00, map_index=-1, run_start_date=2024-03-29 03:43:02.353150+00:00, run_end_date=2024-03-29 03:43:04.158194+00:00, run_duration=1.805044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:43:00.479542+00:00, queued_by_job_id=2, pid=16251 2024-03-29T03:43:47.122880705Z [2024-03-29T03:43:47.122+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:44:00.037589139Z [2024-03-29T03:44:00.037+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:44:00.048700779Z [2024-03-29T03:44:00.048+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:44:00.063756413Z [2024-03-29T03:44:00.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:44:00+00:00, run_after=2024-03-29T03:45:00+00:00 2024-03-29T03:44:00.079440939Z [2024-03-29T03:44:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:44:00+00:00, run_after=2024-03-29T03:45:00+00:00 2024-03-29T03:44:00.198200803Z [2024-03-29T03:44:00.197+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:44:00.198260669Z 2024-03-29T03:44:00.198268084Z 2024-03-29T03:44:00.198273499Z 2024-03-29T03:44:00.198279043Z 2024-03-29T03:44:00.198527803Z [2024-03-29T03:44:00.198+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:44:00.198843543Z [2024-03-29T03:44:00.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:44:00.199158712Z [2024-03-29T03:44:00.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:44:00.199488366Z [2024-03-29T03:44:00.199+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:44:00.200816362Z [2024-03-29T03:44:00.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:44:00.200827080Z 2024-03-29T03:44:00.200832158Z 2024-03-29T03:44:00.200835991Z 2024-03-29T03:44:00.200839920Z 2024-03-29T03:44:00.207856789Z [2024-03-29T03:44:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:44:00.208120957Z [2024-03-29T03:44:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:44:00.208702153Z [2024-03-29T03:44:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:44:00.208986713Z [2024-03-29T03:44:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:44:00.209475095Z [2024-03-29T03:44:00.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:44:00.209690885Z [2024-03-29T03:44:00.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:44:00.210174321Z [2024-03-29T03:44:00.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:44:00.210408451Z [2024-03-29T03:44:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:44:00.501880684Z [2024-03-29T03:44:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status queued for try_number 1 2024-03-29T03:44:00.501914145Z [2024-03-29T03:44:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:43:00+00:00 exited with status queued for try_number 1 2024-03-29T03:44:00.501946472Z [2024-03-29T03:44:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:43:00+00:00 exited with status queued for try_number 1 2024-03-29T03:44:00.502023016Z [2024-03-29T03:44:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:43:00+00:00 exited with status queued for try_number 1 2024-03-29T03:44:00.519435613Z [2024-03-29T03:44:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62ee5889-b7ae-4015-832f-0c04bdad2684 2024-03-29T03:44:00.519784340Z [2024-03-29T03:44:00.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0a73890-3cfe-4234-bb8a-8a6160cd45eb 2024-03-29T03:44:00.520157531Z [2024-03-29T03:44:00.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a1040ac-1830-4fe5-8929-ccf664ed58da 2024-03-29T03:44:00.520556119Z [2024-03-29T03:44:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06a4a467-3cde-4bc2-8694-291646f390e0 2024-03-29T03:44:01.825326915Z [2024-03-29T03:44:01.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:44:01.825677629Z [2024-03-29T03:44:01.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:43:00+00:00, run_id=scheduled__2024-03-29T03:43:00+00:00, run_start_date=2024-03-29 03:44:00.100169+00:00, run_end_date=2024-03-29 03:44:01.825227+00:00, run_duration=1.725058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:43:00+00:00, data_interval_end=2024-03-29 03:44:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:44:01.845737987Z [2024-03-29T03:44:01.845+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:44:00+00:00, run_after=2024-03-29T03:45:00+00:00 2024-03-29T03:44:01.979149796Z [2024-03-29T03:44:01.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:43:00+00:00 exited with status success for try_number 1 2024-03-29T03:44:01.990786818Z [2024-03-29T03:44:01.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:43:00+00:00, map_index=-1, run_start_date=2024-03-29 03:44:01.326882+00:00, run_end_date=2024-03-29 03:44:01.780693+00:00, run_duration=0.453811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:44:00.202787+00:00, queued_by_job_id=2, pid=16286 2024-03-29T03:44:03.033054033Z [2024-03-29T03:44:03.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:44:03.033222155Z [2024-03-29T03:44:03.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:42:00+00:00, run_id=scheduled__2024-03-29T03:42:00+00:00, run_start_date=2024-03-29 03:44:00.097123+00:00, run_end_date=2024-03-29 03:44:03.032924+00:00, run_duration=2.935801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:42:00+00:00, data_interval_end=2024-03-29 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:44:03.041515941Z [2024-03-29T03:44:03.041+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:44:00+00:00, run_after=2024-03-29T03:46:00+00:00 2024-03-29T03:44:03.097563344Z [2024-03-29T03:44:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:42:00+00:00 exited with status success for try_number 1 2024-03-29T03:44:03.104873564Z [2024-03-29T03:44:03.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:42:00+00:00, map_index=-1, run_start_date=2024-03-29 03:44:01.241293+00:00, run_end_date=2024-03-29 03:44:01.852304+00:00, run_duration=0.611011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:44:00.202787+00:00, queued_by_job_id=2, pid=16285 2024-03-29T03:44:04.152592374Z [2024-03-29T03:44:04.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:44:04.152788396Z [2024-03-29T03:44:04.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:43:00+00:00, run_id=scheduled__2024-03-29T03:43:00+00:00, run_start_date=2024-03-29 03:44:00.102952+00:00, run_end_date=2024-03-29 03:44:04.152433+00:00, run_duration=4.049481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:43:00+00:00, data_interval_end=2024-03-29 03:44:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:44:04.170594430Z [2024-03-29T03:44:04.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:44:00+00:00, run_after=2024-03-29T03:45:00+00:00 2024-03-29T03:44:04.181934943Z [2024-03-29T03:44:04.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:44:04.182318950Z [2024-03-29T03:44:04.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:43:00+00:00, run_id=scheduled__2024-03-29T03:43:00+00:00, run_start_date=2024-03-29 03:44:00.105486+00:00, run_end_date=2024-03-29 03:44:04.181825+00:00, run_duration=4.076339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:43:00+00:00, data_interval_end=2024-03-29 03:44:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:44:04.193259942Z [2024-03-29T03:44:04.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:44:00+00:00, run_after=2024-03-29T03:45:00+00:00 2024-03-29T03:44:04.230707552Z [2024-03-29T03:44:04.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:43:00+00:00 exited with status success for try_number 1 2024-03-29T03:44:04.241982035Z [2024-03-29T03:44:04.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:43:00+00:00, map_index=-1, run_start_date=2024-03-29 03:44:02.517972+00:00, run_end_date=2024-03-29 03:44:03.876657+00:00, run_duration=1.358685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:44:00.202787+00:00, queued_by_job_id=2, pid=16310 2024-03-29T03:44:05.317044498Z [2024-03-29T03:44:05.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:43:00+00:00 exited with status success for try_number 1 2024-03-29T03:44:05.326829352Z [2024-03-29T03:44:05.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:43:00+00:00, map_index=-1, run_start_date=2024-03-29 03:44:02.494353+00:00, run_end_date=2024-03-29 03:44:04.125190+00:00, run_duration=1.630837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:44:00.202787+00:00, queued_by_job_id=2, pid=16309 2024-03-29T03:45:00.072632656Z [2024-03-29T03:45:00.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:45:00+00:00, run_after=2024-03-29T03:46:00+00:00 2024-03-29T03:45:00.098332430Z [2024-03-29T03:45:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:45:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:45:00.110226153Z [2024-03-29T03:45:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:45:00.126058241Z [2024-03-29T03:45:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:45:00+00:00, run_after=2024-03-29T03:46:00+00:00 2024-03-29T03:45:00.220161414Z [2024-03-29T03:45:00.219+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:45:00.220198537Z 2024-03-29T03:45:00.220208193Z 2024-03-29T03:45:00.220215849Z 2024-03-29T03:45:00.220223675Z 2024-03-29T03:45:00.220268449Z [2024-03-29T03:45:00.220+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:45:00.220407341Z [2024-03-29T03:45:00.220+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:45:00.220563739Z [2024-03-29T03:45:00.220+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:45:00.220693344Z [2024-03-29T03:45:00.220+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:45:00.221308910Z [2024-03-29T03:45:00.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:45:00.221328158Z 2024-03-29T03:45:00.221336835Z 2024-03-29T03:45:00.221343953Z 2024-03-29T03:45:00.221351284Z 2024-03-29T03:45:00.225325617Z [2024-03-29T03:45:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-29T03:45:00.225475951Z [2024-03-29T03:45:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:45:00.225768342Z [2024-03-29T03:45:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:45:00.225884118Z [2024-03-29T03:45:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:45:00.226164349Z [2024-03-29T03:45:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:45:00.226411764Z [2024-03-29T03:45:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:45:00.226715397Z [2024-03-29T03:45:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:45:00.226826943Z [2024-03-29T03:45:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:45:00.588009195Z [2024-03-29T03:45:00.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:45:00.588966693Z [2024-03-29T03:45:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status queued for try_number 1 2024-03-29T03:45:00.589952145Z [2024-03-29T03:45:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status queued for try_number 1 2024-03-29T03:45:00.590159310Z [2024-03-29T03:45:00.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status queued for try_number 1 2024-03-29T03:45:00.603895159Z [2024-03-29T03:45:00.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98aca2a0-1256-431f-877f-c01737cd330d 2024-03-29T03:45:00.604240104Z [2024-03-29T03:45:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56487abc-5add-455c-b01e-4027dff2e351 2024-03-29T03:45:00.604462320Z [2024-03-29T03:45:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6d15336-668b-4581-a76c-004e7eb28c5c 2024-03-29T03:45:00.604685057Z [2024-03-29T03:45:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75f88b20-5938-4d6f-8ed2-6aa098bc7f33 2024-03-29T03:45:02.658393903Z [2024-03-29T03:45:02.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:45:02.659667661Z [2024-03-29T03:45:02.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:44:00+00:00, run_id=scheduled__2024-03-29T03:44:00+00:00, run_start_date=2024-03-29 03:45:00.137073+00:00, run_end_date=2024-03-29 03:45:02.658294+00:00, run_duration=2.521221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:44:00+00:00, data_interval_end=2024-03-29 03:45:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:45:02.691313900Z [2024-03-29T03:45:02.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:45:00+00:00, run_after=2024-03-29T03:46:00+00:00 2024-03-29T03:45:02.800079476Z [2024-03-29T03:45:02.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status success for try_number 1 2024-03-29T03:45:02.808404879Z [2024-03-29T03:45:02.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:44:00+00:00, map_index=-1, run_start_date=2024-03-29 03:45:01.201933+00:00, run_end_date=2024-03-29 03:45:01.739530+00:00, run_duration=0.537597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:45:00.222130+00:00, queued_by_job_id=2, pid=16344 2024-03-29T03:45:03.876462809Z [2024-03-29T03:45:03.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:45:03.876557488Z [2024-03-29T03:45:03.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:44:00+00:00, run_id=scheduled__2024-03-29T03:44:00+00:00, run_start_date=2024-03-29 03:45:00.138144+00:00, run_end_date=2024-03-29 03:45:03.876301+00:00, run_duration=3.738157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:44:00+00:00, data_interval_end=2024-03-29 03:45:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:45:03.892041105Z [2024-03-29T03:45:03.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:45:00+00:00, run_after=2024-03-29T03:46:00+00:00 2024-03-29T03:45:03.925870259Z [2024-03-29T03:45:03.925+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:45:03.925901633Z 2024-03-29T03:45:03.925919353Z [2024-03-29T03:45:03.925+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:45:03.926785379Z [2024-03-29T03:45:03.926+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:45:03.926807742Z 2024-03-29T03:45:03.930263450Z [2024-03-29T03:45:03.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='split_metrics', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-29T03:45:03.930338350Z [2024-03-29T03:45:03.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'split_metrics', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:45:03.982428552Z [2024-03-29T03:45:03.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:45:03.982908416Z [2024-03-29T03:45:03.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:45:03.983641372Z [2024-03-29T03:45:03.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status success for try_number 1 2024-03-29T03:45:03.995290939Z [2024-03-29T03:45:03.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10cbc4b3-db51-4f45-8ef8-6c98d5233767 2024-03-29T03:45:03.996104995Z [2024-03-29T03:45:03.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=-1, run_start_date=2024-03-29 03:45:02.576986+00:00, run_end_date=2024-03-29 03:45:03.013496+00:00, run_duration=0.43651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:45:00.222130+00:00, queued_by_job_id=2, pid=16369 2024-03-29T03:45:03.996762760Z [2024-03-29T03:45:03.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:44:00+00:00, map_index=-1, run_start_date=2024-03-29 03:45:02.409604+00:00, run_end_date=2024-03-29 03:45:03.809720+00:00, run_duration=1.400116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:45:00.222130+00:00, queued_by_job_id=2, pid=16368 2024-03-29T03:45:05.193161616Z [2024-03-29T03:45:05.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:45:05.193281529Z [2024-03-29T03:45:05.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:44:00+00:00, run_id=scheduled__2024-03-29T03:44:00+00:00, run_start_date=2024-03-29 03:45:00.139136+00:00, run_end_date=2024-03-29 03:45:05.192745+00:00, run_duration=5.053609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:44:00+00:00, data_interval_end=2024-03-29 03:45:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:45:05.225157893Z [2024-03-29T03:45:05.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:45:00+00:00, run_after=2024-03-29T03:46:00+00:00 2024-03-29T03:45:05.304446130Z [2024-03-29T03:45:05.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status success for try_number 1 2024-03-29T03:45:05.313109145Z [2024-03-29T03:45:05.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:44:00+00:00, map_index=-1, run_start_date=2024-03-29 03:45:02.665320+00:00, run_end_date=2024-03-29 03:45:04.316792+00:00, run_duration=1.651472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:45:00.222130+00:00, queued_by_job_id=2, pid=16370 2024-03-29T03:45:06.393026331Z [2024-03-29T03:45:06.391+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:45:06.393081993Z 2024-03-29T03:45:06.394882038Z [2024-03-29T03:45:06.392+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:45:06.396136364Z [2024-03-29T03:45:06.395+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:45:06.396149952Z 2024-03-29T03:45:06.399818761Z [2024-03-29T03:45:06.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='collect_metrics', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-29T03:45:06.400098936Z [2024-03-29T03:45:06.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'collect_metrics', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-29T03:45:06.468277667Z [2024-03-29T03:45:06.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:45:06.470718498Z [2024-03-29T03:45:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.split_metrics run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:45:06.477354368Z [2024-03-29T03:45:06.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2622a9ae-ad02-4251-bfa6-5ff2686a7753 2024-03-29T03:45:06.477574054Z [2024-03-29T03:45:06.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=split_metrics, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=-1, run_start_date=2024-03-29 03:45:05.756657+00:00, run_end_date=2024-03-29 03:45:06.190945+00:00, run_duration=0.434288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:45:03.927226+00:00, queued_by_job_id=2, pid=16393 2024-03-29T03:45:09.024261065Z [2024-03-29T03:45:09.023+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-29T03:45:09.024291760Z 2024-03-29T03:45:09.024345731Z [2024-03-29T03:45:09.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:45:09.025072213Z [2024-03-29T03:45:09.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:45:09.025087897Z 2024-03-29T03:45:09.027610180Z [2024-03-29T03:45:09.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='send_prometheus', run_id='scheduled__2024-03-29T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:45:09.027957663Z [2024-03-29T03:45:09.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'send_prometheus', 'scheduled__2024-03-29T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-29T03:45:09.077360300Z [2024-03-29T03:45:09.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status queued for try_number 1 2024-03-29T03:45:09.077681337Z [2024-03-29T03:45:09.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.collect_metrics run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:45:09.085356570Z [2024-03-29T03:45:09.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72f9bce1-b8aa-492c-9574-977e2d9e0480 2024-03-29T03:45:09.085654788Z [2024-03-29T03:45:09.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=collect_metrics, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=0, run_start_date=2024-03-29 03:45:08.565920+00:00, run_end_date=2024-03-29 03:45:08.865418+00:00, run_duration=0.299498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:45:06.397244+00:00, queued_by_job_id=2, pid=16401 2024-03-29T03:45:11.139852620Z [2024-03-29T03:45:11.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:45:11.139987568Z [2024-03-29T03:45:11.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:40:00+00:00, run_id=scheduled__2024-03-29T03:40:00+00:00, run_start_date=2024-03-29 03:45:00.135829+00:00, run_end_date=2024-03-29 03:45:11.139719+00:00, run_duration=11.00389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:40:00+00:00, data_interval_end=2024-03-29 03:45:00+00:00, dag_hash=578a21e83988391724c4e27801eb4fb6 2024-03-29T03:45:11.145895882Z [2024-03-29T03:45:11.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:45:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:45:11.172367382Z [2024-03-29T03:45:11.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.send_prometheus run_id=scheduled__2024-03-29T03:40:00+00:00 exited with status success for try_number 1 2024-03-29T03:45:11.177938142Z [2024-03-29T03:45:11.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=send_prometheus, run_id=scheduled__2024-03-29T03:40:00+00:00, map_index=-1, run_start_date=2024-03-29 03:45:10.706973+00:00, run_end_date=2024-03-29 03:45:11.060025+00:00, run_duration=0.353052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:45:09.025443+00:00, queued_by_job_id=2, pid=16409 2024-03-29T03:46:00.938837269Z [2024-03-29T03:46:00.938+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:46:00.952522392Z [2024-03-29T03:46:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:46:00+00:00, run_after=2024-03-29T03:47:00+00:00 2024-03-29T03:46:00.966765005Z [2024-03-29T03:46:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:46:00+00:00, run_after=2024-03-29T03:47:00+00:00 2024-03-29T03:46:00.975237686Z [2024-03-29T03:46:00.974+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:46:01.062738437Z [2024-03-29T03:46:01.062+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:46:01.062774055Z 2024-03-29T03:46:01.062780462Z 2024-03-29T03:46:01.062785638Z 2024-03-29T03:46:01.062791236Z 2024-03-29T03:46:01.062806110Z [2024-03-29T03:46:01.062+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:46:01.062945051Z [2024-03-29T03:46:01.062+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:46:01.063081567Z [2024-03-29T03:46:01.062+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:46:01.063220453Z [2024-03-29T03:46:01.063+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:46:01.063939287Z [2024-03-29T03:46:01.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:46:01.063956135Z 2024-03-29T03:46:01.063962319Z 2024-03-29T03:46:01.063967349Z 2024-03-29T03:46:01.063972780Z 2024-03-29T03:46:01.068035790Z [2024-03-29T03:46:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:46:01.068215990Z [2024-03-29T03:46:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:46:01.068532405Z [2024-03-29T03:46:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:46:01.068641213Z [2024-03-29T03:46:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:46:01.068913381Z [2024-03-29T03:46:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:46:01.068980598Z [2024-03-29T03:46:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:46:01.069257951Z [2024-03-29T03:46:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:46:01.069398154Z [2024-03-29T03:46:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:46:01.619815682Z [2024-03-29T03:46:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status queued for try_number 1 2024-03-29T03:46:01.619921806Z [2024-03-29T03:46:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:45:00+00:00 exited with status queued for try_number 1 2024-03-29T03:46:01.620096296Z [2024-03-29T03:46:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:45:00+00:00 exited with status queued for try_number 1 2024-03-29T03:46:01.620255495Z [2024-03-29T03:46:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:45:00+00:00 exited with status queued for try_number 1 2024-03-29T03:46:01.632889516Z [2024-03-29T03:46:01.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42ffe300-15a0-43d0-b369-a4d3a1775413 2024-03-29T03:46:01.634884625Z [2024-03-29T03:46:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57c80f6e-be0d-437a-8902-f8e160dfb76f 2024-03-29T03:46:01.635107808Z [2024-03-29T03:46:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5221996-caec-4d4c-b49c-be073987abcb 2024-03-29T03:46:01.635346086Z [2024-03-29T03:46:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39a000b3-d678-42fc-9c42-16d9e93b9048 2024-03-29T03:46:03.656989188Z [2024-03-29T03:46:03.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:46:03.657057066Z [2024-03-29T03:46:03.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:44:00+00:00, run_id=scheduled__2024-03-29T03:44:00+00:00, run_start_date=2024-03-29 03:46:00.985021+00:00, run_end_date=2024-03-29 03:46:03.656526+00:00, run_duration=2.671505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:44:00+00:00, data_interval_end=2024-03-29 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:46:03.665844375Z [2024-03-29T03:46:03.665+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:46:00+00:00, run_after=2024-03-29T03:48:00+00:00 2024-03-29T03:46:03.673089497Z [2024-03-29T03:46:03.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:46:03.673323568Z [2024-03-29T03:46:03.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:45:00+00:00, run_id=scheduled__2024-03-29T03:45:00+00:00, run_start_date=2024-03-29 03:46:00.986267+00:00, run_end_date=2024-03-29 03:46:03.672985+00:00, run_duration=2.686718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:45:00+00:00, data_interval_end=2024-03-29 03:46:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:46:03.692625326Z [2024-03-29T03:46:03.692+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:46:00+00:00, run_after=2024-03-29T03:47:00+00:00 2024-03-29T03:46:03.787481587Z [2024-03-29T03:46:03.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:44:00+00:00 exited with status success for try_number 1 2024-03-29T03:46:03.787567399Z [2024-03-29T03:46:03.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:45:00+00:00 exited with status success for try_number 1 2024-03-29T03:46:03.796290023Z [2024-03-29T03:46:03.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:44:00+00:00, map_index=-1, run_start_date=2024-03-29 03:46:02.185048+00:00, run_end_date=2024-03-29 03:46:02.641089+00:00, run_duration=0.456041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:46:01.064913+00:00, queued_by_job_id=2, pid=16432 2024-03-29T03:46:03.796501091Z [2024-03-29T03:46:03.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:45:00+00:00, map_index=-1, run_start_date=2024-03-29 03:46:02.444340+00:00, run_end_date=2024-03-29 03:46:02.981726+00:00, run_duration=0.537386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:46:01.064913+00:00, queued_by_job_id=2, pid=16433 2024-03-29T03:46:05.925157572Z [2024-03-29T03:46:05.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:46:05.925197128Z [2024-03-29T03:46:05.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:45:00+00:00, run_id=scheduled__2024-03-29T03:45:00+00:00, run_start_date=2024-03-29 03:46:00.987357+00:00, run_end_date=2024-03-29 03:46:05.924146+00:00, run_duration=4.936789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:45:00+00:00, data_interval_end=2024-03-29 03:46:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:46:05.933903408Z [2024-03-29T03:46:05.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:46:00+00:00, run_after=2024-03-29T03:47:00+00:00 2024-03-29T03:46:05.945824252Z [2024-03-29T03:46:05.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:46:05.945856254Z [2024-03-29T03:46:05.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:45:00+00:00, run_id=scheduled__2024-03-29T03:45:00+00:00, run_start_date=2024-03-29 03:46:00.988473+00:00, run_end_date=2024-03-29 03:46:05.943938+00:00, run_duration=4.955465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:45:00+00:00, data_interval_end=2024-03-29 03:46:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:46:05.959046135Z [2024-03-29T03:46:05.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:46:00+00:00, run_after=2024-03-29T03:47:00+00:00 2024-03-29T03:46:06.018600676Z [2024-03-29T03:46:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:45:00+00:00 exited with status success for try_number 1 2024-03-29T03:46:06.018625463Z [2024-03-29T03:46:06.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:45:00+00:00 exited with status success for try_number 1 2024-03-29T03:46:06.024302303Z [2024-03-29T03:46:06.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:45:00+00:00, map_index=-1, run_start_date=2024-03-29 03:46:03.568958+00:00, run_end_date=2024-03-29 03:46:05.365540+00:00, run_duration=1.796582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:46:01.064913+00:00, queued_by_job_id=2, pid=16457 2024-03-29T03:46:06.024616128Z [2024-03-29T03:46:06.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:45:00+00:00, map_index=-1, run_start_date=2024-03-29 03:46:03.467114+00:00, run_end_date=2024-03-29 03:46:04.758860+00:00, run_duration=1.291746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:46:01.064913+00:00, queued_by_job_id=2, pid=16456 2024-03-29T03:47:00.997119441Z [2024-03-29T03:47:00.996+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:47:01.024300350Z [2024-03-29T03:47:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:47:00+00:00, run_after=2024-03-29T03:48:00+00:00 2024-03-29T03:47:01.046808443Z [2024-03-29T03:47:01.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:47:00+00:00, run_after=2024-03-29T03:48:00+00:00 2024-03-29T03:47:01.149762156Z [2024-03-29T03:47:01.149+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:47:01.149813097Z 2024-03-29T03:47:01.149832391Z 2024-03-29T03:47:01.149836309Z 2024-03-29T03:47:01.149847275Z [2024-03-29T03:47:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:47:01.150071521Z [2024-03-29T03:47:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:47:01.150250076Z [2024-03-29T03:47:01.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:47:01.151445181Z [2024-03-29T03:47:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:47:01.151454432Z 2024-03-29T03:47:01.151458258Z 2024-03-29T03:47:01.151461613Z 2024-03-29T03:47:01.156883401Z [2024-03-29T03:47:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:47:01.157092976Z [2024-03-29T03:47:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:47:01.157497545Z [2024-03-29T03:47:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:47:01.157749836Z [2024-03-29T03:47:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:47:01.158116694Z [2024-03-29T03:47:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:47:01.158248911Z [2024-03-29T03:47:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:47:01.438417714Z [2024-03-29T03:47:01.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status queued for try_number 1 2024-03-29T03:47:01.440738313Z [2024-03-29T03:47:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status queued for try_number 1 2024-03-29T03:47:01.441177262Z [2024-03-29T03:47:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status queued for try_number 1 2024-03-29T03:47:01.454890733Z [2024-03-29T03:47:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to c910f0d3-a741-4451-b2d2-f17fb192e2a9 2024-03-29T03:47:01.455298980Z [2024-03-29T03:47:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 095aa263-97d0-4d0e-8677-73250360641e 2024-03-29T03:47:01.455552430Z [2024-03-29T03:47:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to b20d0cd4-6f78-4b64-8544-6c8727be7cd2 2024-03-29T03:47:03.182691127Z [2024-03-29T03:47:03.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:47:03.182730066Z [2024-03-29T03:47:03.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:46:00+00:00, run_id=scheduled__2024-03-29T03:46:00+00:00, run_start_date=2024-03-29 03:47:01.066574+00:00, run_end_date=2024-03-29 03:47:03.177515+00:00, run_duration=2.110941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:46:00+00:00, data_interval_end=2024-03-29 03:47:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:47:03.201201778Z [2024-03-29T03:47:03.200+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:47:00+00:00, run_after=2024-03-29T03:48:00+00:00 2024-03-29T03:47:03.304997297Z [2024-03-29T03:47:03.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status success for try_number 1 2024-03-29T03:47:03.315966363Z [2024-03-29T03:47:03.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:46:00+00:00, map_index=-1, run_start_date=2024-03-29 03:47:02.052720+00:00, run_end_date=2024-03-29 03:47:02.615564+00:00, run_duration=0.562844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:47:01.152743+00:00, queued_by_job_id=2, pid=16488 2024-03-29T03:47:05.482286274Z [2024-03-29T03:47:05.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:47:05.482876892Z [2024-03-29T03:47:05.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:46:00+00:00, run_id=scheduled__2024-03-29T03:46:00+00:00, run_start_date=2024-03-29 03:47:01.068936+00:00, run_end_date=2024-03-29 03:47:05.482514+00:00, run_duration=4.413578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:46:00+00:00, data_interval_end=2024-03-29 03:47:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:47:05.493420169Z [2024-03-29T03:47:05.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:47:00+00:00, run_after=2024-03-29T03:48:00+00:00 2024-03-29T03:47:05.533484858Z [2024-03-29T03:47:05.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status success for try_number 1 2024-03-29T03:47:05.540528826Z [2024-03-29T03:47:05.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:46:00+00:00, map_index=-1, run_start_date=2024-03-29 03:47:03.446114+00:00, run_end_date=2024-03-29 03:47:04.781641+00:00, run_duration=1.335527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:47:01.152743+00:00, queued_by_job_id=2, pid=16507 2024-03-29T03:47:06.610587868Z [2024-03-29T03:47:06.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:47:06.622530547Z [2024-03-29T03:47:06.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:46:00+00:00, run_id=scheduled__2024-03-29T03:46:00+00:00, run_start_date=2024-03-29 03:47:01.071332+00:00, run_end_date=2024-03-29 03:47:06.608109+00:00, run_duration=5.536777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:46:00+00:00, data_interval_end=2024-03-29 03:47:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:47:06.652122841Z [2024-03-29T03:47:06.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:47:00+00:00, run_after=2024-03-29T03:48:00+00:00 2024-03-29T03:47:06.685955424Z [2024-03-29T03:47:06.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status success for try_number 1 2024-03-29T03:47:06.690843165Z [2024-03-29T03:47:06.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:46:00+00:00, map_index=-1, run_start_date=2024-03-29 03:47:03.379061+00:00, run_end_date=2024-03-29 03:47:05.562978+00:00, run_duration=2.183917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:47:01.152743+00:00, queued_by_job_id=2, pid=16506 2024-03-29T03:48:01.094526812Z [2024-03-29T03:48:01.093+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:48:01.113019654Z [2024-03-29T03:48:01.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:48:00+00:00, run_after=2024-03-29T03:49:00+00:00 2024-03-29T03:48:01.123747810Z [2024-03-29T03:48:01.123+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:48:01.140257509Z [2024-03-29T03:48:01.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:48:00+00:00, run_after=2024-03-29T03:49:00+00:00 2024-03-29T03:48:01.226963627Z [2024-03-29T03:48:01.226+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-29T03:48:01.227024863Z 2024-03-29T03:48:01.227033535Z 2024-03-29T03:48:01.227040558Z 2024-03-29T03:48:01.227047135Z 2024-03-29T03:48:01.227054825Z [2024-03-29T03:48:01.226+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-29T03:48:01.227061240Z [2024-03-29T03:48:01.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:48:01.227091719Z [2024-03-29T03:48:01.226+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:48:01.227098433Z [2024-03-29T03:48:01.226+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:48:01.227507029Z [2024-03-29T03:48:01.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:48:01.227527197Z 2024-03-29T03:48:01.227536192Z 2024-03-29T03:48:01.227543799Z 2024-03-29T03:48:01.227551172Z 2024-03-29T03:48:01.231156924Z [2024-03-29T03:48:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-29T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:48:01.231304305Z [2024-03-29T03:48:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-29T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-29T03:48:01.231492023Z [2024-03-29T03:48:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:48:01.231525405Z [2024-03-29T03:48:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:48:01.231735672Z [2024-03-29T03:48:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:48:01.231813455Z [2024-03-29T03:48:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:48:01.232011157Z [2024-03-29T03:48:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:48:01.232052809Z [2024-03-29T03:48:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:48:01.594769780Z [2024-03-29T03:48:01.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status queued for try_number 1 2024-03-29T03:48:01.595226977Z [2024-03-29T03:48:01.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:47:00+00:00 exited with status queued for try_number 1 2024-03-29T03:48:01.595545761Z [2024-03-29T03:48:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:47:00+00:00 exited with status queued for try_number 1 2024-03-29T03:48:01.595849157Z [2024-03-29T03:48:01.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:47:00+00:00 exited with status queued for try_number 1 2024-03-29T03:48:01.610774645Z [2024-03-29T03:48:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d4c40af-fb2a-456b-b07e-499f444f1628 2024-03-29T03:48:01.611371696Z [2024-03-29T03:48:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdc14b68-4d18-4524-9884-7db20f7be1a6 2024-03-29T03:48:01.611838861Z [2024-03-29T03:48:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7ff46dc-3326-40a5-a89e-4236dbf92384 2024-03-29T03:48:01.612218349Z [2024-03-29T03:48:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to bef96690-4434-41b2-9114-502a8b7a27ea 2024-03-29T03:48:03.618194863Z [2024-03-29T03:48:03.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:48:03.618388953Z [2024-03-29T03:48:03.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-29 03:46:00+00:00, run_id=scheduled__2024-03-29T03:46:00+00:00, run_start_date=2024-03-29 03:48:01.152673+00:00, run_end_date=2024-03-29 03:48:03.618044+00:00, run_duration=2.465371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:46:00+00:00, data_interval_end=2024-03-29 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-29T03:48:03.630323519Z [2024-03-29T03:48:03.629+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-29T03:48:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:48:03.641156529Z [2024-03-29T03:48:03.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:48:03.641545210Z [2024-03-29T03:48:03.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:47:00+00:00, run_id=scheduled__2024-03-29T03:47:00+00:00, run_start_date=2024-03-29 03:48:01.154471+00:00, run_end_date=2024-03-29 03:48:03.641027+00:00, run_duration=2.486556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:47:00+00:00, data_interval_end=2024-03-29 03:48:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:48:03.665625189Z [2024-03-29T03:48:03.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:48:00+00:00, run_after=2024-03-29T03:49:00+00:00 2024-03-29T03:48:03.729231206Z [2024-03-29T03:48:03.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-29T03:46:00+00:00 exited with status success for try_number 1 2024-03-29T03:48:03.729382169Z [2024-03-29T03:48:03.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:47:00+00:00 exited with status success for try_number 1 2024-03-29T03:48:03.742460476Z [2024-03-29T03:48:03.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-29T03:46:00+00:00, map_index=-1, run_start_date=2024-03-29 03:48:02.669248+00:00, run_end_date=2024-03-29 03:48:03.304190+00:00, run_duration=0.634942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:48:01.228233+00:00, queued_by_job_id=2, pid=16542 2024-03-29T03:48:03.742577984Z [2024-03-29T03:48:03.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:47:00+00:00, map_index=-1, run_start_date=2024-03-29 03:48:02.445408+00:00, run_end_date=2024-03-29 03:48:03.115161+00:00, run_duration=0.669753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:48:01.228233+00:00, queued_by_job_id=2, pid=16541 2024-03-29T03:48:06.302603321Z [2024-03-29T03:48:06.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:48:06.302994325Z [2024-03-29T03:48:06.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:47:00+00:00, run_id=scheduled__2024-03-29T03:47:00+00:00, run_start_date=2024-03-29 03:48:01.155615+00:00, run_end_date=2024-03-29 03:48:06.302721+00:00, run_duration=5.147106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:47:00+00:00, data_interval_end=2024-03-29 03:48:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:48:06.328335527Z [2024-03-29T03:48:06.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:48:00+00:00, run_after=2024-03-29T03:49:00+00:00 2024-03-29T03:48:06.367963715Z [2024-03-29T03:48:06.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:47:00+00:00 exited with status success for try_number 1 2024-03-29T03:48:06.378375919Z [2024-03-29T03:48:06.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:47:00+00:00, map_index=-1, run_start_date=2024-03-29 03:48:04.219680+00:00, run_end_date=2024-03-29 03:48:06.064440+00:00, run_duration=1.84476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:48:01.228233+00:00, queued_by_job_id=2, pid=16566 2024-03-29T03:48:07.418238601Z [2024-03-29T03:48:07.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:48:07.418564005Z [2024-03-29T03:48:07.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:47:00+00:00, run_id=scheduled__2024-03-29T03:47:00+00:00, run_start_date=2024-03-29 03:48:01.156803+00:00, run_end_date=2024-03-29 03:48:07.418115+00:00, run_duration=6.261312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:47:00+00:00, data_interval_end=2024-03-29 03:48:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:48:07.428125589Z [2024-03-29T03:48:07.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:48:00+00:00, run_after=2024-03-29T03:49:00+00:00 2024-03-29T03:48:07.464158316Z [2024-03-29T03:48:07.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:47:00+00:00 exited with status success for try_number 1 2024-03-29T03:48:07.470381499Z [2024-03-29T03:48:07.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:47:00+00:00, map_index=-1, run_start_date=2024-03-29 03:48:04.110562+00:00, run_end_date=2024-03-29 03:48:06.235691+00:00, run_duration=2.125129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:48:01.228233+00:00, queued_by_job_id=2, pid=16565 2024-03-29T03:48:47.175918005Z [2024-03-29T03:48:47.175+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-29T03:49:00.848212931Z [2024-03-29T03:49:00.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:49:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:49:00.865928153Z [2024-03-29T03:49:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:49:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:49:00.876637246Z [2024-03-29T03:49:00.876+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-29T03:49:00.946997761Z [2024-03-29T03:49:00.946+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-29T03:49:00.947040591Z 2024-03-29T03:49:00.947044737Z 2024-03-29T03:49:00.947048262Z 2024-03-29T03:49:00.947252503Z [2024-03-29T03:49:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:49:00.947540918Z [2024-03-29T03:49:00.947+0000] {scheduler_job.py:425} INFO - DAG vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d has 0/16 running and queued tasks 2024-03-29T03:49:00.947867395Z [2024-03-29T03:49:00.947+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 has 0/16 running and queued tasks 2024-03-29T03:49:00.949098855Z [2024-03-29T03:49:00.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-29T03:49:00.949114489Z 2024-03-29T03:49:00.949119403Z 2024-03-29T03:49:00.949124073Z 2024-03-29T03:49:00.954792548Z [2024-03-29T03:49:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:49:00.955185941Z [2024-03-29T03:49:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-29T03:49:00.955819856Z [2024-03-29T03:49:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:49:00.956146063Z [2024-03-29T03:49:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-29T03:49:00.956820225Z [2024-03-29T03:49:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-29T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-29T03:49:00.957183100Z [2024-03-29T03:49:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-29T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-29T03:49:01.302517709Z [2024-03-29T03:49:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:48:00+00:00 exited with status queued for try_number 1 2024-03-29T03:49:01.302915370Z [2024-03-29T03:49:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:48:00+00:00 exited with status queued for try_number 1 2024-03-29T03:49:01.303200713Z [2024-03-29T03:49:01.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:48:00+00:00 exited with status queued for try_number 1 2024-03-29T03:49:01.317401220Z [2024-03-29T03:49:01.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5558da7-8b75-4812-8d45-a0c625b10fe6 2024-03-29T03:49:01.317835333Z [2024-03-29T03:49:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b5a8041-892c-4faa-8264-f28281e3140e 2024-03-29T03:49:01.318181455Z [2024-03-29T03:49:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to c379de41-7cbb-4e13-b86b-58ff07f28e47 2024-03-29T03:49:02.486569564Z [2024-03-29T03:49:02.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:49:02.487062417Z [2024-03-29T03:49:02.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, execution_date=2024-03-29 03:48:00+00:00, run_id=scheduled__2024-03-29T03:48:00+00:00, run_start_date=2024-03-29 03:49:00.888391+00:00, run_end_date=2024-03-29 03:49:02.486677+00:00, run_duration=1.598286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:48:00+00:00, data_interval_end=2024-03-29 03:49:00+00:00, dag_hash=a55b0b2b7b63da26e5468c58361748b0 2024-03-29T03:49:02.497637113Z [2024-03-29T03:49:02.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1 to 2024-03-29T03:49:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:49:02.570863163Z [2024-03-29T03:49:02.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:48:00+00:00 exited with status success for try_number 1 2024-03-29T03:49:02.586673222Z [2024-03-29T03:49:02.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_e20fc2af-43a6-4935-8c04-345f151865d1, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:48:00+00:00, map_index=-1, run_start_date=2024-03-29 03:49:01.777798+00:00, run_end_date=2024-03-29 03:49:02.205051+00:00, run_duration=0.427253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:49:00.950800+00:00, queued_by_job_id=2, pid=16598 2024-03-29T03:49:04.848299790Z [2024-03-29T03:49:04.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:49:04.848671316Z [2024-03-29T03:49:04.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:48:00+00:00, run_id=scheduled__2024-03-29T03:48:00+00:00, run_start_date=2024-03-29 03:49:00.890973+00:00, run_end_date=2024-03-29 03:49:04.848152+00:00, run_duration=3.957179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:48:00+00:00, data_interval_end=2024-03-29 03:49:00+00:00, dag_hash=eba6a11367453c74ed5e47186e6f6242 2024-03-29T03:49:04.858517306Z [2024-03-29T03:49:04.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:49:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:49:04.867457371Z [2024-03-29T03:49:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-29T03:49:04.867861787Z [2024-03-29T03:49:04.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, execution_date=2024-03-29 03:48:00+00:00, run_id=scheduled__2024-03-29T03:48:00+00:00, run_start_date=2024-03-29 03:49:00.889708+00:00, run_end_date=2024-03-29 03:49:04.867279+00:00, run_duration=3.977571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-29 03:48:00+00:00, data_interval_end=2024-03-29 03:49:00+00:00, dag_hash=aa881889f76cf2ba7ef75dbde5d2b250 2024-03-29T03:49:04.878306149Z [2024-03-29T03:49:04.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d to 2024-03-29T03:49:00+00:00, run_after=2024-03-29T03:50:00+00:00 2024-03-29T03:49:04.909856774Z [2024-03-29T03:49:04.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:48:00+00:00 exited with status success for try_number 1 2024-03-29T03:49:04.910124563Z [2024-03-29T03:49:04.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-29T03:48:00+00:00 exited with status success for try_number 1 2024-03-29T03:49:04.917126722Z [2024-03-29T03:49:04.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:48:00+00:00, map_index=-1, run_start_date=2024-03-29 03:49:03.028799+00:00, run_end_date=2024-03-29 03:49:04.480836+00:00, run_duration=1.452037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:49:00.950800+00:00, queued_by_job_id=2, pid=16617 2024-03-29T03:49:04.917469755Z [2024-03-29T03:49:04.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2b9dfa8e-2aeb-436c-b3da-c828c084082d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-29T03:48:00+00:00, map_index=-1, run_start_date=2024-03-29 03:49:02.869491+00:00, run_end_date=2024-03-29 03:49:04.601221+00:00, run_duration=1.73173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-29 03:49:00.950800+00:00, queued_by_job_id=2, pid=16616 2024-03-28T23:28:34.042158190Z 2024-03-28T23:28:34.045889101Z Cleaning logs every 900 seconds 2024-03-28T23:28:34.045904413Z Trimming airflow logs to 15 days. 2024-03-28T23:30:00.112566915Z Trimming airflow logs to 15 days. 2024-03-28T23:30:01.146002273Z Trimming airflow logs to 15 days. 2024-03-28T23:45:00.170896038Z Trimming airflow logs to 15 days. 2024-03-28T23:45:01.206751489Z Trimming airflow logs to 15 days. 2024-03-29T00:00:00.266191445Z Trimming airflow logs to 15 days. 2024-03-29T00:00:01.331709422Z Trimming airflow logs to 15 days. 2024-03-29T00:15:00.545698387Z Trimming airflow logs to 15 days. 2024-03-29T00:15:01.583114965Z Trimming airflow logs to 15 days. 2024-03-29T00:30:00.633911843Z Trimming airflow logs to 15 days. 2024-03-29T00:30:01.652107758Z Trimming airflow logs to 15 days. 2024-03-29T00:45:00.687498406Z Trimming airflow logs to 15 days. 2024-03-29T00:45:01.734987508Z Trimming airflow logs to 15 days. 2024-03-29T01:00:00.824762164Z Trimming airflow logs to 15 days. 2024-03-29T01:00:01.874788874Z Trimming airflow logs to 15 days. 2024-03-29T01:15:00.910872816Z Trimming airflow logs to 15 days. 2024-03-29T01:15:01.936289961Z Trimming airflow logs to 15 days. 2024-03-29T01:30:01.009615823Z Trimming airflow logs to 15 days. 2024-03-29T01:45:00.036582050Z Trimming airflow logs to 15 days. 2024-03-29T01:45:01.070724171Z Trimming airflow logs to 15 days. 2024-03-29T02:00:00.105578161Z Trimming airflow logs to 15 days. 2024-03-29T02:00:01.131039833Z Trimming airflow logs to 15 days. 2024-03-29T02:15:00.174767214Z Trimming airflow logs to 15 days. 2024-03-29T02:15:01.197129507Z Trimming airflow logs to 15 days. 2024-03-29T02:30:00.229421577Z Trimming airflow logs to 15 days. 2024-03-29T02:30:01.250528435Z Trimming airflow logs to 15 days. 2024-03-29T02:45:00.285153880Z Trimming airflow logs to 15 days. 2024-03-29T02:45:01.324447073Z Trimming airflow logs to 15 days. 2024-03-29T03:00:00.374438384Z Trimming airflow logs to 15 days. 2024-03-29T03:00:01.389930908Z Trimming airflow logs to 15 days. 2024-03-29T03:15:00.463219812Z Trimming airflow logs to 15 days. 2024-03-29T03:15:01.508438911Z Trimming airflow logs to 15 days. 2024-03-29T03:30:00.561221094Z Trimming airflow logs to 15 days. 2024-03-29T03:30:01.582854698Z Trimming airflow logs to 15 days. 2024-03-29T03:45:00.640807236Z Trimming airflow logs to 15 days. 2024-03-29T03:45:01.666432635Z Trimming airflow logs to 15 days.