2024-04-15T01:24:58.962278250Z ....... 2024-04-15T01:24:59.732760541Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-15T01:25:01.185039223Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-15T01:25:20.281658755Z 2024-04-15T01:25:24.008376350Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-15T01:25:25.514080615Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-15T01:25:38.673342252Z ____________ _____________ 2024-04-15T01:25:38.673354197Z ____ |__( )_________ __/__ /________ __ 2024-04-15T01:25:38.673357627Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-15T01:25:38.673360713Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-15T01:25:38.673363777Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-15T01:25:38.673367316Z [2024-04-15T01:25:38.668+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-15T01:25:38.673370747Z [2024-04-15T01:25:38.669+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-15T01:25:39.482469911Z [2024-04-15T01:25:39.479+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-15T01:25:39.540619516Z [2024-04-15T01:25:39.513+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 16 2024-04-15T01:25:39.541520812Z [2024-04-15T01:25:39.541+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:25:39.599886129Z [2024-04-15T01:25:39.569+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-15T01:25:39.605644450Z [2024-04-15T01:25:39.601+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-15T01:25:56.898012002Z [2024-04-15T01:25:56.896+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:25:56.982402708Z [2024-04-15T01:25:56.981+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:25:56.982419574Z 2024-04-15T01:25:56.986021090Z [2024-04-15T01:25:56.982+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:25:56.986033186Z [2024-04-15T01:25:56.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:25:56.986037016Z 2024-04-15T01:25:56.989132103Z [2024-04-15T01:25:56.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:25:56.991785994Z [2024-04-15T01:25:56.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:25:57.547204147Z [2024-04-15T01:25:57.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:57.560009264Z [2024-04-15T01:25:57.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7358750f-de26-4941-afe0-854e3cbd4290 2024-04-15T01:26:02.779291577Z [2024-04-15T01:26:02.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status success for try_number 1 2024-04-15T01:26:02.819482252Z [2024-04-15T01:26:02.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:22:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:00.760431+00:00, run_end_date=2024-04-15 01:26:02.008331+00:00, run_duration=1.2479, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:56.984702+00:00, queued_by_job_id=2, pid=49 2024-04-15T01:26:12.382275225Z [2024-04-15T01:26:12.382+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:26:12.382290862Z 2024-04-15T01:26:12.382326330Z [2024-04-15T01:26:12.382+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:26:12.386354943Z [2024-04-15T01:26:12.386+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:26:12.386365700Z 2024-04-15T01:26:12.390891400Z [2024-04-15T01:26:12.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:22:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:26:12.390904471Z [2024-04-15T01:26:12.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:26:12.454635186Z [2024-04-15T01:26:12.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status queued for try_number 2 2024-04-15T01:26:12.460049907Z [2024-04-15T01:26:12.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bfded68-1c15-4d9d-8f2a-6f05c17b3f0f 2024-04-15T01:26:14.863968090Z [2024-04-15T01:26:14.863+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:26:14.864178185Z [2024-04-15T01:26:14.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:22:00+00:00, run_id=scheduled__2024-04-15T01:22:00+00:00, run_start_date=2024-04-15 01:25:56.913528+00:00, run_end_date=2024-04-15 01:26:14.863882+00:00, run_duration=17.950354, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:22:00+00:00, data_interval_end=2024-04-15 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:26:14.881345418Z [2024-04-15T01:26:14.879+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:24:00+00:00, run_after=2024-04-15T01:26:00+00:00 2024-04-15T01:26:14.934690870Z [2024-04-15T01:26:14.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status success for try_number 2 2024-04-15T01:26:14.944143490Z [2024-04-15T01:26:14.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:22:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:13.417763+00:00, run_end_date=2024-04-15 01:26:13.870605+00:00, run_duration=0.452842, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:26:12.386553+00:00, queued_by_job_id=2, pid=60 2024-04-15T01:26:15.982873759Z [2024-04-15T01:26:15.982+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:26:16.018484679Z [2024-04-15T01:26:16.018+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:26:16.018497139Z 2024-04-15T01:26:16.018506340Z [2024-04-15T01:26:16.018+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:26:16.020358699Z [2024-04-15T01:26:16.018+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:26:16.020365356Z 2024-04-15T01:26:16.020844929Z [2024-04-15T01:26:16.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:26:16.020885072Z [2024-04-15T01:26:16.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:26:16.229043478Z [2024-04-15T01:26:16.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status queued for try_number 1 2024-04-15T01:26:16.241438544Z [2024-04-15T01:26:16.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81b984be-9106-4206-883c-3a5124cf9474 2024-04-15T01:26:20.563013667Z [2024-04-15T01:26:20.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status success for try_number 1 2024-04-15T01:26:20.575586604Z [2024-04-15T01:26:20.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:24:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:17.447786+00:00, run_end_date=2024-04-15 01:26:19.047093+00:00, run_duration=1.599307, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:26:16.019192+00:00, queued_by_job_id=2, pid=71 2024-04-15T01:26:30.448476629Z [2024-04-15T01:26:30.446+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:26:30.448495751Z 2024-04-15T01:26:30.448499902Z [2024-04-15T01:26:30.446+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:26:30.448503615Z [2024-04-15T01:26:30.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:26:30.448507642Z 2024-04-15T01:26:30.453722213Z [2024-04-15T01:26:30.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:24:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:26:30.453748852Z [2024-04-15T01:26:30.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:26:30.810070121Z [2024-04-15T01:26:30.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status queued for try_number 2 2024-04-15T01:26:30.843103951Z [2024-04-15T01:26:30.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to b95deb0b-dbe2-4d30-a303-e9fbaee73002 2024-04-15T01:26:35.998393147Z [2024-04-15T01:26:35.996+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:26:36.002652162Z [2024-04-15T01:26:35.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:24:00+00:00, run_id=scheduled__2024-04-15T01:24:00+00:00, run_start_date=2024-04-15 01:26:15.992311+00:00, run_end_date=2024-04-15 01:26:35.996542+00:00, run_duration=20.004231, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:24:00+00:00, data_interval_end=2024-04-15 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:26:36.014232481Z [2024-04-15T01:26:36.013+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:26:00+00:00, run_after=2024-04-15T01:28:00+00:00 2024-04-15T01:26:36.055656810Z [2024-04-15T01:26:36.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status success for try_number 2 2024-04-15T01:26:36.061342416Z [2024-04-15T01:26:36.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:24:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:32.959288+00:00, run_end_date=2024-04-15 01:26:35.439145+00:00, run_duration=2.479857, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:26:30.447503+00:00, queued_by_job_id=2, pid=95 2024-04-15T01:28:00.280103233Z [2024-04-15T01:28:00.279+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:28:00.328425885Z [2024-04-15T01:28:00.328+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:28:00.328437799Z 2024-04-15T01:28:00.328790235Z [2024-04-15T01:28:00.328+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:28:00.329364720Z [2024-04-15T01:28:00.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:28:00.329373537Z 2024-04-15T01:28:00.333085752Z [2024-04-15T01:28:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:28:00.333369124Z [2024-04-15T01:28:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:28:00.413142148Z [2024-04-15T01:28:00.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status queued for try_number 1 2024-04-15T01:28:00.420815002Z [2024-04-15T01:28:00.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8943e1a1-25f2-480c-847d-c01aea189187 2024-04-15T01:28:02.323786922Z [2024-04-15T01:28:02.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:28:02.325152889Z [2024-04-15T01:28:02.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:26:00+00:00, run_id=scheduled__2024-04-15T01:26:00+00:00, run_start_date=2024-04-15 01:28:00.293004+00:00, run_end_date=2024-04-15 01:28:02.324772+00:00, run_duration=2.031768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:26:00+00:00, data_interval_end=2024-04-15 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:28:02.332005685Z [2024-04-15T01:28:02.331+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:28:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:28:02.370774708Z [2024-04-15T01:28:02.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status success for try_number 1 2024-04-15T01:28:02.376432553Z [2024-04-15T01:28:02.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:26:00+00:00, map_index=-1, run_start_date=2024-04-15 01:28:01.192340+00:00, run_end_date=2024-04-15 01:28:01.635487+00:00, run_duration=0.443147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:28:00.329786+00:00, queued_by_job_id=2, pid=119 2024-04-15T01:30:00.374963391Z [2024-04-15T01:30:00.374+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:30:00.421499595Z [2024-04-15T01:30:00.421+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:30:00.421510898Z 2024-04-15T01:30:00.421664412Z [2024-04-15T01:30:00.421+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:30:00.423037150Z [2024-04-15T01:30:00.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:30:00.423048385Z 2024-04-15T01:30:00.425068029Z [2024-04-15T01:30:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:30:00.425205932Z [2024-04-15T01:30:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:30:00.487708446Z [2024-04-15T01:30:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:00.495806515Z [2024-04-15T01:30:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 982388cd-f690-4309-9736-d13ecf232ae7 2024-04-15T01:30:01.947670186Z [2024-04-15T01:30:01.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:30:01.947689194Z [2024-04-15T01:30:01.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:28:00+00:00, run_id=scheduled__2024-04-15T01:28:00+00:00, run_start_date=2024-04-15 01:30:00.389767+00:00, run_end_date=2024-04-15 01:30:01.946861+00:00, run_duration=1.557094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:28:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:30:01.960092688Z [2024-04-15T01:30:01.958+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:32:00+00:00 2024-04-15T01:30:02.004172730Z [2024-04-15T01:30:02.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:02.013269336Z [2024-04-15T01:30:02.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:28:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:01.313258+00:00, run_end_date=2024-04-15 01:30:01.732278+00:00, run_duration=0.41902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:00.423394+00:00, queued_by_job_id=2, pid=156 2024-04-15T01:30:39.894956803Z [2024-04-15T01:30:39.894+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:32:00.672746292Z [2024-04-15T01:32:00.672+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:32:00.716538076Z [2024-04-15T01:32:00.716+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:00.716553437Z 2024-04-15T01:32:00.716590470Z [2024-04-15T01:32:00.716+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:32:00.718024394Z [2024-04-15T01:32:00.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:00.718036146Z 2024-04-15T01:32:00.720623042Z [2024-04-15T01:32:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:00.721649052Z [2024-04-15T01:32:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:32:00.792176509Z [2024-04-15T01:32:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:00.818363407Z [2024-04-15T01:32:00.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 399e1393-67dc-49ab-8c29-e749ac3710f1 2024-04-15T01:32:03.083656011Z [2024-04-15T01:32:03.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:03.084353486Z [2024-04-15T01:32:03.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:32:00.688289+00:00, run_end_date=2024-04-15 01:32:03.083132+00:00, run_duration=2.394843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:32:03.094753129Z [2024-04-15T01:32:03.094+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:32:03.133935771Z [2024-04-15T01:32:03.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:03.142049532Z [2024-04-15T01:32:03.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:01.595131+00:00, run_end_date=2024-04-15 01:32:02.001289+00:00, run_duration=0.406158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:00.718358+00:00, queued_by_job_id=2, pid=192 2024-04-15T01:32:23.824953345Z [2024-04-15T01:32:23.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:23.918426581Z [2024-04-15T01:32:23.917+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:23.919116996Z 2024-04-15T01:32:23.919120993Z [2024-04-15T01:32:23.918+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:32:23.919127442Z [2024-04-15T01:32:23.918+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:23.919130436Z 2024-04-15T01:32:23.925968561Z [2024-04-15T01:32:23.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:23.925984362Z [2024-04-15T01:32:23.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:32:24.013545851Z [2024-04-15T01:32:24.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:24.023438808Z [2024-04-15T01:32:24.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to 290dd53d-04e1-4aa9-9b7b-e02b1fe69ed6 2024-04-15T01:32:25.138489239Z [2024-04-15T01:32:25.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:32:25.174726801Z [2024-04-15T01:32:25.174+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:25.174752849Z 2024-04-15T01:32:25.174766012Z [2024-04-15T01:32:25.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:32:25.175372833Z [2024-04-15T01:32:25.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:25.175391989Z 2024-04-15T01:32:25.177186345Z [2024-04-15T01:32:25.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:25.177380528Z [2024-04-15T01:32:25.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:32:25.257095631Z [2024-04-15T01:32:25.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:25.263219887Z [2024-04-15T01:32:25.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cc4495d-17f8-43b6-91e7-022d4be720df 2024-04-15T01:32:27.497277966Z [2024-04-15T01:32:27.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:27.497644538Z [2024-04-15T01:32:27.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:31:00+00:00, run_id=scheduled__2024-04-15T01:31:00+00:00, run_start_date=2024-04-15 01:32:23.855427+00:00, run_end_date=2024-04-15 01:32:27.497336+00:00, run_duration=3.641909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:31:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:32:27.508941289Z [2024-04-15T01:32:27.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:27.543196383Z [2024-04-15T01:32:27.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:27.547570071Z [2024-04-15T01:32:27.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:31:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:25.913797+00:00, run_end_date=2024-04-15 01:32:27.164834+00:00, run_duration=1.251037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:23.918941+00:00, queued_by_job_id=2, pid=227 2024-04-15T01:32:28.916706207Z [2024-04-15T01:32:28.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:28.916935743Z [2024-04-15T01:32:28.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:31:00+00:00, run_id=scheduled__2024-04-15T01:31:00+00:00, run_start_date=2024-04-15 01:32:25.147207+00:00, run_end_date=2024-04-15 01:32:28.916612+00:00, run_duration=3.769405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:31:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:32:28.930547873Z [2024-04-15T01:32:28.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:28.964273214Z [2024-04-15T01:32:28.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:28.970657664Z [2024-04-15T01:32:28.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:31:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:27.036868+00:00, run_end_date=2024-04-15 01:32:28.648968+00:00, run_duration=1.6121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:25.175707+00:00, queued_by_job_id=2, pid=247 2024-04-15T01:32:34.091704464Z [2024-04-15T01:32:34.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:32:34.142018037Z [2024-04-15T01:32:34.141+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:34.142033272Z 2024-04-15T01:32:34.142205928Z [2024-04-15T01:32:34.142+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:32:34.142678796Z [2024-04-15T01:32:34.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:34.142685914Z 2024-04-15T01:32:34.144503590Z [2024-04-15T01:32:34.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:32:34.144652666Z [2024-04-15T01:32:34.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:32:34.195406823Z [2024-04-15T01:32:34.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:34.205384974Z [2024-04-15T01:32:34.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbaece48-f2a7-40db-a3ff-b2865c3aa507 2024-04-15T01:32:36.505730924Z [2024-04-15T01:32:36.505+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:36.505748443Z 2024-04-15T01:32:36.505783684Z [2024-04-15T01:32:36.505+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:32:36.506322407Z [2024-04-15T01:32:36.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:36.506498824Z 2024-04-15T01:32:36.508177725Z [2024-04-15T01:32:36.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:32:36.508370427Z [2024-04-15T01:32:36.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:32:36.562571667Z [2024-04-15T01:32:36.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:36.563085037Z [2024-04-15T01:32:36.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:36.571467838Z [2024-04-15T01:32:36.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74c5525e-59ce-4a73-badd-5f92a7f3f8d1 2024-04-15T01:32:36.571608583Z [2024-04-15T01:32:36.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:35.913386+00:00, run_end_date=2024-04-15 01:32:36.298932+00:00, run_duration=0.385546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:34.142942+00:00, queued_by_job_id=2, pid=267 2024-04-15T01:32:38.817423198Z [2024-04-15T01:32:38.816+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:38.817452663Z 2024-04-15T01:32:38.817516289Z [2024-04-15T01:32:38.817+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:32:38.818089532Z [2024-04-15T01:32:38.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:38.818100961Z 2024-04-15T01:32:38.819741632Z [2024-04-15T01:32:38.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:32:38.819805212Z [2024-04-15T01:32:38.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:32:38.867395190Z [2024-04-15T01:32:38.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:38.867560560Z [2024-04-15T01:32:38.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:38.883597137Z [2024-04-15T01:32:38.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e452293-6bb6-4b98-b6e5-77d98653c96a 2024-04-15T01:32:38.883910166Z [2024-04-15T01:32:38.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:38.286167+00:00, run_end_date=2024-04-15 01:32:38.578778+00:00, run_duration=0.292611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:36.506628+00:00, queued_by_job_id=2, pid=287 2024-04-15T01:32:42.080695132Z [2024-04-15T01:32:42.080+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:42.080715215Z 2024-04-15T01:32:42.080837533Z [2024-04-15T01:32:42.080+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:32:42.081878133Z [2024-04-15T01:32:42.081+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:42.081913375Z 2024-04-15T01:32:42.090276169Z [2024-04-15T01:32:42.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:42.090408893Z [2024-04-15T01:32:42.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:32:42.146567955Z [2024-04-15T01:32:42.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:42.146728718Z [2024-04-15T01:32:42.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:42.155198002Z [2024-04-15T01:32:42.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f92675c-671a-464d-9b6e-07c24539a91f 2024-04-15T01:32:42.157734883Z [2024-04-15T01:32:42.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=0, run_start_date=2024-04-15 01:32:40.728763+00:00, run_end_date=2024-04-15 01:32:41.087836+00:00, run_duration=0.359073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:38.818329+00:00, queued_by_job_id=2, pid=299 2024-04-15T01:32:45.543697921Z [2024-04-15T01:32:45.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:45.544106790Z [2024-04-15T01:32:45.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:25:00+00:00, run_id=scheduled__2024-04-15T01:25:00+00:00, run_start_date=2024-04-15 01:32:34.103660+00:00, run_end_date=2024-04-15 01:32:45.543619+00:00, run_duration=11.439959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:25:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T01:32:45.550298817Z [2024-04-15T01:32:45.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:32:45.586703216Z [2024-04-15T01:32:45.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:45.596253583Z [2024-04-15T01:32:45.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:44.157871+00:00, run_end_date=2024-04-15 01:32:44.572548+00:00, run_duration=0.414677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:42.081772+00:00, queued_by_job_id=2, pid=311 2024-04-15T01:32:56.733653158Z [2024-04-15T01:32:56.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:56.785270021Z [2024-04-15T01:32:56.785+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:56.785297875Z 2024-04-15T01:32:56.785413310Z [2024-04-15T01:32:56.785+0000] {scheduler_job.py:425} INFO - DAG vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:32:56.785881492Z [2024-04-15T01:32:56.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:56.785891602Z 2024-04-15T01:32:56.788079891Z [2024-04-15T01:32:56.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:56.788282787Z [2024-04-15T01:32:56.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:32:56.846631692Z [2024-04-15T01:32:56.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:56.852195065Z [2024-04-15T01:32:56.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6008f602-80a8-40ee-a95b-9f124abb09c7 2024-04-15T01:32:58.033686338Z [2024-04-15T01:32:58.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:32:58.103892809Z [2024-04-15T01:32:58.103+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:32:58.103910954Z 2024-04-15T01:32:58.104205082Z [2024-04-15T01:32:58.104+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:32:58.105044666Z [2024-04-15T01:32:58.104+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:58.105067309Z 2024-04-15T01:32:58.107388694Z [2024-04-15T01:32:58.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:58.108113796Z [2024-04-15T01:32:58.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:32:58.153840668Z [2024-04-15T01:32:58.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:58.162063378Z [2024-04-15T01:32:58.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58633582-f669-4c74-8ae7-91a1f47cf69a 2024-04-15T01:33:00.808932019Z [2024-04-15T01:33:00.808+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:33:00.826228281Z [2024-04-15T01:33:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:00.830764795Z [2024-04-15T01:33:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:00.909949579Z [2024-04-15T01:33:00.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:00.910243054Z [2024-04-15T01:33:00.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, execution_date=2024-04-15 01:31:00+00:00, run_id=scheduled__2024-04-15T01:31:00+00:00, run_start_date=2024-04-15 01:32:56.757230+00:00, run_end_date=2024-04-15 01:33:00.909827+00:00, run_duration=4.152597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:31:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=f4b9bbfde90445098fe8e73410a64b1f 2024-04-15T01:33:00.921455891Z [2024-04-15T01:33:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:33:00.946794669Z [2024-04-15T01:33:00.946+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:33:00.946809960Z 2024-04-15T01:33:00.946813486Z 2024-04-15T01:33:00.946816634Z 2024-04-15T01:33:00.946830105Z [2024-04-15T01:33:00.946+0000] {scheduler_job.py:425} INFO - DAG vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:33:00.946973639Z [2024-04-15T01:33:00.946+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:33:00.947003910Z [2024-04-15T01:33:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:33:00.947502764Z [2024-04-15T01:33:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:33:00.947511986Z 2024-04-15T01:33:00.947515279Z 2024-04-15T01:33:00.947518386Z 2024-04-15T01:33:00.951118242Z [2024-04-15T01:33:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:00.951196597Z [2024-04-15T01:33:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:33:00.951355290Z [2024-04-15T01:33:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:00.951433209Z [2024-04-15T01:33:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:33:00.951565157Z [2024-04-15T01:33:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:00.951653806Z [2024-04-15T01:33:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:33:01.351881459Z [2024-04-15T01:33:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:01.352066557Z [2024-04-15T01:33:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:01.352176020Z [2024-04-15T01:33:01.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:01.352284126Z [2024-04-15T01:33:01.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:01.370352746Z [2024-04-15T01:33:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57381865-9604-4e06-92e1-daf89ab3f525 2024-04-15T01:33:01.370627433Z [2024-04-15T01:33:01.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:31:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:58.720721+00:00, run_end_date=2024-04-15 01:33:00.078629+00:00, run_duration=1.357908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:56.786220+00:00, queued_by_job_id=2, pid=323 2024-04-15T01:33:01.370809848Z [2024-04-15T01:33:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85e0f80d-d08a-4f01-954d-9cdb99599acc 2024-04-15T01:33:01.370923978Z [2024-04-15T01:33:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 619b2bd0-c494-409f-b556-033c8d6f515f 2024-04-15T01:33:01.420810302Z [2024-04-15T01:33:01.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:02.691835986Z [2024-04-15T01:33:02.691+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:02.692946253Z [2024-04-15T01:33:02.692+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, execution_date=2024-04-15 01:31:00+00:00, run_id=scheduled__2024-04-15T01:31:00+00:00, run_start_date=2024-04-15 01:32:58.055826+00:00, run_end_date=2024-04-15 01:33:02.692555+00:00, run_duration=4.636729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:31:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=475f65c4e6ee52187e988e277b582188 2024-04-15T01:33:02.708704346Z [2024-04-15T01:33:02.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:33:02.802801238Z [2024-04-15T01:33:02.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:02.809008186Z [2024-04-15T01:33:02.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:31:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:59.986812+00:00, run_end_date=2024-04-15 01:33:01.822565+00:00, run_duration=1.835753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:58.105792+00:00, queued_by_job_id=2, pid=343 2024-04-15T01:33:03.882896597Z [2024-04-15T01:33:03.882+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:33:03.963633480Z [2024-04-15T01:33:03.963+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:33:03.963647712Z 2024-04-15T01:33:03.963779476Z [2024-04-15T01:33:03.963+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:33:03.965404438Z [2024-04-15T01:33:03.964+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:33:03.965435292Z 2024-04-15T01:33:03.967803606Z [2024-04-15T01:33:03.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:03.968061433Z [2024-04-15T01:33:03.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:33:04.049252209Z [2024-04-15T01:33:04.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:04.059814444Z [2024-04-15T01:33:04.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7728feb1-9241-4e6c-8f1a-a979026c0bd8 2024-04-15T01:33:06.085858268Z [2024-04-15T01:33:06.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:06.086286089Z [2024-04-15T01:33:06.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:33:00.864025+00:00, run_end_date=2024-04-15 01:33:06.085809+00:00, run_duration=5.221784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:33:00+00:00, dag_hash=f4b9bbfde90445098fe8e73410a64b1f 2024-04-15T01:33:06.100281905Z [2024-04-15T01:33:06.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:06.127643162Z [2024-04-15T01:33:06.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:06.128015324Z [2024-04-15T01:33:06.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:33:00.863689+00:00, run_end_date=2024-04-15 01:33:06.127645+00:00, run_duration=5.263956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:33:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:33:06.137127658Z [2024-04-15T01:33:06.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:06.203239490Z [2024-04-15T01:33:06.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:06.208323692Z [2024-04-15T01:33:06.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:06.217324688Z [2024-04-15T01:33:06.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:04.347785+00:00, run_end_date=2024-04-15 01:33:05.963876+00:00, run_duration=1.616091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:00.948116+00:00, queued_by_job_id=2, pid=388 2024-04-15T01:33:06.217541709Z [2024-04-15T01:33:06.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:04.051593+00:00, run_end_date=2024-04-15 01:33:05.794056+00:00, run_duration=1.742463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:00.948116+00:00, queued_by_job_id=2, pid=387 2024-04-15T01:33:07.278221002Z [2024-04-15T01:33:07.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:33:07.308360754Z [2024-04-15T01:33:07.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:07.309257704Z [2024-04-15T01:33:07.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:33:00.862129+00:00, run_end_date=2024-04-15 01:33:07.308299+00:00, run_duration=6.44617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:33:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:33:07.319156036Z [2024-04-15T01:33:07.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:07.341858710Z [2024-04-15T01:33:07.341+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:33:07.341993735Z 2024-04-15T01:33:07.342492528Z [2024-04-15T01:33:07.342+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:33:07.343323333Z [2024-04-15T01:33:07.343+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:33:07.343339533Z 2024-04-15T01:33:07.346219143Z [2024-04-15T01:33:07.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:33:07.346489687Z [2024-04-15T01:33:07.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:33:07.392968701Z [2024-04-15T01:33:07.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:07.393087935Z [2024-04-15T01:33:07.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:07.398999455Z [2024-04-15T01:33:07.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:03.998313+00:00, run_end_date=2024-04-15 01:33:06.241788+00:00, run_duration=2.243475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:00.948116+00:00, queued_by_job_id=2, pid=386 2024-04-15T01:33:07.399164467Z [2024-04-15T01:33:07.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a2dce15-a799-496e-9e9d-a75b591fab8a 2024-04-15T01:33:08.514745548Z [2024-04-15T01:33:08.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:08.515009300Z [2024-04-15T01:33:08.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:33:03.890813+00:00, run_end_date=2024-04-15 01:33:08.514675+00:00, run_duration=4.623862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:33:00+00:00, dag_hash=475f65c4e6ee52187e988e277b582188 2024-04-15T01:33:08.523906984Z [2024-04-15T01:33:08.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:08.562087686Z [2024-04-15T01:33:08.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:08.567004915Z [2024-04-15T01:33:08.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:06.215880+00:00, run_end_date=2024-04-15 01:33:07.701670+00:00, run_duration=1.48579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:03.965778+00:00, queued_by_job_id=2, pid=426 2024-04-15T01:33:09.658741907Z [2024-04-15T01:33:09.658+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:33:09.658757963Z 2024-04-15T01:33:09.658943014Z [2024-04-15T01:33:09.658+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:33:09.659423866Z [2024-04-15T01:33:09.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:33:09.659433647Z 2024-04-15T01:33:09.661364943Z [2024-04-15T01:33:09.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='split_metrics', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:33:09.661617141Z [2024-04-15T01:33:09.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'split_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:33:09.762892961Z [2024-04-15T01:33:09.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.split_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:09.771574957Z [2024-04-15T01:33:09.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed6717dc-1a35-4ff1-acba-bf2f68d19133 2024-04-15T01:33:09.861086134Z [2024-04-15T01:33:09.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:09.868853974Z [2024-04-15T01:33:09.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:09.175185+00:00, run_end_date=2024-04-15 01:33:09.547789+00:00, run_duration=0.372604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:07.344026+00:00, queued_by_job_id=2, pid=447 2024-04-15T01:33:12.379445825Z [2024-04-15T01:33:12.379+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:33:12.379467671Z 2024-04-15T01:33:12.380332704Z [2024-04-15T01:33:12.379+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:33:12.381026157Z [2024-04-15T01:33:12.380+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:33:12.381037510Z 2024-04-15T01:33:12.384318033Z [2024-04-15T01:33:12.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:33:12.384556601Z [2024-04-15T01:33:12.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'collect_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:33:12.460024485Z [2024-04-15T01:33:12.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.collect_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:12.460039903Z [2024-04-15T01:33:12.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.split_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:12.472475885Z [2024-04-15T01:33:12.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=split_metrics, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:11.521633+00:00, run_end_date=2024-04-15 01:33:11.888264+00:00, run_duration=0.366631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:09.659810+00:00, queued_by_job_id=2, pid=468 2024-04-15T01:33:12.472902905Z [2024-04-15T01:33:12.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3801a6f-978a-466c-b211-0bcd039dc08e 2024-04-15T01:33:15.199390039Z [2024-04-15T01:33:15.199+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:33:15.199406397Z 2024-04-15T01:33:15.199415938Z [2024-04-15T01:33:15.199+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:33:15.199908507Z [2024-04-15T01:33:15.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:33:15.199920707Z 2024-04-15T01:33:15.202899965Z [2024-04-15T01:33:15.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:15.203171189Z [2024-04-15T01:33:15.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'send_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:33:15.291684088Z [2024-04-15T01:33:15.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.send_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:15.294016686Z [2024-04-15T01:33:15.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.collect_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:15.298670252Z [2024-04-15T01:33:15.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=0, run_start_date=2024-04-15 01:33:14.804305+00:00, run_end_date=2024-04-15 01:33:15.129581+00:00, run_duration=0.325276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:12.381768+00:00, queued_by_job_id=2, pid=480 2024-04-15T01:33:15.298933292Z [2024-04-15T01:33:15.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71dc71c0-f20a-4b65-9f9a-502e6e4e505d 2024-04-15T01:33:17.528856837Z [2024-04-15T01:33:17.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:17.529193655Z [2024-04-15T01:33:17.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, execution_date=2024-04-15 01:25:00+00:00, run_id=scheduled__2024-04-15T01:25:00+00:00, run_start_date=2024-04-15 01:33:07.287240+00:00, run_end_date=2024-04-15 01:33:17.528778+00:00, run_duration=10.241538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:25:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=e32a8594a83c7d279b3e16f1d7b84cac 2024-04-15T01:33:17.534825901Z [2024-04-15T01:33:17.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:33:17.568036915Z [2024-04-15T01:33:17.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.send_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:17.577069212Z [2024-04-15T01:33:17.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:17.092749+00:00, run_end_date=2024-04-15 01:33:17.430974+00:00, run_duration=0.338225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:15.200291+00:00, queued_by_job_id=2, pid=492 2024-04-15T01:34:00.564850635Z [2024-04-15T01:34:00.564+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:34:00.578649681Z [2024-04-15T01:34:00.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:00.584681074Z [2024-04-15T01:34:00.584+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:34:00.590475149Z [2024-04-15T01:34:00.590+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:34:00.601814541Z [2024-04-15T01:34:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:00.682048891Z [2024-04-15T01:34:00.681+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:34:00.682061778Z 2024-04-15T01:34:00.682077702Z 2024-04-15T01:34:00.682080780Z 2024-04-15T01:34:00.682083527Z 2024-04-15T01:34:00.682109235Z 2024-04-15T01:34:00.682342958Z [2024-04-15T01:34:00.682+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:34:00.682761288Z [2024-04-15T01:34:00.682+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:34:00.682942258Z [2024-04-15T01:34:00.682+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:34:00.683111493Z [2024-04-15T01:34:00.683+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:34:00.683276427Z [2024-04-15T01:34:00.683+0000] {scheduler_job.py:425} INFO - DAG vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:34:00.683900619Z [2024-04-15T01:34:00.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:34:00.683910731Z 2024-04-15T01:34:00.683914427Z 2024-04-15T01:34:00.683917441Z 2024-04-15T01:34:00.683920481Z 2024-04-15T01:34:00.683923502Z 2024-04-15T01:34:00.690366208Z [2024-04-15T01:34:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:00.690759066Z [2024-04-15T01:34:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:34:00.691268961Z [2024-04-15T01:34:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:00.691537948Z [2024-04-15T01:34:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:34:00.691823966Z [2024-04-15T01:34:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:00.692298978Z [2024-04-15T01:34:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:34:00.692592965Z [2024-04-15T01:34:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:00.692794127Z [2024-04-15T01:34:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:34:00.693798949Z [2024-04-15T01:34:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:00.694037012Z [2024-04-15T01:34:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:34:01.270674194Z [2024-04-15T01:34:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.270696552Z [2024-04-15T01:34:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.270700030Z [2024-04-15T01:34:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.270753713Z [2024-04-15T01:34:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.270989035Z [2024-04-15T01:34:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.304339212Z [2024-04-15T01:34:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d359020-5daf-4b42-9450-cf2944fbe4da 2024-04-15T01:34:01.304606386Z [2024-04-15T01:34:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 999625e2-6ab3-4cb2-8f6d-7514f8b757ab 2024-04-15T01:34:01.307799094Z [2024-04-15T01:34:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01e08091-5ca0-4f41-a40b-4532d454854b 2024-04-15T01:34:01.307977228Z [2024-04-15T01:34:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2361a599-3adf-4787-9678-5f97c19c8fe0 2024-04-15T01:34:01.311727659Z [2024-04-15T01:34:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72a72cb2-202a-4d22-8a67-71216424f080 2024-04-15T01:34:03.704671076Z [2024-04-15T01:34:03.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:34:03.711946176Z [2024-04-15T01:34:03.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:34:00.611196+00:00, run_end_date=2024-04-15 01:34:03.704755+00:00, run_duration=3.093559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:34:03.731155851Z [2024-04-15T01:34:03.730+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:34:03.989643852Z [2024-04-15T01:34:03.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:34:04.003352926Z [2024-04-15T01:34:04.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:34:02.181779+00:00, run_end_date=2024-04-15 01:34:03.379097+00:00, run_duration=1.197318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:00.684907+00:00, queued_by_job_id=2, pid=511 2024-04-15T01:34:05.002280649Z [2024-04-15T01:34:05.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status failed for try_number 1 2024-04-15T01:34:05.013697084Z [2024-04-15T01:34:05.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:00.684907+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:34:05.015724730Z [2024-04-15T01:34:05.013+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:05.020343163Z [2024-04-15T01:34:05.020+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:05.044662770Z [2024-04-15T01:34:05.044+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T013300, start_date=, end_date=20240415T013405 2024-04-15T01:34:06.131552322Z [2024-04-15T01:34:06.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:34:06.132054777Z [2024-04-15T01:34:06.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:33:00+00:00, run_id=scheduled__2024-04-15T01:33:00+00:00, run_start_date=2024-04-15 01:34:00.612228+00:00, run_end_date=2024-04-15 01:34:06.131713+00:00, run_duration=5.519485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:33:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:34:06.139966539Z [2024-04-15T01:34:06.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:06.187526565Z [2024-04-15T01:34:06.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status success for try_number 1 2024-04-15T01:34:06.187658164Z [2024-04-15T01:34:06.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status failed for try_number 1 2024-04-15T01:34:06.193692633Z [2024-04-15T01:34:06.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:00.684907+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:34:06.194258191Z [2024-04-15T01:34:06.194+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:06.196661259Z [2024-04-15T01:34:06.196+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:06.212228998Z [2024-04-15T01:34:06.211+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T013300, start_date=, end_date=20240415T013406 2024-04-15T01:34:06.219808759Z [2024-04-15T01:34:06.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=2024-04-15 01:34:04.084113+00:00, run_end_date=2024-04-15 01:34:05.951740+00:00, run_duration=1.867627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:00.684907+00:00, queued_by_job_id=2, pid=534 2024-04-15T01:34:06.397800666Z [2024-04-15T01:34:06.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:34:06.398044743Z [2024-04-15T01:34:06.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:33:00+00:00, run_id=scheduled__2024-04-15T01:33:00+00:00, run_start_date=2024-04-15 01:34:00.613198+00:00, run_end_date=2024-04-15 01:34:06.397720+00:00, run_duration=5.784522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:33:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:34:06.406759012Z [2024-04-15T01:34:06.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:06.469053756Z [2024-04-15T01:34:06.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status success for try_number 1 2024-04-15T01:34:06.475054445Z [2024-04-15T01:34:06.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=2024-04-15 01:34:04.978065+00:00, run_end_date=2024-04-15 01:34:06.210244+00:00, run_duration=1.232179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:00.684907+00:00, queued_by_job_id=2, pid=589 2024-04-15T01:34:15.146086103Z [2024-04-15T01:34:15.145+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:34:15.146104313Z 2024-04-15T01:34:15.146276595Z [2024-04-15T01:34:15.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:34:15.146954081Z [2024-04-15T01:34:15.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:34:15.146963345Z 2024-04-15T01:34:15.148777720Z [2024-04-15T01:34:15.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:15.148942094Z [2024-04-15T01:34:15.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:34:15.196623238Z [2024-04-15T01:34:15.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 2 2024-04-15T01:34:15.200821479Z [2024-04-15T01:34:15.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb0a2ff3-038d-4e66-a280-1099ca7e1375 2024-04-15T01:34:16.352489627Z [2024-04-15T01:34:16.352+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:34:16.352506201Z 2024-04-15T01:34:16.352798003Z [2024-04-15T01:34:16.352+0000] {scheduler_job.py:425} INFO - DAG vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc has 0/16 running and queued tasks 2024-04-15T01:34:16.353408054Z [2024-04-15T01:34:16.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:34:16.353418775Z 2024-04-15T01:34:16.355930820Z [2024-04-15T01:34:16.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:16.356099546Z [2024-04-15T01:34:16.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:34:16.438030598Z [2024-04-15T01:34:16.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 2 2024-04-15T01:34:16.445998698Z [2024-04-15T01:34:16.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85eeaa78-5a83-4497-b592-679beb9593a6 2024-04-15T01:34:17.759831667Z [2024-04-15T01:34:17.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status failed for try_number 2 2024-04-15T01:34:17.763840431Z [2024-04-15T01:34:17.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 01:34:05.025774+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:15.147203+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:34:17.764303001Z [2024-04-15T01:34:17.764+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:17.766760557Z [2024-04-15T01:34:17.766+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:17.778828578Z [2024-04-15T01:34:17.778+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T013300, start_date=, end_date=20240415T013417 2024-04-15T01:34:18.838877200Z [2024-04-15T01:34:18.838+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:34:18.839120818Z [2024-04-15T01:34:18.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc, execution_date=2024-04-15 01:33:00+00:00, run_id=scheduled__2024-04-15T01:33:00+00:00, run_start_date=2024-04-15 01:34:00.614096+00:00, run_end_date=2024-04-15 01:34:18.838789+00:00, run_duration=18.224693, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:33:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=475f65c4e6ee52187e988e277b582188 2024-04-15T01:34:18.847168741Z [2024-04-15T01:34:18.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:18.891074618Z [2024-04-15T01:34:18.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status failed for try_number 2 2024-04-15T01:34:18.903246792Z [2024-04-15T01:34:18.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 01:34:06.201476+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:16.354119+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:34:18.907072248Z [2024-04-15T01:34:18.906+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:18.911838495Z [2024-04-15T01:34:18.911+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:34:18.924690220Z [2024-04-15T01:34:18.924+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T013300, start_date=, end_date=20240415T013418 2024-04-15T01:34:19.989943893Z [2024-04-15T01:34:19.989+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:34:19.990700933Z [2024-04-15T01:34:19.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc, execution_date=2024-04-15 01:33:00+00:00, run_id=scheduled__2024-04-15T01:33:00+00:00, run_start_date=2024-04-15 01:34:00.615304+00:00, run_end_date=2024-04-15 01:34:19.990115+00:00, run_duration=19.374811, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:33:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=f4b9bbfde90445098fe8e73410a64b1f 2024-04-15T01:34:20.022112463Z [2024-04-15T01:34:20.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:35:00.871271045Z [2024-04-15T01:35:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:35:00.877836646Z [2024-04-15T01:35:00.877+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:35:00.895262805Z [2024-04-15T01:35:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:00.968868756Z [2024-04-15T01:35:00.968+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:35:00.968887316Z 2024-04-15T01:35:00.968891285Z 2024-04-15T01:35:00.968894302Z 2024-04-15T01:35:00.970471042Z [2024-04-15T01:35:00.969+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:35:00.971182065Z [2024-04-15T01:35:00.970+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:35:00.971497082Z [2024-04-15T01:35:00.971+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:35:00.974299406Z [2024-04-15T01:35:00.973+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:00.974312030Z 2024-04-15T01:35:00.974316157Z 2024-04-15T01:35:00.974319273Z 2024-04-15T01:35:00.982025881Z [2024-04-15T01:35:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:35:00.982302504Z [2024-04-15T01:35:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:00.982934225Z [2024-04-15T01:35:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:35:00.983205356Z [2024-04-15T01:35:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:35:00.983637399Z [2024-04-15T01:35:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:35:00.983918469Z [2024-04-15T01:35:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:35:01.300861241Z [2024-04-15T01:35:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:01.301035344Z [2024-04-15T01:35:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:01.301123165Z [2024-04-15T01:35:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:01.311711561Z [2024-04-15T01:35:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0debe326-cb97-4624-bde5-a8e2e00d588f 2024-04-15T01:35:01.311958263Z [2024-04-15T01:35:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b26b082-eb17-4a9d-8dbd-e1ba81e27b71 2024-04-15T01:35:01.312343853Z [2024-04-15T01:35:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a5317e3-b6cf-4230-93de-54c8833ee97e 2024-04-15T01:35:05.527680154Z [2024-04-15T01:35:05.527+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:35:05.527694891Z 2024-04-15T01:35:05.527738469Z [2024-04-15T01:35:05.527+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:35:05.528358320Z [2024-04-15T01:35:05.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:05.528380183Z 2024-04-15T01:35:05.531822778Z [2024-04-15T01:35:05.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:35:05.531896287Z [2024-04-15T01:35:05.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:05.613512038Z [2024-04-15T01:35:05.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:05.613886993Z [2024-04-15T01:35:05.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:05.620013799Z [2024-04-15T01:35:05.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to b60addba-fca8-4786-9ec7-ae8dcf4586b0 2024-04-15T01:35:05.620350056Z [2024-04-15T01:35:05.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:04.662516+00:00, run_end_date=2024-04-15 01:35:05.230304+00:00, run_duration=0.567788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:00.977857+00:00, queued_by_job_id=2, pid=684 2024-04-15T01:35:06.824977747Z [2024-04-15T01:35:06.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:35:06.825483952Z [2024-04-15T01:35:06.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:34:00+00:00, run_id=scheduled__2024-04-15T01:34:00+00:00, run_start_date=2024-04-15 01:35:00.907134+00:00, run_end_date=2024-04-15 01:35:06.824909+00:00, run_duration=5.917775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:34:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:35:06.839070730Z [2024-04-15T01:35:06.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:06.852306463Z [2024-04-15T01:35:06.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:35:06.854377608Z [2024-04-15T01:35:06.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:34:00+00:00, run_id=scheduled__2024-04-15T01:34:00+00:00, run_start_date=2024-04-15 01:35:00.906205+00:00, run_end_date=2024-04-15 01:35:06.852274+00:00, run_duration=5.946069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:34:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:35:06.868713630Z [2024-04-15T01:35:06.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:06.935755273Z [2024-04-15T01:35:06.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:06.940049254Z [2024-04-15T01:35:06.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:34:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:04.153988+00:00, run_end_date=2024-04-15 01:35:05.807061+00:00, run_duration=1.653073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:00.977857+00:00, queued_by_job_id=2, pid=667 2024-04-15T01:35:07.438686612Z [2024-04-15T01:35:07.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:07.449053523Z [2024-04-15T01:35:07.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:34:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:05.106824+00:00, run_end_date=2024-04-15 01:35:06.764425+00:00, run_duration=1.657601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:00.977857+00:00, queued_by_job_id=2, pid=699 2024-04-15T01:35:08.522206590Z [2024-04-15T01:35:08.521+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:35:08.522246423Z 2024-04-15T01:35:08.522256423Z [2024-04-15T01:35:08.522+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:35:08.522670403Z [2024-04-15T01:35:08.522+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:08.522686059Z 2024-04-15T01:35:08.525271915Z [2024-04-15T01:35:08.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:35:08.525365457Z [2024-04-15T01:35:08.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:35:08.578003132Z [2024-04-15T01:35:08.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:08.578065809Z [2024-04-15T01:35:08.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:08.588535887Z [2024-04-15T01:35:08.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8704cbc-524c-4ee1-b2a2-edbc1646fde0 2024-04-15T01:35:08.588705167Z [2024-04-15T01:35:08.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:07.422265+00:00, run_end_date=2024-04-15 01:35:07.755115+00:00, run_duration=0.33285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:05.528668+00:00, queued_by_job_id=2, pid=726 2024-04-15T01:35:10.844627879Z [2024-04-15T01:35:10.837+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:35:10.844660371Z 2024-04-15T01:35:10.844668076Z [2024-04-15T01:35:10.837+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:35:10.844674547Z [2024-04-15T01:35:10.837+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:10.844680638Z 2024-04-15T01:35:10.844687572Z [2024-04-15T01:35:10.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:35:10.844694398Z [2024-04-15T01:35:10.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:10.909743018Z [2024-04-15T01:35:10.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:10.917570481Z [2024-04-15T01:35:10.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c86bc35-052a-4508-903f-bf2f02a98a9d 2024-04-15T01:35:11.016882457Z [2024-04-15T01:35:11.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:11.023233192Z [2024-04-15T01:35:11.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=0, run_start_date=2024-04-15 01:35:10.428202+00:00, run_end_date=2024-04-15 01:35:10.773267+00:00, run_duration=0.345065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:08.522952+00:00, queued_by_job_id=2, pid=738 2024-04-15T01:35:13.643756302Z [2024-04-15T01:35:13.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:35:13.644253757Z [2024-04-15T01:35:13.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:35:00.905089+00:00, run_end_date=2024-04-15 01:35:13.643664+00:00, run_duration=12.738575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T01:35:13.651833097Z [2024-04-15T01:35:13.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:35:13.691781261Z [2024-04-15T01:35:13.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:13.696167677Z [2024-04-15T01:35:13.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:12.637379+00:00, run_end_date=2024-04-15 01:35:13.017107+00:00, run_duration=0.379728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:10.838219+00:00, queued_by_job_id=2, pid=749 2024-04-15T01:35:39.964375842Z [2024-04-15T01:35:39.963+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:36:00.028566532Z [2024-04-15T01:36:00.028+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:36:00.034741923Z [2024-04-15T01:36:00.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:36:00.055606706Z [2024-04-15T01:36:00.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:00.125983154Z [2024-04-15T01:36:00.125+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:36:00.125997202Z 2024-04-15T01:36:00.126000847Z 2024-04-15T01:36:00.126003833Z 2024-04-15T01:36:00.127541063Z [2024-04-15T01:36:00.127+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:36:00.127643944Z [2024-04-15T01:36:00.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:36:00.127724540Z [2024-04-15T01:36:00.127+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:36:00.128232228Z [2024-04-15T01:36:00.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:00.128243031Z 2024-04-15T01:36:00.128246577Z 2024-04-15T01:36:00.128249617Z 2024-04-15T01:36:00.131345906Z [2024-04-15T01:36:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:00.131454343Z [2024-04-15T01:36:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:36:00.131686379Z [2024-04-15T01:36:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:00.131790806Z [2024-04-15T01:36:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:36:00.131995736Z [2024-04-15T01:36:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:00.132095843Z [2024-04-15T01:36:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:36:00.447389830Z [2024-04-15T01:36:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:00.450376059Z [2024-04-15T01:36:00.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:00.450548652Z [2024-04-15T01:36:00.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:00.466118773Z [2024-04-15T01:36:00.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38eeffd6-86e0-4969-81a0-1c424bb986cd 2024-04-15T01:36:00.466367014Z [2024-04-15T01:36:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04a8175d-dbf1-4ff5-9b14-21733e869639 2024-04-15T01:36:00.466547804Z [2024-04-15T01:36:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18ffa34e-2778-4582-90fc-4b4845542a85 2024-04-15T01:36:01.636232570Z [2024-04-15T01:36:01.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:01.636435601Z [2024-04-15T01:36:01.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:34:00+00:00, run_id=scheduled__2024-04-15T01:34:00+00:00, run_start_date=2024-04-15 01:36:00.069266+00:00, run_end_date=2024-04-15 01:36:01.636108+00:00, run_duration=1.566842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:34:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:36:01.668090153Z [2024-04-15T01:36:01.667+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:36:02.960128347Z [2024-04-15T01:36:02.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:02.969298541Z [2024-04-15T01:36:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:34:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:01.033064+00:00, run_end_date=2024-04-15 01:36:01.567336+00:00, run_duration=0.534272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:00.128808+00:00, queued_by_job_id=2, pid=767 2024-04-15T01:36:05.424225684Z [2024-04-15T01:36:05.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:05.424513450Z [2024-04-15T01:36:05.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:36:00.071340+00:00, run_end_date=2024-04-15 01:36:05.424204+00:00, run_duration=5.352864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:36:05.432764526Z [2024-04-15T01:36:05.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:05.440569865Z [2024-04-15T01:36:05.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:05.440963501Z [2024-04-15T01:36:05.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:36:00.072749+00:00, run_end_date=2024-04-15 01:36:05.440638+00:00, run_duration=5.367889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:36:05.454271605Z [2024-04-15T01:36:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:05.486592029Z [2024-04-15T01:36:05.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:05.488542300Z [2024-04-15T01:36:05.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:05.495879646Z [2024-04-15T01:36:05.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:02.854738+00:00, run_end_date=2024-04-15 01:36:04.418063+00:00, run_duration=1.563325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:00.128808+00:00, queued_by_job_id=2, pid=798 2024-04-15T01:36:05.496219844Z [2024-04-15T01:36:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:02.635765+00:00, run_end_date=2024-04-15 01:36:04.775423+00:00, run_duration=2.139658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:00.128808+00:00, queued_by_job_id=2, pid=797 2024-04-15T01:36:08.339354615Z [2024-04-15T01:36:08.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:08.386242970Z [2024-04-15T01:36:08.385+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:36:08.386262241Z 2024-04-15T01:36:08.387403067Z [2024-04-15T01:36:08.386+0000] {scheduler_job.py:425} INFO - DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:36:08.389050004Z [2024-04-15T01:36:08.388+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:08.389062025Z 2024-04-15T01:36:08.394129462Z [2024-04-15T01:36:08.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:08.394367777Z [2024-04-15T01:36:08.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:36:08.451365601Z [2024-04-15T01:36:08.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:08.457622230Z [2024-04-15T01:36:08.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e5145dd-3fc6-4825-8ab5-e01129ca8a27 2024-04-15T01:36:09.612549067Z [2024-04-15T01:36:09.612+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:36:09.708727497Z [2024-04-15T01:36:09.708+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:36:09.708737608Z 2024-04-15T01:36:09.708925820Z [2024-04-15T01:36:09.708+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:36:09.709878319Z [2024-04-15T01:36:09.709+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:09.709884826Z 2024-04-15T01:36:09.712369920Z [2024-04-15T01:36:09.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:09.714276904Z [2024-04-15T01:36:09.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:36:09.769613529Z [2024-04-15T01:36:09.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:09.775928879Z [2024-04-15T01:36:09.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3db3037e-9087-4218-b379-ada8ff38c9ce 2024-04-15T01:36:12.036533337Z [2024-04-15T01:36:12.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:12.039284964Z [2024-04-15T01:36:12.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:36:08.352886+00:00, run_end_date=2024-04-15 01:36:12.038805+00:00, run_duration=3.685919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=1bbd62ef50a4f72026564fc071fcd053 2024-04-15T01:36:12.055924523Z [2024-04-15T01:36:12.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:12.120005877Z [2024-04-15T01:36:12.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:12.129488011Z [2024-04-15T01:36:12.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:10.442567+00:00, run_end_date=2024-04-15 01:36:11.805194+00:00, run_duration=1.362627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:08.389435+00:00, queued_by_job_id=2, pid=829 2024-04-15T01:36:14.039489858Z [2024-04-15T01:36:14.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:14.039846724Z [2024-04-15T01:36:14.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:36:09.626182+00:00, run_end_date=2024-04-15 01:36:14.039381+00:00, run_duration=4.413199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=d22ecc1c92ec5466159b9fc072087870 2024-04-15T01:36:14.050033990Z [2024-04-15T01:36:14.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:14.078117745Z [2024-04-15T01:36:14.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:14.083033403Z [2024-04-15T01:36:14.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:11.901189+00:00, run_end_date=2024-04-15 01:36:13.610882+00:00, run_duration=1.709693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:09.710283+00:00, queued_by_job_id=2, pid=849 2024-04-15T01:36:18.146632222Z [2024-04-15T01:36:18.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:36:18.205404897Z [2024-04-15T01:36:18.205+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:36:18.205421684Z 2024-04-15T01:36:18.205491900Z [2024-04-15T01:36:18.205+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:36:18.206249386Z [2024-04-15T01:36:18.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:18.206267775Z 2024-04-15T01:36:18.208291481Z [2024-04-15T01:36:18.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:36:18.208469966Z [2024-04-15T01:36:18.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:36:18.263493056Z [2024-04-15T01:36:18.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:18.272137827Z [2024-04-15T01:36:18.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcd50d15-0038-402a-8f51-93b0477e17e6 2024-04-15T01:36:20.890887317Z [2024-04-15T01:36:20.890+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:36:20.890916124Z 2024-04-15T01:36:20.890927035Z [2024-04-15T01:36:20.890+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:36:20.891441652Z [2024-04-15T01:36:20.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:20.891452006Z 2024-04-15T01:36:20.894435423Z [2024-04-15T01:36:20.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='split_metrics', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:36:20.894507932Z [2024-04-15T01:36:20.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'split_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:36:20.997420557Z [2024-04-15T01:36:20.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.split_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:20.997478448Z [2024-04-15T01:36:20.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:21.010372124Z [2024-04-15T01:36:21.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 090059e1-a219-416e-a8d8-b6bb5f20e834 2024-04-15T01:36:21.010569624Z [2024-04-15T01:36:21.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:20.239949+00:00, run_end_date=2024-04-15 01:36:20.589312+00:00, run_duration=0.349363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:18.206495+00:00, queued_by_job_id=2, pid=870 2024-04-15T01:36:24.881117115Z [2024-04-15T01:36:24.880+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:36:24.881133069Z 2024-04-15T01:36:24.882037342Z [2024-04-15T01:36:24.881+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:36:24.883636422Z [2024-04-15T01:36:24.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:24.883651385Z 2024-04-15T01:36:24.885491650Z [2024-04-15T01:36:24.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:36:24.885724488Z [2024-04-15T01:36:24.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'collect_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:36:24.946732424Z [2024-04-15T01:36:24.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.collect_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:24.946935662Z [2024-04-15T01:36:24.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.split_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:24.959741616Z [2024-04-15T01:36:24.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd3086a7-a518-4a81-8238-71967ca8e63f 2024-04-15T01:36:24.961892010Z [2024-04-15T01:36:24.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=split_metrics, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:23.348438+00:00, run_end_date=2024-04-15 01:36:23.710855+00:00, run_duration=0.362417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:20.892236+00:00, queued_by_job_id=2, pid=900 2024-04-15T01:36:27.214057489Z [2024-04-15T01:36:27.213+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:36:27.214075979Z 2024-04-15T01:36:27.214328942Z [2024-04-15T01:36:27.213+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:36:27.214907329Z [2024-04-15T01:36:27.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:27.214934609Z 2024-04-15T01:36:27.217326624Z [2024-04-15T01:36:27.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:27.217500505Z [2024-04-15T01:36:27.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'send_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:36:27.274946933Z [2024-04-15T01:36:27.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.send_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:27.275138891Z [2024-04-15T01:36:27.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.collect_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:27.281158074Z [2024-04-15T01:36:27.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=0, run_start_date=2024-04-15 01:36:26.651526+00:00, run_end_date=2024-04-15 01:36:27.034745+00:00, run_duration=0.383219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:24.883998+00:00, queued_by_job_id=2, pid=915 2024-04-15T01:36:27.281494112Z [2024-04-15T01:36:27.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to e13b8c20-c717-40ea-8c8a-e99c198dbe4f 2024-04-15T01:36:30.284397780Z [2024-04-15T01:36:30.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:30.284805294Z [2024-04-15T01:36:30.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:36:18.157736+00:00, run_end_date=2024-04-15 01:36:30.284319+00:00, run_duration=12.126583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=2c6f670f2efb1bc99f0c24ffa4e7bb6e 2024-04-15T01:36:30.291493982Z [2024-04-15T01:36:30.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:36:30.326313839Z [2024-04-15T01:36:30.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.send_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:30.331828985Z [2024-04-15T01:36:30.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:29.038758+00:00, run_end_date=2024-04-15 01:36:29.440819+00:00, run_duration=0.402061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:27.215268+00:00, queued_by_job_id=2, pid=927 2024-04-15T01:37:00.374801609Z [2024-04-15T01:37:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:00.387777793Z [2024-04-15T01:37:00.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:00.394871870Z [2024-04-15T01:37:00.394+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:37:00.401502616Z [2024-04-15T01:37:00.401+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:37:00.489589897Z [2024-04-15T01:37:00.489+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:37:00.489605515Z 2024-04-15T01:37:00.489608721Z 2024-04-15T01:37:00.489611813Z 2024-04-15T01:37:00.489614744Z 2024-04-15T01:37:00.489617807Z [2024-04-15T01:37:00.489+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:37:00.490090253Z [2024-04-15T01:37:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:37:00.490675316Z [2024-04-15T01:37:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:37:00.490684922Z [2024-04-15T01:37:00.490+0000] {scheduler_job.py:425} INFO - DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:37:00.491052439Z [2024-04-15T01:37:00.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:37:00.491060687Z 2024-04-15T01:37:00.491063974Z 2024-04-15T01:37:00.491066994Z 2024-04-15T01:37:00.491070164Z 2024-04-15T01:37:00.495526589Z [2024-04-15T01:37:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:37:00.495629759Z [2024-04-15T01:37:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:37:00.495912097Z [2024-04-15T01:37:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:37:00.496102988Z [2024-04-15T01:37:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:37:00.496421711Z [2024-04-15T01:37:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:37:00.496526102Z [2024-04-15T01:37:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:37:00.496761720Z [2024-04-15T01:37:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:37:00.496873625Z [2024-04-15T01:37:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:37:00.893728134Z [2024-04-15T01:37:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:37:00.894163314Z [2024-04-15T01:37:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:37:00.894380443Z [2024-04-15T01:37:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:37:00.895747962Z [2024-04-15T01:37:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:37:00.904440639Z [2024-04-15T01:37:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66b0bd2c-d375-4f1a-a47d-62db1d33f4bb 2024-04-15T01:37:00.904700996Z [2024-04-15T01:37:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ffaf150-07f0-4ab3-866c-71edd7e9018e 2024-04-15T01:37:00.904905274Z [2024-04-15T01:37:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b22f8fb-46be-404e-b190-f0e19f7fcf60 2024-04-15T01:37:00.905073314Z [2024-04-15T01:37:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfd6be39-51cf-4944-945c-48a80c83459a 2024-04-15T01:37:05.546116943Z [2024-04-15T01:37:05.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:37:05.546163091Z [2024-04-15T01:37:05.545+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:37:00.422639+00:00, run_end_date=2024-04-15 01:37:05.545516+00:00, run_duration=5.122877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:37:00+00:00, dag_hash=1bbd62ef50a4f72026564fc071fcd053 2024-04-15T01:37:05.555585433Z [2024-04-15T01:37:05.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:05.606846948Z [2024-04-15T01:37:05.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:37:05.616346738Z [2024-04-15T01:37:05.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:37:03.574682+00:00, run_end_date=2024-04-15 01:37:05.339799+00:00, run_duration=1.765117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:37:00.491627+00:00, queued_by_job_id=2, pid=945 2024-04-15T01:37:06.357182153Z [2024-04-15T01:37:06.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:37:06.357338404Z [2024-04-15T01:37:06.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:37:00.416714+00:00, run_end_date=2024-04-15 01:37:06.357071+00:00, run_duration=5.940357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:37:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:37:06.365662484Z [2024-04-15T01:37:06.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:06.373587754Z [2024-04-15T01:37:06.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:37:06.373768723Z [2024-04-15T01:37:06.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:37:00.419344+00:00, run_end_date=2024-04-15 01:37:06.373513+00:00, run_duration=5.954169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:37:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:37:06.384013211Z [2024-04-15T01:37:06.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:06.428919844Z [2024-04-15T01:37:06.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:37:06.437738993Z [2024-04-15T01:37:06.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:37:04.539346+00:00, run_end_date=2024-04-15 01:37:06.051309+00:00, run_duration=1.511963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:37:00.491627+00:00, queued_by_job_id=2, pid=993 2024-04-15T01:37:07.505378810Z [2024-04-15T01:37:07.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:37:07.506285156Z [2024-04-15T01:37:07.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:37:00.421501+00:00, run_end_date=2024-04-15 01:37:07.505309+00:00, run_duration=7.083808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:37:00+00:00, dag_hash=d22ecc1c92ec5466159b9fc072087870 2024-04-15T01:37:07.517825743Z [2024-04-15T01:37:07.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:07.553471612Z [2024-04-15T01:37:07.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:37:07.553552610Z [2024-04-15T01:37:07.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:37:07.558862575Z [2024-04-15T01:37:07.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:37:04.438180+00:00, run_end_date=2024-04-15 01:37:06.276451+00:00, run_duration=1.838271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:37:00.491627+00:00, queued_by_job_id=2, pid=983 2024-04-15T01:37:07.559030635Z [2024-04-15T01:37:07.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:37:04.067243+00:00, run_end_date=2024-04-15 01:37:06.964896+00:00, run_duration=2.897653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:37:00.491627+00:00, queued_by_job_id=2, pid=973 2024-04-15T01:38:00.160490365Z [2024-04-15T01:38:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:38:00.167039906Z [2024-04-15T01:38:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:38:00.182367367Z [2024-04-15T01:38:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:00.188464440Z [2024-04-15T01:38:00.188+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:38:00.202788249Z [2024-04-15T01:38:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:00.309708408Z [2024-04-15T01:38:00.309+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:38:00.309729365Z 2024-04-15T01:38:00.309733294Z 2024-04-15T01:38:00.309737647Z 2024-04-15T01:38:00.309740619Z 2024-04-15T01:38:00.309743555Z 2024-04-15T01:38:00.309747070Z [2024-04-15T01:38:00.309+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:38:00.310316637Z [2024-04-15T01:38:00.309+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:38:00.310764969Z [2024-04-15T01:38:00.310+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:38:00.311005517Z [2024-04-15T01:38:00.310+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:38:00.311660717Z [2024-04-15T01:38:00.310+0000] {scheduler_job.py:425} INFO - DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:38:00.313533892Z [2024-04-15T01:38:00.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:38:00.313545632Z 2024-04-15T01:38:00.313563870Z 2024-04-15T01:38:00.313567273Z 2024-04-15T01:38:00.313570325Z 2024-04-15T01:38:00.313573364Z 2024-04-15T01:38:00.319389968Z [2024-04-15T01:38:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.319669805Z [2024-04-15T01:38:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:38:00.320457800Z [2024-04-15T01:38:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.320468365Z [2024-04-15T01:38:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:38:00.320898391Z [2024-04-15T01:38:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.321559965Z [2024-04-15T01:38:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:38:00.322285229Z [2024-04-15T01:38:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.322518740Z [2024-04-15T01:38:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:38:00.322823845Z [2024-04-15T01:38:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.323135292Z [2024-04-15T01:38:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:38:00.961848684Z [2024-04-15T01:38:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:00.962029079Z [2024-04-15T01:38:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:00.962147066Z [2024-04-15T01:38:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:00.962305385Z [2024-04-15T01:38:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:00.962334439Z [2024-04-15T01:38:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:00.973467923Z [2024-04-15T01:38:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8f1e834-ae9a-4b35-ab05-4198bd0ec470 2024-04-15T01:38:00.975005887Z [2024-04-15T01:38:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fba28d7-8cab-45ce-a81d-74f592333db0 2024-04-15T01:38:00.975768170Z [2024-04-15T01:38:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d734161-53b7-41e8-a8ab-84982a1f54aa 2024-04-15T01:38:00.975918417Z [2024-04-15T01:38:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0b14865-e672-4fdb-967e-c3f92694dbbb 2024-04-15T01:38:00.976254020Z [2024-04-15T01:38:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to f87c57e5-f430-4fe5-bd46-21e24f98056a 2024-04-15T01:38:03.596579482Z [2024-04-15T01:38:03.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:03.596812644Z [2024-04-15T01:38:03.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:38:00.214199+00:00, run_end_date=2024-04-15 01:38:03.596508+00:00, run_duration=3.382309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:38:03.612995824Z [2024-04-15T01:38:03.612+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:38:03.745126807Z [2024-04-15T01:38:03.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:03.753538867Z [2024-04-15T01:38:03.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:01.959067+00:00, run_end_date=2024-04-15 01:38:02.763602+00:00, run_duration=0.804535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.314479+00:00, queued_by_job_id=2, pid=1030 2024-04-15T01:38:06.776180859Z [2024-04-15T01:38:06.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:06.776462898Z [2024-04-15T01:38:06.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:37:00+00:00, run_id=scheduled__2024-04-15T01:37:00+00:00, run_start_date=2024-04-15 01:38:00.215714+00:00, run_end_date=2024-04-15 01:38:06.776176+00:00, run_duration=6.560462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:37:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=d22ecc1c92ec5466159b9fc072087870 2024-04-15T01:38:06.787154299Z [2024-04-15T01:38:06.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:06.793621697Z [2024-04-15T01:38:06.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:06.793943787Z [2024-04-15T01:38:06.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:37:00+00:00, run_id=scheduled__2024-04-15T01:37:00+00:00, run_start_date=2024-04-15 01:38:00.216781+00:00, run_end_date=2024-04-15 01:38:06.793675+00:00, run_duration=6.576894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:37:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:38:06.812550018Z [2024-04-15T01:38:06.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:06.820978746Z [2024-04-15T01:38:06.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:06.821286320Z [2024-04-15T01:38:06.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:37:00+00:00, run_id=scheduled__2024-04-15T01:37:00+00:00, run_start_date=2024-04-15 01:38:00.220112+00:00, run_end_date=2024-04-15 01:38:06.821002+00:00, run_duration=6.60089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:37:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=1bbd62ef50a4f72026564fc071fcd053 2024-04-15T01:38:06.830612703Z [2024-04-15T01:38:06.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:06.836182697Z [2024-04-15T01:38:06.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:06.836425834Z [2024-04-15T01:38:06.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:37:00+00:00, run_id=scheduled__2024-04-15T01:37:00+00:00, run_start_date=2024-04-15 01:38:00.219144+00:00, run_end_date=2024-04-15 01:38:06.836173+00:00, run_duration=6.617029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:37:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:38:06.846890433Z [2024-04-15T01:38:06.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:06.881771947Z [2024-04-15T01:38:06.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:06.883574683Z [2024-04-15T01:38:06.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:06.883687582Z [2024-04-15T01:38:06.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:06.889665514Z [2024-04-15T01:38:06.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:37:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:04.102073+00:00, run_end_date=2024-04-15 01:38:06.231978+00:00, run_duration=2.129905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.314479+00:00, queued_by_job_id=2, pid=1053 2024-04-15T01:38:06.890035310Z [2024-04-15T01:38:06.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:37:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:04.608846+00:00, run_end_date=2024-04-15 01:38:06.270549+00:00, run_duration=1.661703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.314479+00:00, queued_by_job_id=2, pid=1081 2024-04-15T01:38:06.890285009Z [2024-04-15T01:38:06.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:37:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:04.847009+00:00, run_end_date=2024-04-15 01:38:06.391296+00:00, run_duration=1.544287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.314479+00:00, queued_by_job_id=2, pid=1091 2024-04-15T01:38:07.959526340Z [2024-04-15T01:38:07.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:07.964279585Z [2024-04-15T01:38:07.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:37:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:04.970501+00:00, run_end_date=2024-04-15 01:38:06.727595+00:00, run_duration=1.757094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.314479+00:00, queued_by_job_id=2, pid=1092 2024-04-15T01:39:00.925072288Z [2024-04-15T01:39:00.924+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:39:00.946300808Z [2024-04-15T01:39:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:39:00.965032672Z [2024-04-15T01:39:00.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:00.976812844Z [2024-04-15T01:39:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:01.050016252Z [2024-04-15T01:39:01.049+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:39:01.050031150Z 2024-04-15T01:39:01.050034987Z 2024-04-15T01:39:01.050038580Z 2024-04-15T01:39:01.050041922Z 2024-04-15T01:39:01.050213443Z [2024-04-15T01:39:01.050+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:39:01.050377711Z [2024-04-15T01:39:01.050+0000] {scheduler_job.py:425} INFO - DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:39:01.050525072Z [2024-04-15T01:39:01.050+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:39:01.050635394Z [2024-04-15T01:39:01.050+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:39:01.051408131Z [2024-04-15T01:39:01.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:39:01.051419002Z 2024-04-15T01:39:01.051422367Z 2024-04-15T01:39:01.051437705Z 2024-04-15T01:39:01.051440637Z 2024-04-15T01:39:01.054534203Z [2024-04-15T01:39:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:01.054845344Z [2024-04-15T01:39:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:39:01.055084498Z [2024-04-15T01:39:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:01.055519096Z [2024-04-15T01:39:01.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:39:01.055807026Z [2024-04-15T01:39:01.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:01.055944025Z [2024-04-15T01:39:01.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:39:01.056352076Z [2024-04-15T01:39:01.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:01.056717857Z [2024-04-15T01:39:01.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:39:01.567549403Z [2024-04-15T01:39:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:39:01.567785690Z [2024-04-15T01:39:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:39:01.567957446Z [2024-04-15T01:39:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:39:01.568186016Z [2024-04-15T01:39:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:39:01.590554103Z [2024-04-15T01:39:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccac20bf-d7fa-44bc-b1a3-c3e94c0df5fb 2024-04-15T01:39:01.591221126Z [2024-04-15T01:39:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bfa0f60-7ae8-44d6-8f41-ba69e96b2347 2024-04-15T01:39:01.591658587Z [2024-04-15T01:39:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d34f37a-6bd4-43be-a399-c7c9e5882f99 2024-04-15T01:39:01.591667605Z [2024-04-15T01:39:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64dc4268-083d-4a1f-a245-988f25fdadd3 2024-04-15T01:39:05.491168685Z [2024-04-15T01:39:05.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status failed for try_number 1 2024-04-15T01:39:05.491636426Z [2024-04-15T01:39:05.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status failed for try_number 1 2024-04-15T01:39:05.499720419Z [2024-04-15T01:39:05.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:01.052116+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:39:05.500549638Z [2024-04-15T01:39:05.500+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:05.503497135Z [2024-04-15T01:39:05.503+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:05.518023501Z [2024-04-15T01:39:05.517+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T013800, start_date=, end_date=20240415T013905 2024-04-15T01:39:05.531620403Z [2024-04-15T01:39:05.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:01.052116+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:39:05.532502147Z [2024-04-15T01:39:05.532+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:05.538711577Z [2024-04-15T01:39:05.538+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:05.551134121Z [2024-04-15T01:39:05.550+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T013800, start_date=, end_date=20240415T013905 2024-04-15T01:39:06.604419370Z [2024-04-15T01:39:06.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:39:06.605315463Z [2024-04-15T01:39:06.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:39:00.989560+00:00, run_end_date=2024-04-15 01:39:06.604788+00:00, run_duration=5.615228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:39:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:39:06.615170804Z [2024-04-15T01:39:06.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:06.685844238Z [2024-04-15T01:39:06.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status success for try_number 1 2024-04-15T01:39:06.694423923Z [2024-04-15T01:39:06.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=2024-04-15 01:39:04.344433+00:00, run_end_date=2024-04-15 01:39:05.957693+00:00, run_duration=1.61326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:01.052116+00:00, queued_by_job_id=2, pid=1158 2024-04-15T01:39:07.127715201Z [2024-04-15T01:39:07.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:39:07.127951961Z [2024-04-15T01:39:07.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:39:00.993599+00:00, run_end_date=2024-04-15 01:39:07.127644+00:00, run_duration=6.134045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:39:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:39:07.136658911Z [2024-04-15T01:39:07.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:07.180639682Z [2024-04-15T01:39:07.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status success for try_number 1 2024-04-15T01:39:07.185172108Z [2024-04-15T01:39:07.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=2024-04-15 01:39:05.012681+00:00, run_end_date=2024-04-15 01:39:06.712320+00:00, run_duration=1.699639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:01.052116+00:00, queued_by_job_id=2, pid=1204 2024-04-15T01:39:16.025850074Z [2024-04-15T01:39:16.025+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:39:16.025893322Z 2024-04-15T01:39:16.025897502Z 2024-04-15T01:39:16.026180811Z [2024-04-15T01:39:16.025+0000] {scheduler_job.py:425} INFO - DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:39:16.026343591Z [2024-04-15T01:39:16.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 has 0/16 running and queued tasks 2024-04-15T01:39:16.026962167Z [2024-04-15T01:39:16.026+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:39:16.026972969Z 2024-04-15T01:39:16.026976299Z 2024-04-15T01:39:16.030092355Z [2024-04-15T01:39:16.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:16.030299383Z [2024-04-15T01:39:16.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:39:16.030523314Z [2024-04-15T01:39:16.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:16.030726738Z [2024-04-15T01:39:16.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:39:16.180526081Z [2024-04-15T01:39:16.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 2 2024-04-15T01:39:16.180564912Z [2024-04-15T01:39:16.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 2 2024-04-15T01:39:16.189248636Z [2024-04-15T01:39:16.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f8fe117-b6f7-4505-b48b-a079898f3373 2024-04-15T01:39:16.189326921Z [2024-04-15T01:39:16.189+0000] {scheduler_job.py:635} INFO - Setting external_id for to c24a3310-3912-4e5f-ac6d-ec6f0ba309a2 2024-04-15T01:39:18.539588999Z [2024-04-15T01:39:18.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status failed for try_number 2 2024-04-15T01:39:18.539941731Z [2024-04-15T01:39:18.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status failed for try_number 2 2024-04-15T01:39:18.555156595Z [2024-04-15T01:39:18.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 01:39:05.506202+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:16.027403+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:39:18.555708803Z [2024-04-15T01:39:18.555+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:18.558107315Z [2024-04-15T01:39:18.557+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:18.571844634Z [2024-04-15T01:39:18.571+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T013800, start_date=, end_date=20240415T013918 2024-04-15T01:39:18.580629320Z [2024-04-15T01:39:18.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 01:39:05.540976+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:16.027403+00:00, queued_by_job_id=2, pid=None 2024-04-15T01:39:18.581226633Z [2024-04-15T01:39:18.580+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:18.583505214Z [2024-04-15T01:39:18.583+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:39:18.595303808Z [2024-04-15T01:39:18.594+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T013800, start_date=, end_date=20240415T013918 2024-04-15T01:39:19.669550564Z [2024-04-15T01:39:19.669+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:39:19.669969770Z [2024-04-15T01:39:19.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:39:00.991516+00:00, run_end_date=2024-04-15 01:39:19.669611+00:00, run_duration=18.678095, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:39:00+00:00, dag_hash=1bbd62ef50a4f72026564fc071fcd053 2024-04-15T01:39:19.681652258Z [2024-04-15T01:39:19.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:19.691315654Z [2024-04-15T01:39:19.691+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:39:19.691961885Z [2024-04-15T01:39:19.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:39:00.992630+00:00, run_end_date=2024-04-15 01:39:19.691324+00:00, run_duration=18.698694, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:39:00+00:00, dag_hash=d22ecc1c92ec5466159b9fc072087870 2024-04-15T01:39:19.704389564Z [2024-04-15T01:39:19.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:40:00.051781150Z [2024-04-15T01:40:00.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:00.059994939Z [2024-04-15T01:40:00.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:40:00.066659191Z [2024-04-15T01:40:00.066+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:40:00.081063138Z [2024-04-15T01:40:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:40:00.171345721Z [2024-04-15T01:40:00.171+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:40:00.171363989Z 2024-04-15T01:40:00.171383966Z 2024-04-15T01:40:00.171388176Z 2024-04-15T01:40:00.171391398Z 2024-04-15T01:40:00.171774553Z [2024-04-15T01:40:00.171+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:40:00.171957393Z [2024-04-15T01:40:00.171+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:40:00.172234348Z [2024-04-15T01:40:00.171+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:40:00.172374638Z [2024-04-15T01:40:00.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:40:00.172978160Z [2024-04-15T01:40:00.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:00.172992359Z 2024-04-15T01:40:00.172998486Z 2024-04-15T01:40:00.173004141Z 2024-04-15T01:40:00.173009764Z 2024-04-15T01:40:00.176620933Z [2024-04-15T01:40:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:40:00.176809052Z [2024-04-15T01:40:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:00.177530723Z [2024-04-15T01:40:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:00.177722709Z [2024-04-15T01:40:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:40:00.178383269Z [2024-04-15T01:40:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:00.178565545Z [2024-04-15T01:40:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:40:00.178849138Z [2024-04-15T01:40:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:00.179037829Z [2024-04-15T01:40:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:40:00.485668806Z [2024-04-15T01:40:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:00.486042347Z [2024-04-15T01:40:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:00.486388925Z [2024-04-15T01:40:00.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:00.486782764Z [2024-04-15T01:40:00.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:00.497190073Z [2024-04-15T01:40:00.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a5f82be-ccfc-4d3f-a94e-b234d88edc45 2024-04-15T01:40:00.497499981Z [2024-04-15T01:40:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30bf2e93-21a7-4b88-94c9-9fa330db804b 2024-04-15T01:40:00.497655474Z [2024-04-15T01:40:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23ba4ea7-d23e-4786-85d0-bf91dab13e83 2024-04-15T01:40:00.497854380Z [2024-04-15T01:40:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1df39d59-a1ce-4f4d-b6d4-228229c2144d 2024-04-15T01:40:03.050009521Z [2024-04-15T01:40:03.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:03.050044810Z [2024-04-15T01:40:03.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:40:00.094695+00:00, run_end_date=2024-04-15 01:40:03.049345+00:00, run_duration=2.95465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:40:03.084186091Z [2024-04-15T01:40:03.083+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:40:03.258726293Z [2024-04-15T01:40:03.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:03.266815875Z [2024-04-15T01:40:03.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:01.457230+00:00, run_end_date=2024-04-15 01:40:02.198435+00:00, run_duration=0.741205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.173772+00:00, queued_by_job_id=2, pid=1270 2024-04-15T01:40:05.539724279Z [2024-04-15T01:40:05.539+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:40:05.539740221Z 2024-04-15T01:40:05.539981989Z [2024-04-15T01:40:05.539+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:40:05.540708170Z [2024-04-15T01:40:05.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:05.540719562Z 2024-04-15T01:40:05.543195476Z [2024-04-15T01:40:05.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:40:05.543398662Z [2024-04-15T01:40:05.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:05.604090568Z [2024-04-15T01:40:05.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:05.604399064Z [2024-04-15T01:40:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:05.611002787Z [2024-04-15T01:40:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:04.536546+00:00, run_end_date=2024-04-15 01:40:05.109301+00:00, run_duration=0.572755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.173772+00:00, queued_by_job_id=2, pid=1311 2024-04-15T01:40:05.611562357Z [2024-04-15T01:40:05.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a2064cd-7262-4904-a158-8b5df99b0ba0 2024-04-15T01:40:05.654621118Z [2024-04-15T01:40:05.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:05.654995624Z [2024-04-15T01:40:05.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:39:00+00:00, run_id=scheduled__2024-04-15T01:39:00+00:00, run_start_date=2024-04-15 01:40:00.095744+00:00, run_end_date=2024-04-15 01:40:05.654702+00:00, run_duration=5.558958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:39:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:40:05.670841881Z [2024-04-15T01:40:05.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:06.819599142Z [2024-04-15T01:40:06.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:06.820000682Z [2024-04-15T01:40:06.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:39:00+00:00, run_id=scheduled__2024-04-15T01:39:00+00:00, run_start_date=2024-04-15 01:40:00.096668+00:00, run_end_date=2024-04-15 01:40:06.819452+00:00, run_duration=6.722784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:39:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:40:06.830551726Z [2024-04-15T01:40:06.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:06.885117622Z [2024-04-15T01:40:06.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:06.885458890Z [2024-04-15T01:40:06.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:06.894270161Z [2024-04-15T01:40:06.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:39:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:04.290041+00:00, run_end_date=2024-04-15 01:40:05.604426+00:00, run_duration=1.314385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.173772+00:00, queued_by_job_id=2, pid=1301 2024-04-15T01:40:06.894937312Z [2024-04-15T01:40:06.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:39:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:04.698102+00:00, run_end_date=2024-04-15 01:40:06.558935+00:00, run_duration=1.860833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.173772+00:00, queued_by_job_id=2, pid=1321 2024-04-15T01:40:08.389451974Z [2024-04-15T01:40:08.389+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:40:08.389495329Z 2024-04-15T01:40:08.389502825Z [2024-04-15T01:40:08.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:40:08.390133149Z [2024-04-15T01:40:08.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:08.390148970Z 2024-04-15T01:40:08.392577975Z [2024-04-15T01:40:08.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:40:08.392664233Z [2024-04-15T01:40:08.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:40:08.450028120Z [2024-04-15T01:40:08.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:08.450168315Z [2024-04-15T01:40:08.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:08.467692628Z [2024-04-15T01:40:08.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:07.452254+00:00, run_end_date=2024-04-15 01:40:07.768832+00:00, run_duration=0.316578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:05.541011+00:00, queued_by_job_id=2, pid=1351 2024-04-15T01:40:08.468377362Z [2024-04-15T01:40:08.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf0ceaa-55de-499d-b1cc-bf3641eb363b 2024-04-15T01:40:12.954180796Z [2024-04-15T01:40:12.953+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:40:12.954202755Z 2024-04-15T01:40:12.954405154Z [2024-04-15T01:40:12.954+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:40:12.955022764Z [2024-04-15T01:40:12.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:12.955051581Z 2024-04-15T01:40:12.957185816Z [2024-04-15T01:40:12.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:12.957352568Z [2024-04-15T01:40:12.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:12.996632793Z [2024-04-15T01:40:12.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:12.996678984Z [2024-04-15T01:40:12.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:13.006100618Z [2024-04-15T01:40:13.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bea80ce-5044-44e6-aac4-c8060940b6a2 2024-04-15T01:40:13.006363079Z [2024-04-15T01:40:13.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=0, run_start_date=2024-04-15 01:40:10.340922+00:00, run_end_date=2024-04-15 01:40:12.318283+00:00, run_duration=1.977361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:08.390455+00:00, queued_by_job_id=2, pid=1363 2024-04-15T01:40:15.554750894Z [2024-04-15T01:40:15.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:15.555153649Z [2024-04-15T01:40:15.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:40:00.093461+00:00, run_end_date=2024-04-15 01:40:15.554696+00:00, run_duration=15.461235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T01:40:15.564133703Z [2024-04-15T01:40:15.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:40:15.597705113Z [2024-04-15T01:40:15.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:15.602382572Z [2024-04-15T01:40:15.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:14.851509+00:00, run_end_date=2024-04-15 01:40:15.214834+00:00, run_duration=0.363325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:12.955446+00:00, queued_by_job_id=2, pid=1384 2024-04-15T01:40:40.009323267Z [2024-04-15T01:40:40.008+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:41:00.291591612Z [2024-04-15T01:41:00.291+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:41:00.304466600Z [2024-04-15T01:41:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:00.362382855Z [2024-04-15T01:41:00.361+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:41:00.362395491Z 2024-04-15T01:41:00.362398689Z 2024-04-15T01:41:00.362580634Z [2024-04-15T01:41:00.362+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:41:00.362804516Z [2024-04-15T01:41:00.362+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:41:00.364468856Z [2024-04-15T01:41:00.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:41:00.364479800Z 2024-04-15T01:41:00.364483281Z 2024-04-15T01:41:00.374460930Z [2024-04-15T01:41:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:41:00.375023115Z [2024-04-15T01:41:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:41:00.375468710Z [2024-04-15T01:41:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:41:00.375621969Z [2024-04-15T01:41:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:41:00.528517624Z [2024-04-15T01:41:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:41:00.528610141Z [2024-04-15T01:41:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:41:00.535472789Z [2024-04-15T01:41:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0876b618-fe3f-437a-88dc-0d69bf2fc87e 2024-04-15T01:41:00.535574049Z [2024-04-15T01:41:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48150f43-d753-4d3b-827d-42944ad1de0b 2024-04-15T01:41:05.399166169Z [2024-04-15T01:41:05.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:41:05.400182248Z [2024-04-15T01:41:05.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:41:00.318438+00:00, run_end_date=2024-04-15 01:41:05.399766+00:00, run_duration=5.081328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:41:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:41:05.411672809Z [2024-04-15T01:41:05.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:05.417806856Z [2024-04-15T01:41:05.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:41:05.418174455Z [2024-04-15T01:41:05.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:41:00.320349+00:00, run_end_date=2024-04-15 01:41:05.417813+00:00, run_duration=5.097464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:41:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:41:05.427068030Z [2024-04-15T01:41:05.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:05.459724240Z [2024-04-15T01:41:05.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:41:05.460518338Z [2024-04-15T01:41:05.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:41:05.465881785Z [2024-04-15T01:41:05.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:41:02.653494+00:00, run_end_date=2024-04-15 01:41:05.268318+00:00, run_duration=2.614824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:41:00.369805+00:00, queued_by_job_id=2, pid=1420 2024-04-15T01:41:05.466236805Z [2024-04-15T01:41:05.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:41:02.841408+00:00, run_end_date=2024-04-15 01:41:04.890497+00:00, run_duration=2.049089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:41:00.369805+00:00, queued_by_job_id=2, pid=1421 2024-04-15T01:42:00.078889154Z [2024-04-15T01:42:00.078+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:42:00.089629039Z [2024-04-15T01:42:00.089+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:42:00.101461172Z [2024-04-15T01:42:00.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:00.211827566Z [2024-04-15T01:42:00.211+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:42:00.211847126Z 2024-04-15T01:42:00.211853765Z 2024-04-15T01:42:00.211859086Z 2024-04-15T01:42:00.212304990Z [2024-04-15T01:42:00.212+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:42:00.212851518Z [2024-04-15T01:42:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:42:00.213010469Z [2024-04-15T01:42:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:42:00.213557621Z [2024-04-15T01:42:00.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:42:00.213567563Z 2024-04-15T01:42:00.213570850Z 2024-04-15T01:42:00.213573917Z 2024-04-15T01:42:00.218653320Z [2024-04-15T01:42:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:42:00.220848488Z [2024-04-15T01:42:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:42:00.221287111Z [2024-04-15T01:42:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:42:00.222500000Z [2024-04-15T01:42:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:42:00.223147490Z [2024-04-15T01:42:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:42:00.223514803Z [2024-04-15T01:42:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:42:00.633806906Z [2024-04-15T01:42:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:42:00.633992054Z [2024-04-15T01:42:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status queued for try_number 1 2024-04-15T01:42:00.634147766Z [2024-04-15T01:42:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status queued for try_number 1 2024-04-15T01:42:00.641916260Z [2024-04-15T01:42:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb9d6ddb-2d3a-4166-8e49-1f2a6c292987 2024-04-15T01:42:00.642057541Z [2024-04-15T01:42:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44214cae-047a-48c1-a4e0-accd88c9bdad 2024-04-15T01:42:00.642230869Z [2024-04-15T01:42:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 828d3a29-c525-4c7f-b61a-a8b7fc87a459 2024-04-15T01:42:02.399326935Z [2024-04-15T01:42:02.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:42:02.399621187Z [2024-04-15T01:42:02.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:42:00.109885+00:00, run_end_date=2024-04-15 01:42:02.399293+00:00, run_duration=2.289408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:42:02.410016132Z [2024-04-15T01:42:02.409+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:42:02.505260522Z [2024-04-15T01:42:02.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:42:02.510762654Z [2024-04-15T01:42:02.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:42:01.400843+00:00, run_end_date=2024-04-15 01:42:02.095667+00:00, run_duration=0.694824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:42:00.215316+00:00, queued_by_job_id=2, pid=1456 2024-04-15T01:42:05.713300774Z [2024-04-15T01:42:05.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:42:05.713510563Z [2024-04-15T01:42:05.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:41:00+00:00, run_id=scheduled__2024-04-15T01:41:00+00:00, run_start_date=2024-04-15 01:42:00.111918+00:00, run_end_date=2024-04-15 01:42:05.713217+00:00, run_duration=5.601299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:41:00+00:00, data_interval_end=2024-04-15 01:42:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:42:05.723534160Z [2024-04-15T01:42:05.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:05.766327742Z [2024-04-15T01:42:05.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status success for try_number 1 2024-04-15T01:42:05.771102338Z [2024-04-15T01:42:05.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:41:00+00:00, map_index=-1, run_start_date=2024-04-15 01:42:03.622934+00:00, run_end_date=2024-04-15 01:42:05.355749+00:00, run_duration=1.732815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:42:00.215316+00:00, queued_by_job_id=2, pid=1477 2024-04-15T01:42:06.827852401Z [2024-04-15T01:42:06.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:42:06.828347868Z [2024-04-15T01:42:06.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:41:00+00:00, run_id=scheduled__2024-04-15T01:41:00+00:00, run_start_date=2024-04-15 01:42:00.110924+00:00, run_end_date=2024-04-15 01:42:06.827962+00:00, run_duration=6.717038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:41:00+00:00, data_interval_end=2024-04-15 01:42:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:42:06.842874183Z [2024-04-15T01:42:06.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:06.892632696Z [2024-04-15T01:42:06.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status success for try_number 1 2024-04-15T01:42:06.899214135Z [2024-04-15T01:42:06.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:41:00+00:00, map_index=-1, run_start_date=2024-04-15 01:42:03.897148+00:00, run_end_date=2024-04-15 01:42:05.742463+00:00, run_duration=1.845315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:42:00.215316+00:00, queued_by_job_id=2, pid=1487 2024-04-15T01:43:00.901414908Z [2024-04-15T01:43:00.900+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:43:00.913766160Z [2024-04-15T01:43:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:00.967260755Z [2024-04-15T01:43:00.966+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:43:00.967280195Z 2024-04-15T01:43:00.967285555Z 2024-04-15T01:43:00.967380215Z [2024-04-15T01:43:00.967+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:43:00.967387310Z [2024-04-15T01:43:00.967+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:43:00.968190385Z [2024-04-15T01:43:00.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:43:00.968202642Z 2024-04-15T01:43:00.968206870Z 2024-04-15T01:43:00.972701626Z [2024-04-15T01:43:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:43:00.973082769Z [2024-04-15T01:43:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:43:00.973347731Z [2024-04-15T01:43:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:43:00.973462038Z [2024-04-15T01:43:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:43:01.283762571Z [2024-04-15T01:43:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status queued for try_number 1 2024-04-15T01:43:01.284199936Z [2024-04-15T01:43:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status queued for try_number 1 2024-04-15T01:43:01.295766166Z [2024-04-15T01:43:01.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81972b6c-3cb7-417e-bd0b-765001b2886d 2024-04-15T01:43:01.296075926Z [2024-04-15T01:43:01.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to b52fb9e0-4344-4c49-b8e7-dbaa92c7a5da 2024-04-15T01:43:05.945222788Z [2024-04-15T01:43:05.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:43:05.945791627Z [2024-04-15T01:43:05.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:42:00+00:00, run_id=scheduled__2024-04-15T01:42:00+00:00, run_start_date=2024-04-15 01:43:00.925394+00:00, run_end_date=2024-04-15 01:43:05.945396+00:00, run_duration=5.020002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:42:00+00:00, data_interval_end=2024-04-15 01:43:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:43:05.956779920Z [2024-04-15T01:43:05.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:05.963530650Z [2024-04-15T01:43:05.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:43:05.963832667Z [2024-04-15T01:43:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:42:00+00:00, run_id=scheduled__2024-04-15T01:42:00+00:00, run_start_date=2024-04-15 01:43:00.924124+00:00, run_end_date=2024-04-15 01:43:05.963539+00:00, run_duration=5.039415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:42:00+00:00, data_interval_end=2024-04-15 01:43:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:43:05.973099183Z [2024-04-15T01:43:05.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:06.000258244Z [2024-04-15T01:43:05.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status success for try_number 1 2024-04-15T01:43:06.000431774Z [2024-04-15T01:43:06.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status success for try_number 1 2024-04-15T01:43:06.007306547Z [2024-04-15T01:43:06.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:42:00+00:00, map_index=-1, run_start_date=2024-04-15 01:43:03.970369+00:00, run_end_date=2024-04-15 01:43:05.802985+00:00, run_duration=1.832616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:43:00.968973+00:00, queued_by_job_id=2, pid=1541 2024-04-15T01:43:06.007538057Z [2024-04-15T01:43:06.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:42:00+00:00, map_index=-1, run_start_date=2024-04-15 01:43:03.856440+00:00, run_end_date=2024-04-15 01:43:05.418448+00:00, run_duration=1.562008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:43:00.968973+00:00, queued_by_job_id=2, pid=1540 2024-04-15T01:44:00.150759146Z [2024-04-15T01:44:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:44:00.166171197Z [2024-04-15T01:44:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:00.172522618Z [2024-04-15T01:44:00.172+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:44:00.234175109Z [2024-04-15T01:44:00.233+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:44:00.234209929Z 2024-04-15T01:44:00.234213946Z 2024-04-15T01:44:00.234216955Z 2024-04-15T01:44:00.234230186Z [2024-04-15T01:44:00.234+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:44:00.234345463Z [2024-04-15T01:44:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:44:00.234437287Z [2024-04-15T01:44:00.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:44:00.234920367Z [2024-04-15T01:44:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:44:00.234928819Z 2024-04-15T01:44:00.234932052Z 2024-04-15T01:44:00.234934822Z 2024-04-15T01:44:00.237853823Z [2024-04-15T01:44:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:44:00.238004854Z [2024-04-15T01:44:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:44:00.238189867Z [2024-04-15T01:44:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:44:00.238257973Z [2024-04-15T01:44:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:44:00.238424371Z [2024-04-15T01:44:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:44:00.238476590Z [2024-04-15T01:44:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:44:00.465514114Z [2024-04-15T01:44:00.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status queued for try_number 1 2024-04-15T01:44:00.467841700Z [2024-04-15T01:44:00.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status queued for try_number 1 2024-04-15T01:44:00.467899122Z [2024-04-15T01:44:00.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status queued for try_number 1 2024-04-15T01:44:00.475917247Z [2024-04-15T01:44:00.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ce24dbd-8dfb-46e5-b419-27f0c1f3d8c1 2024-04-15T01:44:00.476058484Z [2024-04-15T01:44:00.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa4adbcd-fc90-4ebb-8512-58cdba459b8f 2024-04-15T01:44:00.476225891Z [2024-04-15T01:44:00.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfb8289e-7449-4088-b2a5-fe4e22e0745d 2024-04-15T01:44:02.426980368Z [2024-04-15T01:44:02.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:44:02.427387583Z [2024-04-15T01:44:02.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:42:00+00:00, run_id=scheduled__2024-04-15T01:42:00+00:00, run_start_date=2024-04-15 01:44:00.184346+00:00, run_end_date=2024-04-15 01:44:02.427001+00:00, run_duration=2.242655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:42:00+00:00, data_interval_end=2024-04-15 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:44:02.446558702Z [2024-04-15T01:44:02.446+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:44:02.543805028Z [2024-04-15T01:44:02.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status success for try_number 1 2024-04-15T01:44:02.561873465Z [2024-04-15T01:44:02.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:42:00+00:00, map_index=-1, run_start_date=2024-04-15 01:44:01.410441+00:00, run_end_date=2024-04-15 01:44:01.853338+00:00, run_duration=0.442897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:44:00.235453+00:00, queued_by_job_id=2, pid=1576 2024-04-15T01:44:04.735733296Z [2024-04-15T01:44:04.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:44:04.736110551Z [2024-04-15T01:44:04.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:43:00+00:00, run_id=scheduled__2024-04-15T01:43:00+00:00, run_start_date=2024-04-15 01:44:00.188107+00:00, run_end_date=2024-04-15 01:44:04.735745+00:00, run_duration=4.547638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:43:00+00:00, data_interval_end=2024-04-15 01:44:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:44:04.749356331Z [2024-04-15T01:44:04.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:04.851502253Z [2024-04-15T01:44:04.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status success for try_number 1 2024-04-15T01:44:04.855739598Z [2024-04-15T01:44:04.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:43:00+00:00, map_index=-1, run_start_date=2024-04-15 01:44:03.000645+00:00, run_end_date=2024-04-15 01:44:04.354318+00:00, run_duration=1.353673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:44:00.235453+00:00, queued_by_job_id=2, pid=1607 2024-04-15T01:44:05.910703257Z [2024-04-15T01:44:05.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:44:05.911655388Z [2024-04-15T01:44:05.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:43:00+00:00, run_id=scheduled__2024-04-15T01:43:00+00:00, run_start_date=2024-04-15 01:44:00.186702+00:00, run_end_date=2024-04-15 01:44:05.910599+00:00, run_duration=5.723897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:43:00+00:00, data_interval_end=2024-04-15 01:44:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:44:05.920532664Z [2024-04-15T01:44:05.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:05.946004314Z [2024-04-15T01:44:05.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status success for try_number 1 2024-04-15T01:44:05.952843322Z [2024-04-15T01:44:05.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:43:00+00:00, map_index=-1, run_start_date=2024-04-15 01:44:02.743789+00:00, run_end_date=2024-04-15 01:44:04.719654+00:00, run_duration=1.975865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:44:00.235453+00:00, queued_by_job_id=2, pid=1606 2024-04-15T01:45:00.543769910Z [2024-04-15T01:45:00.543+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:45:00.558419727Z [2024-04-15T01:45:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:45:00.572375258Z [2024-04-15T01:45:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:00.662205798Z [2024-04-15T01:45:00.661+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:45:00.662220705Z 2024-04-15T01:45:00.662224520Z 2024-04-15T01:45:00.662232347Z 2024-04-15T01:45:00.662841488Z [2024-04-15T01:45:00.662+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:45:00.663046045Z [2024-04-15T01:45:00.662+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:45:00.663197753Z [2024-04-15T01:45:00.663+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:45:00.663798105Z [2024-04-15T01:45:00.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:00.663808997Z 2024-04-15T01:45:00.663812819Z 2024-04-15T01:45:00.663816133Z 2024-04-15T01:45:00.667477644Z [2024-04-15T01:45:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:45:00.667694519Z [2024-04-15T01:45:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:00.667984514Z [2024-04-15T01:45:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:45:00.668318569Z [2024-04-15T01:45:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:45:00.668608191Z [2024-04-15T01:45:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:45:00.668744318Z [2024-04-15T01:45:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:45:01.126611259Z [2024-04-15T01:45:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:01.132901290Z [2024-04-15T01:45:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:01.133188153Z [2024-04-15T01:45:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:01.161467189Z [2024-04-15T01:45:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 028161c2-e664-4ae4-88a8-7f4be2f9c084 2024-04-15T01:45:01.161728621Z [2024-04-15T01:45:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to b80b6764-3f4a-4457-885f-387e0cd81291 2024-04-15T01:45:01.161965491Z [2024-04-15T01:45:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e7bdc80-978d-4595-a7ca-b57edfde6169 2024-04-15T01:45:05.584133075Z [2024-04-15T01:45:05.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:45:05.589848070Z [2024-04-15T01:45:05.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:44:00+00:00, run_id=scheduled__2024-04-15T01:44:00+00:00, run_start_date=2024-04-15 01:45:00.585279+00:00, run_end_date=2024-04-15 01:45:05.586333+00:00, run_duration=5.001054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:44:00+00:00, data_interval_end=2024-04-15 01:45:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:45:05.608810421Z [2024-04-15T01:45:05.607+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:05.624340655Z [2024-04-15T01:45:05.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:45:05.624356602Z 2024-04-15T01:45:05.624576229Z [2024-04-15T01:45:05.624+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:45:05.625212669Z [2024-04-15T01:45:05.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:05.625224055Z 2024-04-15T01:45:05.627775636Z [2024-04-15T01:45:05.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:45:05.627976307Z [2024-04-15T01:45:05.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:05.713828648Z [2024-04-15T01:45:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:05.713858175Z [2024-04-15T01:45:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:05.713919535Z [2024-04-15T01:45:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:05.714018376Z [2024-04-15T01:45:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:05.728003072Z [2024-04-15T01:45:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:44:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:03.592350+00:00, run_end_date=2024-04-15 01:45:05.550277+00:00, run_duration=1.957927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:00.664666+00:00, queued_by_job_id=2, pid=1653 2024-04-15T01:45:05.728166555Z [2024-04-15T01:45:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:04.173720+00:00, run_end_date=2024-04-15 01:45:04.612802+00:00, run_duration=0.439082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:00.664666+00:00, queued_by_job_id=2, pid=1682 2024-04-15T01:45:05.728290597Z [2024-04-15T01:45:05.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6654fb4-4444-4bf8-81dd-d1d1b6d92166 2024-04-15T01:45:05.728444091Z [2024-04-15T01:45:05.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:44:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:03.953277+00:00, run_end_date=2024-04-15 01:45:05.430120+00:00, run_duration=1.476843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:00.664666+00:00, queued_by_job_id=2, pid=1672 2024-04-15T01:45:05.779352247Z [2024-04-15T01:45:05.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:45:05.779550349Z [2024-04-15T01:45:05.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:44:00+00:00, run_id=scheduled__2024-04-15T01:44:00+00:00, run_start_date=2024-04-15 01:45:00.584340+00:00, run_end_date=2024-04-15 01:45:05.779292+00:00, run_duration=5.194952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:44:00+00:00, data_interval_end=2024-04-15 01:45:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:45:05.789309221Z [2024-04-15T01:45:05.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:07.995923438Z [2024-04-15T01:45:07.995+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:45:07.995942045Z 2024-04-15T01:45:07.997315147Z [2024-04-15T01:45:07.995+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:45:07.998310515Z [2024-04-15T01:45:07.998+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:07.998328587Z 2024-04-15T01:45:08.004625430Z [2024-04-15T01:45:08.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:45:08.004875113Z [2024-04-15T01:45:08.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:45:08.055048263Z [2024-04-15T01:45:08.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:08.055080360Z [2024-04-15T01:45:08.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:08.063830872Z [2024-04-15T01:45:08.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:07.452112+00:00, run_end_date=2024-04-15 01:45:07.768211+00:00, run_duration=0.316099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:05.625877+00:00, queued_by_job_id=2, pid=1712 2024-04-15T01:45:08.064185736Z [2024-04-15T01:45:08.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 620ebe73-dcb6-42a2-87bb-6b31395226f6 2024-04-15T01:45:10.639640724Z [2024-04-15T01:45:10.639+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:45:10.639664214Z 2024-04-15T01:45:10.639684563Z [2024-04-15T01:45:10.639+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:45:10.640170578Z [2024-04-15T01:45:10.639+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:10.640181278Z 2024-04-15T01:45:10.641918607Z [2024-04-15T01:45:10.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:45:10.642033562Z [2024-04-15T01:45:10.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:10.713889440Z [2024-04-15T01:45:10.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:10.713909392Z [2024-04-15T01:45:10.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:10.722800755Z [2024-04-15T01:45:10.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=0, run_start_date=2024-04-15 01:45:09.977103+00:00, run_end_date=2024-04-15 01:45:10.333139+00:00, run_duration=0.356036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:07.998684+00:00, queued_by_job_id=2, pid=1724 2024-04-15T01:45:10.722915828Z [2024-04-15T01:45:10.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to a825f64a-3f62-4995-b22f-7e3bc7440657 2024-04-15T01:45:13.553375608Z [2024-04-15T01:45:13.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:45:13.554388337Z [2024-04-15T01:45:13.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:45:00.583183+00:00, run_end_date=2024-04-15 01:45:13.553677+00:00, run_duration=12.970494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:45:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T01:45:13.568948721Z [2024-04-15T01:45:13.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:45:13.595894242Z [2024-04-15T01:45:13.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:13.600949454Z [2024-04-15T01:45:13.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:12.879535+00:00, run_end_date=2024-04-15 01:45:13.297812+00:00, run_duration=0.418277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:10.640383+00:00, queued_by_job_id=2, pid=1736 2024-04-15T01:45:40.078941739Z [2024-04-15T01:45:40.078+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:46:00.917424881Z [2024-04-15T01:46:00.917+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:46:00.922766119Z [2024-04-15T01:46:00.922+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:46:00.936373157Z [2024-04-15T01:46:00.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:00.994032674Z [2024-04-15T01:46:00.993+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:46:00.994044143Z 2024-04-15T01:46:00.994049041Z 2024-04-15T01:46:00.994053350Z 2024-04-15T01:46:00.994218365Z [2024-04-15T01:46:00.994+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:46:00.994347250Z [2024-04-15T01:46:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:46:00.994455247Z [2024-04-15T01:46:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:46:00.995197681Z [2024-04-15T01:46:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:46:00.995211090Z 2024-04-15T01:46:00.995216002Z 2024-04-15T01:46:00.995220600Z 2024-04-15T01:46:00.997979265Z [2024-04-15T01:46:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:46:00.998166743Z [2024-04-15T01:46:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:46:00.998545969Z [2024-04-15T01:46:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:46:00.998706072Z [2024-04-15T01:46:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:46:00.998891157Z [2024-04-15T01:46:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:46:00.999230534Z [2024-04-15T01:46:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:46:01.398193722Z [2024-04-15T01:46:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status queued for try_number 1 2024-04-15T01:46:01.398294512Z [2024-04-15T01:46:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:46:01.398305912Z [2024-04-15T01:46:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:46:01.410841579Z [2024-04-15T01:46:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9773f718-413c-495c-9a86-b60cf8a245b8 2024-04-15T01:46:01.411257831Z [2024-04-15T01:46:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4ef8851-6deb-4499-bf3d-89a9ac5badf0 2024-04-15T01:46:01.411449595Z [2024-04-15T01:46:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b18bf64-9d3b-43ae-914b-4072b3c786ea 2024-04-15T01:46:03.599303908Z [2024-04-15T01:46:03.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:46:03.599711261Z [2024-04-15T01:46:03.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:44:00+00:00, run_id=scheduled__2024-04-15T01:44:00+00:00, run_start_date=2024-04-15 01:46:00.948484+00:00, run_end_date=2024-04-15 01:46:03.599367+00:00, run_duration=2.650883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:44:00+00:00, data_interval_end=2024-04-15 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:46:03.610610154Z [2024-04-15T01:46:03.610+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:46:03.674028213Z [2024-04-15T01:46:03.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status success for try_number 1 2024-04-15T01:46:03.680219686Z [2024-04-15T01:46:03.679+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:44:00+00:00, map_index=-1, run_start_date=2024-04-15 01:46:02.037367+00:00, run_end_date=2024-04-15 01:46:02.684277+00:00, run_duration=0.64691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:46:00.995987+00:00, queued_by_job_id=2, pid=1753 2024-04-15T01:46:06.597578508Z [2024-04-15T01:46:06.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:46:06.597964530Z [2024-04-15T01:46:06.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:45:00+00:00, run_id=scheduled__2024-04-15T01:45:00+00:00, run_start_date=2024-04-15 01:46:00.949741+00:00, run_end_date=2024-04-15 01:46:06.597479+00:00, run_duration=5.647738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:45:00+00:00, data_interval_end=2024-04-15 01:46:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:46:06.611839851Z [2024-04-15T01:46:06.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:06.618815593Z [2024-04-15T01:46:06.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:46:06.619104077Z [2024-04-15T01:46:06.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:45:00+00:00, run_id=scheduled__2024-04-15T01:45:00+00:00, run_start_date=2024-04-15 01:46:00.950660+00:00, run_end_date=2024-04-15 01:46:06.618711+00:00, run_duration=5.668051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:45:00+00:00, data_interval_end=2024-04-15 01:46:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:46:06.630345296Z [2024-04-15T01:46:06.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:06.661162381Z [2024-04-15T01:46:06.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:46:06.661242655Z [2024-04-15T01:46:06.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:46:06.668044544Z [2024-04-15T01:46:06.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:46:03.969994+00:00, run_end_date=2024-04-15 01:46:05.425792+00:00, run_duration=1.455798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:46:00.995987+00:00, queued_by_job_id=2, pid=1784 2024-04-15T01:46:06.668295001Z [2024-04-15T01:46:06.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:46:03.622687+00:00, run_end_date=2024-04-15 01:46:05.475070+00:00, run_duration=1.852383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:46:00.995987+00:00, queued_by_job_id=2, pid=1774 2024-04-15T01:47:00.147271820Z [2024-04-15T01:47:00.146+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:47:00.159885501Z [2024-04-15T01:47:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:00.212165498Z [2024-04-15T01:47:00.211+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:47:00.212215311Z 2024-04-15T01:47:00.212219685Z 2024-04-15T01:47:00.212227331Z [2024-04-15T01:47:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:47:00.212323020Z [2024-04-15T01:47:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:47:00.212815674Z [2024-04-15T01:47:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:47:00.212838918Z 2024-04-15T01:47:00.212842277Z 2024-04-15T01:47:00.216089260Z [2024-04-15T01:47:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:47:00.217013092Z [2024-04-15T01:47:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:47:00.217536099Z [2024-04-15T01:47:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:47:00.217605381Z [2024-04-15T01:47:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:47:00.425796866Z [2024-04-15T01:47:00.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status queued for try_number 1 2024-04-15T01:47:00.426132357Z [2024-04-15T01:47:00.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status queued for try_number 1 2024-04-15T01:47:00.435154857Z [2024-04-15T01:47:00.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f46018b-3574-4af4-b3de-662860476406 2024-04-15T01:47:00.435447221Z [2024-04-15T01:47:00.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2afc21b6-7746-4816-a20a-91c951a6a335 2024-04-15T01:47:04.042398782Z [2024-04-15T01:47:04.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:47:04.042596252Z [2024-04-15T01:47:04.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:46:00+00:00, run_id=scheduled__2024-04-15T01:46:00+00:00, run_start_date=2024-04-15 01:47:00.174424+00:00, run_end_date=2024-04-15 01:47:04.042259+00:00, run_duration=3.867835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:46:00+00:00, data_interval_end=2024-04-15 01:47:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:47:04.051985693Z [2024-04-15T01:47:04.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:04.095585575Z [2024-04-15T01:47:04.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status success for try_number 1 2024-04-15T01:47:04.105465651Z [2024-04-15T01:47:04.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:46:00+00:00, map_index=-1, run_start_date=2024-04-15 01:47:02.479218+00:00, run_end_date=2024-04-15 01:47:03.886732+00:00, run_duration=1.407514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:47:00.213254+00:00, queued_by_job_id=2, pid=1839 2024-04-15T01:47:05.171831708Z [2024-04-15T01:47:05.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:47:05.172272154Z [2024-04-15T01:47:05.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:46:00+00:00, run_id=scheduled__2024-04-15T01:46:00+00:00, run_start_date=2024-04-15 01:47:00.173226+00:00, run_end_date=2024-04-15 01:47:05.171708+00:00, run_duration=4.998482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:46:00+00:00, data_interval_end=2024-04-15 01:47:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:47:05.187081057Z [2024-04-15T01:47:05.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:05.213551260Z [2024-04-15T01:47:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status success for try_number 1 2024-04-15T01:47:05.218516627Z [2024-04-15T01:47:05.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:46:00+00:00, map_index=-1, run_start_date=2024-04-15 01:47:02.345129+00:00, run_end_date=2024-04-15 01:47:04.263293+00:00, run_duration=1.918164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:47:00.213254+00:00, queued_by_job_id=2, pid=1838 2024-04-15T01:48:00.372171850Z [2024-04-15T01:48:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:00.379905820Z [2024-04-15T01:48:00.379+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:48:00.385829948Z [2024-04-15T01:48:00.385+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:48:00.462056096Z [2024-04-15T01:48:00.461+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:48:00.462083874Z 2024-04-15T01:48:00.462119101Z 2024-04-15T01:48:00.462128112Z 2024-04-15T01:48:00.462149575Z [2024-04-15T01:48:00.461+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:48:00.462158509Z [2024-04-15T01:48:00.462+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:48:00.462209239Z [2024-04-15T01:48:00.462+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:48:00.463750370Z [2024-04-15T01:48:00.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:48:00.463774831Z 2024-04-15T01:48:00.463785077Z 2024-04-15T01:48:00.463793808Z 2024-04-15T01:48:00.473173098Z [2024-04-15T01:48:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:48:00.473621529Z [2024-04-15T01:48:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:48:00.474240973Z [2024-04-15T01:48:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:48:00.474566271Z [2024-04-15T01:48:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:48:00.475032463Z [2024-04-15T01:48:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:48:00.475312162Z [2024-04-15T01:48:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:48:00.892864872Z [2024-04-15T01:48:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status queued for try_number 1 2024-04-15T01:48:00.892886739Z [2024-04-15T01:48:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status queued for try_number 1 2024-04-15T01:48:00.892900668Z [2024-04-15T01:48:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status queued for try_number 1 2024-04-15T01:48:00.907087456Z [2024-04-15T01:48:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0946656e-4372-4c96-8de0-a9b7faf0f481 2024-04-15T01:48:00.907258937Z [2024-04-15T01:48:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70276154-3b17-40b5-a2ea-c49a02d55c73 2024-04-15T01:48:00.907445047Z [2024-04-15T01:48:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7d1ed07-929b-4f15-a3c0-cd425ca311b3 2024-04-15T01:48:03.245126544Z [2024-04-15T01:48:03.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:48:03.246305107Z [2024-04-15T01:48:03.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:46:00+00:00, run_id=scheduled__2024-04-15T01:46:00+00:00, run_start_date=2024-04-15 01:48:00.399606+00:00, run_end_date=2024-04-15 01:48:03.245090+00:00, run_duration=2.845484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:46:00+00:00, data_interval_end=2024-04-15 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:48:03.256492390Z [2024-04-15T01:48:03.256+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:48:03.362727451Z [2024-04-15T01:48:03.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status success for try_number 1 2024-04-15T01:48:03.373201150Z [2024-04-15T01:48:03.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:46:00+00:00, map_index=-1, run_start_date=2024-04-15 01:48:01.540603+00:00, run_end_date=2024-04-15 01:48:02.458474+00:00, run_duration=0.917871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:48:00.465017+00:00, queued_by_job_id=2, pid=1874 2024-04-15T01:48:05.556783334Z [2024-04-15T01:48:05.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:48:05.556985172Z [2024-04-15T01:48:05.556+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:47:00+00:00, run_id=scheduled__2024-04-15T01:47:00+00:00, run_start_date=2024-04-15 01:48:00.400958+00:00, run_end_date=2024-04-15 01:48:05.556723+00:00, run_duration=5.155765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:47:00+00:00, data_interval_end=2024-04-15 01:48:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:48:05.567294161Z [2024-04-15T01:48:05.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:05.600820983Z [2024-04-15T01:48:05.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status success for try_number 1 2024-04-15T01:48:05.606395946Z [2024-04-15T01:48:05.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:47:00+00:00, map_index=-1, run_start_date=2024-04-15 01:48:03.630553+00:00, run_end_date=2024-04-15 01:48:05.085808+00:00, run_duration=1.455255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:48:00.465017+00:00, queued_by_job_id=2, pid=1895 2024-04-15T01:48:06.430741183Z [2024-04-15T01:48:06.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:48:06.431128747Z [2024-04-15T01:48:06.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:47:00+00:00, run_id=scheduled__2024-04-15T01:47:00+00:00, run_start_date=2024-04-15 01:48:00.402161+00:00, run_end_date=2024-04-15 01:48:06.430686+00:00, run_duration=6.028525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:47:00+00:00, data_interval_end=2024-04-15 01:48:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:48:06.440356174Z [2024-04-15T01:48:06.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:06.471990437Z [2024-04-15T01:48:06.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status success for try_number 1 2024-04-15T01:48:06.478163429Z [2024-04-15T01:48:06.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:47:00+00:00, map_index=-1, run_start_date=2024-04-15 01:48:04.055150+00:00, run_end_date=2024-04-15 01:48:05.678992+00:00, run_duration=1.623842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:48:00.465017+00:00, queued_by_job_id=2, pid=1914 2024-04-15T01:49:00.376328364Z [2024-04-15T01:49:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:00.383462450Z [2024-04-15T01:49:00.383+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:49:00.443890095Z [2024-04-15T01:49:00.443+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:49:00.443918907Z 2024-04-15T01:49:00.443925572Z 2024-04-15T01:49:00.444016657Z [2024-04-15T01:49:00.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:49:00.444231376Z [2024-04-15T01:49:00.444+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:49:00.444825033Z [2024-04-15T01:49:00.444+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:49:00.444836976Z 2024-04-15T01:49:00.444840897Z 2024-04-15T01:49:00.447527144Z [2024-04-15T01:49:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:49:00.447716789Z [2024-04-15T01:49:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:49:00.448068316Z [2024-04-15T01:49:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:49:00.448224007Z [2024-04-15T01:49:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:49:00.641520762Z [2024-04-15T01:49:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status queued for try_number 1 2024-04-15T01:49:00.641565896Z [2024-04-15T01:49:00.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status queued for try_number 1 2024-04-15T01:49:00.651711002Z [2024-04-15T01:49:00.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c88f849-ed39-4a6c-93a9-5b62af788bf0 2024-04-15T01:49:00.651806771Z [2024-04-15T01:49:00.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28bf798c-332c-4059-afe3-eaff7e0f34eb 2024-04-15T01:49:04.727292248Z [2024-04-15T01:49:04.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:49:04.727654277Z [2024-04-15T01:49:04.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:48:00+00:00, run_id=scheduled__2024-04-15T01:48:00+00:00, run_start_date=2024-04-15 01:49:00.396434+00:00, run_end_date=2024-04-15 01:49:04.727227+00:00, run_duration=4.330793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:48:00+00:00, data_interval_end=2024-04-15 01:49:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:49:04.740189429Z [2024-04-15T01:49:04.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:04.798166023Z [2024-04-15T01:49:04.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status success for try_number 1 2024-04-15T01:49:04.815855084Z [2024-04-15T01:49:04.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:48:00+00:00, map_index=-1, run_start_date=2024-04-15 01:49:02.808475+00:00, run_end_date=2024-04-15 01:49:04.196092+00:00, run_duration=1.387617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:49:00.445425+00:00, queued_by_job_id=2, pid=1960 2024-04-15T01:49:05.862221446Z [2024-04-15T01:49:05.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:49:05.862639697Z [2024-04-15T01:49:05.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:48:00+00:00, run_id=scheduled__2024-04-15T01:48:00+00:00, run_start_date=2024-04-15 01:49:00.397674+00:00, run_end_date=2024-04-15 01:49:05.862253+00:00, run_duration=5.464579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:48:00+00:00, data_interval_end=2024-04-15 01:49:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:49:05.877185194Z [2024-04-15T01:49:05.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:05.917203539Z [2024-04-15T01:49:05.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status success for try_number 1 2024-04-15T01:49:05.925269462Z [2024-04-15T01:49:05.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:48:00+00:00, map_index=-1, run_start_date=2024-04-15 01:49:02.688238+00:00, run_end_date=2024-04-15 01:49:04.610536+00:00, run_duration=1.922298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:49:00.445425+00:00, queued_by_job_id=2, pid=1959 2024-04-15T01:50:00.233951621Z [2024-04-15T01:50:00.233+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:50:00.247054948Z [2024-04-15T01:50:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:50:00.254447659Z [2024-04-15T01:50:00.254+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:50:00.267373317Z [2024-04-15T01:50:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:00.341362568Z [2024-04-15T01:50:00.341+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:50:00.341377130Z 2024-04-15T01:50:00.341380435Z 2024-04-15T01:50:00.341383852Z 2024-04-15T01:50:00.341386833Z 2024-04-15T01:50:00.341491826Z [2024-04-15T01:50:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:50:00.341618579Z [2024-04-15T01:50:00.341+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:50:00.341736217Z [2024-04-15T01:50:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:50:00.341851551Z [2024-04-15T01:50:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:50:00.342407746Z [2024-04-15T01:50:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:00.342418611Z 2024-04-15T01:50:00.342422204Z 2024-04-15T01:50:00.342425248Z 2024-04-15T01:50:00.342427977Z 2024-04-15T01:50:00.347671702Z [2024-04-15T01:50:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:50:00.347861092Z [2024-04-15T01:50:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:00.348169981Z [2024-04-15T01:50:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:00.348396003Z [2024-04-15T01:50:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:50:00.348649449Z [2024-04-15T01:50:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:00.348825717Z [2024-04-15T01:50:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:50:00.349061842Z [2024-04-15T01:50:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:00.349185695Z [2024-04-15T01:50:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:50:00.628263656Z [2024-04-15T01:50:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:00.628282529Z [2024-04-15T01:50:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:00.628363268Z [2024-04-15T01:50:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:00.628412300Z [2024-04-15T01:50:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:00.637407490Z [2024-04-15T01:50:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30196c83-1413-4dd7-a1e8-735790b0ed8a 2024-04-15T01:50:00.637492871Z [2024-04-15T01:50:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c88ab79-1838-4f23-a5af-6c30a1abdfa9 2024-04-15T01:50:00.637562705Z [2024-04-15T01:50:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8fd1f03-d722-4314-a4d1-84c01ce3eb3c 2024-04-15T01:50:00.637660293Z [2024-04-15T01:50:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34f6c729-351b-4a98-9869-421aee137337 2024-04-15T01:50:03.933985878Z [2024-04-15T01:50:03.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:03.939027893Z [2024-04-15T01:50:03.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:48:00+00:00, run_id=scheduled__2024-04-15T01:48:00+00:00, run_start_date=2024-04-15 01:50:00.280840+00:00, run_end_date=2024-04-15 01:50:03.938341+00:00, run_duration=3.657501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:48:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:50:03.975635516Z [2024-04-15T01:50:03.975+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:50:04.128795330Z [2024-04-15T01:50:04.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:04.140926388Z [2024-04-15T01:50:04.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:48:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:02.096734+00:00, run_end_date=2024-04-15 01:50:03.154732+00:00, run_duration=1.057998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:00.343096+00:00, queued_by_job_id=2, pid=1996 2024-04-15T01:50:05.269087378Z [2024-04-15T01:50:05.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:50:05.269106636Z 2024-04-15T01:50:05.269976842Z [2024-04-15T01:50:05.269+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:50:05.272196765Z [2024-04-15T01:50:05.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:05.272207663Z 2024-04-15T01:50:05.279509662Z [2024-04-15T01:50:05.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:50:05.280610039Z [2024-04-15T01:50:05.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:05.336269990Z [2024-04-15T01:50:05.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:05.336635398Z [2024-04-15T01:50:05.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:05.350199926Z [2024-04-15T01:50:05.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:04.431978+00:00, run_end_date=2024-04-15 01:50:04.994440+00:00, run_duration=0.562462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:00.343096+00:00, queued_by_job_id=2, pid=2037 2024-04-15T01:50:05.350637184Z [2024-04-15T01:50:05.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb180167-079f-4e7b-8f7c-c896ae96e8bc 2024-04-15T01:50:06.541043164Z [2024-04-15T01:50:06.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:06.542381971Z [2024-04-15T01:50:06.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:49:00+00:00, run_id=scheduled__2024-04-15T01:49:00+00:00, run_start_date=2024-04-15 01:50:00.281796+00:00, run_end_date=2024-04-15 01:50:06.541667+00:00, run_duration=6.259871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:49:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:50:06.558547268Z [2024-04-15T01:50:06.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:06.568008391Z [2024-04-15T01:50:06.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:06.568357218Z [2024-04-15T01:50:06.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:49:00+00:00, run_id=scheduled__2024-04-15T01:49:00+00:00, run_start_date=2024-04-15 01:50:00.282864+00:00, run_end_date=2024-04-15 01:50:06.568051+00:00, run_duration=6.285187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:49:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:50:06.577284411Z [2024-04-15T01:50:06.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:06.628736792Z [2024-04-15T01:50:06.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:06.628955433Z [2024-04-15T01:50:06.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:06.637063751Z [2024-04-15T01:50:06.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:49:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:04.261772+00:00, run_end_date=2024-04-15 01:50:06.138294+00:00, run_duration=1.876522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:00.343096+00:00, queued_by_job_id=2, pid=2036 2024-04-15T01:50:06.637383548Z [2024-04-15T01:50:06.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:49:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:04.155583+00:00, run_end_date=2024-04-15 01:50:05.970734+00:00, run_duration=1.815151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:00.343096+00:00, queued_by_job_id=2, pid=2035 2024-04-15T01:50:07.713141624Z [2024-04-15T01:50:07.712+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:50:07.713161033Z 2024-04-15T01:50:07.713457498Z [2024-04-15T01:50:07.713+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:50:07.714236006Z [2024-04-15T01:50:07.713+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:07.714248115Z 2024-04-15T01:50:07.716811946Z [2024-04-15T01:50:07.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:50:07.717004218Z [2024-04-15T01:50:07.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:50:07.789670113Z [2024-04-15T01:50:07.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:07.789697038Z [2024-04-15T01:50:07.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:07.798036911Z [2024-04-15T01:50:07.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45020723-0028-463b-a646-eeb76a27dae1 2024-04-15T01:50:07.798100643Z [2024-04-15T01:50:07.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:07.077720+00:00, run_end_date=2024-04-15 01:50:07.435272+00:00, run_duration=0.357552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:05.273192+00:00, queued_by_job_id=2, pid=2076 2024-04-15T01:50:10.531942546Z [2024-04-15T01:50:10.531+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:50:10.531969235Z 2024-04-15T01:50:10.532234437Z [2024-04-15T01:50:10.531+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:50:10.532800500Z [2024-04-15T01:50:10.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:10.532811226Z 2024-04-15T01:50:10.534957229Z [2024-04-15T01:50:10.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:10.535109073Z [2024-04-15T01:50:10.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:10.612554233Z [2024-04-15T01:50:10.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:10.612721572Z [2024-04-15T01:50:10.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:10.625014428Z [2024-04-15T01:50:10.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc53c5d6-0685-40f6-9792-e28630b36650 2024-04-15T01:50:10.625267602Z [2024-04-15T01:50:10.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=0, run_start_date=2024-04-15 01:50:09.607884+00:00, run_end_date=2024-04-15 01:50:09.984279+00:00, run_duration=0.376395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:07.714493+00:00, queued_by_job_id=2, pid=2088 2024-04-15T01:50:13.219680059Z [2024-04-15T01:50:13.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:13.220152333Z [2024-04-15T01:50:13.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:45:00+00:00, run_id=scheduled__2024-04-15T01:45:00+00:00, run_start_date=2024-04-15 01:50:00.279654+00:00, run_end_date=2024-04-15 01:50:13.219772+00:00, run_duration=12.940118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:45:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T01:50:13.232258712Z [2024-04-15T01:50:13.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:50:13.375999551Z [2024-04-15T01:50:13.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:13.380002662Z [2024-04-15T01:50:13.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:12.655260+00:00, run_end_date=2024-04-15 01:50:13.149846+00:00, run_duration=0.494586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:10.533221+00:00, queued_by_job_id=2, pid=2100 2024-04-15T01:50:40.166188948Z [2024-04-15T01:50:40.165+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:51:00.078142724Z [2024-04-15T01:51:00.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:51:00.095678644Z [2024-04-15T01:51:00.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:00.152585841Z [2024-04-15T01:51:00.152+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:51:00.152600267Z 2024-04-15T01:51:00.152603690Z 2024-04-15T01:51:00.152760593Z [2024-04-15T01:51:00.152+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:51:00.152888424Z [2024-04-15T01:51:00.152+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:51:00.153446183Z [2024-04-15T01:51:00.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:51:00.153458872Z 2024-04-15T01:51:00.153464735Z 2024-04-15T01:51:00.158812763Z [2024-04-15T01:51:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:51:00.158934363Z [2024-04-15T01:51:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:51:00.159180061Z [2024-04-15T01:51:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:51:00.159247159Z [2024-04-15T01:51:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:51:00.366771283Z [2024-04-15T01:51:00.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:51:00.367124808Z [2024-04-15T01:51:00.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:51:00.378110597Z [2024-04-15T01:51:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96880bf0-6b18-4254-862b-96728ea2dc40 2024-04-15T01:51:00.378363341Z [2024-04-15T01:51:00.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d949332-1de7-4e95-beb4-dddfad957ddb 2024-04-15T01:51:03.689278234Z [2024-04-15T01:51:03.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:51:03.689652181Z [2024-04-15T01:51:03.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:51:00.110391+00:00, run_end_date=2024-04-15 01:51:03.689339+00:00, run_duration=3.578948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:51:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:51:03.705736744Z [2024-04-15T01:51:03.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:04.104549023Z [2024-04-15T01:51:04.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:51:04.108944467Z [2024-04-15T01:51:04.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:51:02.210363+00:00, run_end_date=2024-04-15 01:51:03.527580+00:00, run_duration=1.317217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:51:00.153957+00:00, queued_by_job_id=2, pid=2136 2024-04-15T01:51:04.429982224Z [2024-04-15T01:51:04.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:51:04.430290123Z [2024-04-15T01:51:04.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:51:00.108951+00:00, run_end_date=2024-04-15 01:51:04.429944+00:00, run_duration=4.320993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:51:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:51:04.440065881Z [2024-04-15T01:51:04.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:04.482574974Z [2024-04-15T01:51:04.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:51:04.488149441Z [2024-04-15T01:51:04.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:51:02.399256+00:00, run_end_date=2024-04-15 01:51:04.325611+00:00, run_duration=1.926355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:51:00.153957+00:00, queued_by_job_id=2, pid=2137 2024-04-15T01:52:01.042920216Z [2024-04-15T01:52:01.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:52:01.051197788Z [2024-04-15T01:52:01.050+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:52:01.062547561Z [2024-04-15T01:52:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:01.126990356Z [2024-04-15T01:52:01.126+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:52:01.127003250Z 2024-04-15T01:52:01.127007158Z 2024-04-15T01:52:01.127010158Z 2024-04-15T01:52:01.127186204Z [2024-04-15T01:52:01.126+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:52:01.127359467Z [2024-04-15T01:52:01.127+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:52:01.127551131Z [2024-04-15T01:52:01.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:52:01.131448165Z [2024-04-15T01:52:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:52:01.131460890Z 2024-04-15T01:52:01.131468611Z 2024-04-15T01:52:01.131472015Z 2024-04-15T01:52:01.134868887Z [2024-04-15T01:52:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:52:01.135074042Z [2024-04-15T01:52:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:52:01.135418588Z [2024-04-15T01:52:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:52:01.135609322Z [2024-04-15T01:52:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:52:01.136005786Z [2024-04-15T01:52:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:52:01.136201271Z [2024-04-15T01:52:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:52:01.551609273Z [2024-04-15T01:52:01.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:52:01.551790565Z [2024-04-15T01:52:01.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status queued for try_number 1 2024-04-15T01:52:01.552052585Z [2024-04-15T01:52:01.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status queued for try_number 1 2024-04-15T01:52:01.573485764Z [2024-04-15T01:52:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80b41034-f4ce-4153-97fb-8566144a865e 2024-04-15T01:52:01.573766373Z [2024-04-15T01:52:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b1909e3-f903-44e8-960b-c372f1de3531 2024-04-15T01:52:01.574035793Z [2024-04-15T01:52:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79c94c74-f248-4216-a4b7-851e61242b24 2024-04-15T01:52:02.774502305Z [2024-04-15T01:52:02.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:52:02.774765069Z [2024-04-15T01:52:02.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:52:01.074299+00:00, run_end_date=2024-04-15 01:52:02.774455+00:00, run_duration=1.700156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:52:02.782534334Z [2024-04-15T01:52:02.782+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:52:02.835770095Z [2024-04-15T01:52:02.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:52:02.841140424Z [2024-04-15T01:52:02.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:52:02.012842+00:00, run_end_date=2024-04-15 01:52:02.514893+00:00, run_duration=0.502051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:52:01.132506+00:00, queued_by_job_id=2, pid=2172 2024-04-15T01:52:06.141852579Z [2024-04-15T01:52:06.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:52:06.142117067Z [2024-04-15T01:52:06.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:51:00+00:00, run_id=scheduled__2024-04-15T01:51:00+00:00, run_start_date=2024-04-15 01:52:01.075500+00:00, run_end_date=2024-04-15 01:52:06.141791+00:00, run_duration=5.066291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:51:00+00:00, data_interval_end=2024-04-15 01:52:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:52:06.150603481Z [2024-04-15T01:52:06.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:06.157534163Z [2024-04-15T01:52:06.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:52:06.157678141Z [2024-04-15T01:52:06.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:51:00+00:00, run_id=scheduled__2024-04-15T01:51:00+00:00, run_start_date=2024-04-15 01:52:01.076496+00:00, run_end_date=2024-04-15 01:52:06.157434+00:00, run_duration=5.080938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:51:00+00:00, data_interval_end=2024-04-15 01:52:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:52:06.167204017Z [2024-04-15T01:52:06.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:06.201853715Z [2024-04-15T01:52:06.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status success for try_number 1 2024-04-15T01:52:06.201944869Z [2024-04-15T01:52:06.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status success for try_number 1 2024-04-15T01:52:06.207861177Z [2024-04-15T01:52:06.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:51:00+00:00, map_index=-1, run_start_date=2024-04-15 01:52:03.666794+00:00, run_end_date=2024-04-15 01:52:05.107130+00:00, run_duration=1.440336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:52:01.132506+00:00, queued_by_job_id=2, pid=2193 2024-04-15T01:52:06.208031354Z [2024-04-15T01:52:06.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:51:00+00:00, map_index=-1, run_start_date=2024-04-15 01:52:04.133369+00:00, run_end_date=2024-04-15 01:52:05.838247+00:00, run_duration=1.704878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:52:01.132506+00:00, queued_by_job_id=2, pid=2212 2024-04-15T01:53:00.732517802Z [2024-04-15T01:53:00.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:00.761415002Z [2024-04-15T01:53:00.759+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:53:00.848979979Z [2024-04-15T01:53:00.848+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:53:00.848999443Z 2024-04-15T01:53:00.849015693Z 2024-04-15T01:53:00.849340481Z [2024-04-15T01:53:00.849+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:53:00.849516554Z [2024-04-15T01:53:00.849+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:53:00.852023531Z [2024-04-15T01:53:00.850+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:53:00.852035831Z 2024-04-15T01:53:00.852039764Z 2024-04-15T01:53:00.858012595Z [2024-04-15T01:53:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:53:00.858024450Z [2024-04-15T01:53:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:53:00.858027905Z [2024-04-15T01:53:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:53:00.858233430Z [2024-04-15T01:53:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:53:01.091849227Z [2024-04-15T01:53:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status queued for try_number 1 2024-04-15T01:53:01.092152490Z [2024-04-15T01:53:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status queued for try_number 1 2024-04-15T01:53:01.102124983Z [2024-04-15T01:53:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b0393c2-04e5-49ae-8684-ce647618616c 2024-04-15T01:53:01.106324282Z [2024-04-15T01:53:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to e65db3e2-9702-41a4-8153-c55eeaaef51e 2024-04-15T01:53:06.087828258Z [2024-04-15T01:53:06.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:53:06.088823974Z [2024-04-15T01:53:06.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:52:00+00:00, run_id=scheduled__2024-04-15T01:52:00+00:00, run_start_date=2024-04-15 01:53:00.773570+00:00, run_end_date=2024-04-15 01:53:06.088424+00:00, run_duration=5.314854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:52:00+00:00, data_interval_end=2024-04-15 01:53:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:53:06.101324088Z [2024-04-15T01:53:06.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:06.108915720Z [2024-04-15T01:53:06.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:53:06.109535940Z [2024-04-15T01:53:06.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:52:00+00:00, run_id=scheduled__2024-04-15T01:52:00+00:00, run_start_date=2024-04-15 01:53:00.772221+00:00, run_end_date=2024-04-15 01:53:06.109139+00:00, run_duration=5.336918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:52:00+00:00, data_interval_end=2024-04-15 01:53:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:53:06.121981112Z [2024-04-15T01:53:06.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:06.163132792Z [2024-04-15T01:53:06.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status success for try_number 1 2024-04-15T01:53:06.163388636Z [2024-04-15T01:53:06.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status success for try_number 1 2024-04-15T01:53:06.171074659Z [2024-04-15T01:53:06.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:52:00+00:00, map_index=-1, run_start_date=2024-04-15 01:53:03.650378+00:00, run_end_date=2024-04-15 01:53:05.254510+00:00, run_duration=1.604132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:53:00.850872+00:00, queued_by_job_id=2, pid=2257 2024-04-15T01:53:06.171395932Z [2024-04-15T01:53:06.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:52:00+00:00, map_index=-1, run_start_date=2024-04-15 01:53:03.496430+00:00, run_end_date=2024-04-15 01:53:05.482183+00:00, run_duration=1.985753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:53:00.850872+00:00, queued_by_job_id=2, pid=2256 2024-04-15T01:54:00.098807294Z [2024-04-15T01:54:00.098+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:54:00.104270241Z [2024-04-15T01:54:00.104+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:54:00.114833461Z [2024-04-15T01:54:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:00.179104694Z [2024-04-15T01:54:00.178+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:54:00.179124389Z 2024-04-15T01:54:00.179128876Z 2024-04-15T01:54:00.179132142Z 2024-04-15T01:54:00.179325672Z [2024-04-15T01:54:00.179+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:54:00.179485116Z [2024-04-15T01:54:00.179+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:54:00.179615425Z [2024-04-15T01:54:00.179+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:54:00.180212004Z [2024-04-15T01:54:00.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:54:00.180222783Z 2024-04-15T01:54:00.180226877Z 2024-04-15T01:54:00.180230391Z 2024-04-15T01:54:00.183822091Z [2024-04-15T01:54:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:54:00.184011672Z [2024-04-15T01:54:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:54:00.184287212Z [2024-04-15T01:54:00.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:54:00.184433318Z [2024-04-15T01:54:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:54:00.184768895Z [2024-04-15T01:54:00.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:54:00.184908392Z [2024-04-15T01:54:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:54:00.508781250Z [2024-04-15T01:54:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status queued for try_number 1 2024-04-15T01:54:00.508923062Z [2024-04-15T01:54:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status queued for try_number 1 2024-04-15T01:54:00.509014750Z [2024-04-15T01:54:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status queued for try_number 1 2024-04-15T01:54:00.518629728Z [2024-04-15T01:54:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48a8f84a-085d-4c8b-8d38-3d8da24d7728 2024-04-15T01:54:00.518809174Z [2024-04-15T01:54:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66e96acf-1665-4c20-8cc3-ca823459d542 2024-04-15T01:54:00.518942244Z [2024-04-15T01:54:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd1c8314-4315-4bad-90e4-d4f89a1edad9 2024-04-15T01:54:03.144794174Z [2024-04-15T01:54:03.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:54:03.145256343Z [2024-04-15T01:54:03.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:52:00+00:00, run_id=scheduled__2024-04-15T01:52:00+00:00, run_start_date=2024-04-15 01:54:00.127775+00:00, run_end_date=2024-04-15 01:54:03.144899+00:00, run_duration=3.017124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:52:00+00:00, data_interval_end=2024-04-15 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:54:03.154827238Z [2024-04-15T01:54:03.154+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:54:03.211741831Z [2024-04-15T01:54:03.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status success for try_number 1 2024-04-15T01:54:03.223262343Z [2024-04-15T01:54:03.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:52:00+00:00, map_index=-1, run_start_date=2024-04-15 01:54:01.178749+00:00, run_end_date=2024-04-15 01:54:01.891676+00:00, run_duration=0.712927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:54:00.181171+00:00, queued_by_job_id=2, pid=2292 2024-04-15T01:54:04.933189745Z [2024-04-15T01:54:04.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:54:04.933602434Z [2024-04-15T01:54:04.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:53:00+00:00, run_id=scheduled__2024-04-15T01:53:00+00:00, run_start_date=2024-04-15 01:54:00.129464+00:00, run_end_date=2024-04-15 01:54:04.933249+00:00, run_duration=4.803785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:53:00+00:00, data_interval_end=2024-04-15 01:54:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:54:04.947992002Z [2024-04-15T01:54:04.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:04.955132367Z [2024-04-15T01:54:04.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:54:04.955468857Z [2024-04-15T01:54:04.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:53:00+00:00, run_id=scheduled__2024-04-15T01:53:00+00:00, run_start_date=2024-04-15 01:54:00.130369+00:00, run_end_date=2024-04-15 01:54:04.955019+00:00, run_duration=4.82465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:53:00+00:00, data_interval_end=2024-04-15 01:54:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:54:04.965411220Z [2024-04-15T01:54:04.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:04.996382472Z [2024-04-15T01:54:04.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status success for try_number 1 2024-04-15T01:54:04.996401629Z [2024-04-15T01:54:04.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status success for try_number 1 2024-04-15T01:54:05.003990505Z [2024-04-15T01:54:05.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:53:00+00:00, map_index=-1, run_start_date=2024-04-15 01:54:02.814544+00:00, run_end_date=2024-04-15 01:54:04.805733+00:00, run_duration=1.991189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:54:00.181171+00:00, queued_by_job_id=2, pid=2323 2024-04-15T01:54:05.004371218Z [2024-04-15T01:54:05.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:53:00+00:00, map_index=-1, run_start_date=2024-04-15 01:54:02.763065+00:00, run_end_date=2024-04-15 01:54:04.177604+00:00, run_duration=1.414539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:54:00.181171+00:00, queued_by_job_id=2, pid=2322 2024-04-15T01:55:00.144311418Z [2024-04-15T01:55:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:00.155023742Z [2024-04-15T01:55:00.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:55:00.161249158Z [2024-04-15T01:55:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:55:00.302587227Z [2024-04-15T01:55:00.299+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:55:00.302604373Z 2024-04-15T01:55:00.302610510Z 2024-04-15T01:55:00.302614109Z 2024-04-15T01:55:00.302617192Z [2024-04-15T01:55:00.299+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:55:00.302620100Z [2024-04-15T01:55:00.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:55:00.302623224Z [2024-04-15T01:55:00.299+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:55:00.302626745Z [2024-04-15T01:55:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:00.302629883Z 2024-04-15T01:55:00.302632998Z 2024-04-15T01:55:00.302635808Z 2024-04-15T01:55:00.310335031Z [2024-04-15T01:55:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:55:00.311126068Z [2024-04-15T01:55:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:00.311597514Z [2024-04-15T01:55:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:55:00.313455015Z [2024-04-15T01:55:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:55:00.313466928Z [2024-04-15T01:55:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:55:00.313847780Z [2024-04-15T01:55:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:55:00.714277813Z [2024-04-15T01:55:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:00.714289861Z [2024-04-15T01:55:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:00.715346940Z [2024-04-15T01:55:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:00.736500923Z [2024-04-15T01:55:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ef2ec27-c19b-4add-a848-0b3b61f28892 2024-04-15T01:55:00.736509842Z [2024-04-15T01:55:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a086cef-d2de-4b23-bdd3-6cbc181044aa 2024-04-15T01:55:00.736517721Z [2024-04-15T01:55:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e8b905d-a164-45ec-a705-e11c2e997f1f 2024-04-15T01:55:05.502953915Z [2024-04-15T01:55:05.502+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:55:05.502978202Z 2024-04-15T01:55:05.502990602Z [2024-04-15T01:55:05.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:55:05.502994271Z [2024-04-15T01:55:05.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:05.502997338Z 2024-04-15T01:55:05.505564424Z [2024-04-15T01:55:05.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:55:05.505646575Z [2024-04-15T01:55:05.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:05.583209858Z [2024-04-15T01:55:05.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:05.583221430Z [2024-04-15T01:55:05.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:05.598586403Z [2024-04-15T01:55:05.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87cc10b5-2b24-4d3b-a8bc-bde2eee2689d 2024-04-15T01:55:05.598740532Z [2024-04-15T01:55:05.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:03.776293+00:00, run_end_date=2024-04-15 01:55:04.726647+00:00, run_duration=0.950354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:00.301234+00:00, queued_by_job_id=2, pid=2370 2024-04-15T01:55:06.764605981Z [2024-04-15T01:55:06.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:55:06.764622567Z [2024-04-15T01:55:06.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:54:00+00:00, run_id=scheduled__2024-04-15T01:54:00+00:00, run_start_date=2024-04-15 01:55:00.184236+00:00, run_end_date=2024-04-15 01:55:06.760950+00:00, run_duration=6.576714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:54:00+00:00, data_interval_end=2024-04-15 01:55:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:55:06.771038677Z [2024-04-15T01:55:06.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:06.776942769Z [2024-04-15T01:55:06.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:55:06.776957549Z [2024-04-15T01:55:06.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:54:00+00:00, run_id=scheduled__2024-04-15T01:54:00+00:00, run_start_date=2024-04-15 01:55:00.186358+00:00, run_end_date=2024-04-15 01:55:06.776029+00:00, run_duration=6.589671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:54:00+00:00, data_interval_end=2024-04-15 01:55:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:55:06.786089159Z [2024-04-15T01:55:06.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:06.837914662Z [2024-04-15T01:55:06.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:06.837952062Z [2024-04-15T01:55:06.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:06.842702913Z [2024-04-15T01:55:06.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:54:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:04.958833+00:00, run_end_date=2024-04-15 01:55:06.254170+00:00, run_duration=1.295337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:00.301234+00:00, queued_by_job_id=2, pid=2399 2024-04-15T01:55:06.842828308Z [2024-04-15T01:55:06.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:54:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:04.767645+00:00, run_end_date=2024-04-15 01:55:06.613136+00:00, run_duration=1.845491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:00.301234+00:00, queued_by_job_id=2, pid=2398 2024-04-15T01:55:08.246348748Z [2024-04-15T01:55:08.243+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:55:08.246363326Z 2024-04-15T01:55:08.246366660Z [2024-04-15T01:55:08.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:55:08.246369986Z [2024-04-15T01:55:08.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:08.246372970Z 2024-04-15T01:55:08.246468603Z [2024-04-15T01:55:08.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:55:08.246543077Z [2024-04-15T01:55:08.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:55:08.310186255Z [2024-04-15T01:55:08.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:08.313090669Z [2024-04-15T01:55:08.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:08.323820581Z [2024-04-15T01:55:08.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to f854ae00-0b93-4afc-84bf-705968dcfd54 2024-04-15T01:55:08.324275804Z [2024-04-15T01:55:08.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:07.528039+00:00, run_end_date=2024-04-15 01:55:07.927761+00:00, run_duration=0.399722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:05.503088+00:00, queued_by_job_id=2, pid=2429 2024-04-15T01:55:11.676875218Z [2024-04-15T01:55:11.676+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:55:11.676890555Z 2024-04-15T01:55:11.676930305Z [2024-04-15T01:55:11.676+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:55:11.677378190Z [2024-04-15T01:55:11.677+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:11.677385614Z 2024-04-15T01:55:11.679136647Z [2024-04-15T01:55:11.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:55:11.679233059Z [2024-04-15T01:55:11.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:11.761847950Z [2024-04-15T01:55:11.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:11.761864539Z [2024-04-15T01:55:11.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:11.778073125Z [2024-04-15T01:55:11.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41a8dfa9-fd88-4bff-b8c8-091c5c7289d4 2024-04-15T01:55:11.778090002Z [2024-04-15T01:55:11.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=0, run_start_date=2024-04-15 01:55:10.464898+00:00, run_end_date=2024-04-15 01:55:10.928874+00:00, run_duration=0.463976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:08.244926+00:00, queued_by_job_id=2, pid=2441 2024-04-15T01:55:14.482768831Z [2024-04-15T01:55:14.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:55:14.483308227Z [2024-04-15T01:55:14.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:55:00.171267+00:00, run_end_date=2024-04-15 01:55:14.482784+00:00, run_duration=14.311517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:55:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T01:55:14.501881481Z [2024-04-15T01:55:14.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:55:14.560174193Z [2024-04-15T01:55:14.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:14.568945238Z [2024-04-15T01:55:14.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:13.780927+00:00, run_end_date=2024-04-15 01:55:14.236088+00:00, run_duration=0.455161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:11.677620+00:00, queued_by_job_id=2, pid=2453 2024-04-15T01:55:40.222787860Z [2024-04-15T01:55:40.222+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:56:00.097650340Z [2024-04-15T01:56:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:56:00.108976452Z [2024-04-15T01:56:00.108+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:56:00.128457399Z [2024-04-15T01:56:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:00.223027485Z [2024-04-15T01:56:00.222+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:56:00.223043168Z 2024-04-15T01:56:00.223048222Z 2024-04-15T01:56:00.223052318Z 2024-04-15T01:56:00.223207074Z [2024-04-15T01:56:00.223+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:56:00.223397376Z [2024-04-15T01:56:00.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:56:00.223974679Z [2024-04-15T01:56:00.223+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:56:00.224613979Z [2024-04-15T01:56:00.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:56:00.224624553Z 2024-04-15T01:56:00.224628387Z 2024-04-15T01:56:00.224631834Z 2024-04-15T01:56:00.228103778Z [2024-04-15T01:56:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:56:00.228292089Z [2024-04-15T01:56:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:56:00.230383856Z [2024-04-15T01:56:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:56:00.230853369Z [2024-04-15T01:56:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:56:00.231221703Z [2024-04-15T01:56:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:56:00.231404916Z [2024-04-15T01:56:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:56:00.561564955Z [2024-04-15T01:56:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status queued for try_number 1 2024-04-15T01:56:00.561584706Z [2024-04-15T01:56:00.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:56:00.561736399Z [2024-04-15T01:56:00.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:56:00.582282286Z [2024-04-15T01:56:00.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7e13668-f38e-45f2-b58f-b44101dda571 2024-04-15T01:56:00.582546912Z [2024-04-15T01:56:00.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef063217-b4d5-433c-bbb4-dc2b6578633e 2024-04-15T01:56:00.582709910Z [2024-04-15T01:56:00.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39d67bdf-daff-443e-8e9f-fdf089c7f329 2024-04-15T01:56:03.230014857Z [2024-04-15T01:56:03.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:56:03.230306892Z [2024-04-15T01:56:03.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:54:00+00:00, run_id=scheduled__2024-04-15T01:54:00+00:00, run_start_date=2024-04-15 01:56:00.143662+00:00, run_end_date=2024-04-15 01:56:03.229950+00:00, run_duration=3.086288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:54:00+00:00, data_interval_end=2024-04-15 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:56:03.237567234Z [2024-04-15T01:56:03.237+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:56:03.299649981Z [2024-04-15T01:56:03.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status success for try_number 1 2024-04-15T01:56:03.307409262Z [2024-04-15T01:56:03.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:54:00+00:00, map_index=-1, run_start_date=2024-04-15 01:56:01.579292+00:00, run_end_date=2024-04-15 01:56:02.533231+00:00, run_duration=0.953939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:56:00.225353+00:00, queued_by_job_id=2, pid=2469 2024-04-15T01:56:04.972627132Z [2024-04-15T01:56:04.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:56:04.972831815Z [2024-04-15T01:56:04.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:55:00+00:00, run_id=scheduled__2024-04-15T01:55:00+00:00, run_start_date=2024-04-15 01:56:00.148425+00:00, run_end_date=2024-04-15 01:56:04.972574+00:00, run_duration=4.824149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:55:00+00:00, data_interval_end=2024-04-15 01:56:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:56:04.981822766Z [2024-04-15T01:56:04.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:05.021311756Z [2024-04-15T01:56:05.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:56:05.025557342Z [2024-04-15T01:56:05.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:56:03.226233+00:00, run_end_date=2024-04-15 01:56:04.519620+00:00, run_duration=1.293387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:56:00.225353+00:00, queued_by_job_id=2, pid=2490 2024-04-15T01:56:05.854118152Z [2024-04-15T01:56:05.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:56:05.855448732Z [2024-04-15T01:56:05.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:55:00+00:00, run_id=scheduled__2024-04-15T01:55:00+00:00, run_start_date=2024-04-15 01:56:00.147038+00:00, run_end_date=2024-04-15 01:56:05.854087+00:00, run_duration=5.707049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:55:00+00:00, data_interval_end=2024-04-15 01:56:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:56:05.886455968Z [2024-04-15T01:56:05.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:05.968423031Z [2024-04-15T01:56:05.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:56:05.976905471Z [2024-04-15T01:56:05.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:56:03.599958+00:00, run_end_date=2024-04-15 01:56:05.650249+00:00, run_duration=2.050291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:56:00.225353+00:00, queued_by_job_id=2, pid=2509 2024-04-15T01:57:00.799615751Z [2024-04-15T01:57:00.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:00.820595104Z [2024-04-15T01:57:00.819+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:57:00.872581995Z [2024-04-15T01:57:00.868+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:57:00.872612809Z 2024-04-15T01:57:00.872616434Z 2024-04-15T01:57:00.872619891Z [2024-04-15T01:57:00.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:57:00.872623304Z [2024-04-15T01:57:00.869+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:57:00.872627232Z [2024-04-15T01:57:00.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:57:00.872641572Z 2024-04-15T01:57:00.872644802Z 2024-04-15T01:57:00.872650718Z [2024-04-15T01:57:00.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:57:00.872757093Z [2024-04-15T01:57:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:57:00.872762842Z [2024-04-15T01:57:00.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:57:00.872766060Z [2024-04-15T01:57:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:57:01.152632643Z [2024-04-15T01:57:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status queued for try_number 1 2024-04-15T01:57:01.152677296Z [2024-04-15T01:57:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status queued for try_number 1 2024-04-15T01:57:01.165709626Z [2024-04-15T01:57:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 304633ef-7e35-43c1-9e69-e4e21c1ba5e1 2024-04-15T01:57:01.165773397Z [2024-04-15T01:57:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d0172e5-3e6e-474b-90f4-f1a96b4b0cf6 2024-04-15T01:57:04.594800671Z [2024-04-15T01:57:04.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:57:04.595020370Z [2024-04-15T01:57:04.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:56:00+00:00, run_id=scheduled__2024-04-15T01:56:00+00:00, run_start_date=2024-04-15 01:57:00.837167+00:00, run_end_date=2024-04-15 01:57:04.594738+00:00, run_duration=3.757571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:56:00+00:00, data_interval_end=2024-04-15 01:57:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:57:04.615371684Z [2024-04-15T01:57:04.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:04.656774773Z [2024-04-15T01:57:04.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status success for try_number 1 2024-04-15T01:57:04.662081240Z [2024-04-15T01:57:04.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:56:00+00:00, map_index=-1, run_start_date=2024-04-15 01:57:03.109673+00:00, run_end_date=2024-04-15 01:57:04.472115+00:00, run_duration=1.362442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:57:00.870279+00:00, queued_by_job_id=2, pid=2553 2024-04-15T01:57:05.336511869Z [2024-04-15T01:57:05.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:57:05.336742342Z [2024-04-15T01:57:05.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:56:00+00:00, run_id=scheduled__2024-04-15T01:56:00+00:00, run_start_date=2024-04-15 01:57:00.838536+00:00, run_end_date=2024-04-15 01:57:05.336445+00:00, run_duration=4.497909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:56:00+00:00, data_interval_end=2024-04-15 01:57:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:57:05.345424191Z [2024-04-15T01:57:05.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:05.371573824Z [2024-04-15T01:57:05.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status success for try_number 1 2024-04-15T01:57:05.380638989Z [2024-04-15T01:57:05.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:56:00+00:00, map_index=-1, run_start_date=2024-04-15 01:57:03.245693+00:00, run_end_date=2024-04-15 01:57:04.948949+00:00, run_duration=1.703256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:57:00.870279+00:00, queued_by_job_id=2, pid=2554 2024-04-15T01:58:00.801361290Z [2024-04-15T01:58:00.799+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:58:00.811186759Z [2024-04-15T01:58:00.810+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:58:00.845381137Z [2024-04-15T01:58:00.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:00.936554448Z [2024-04-15T01:58:00.936+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:58:00.936567560Z 2024-04-15T01:58:00.936572633Z 2024-04-15T01:58:00.936586960Z 2024-04-15T01:58:00.936649242Z [2024-04-15T01:58:00.936+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:58:00.936845096Z [2024-04-15T01:58:00.936+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:58:00.936991724Z [2024-04-15T01:58:00.936+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:58:00.937682678Z [2024-04-15T01:58:00.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:58:00.937694949Z 2024-04-15T01:58:00.937699285Z 2024-04-15T01:58:00.937703108Z 2024-04-15T01:58:00.941375482Z [2024-04-15T01:58:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:58:00.941586325Z [2024-04-15T01:58:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:58:00.942017901Z [2024-04-15T01:58:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:58:00.942195655Z [2024-04-15T01:58:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:58:00.942507129Z [2024-04-15T01:58:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:58:00.942702224Z [2024-04-15T01:58:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:58:01.275435595Z [2024-04-15T01:58:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status queued for try_number 1 2024-04-15T01:58:01.275525698Z [2024-04-15T01:58:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status queued for try_number 1 2024-04-15T01:58:01.275657749Z [2024-04-15T01:58:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status queued for try_number 1 2024-04-15T01:58:01.289539095Z [2024-04-15T01:58:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37001400-0dfe-4bf2-8bf4-5c14f8a89fbd 2024-04-15T01:58:01.289757306Z [2024-04-15T01:58:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f836ae0-6c5e-4884-89cf-351951d9722a 2024-04-15T01:58:01.289940094Z [2024-04-15T01:58:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dd9df00-0968-4125-8741-24d3d6c797ad 2024-04-15T01:58:03.748488383Z [2024-04-15T01:58:03.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:58:03.749011122Z [2024-04-15T01:58:03.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:56:00+00:00, run_id=scheduled__2024-04-15T01:56:00+00:00, run_start_date=2024-04-15 01:58:00.868207+00:00, run_end_date=2024-04-15 01:58:03.748430+00:00, run_duration=2.880223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:56:00+00:00, data_interval_end=2024-04-15 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:58:03.769460842Z [2024-04-15T01:58:03.769+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:58:03.931688025Z [2024-04-15T01:58:03.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status success for try_number 1 2024-04-15T01:58:03.956213910Z [2024-04-15T01:58:03.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:56:00+00:00, map_index=-1, run_start_date=2024-04-15 01:58:02.062758+00:00, run_end_date=2024-04-15 01:58:02.795102+00:00, run_duration=0.732344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:58:00.938871+00:00, queued_by_job_id=2, pid=2589 2024-04-15T01:58:06.402558816Z [2024-04-15T01:58:06.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:58:06.402955425Z [2024-04-15T01:58:06.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:57:00+00:00, run_id=scheduled__2024-04-15T01:57:00+00:00, run_start_date=2024-04-15 01:58:00.870566+00:00, run_end_date=2024-04-15 01:58:06.402492+00:00, run_duration=5.531926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:57:00+00:00, data_interval_end=2024-04-15 01:58:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:58:06.411950608Z [2024-04-15T01:58:06.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:06.420582934Z [2024-04-15T01:58:06.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:58:06.420813425Z [2024-04-15T01:58:06.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:57:00+00:00, run_id=scheduled__2024-04-15T01:57:00+00:00, run_start_date=2024-04-15 01:58:00.872424+00:00, run_end_date=2024-04-15 01:58:06.420492+00:00, run_duration=5.548068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:57:00+00:00, data_interval_end=2024-04-15 01:58:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:58:06.432042221Z [2024-04-15T01:58:06.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:06.480804776Z [2024-04-15T01:58:06.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status success for try_number 1 2024-04-15T01:58:06.481355389Z [2024-04-15T01:58:06.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status success for try_number 1 2024-04-15T01:58:06.490065301Z [2024-04-15T01:58:06.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:57:00+00:00, map_index=-1, run_start_date=2024-04-15 01:58:04.198861+00:00, run_end_date=2024-04-15 01:58:05.994201+00:00, run_duration=1.79534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:58:00.938871+00:00, queued_by_job_id=2, pid=2618 2024-04-15T01:58:06.490292650Z [2024-04-15T01:58:06.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:57:00+00:00, map_index=-1, run_start_date=2024-04-15 01:58:04.427143+00:00, run_end_date=2024-04-15 01:58:05.940201+00:00, run_duration=1.513058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:58:00.938871+00:00, queued_by_job_id=2, pid=2619 2024-04-15T01:59:00.459551744Z [2024-04-15T01:59:00.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:00.466113613Z [2024-04-15T01:59:00.465+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:59:00.518016944Z [2024-04-15T01:59:00.517+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:59:00.518025256Z 2024-04-15T01:59:00.518046909Z 2024-04-15T01:59:00.518957956Z [2024-04-15T01:59:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:59:00.519277731Z [2024-04-15T01:59:00.519+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T01:59:00.520487539Z [2024-04-15T01:59:00.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:59:00.520492793Z 2024-04-15T01:59:00.520495999Z 2024-04-15T01:59:00.526015726Z [2024-04-15T01:59:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:59:00.526201675Z [2024-04-15T01:59:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:59:00.526512506Z [2024-04-15T01:59:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:59:00.526640623Z [2024-04-15T01:59:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:59:00.698018997Z [2024-04-15T01:59:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status queued for try_number 1 2024-04-15T01:59:00.698167857Z [2024-04-15T01:59:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status queued for try_number 1 2024-04-15T01:59:00.709696701Z [2024-04-15T01:59:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 837d0e39-4097-45d1-8977-f7d3c8b15be9 2024-04-15T01:59:00.709807919Z [2024-04-15T01:59:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecc55e8c-918b-4bca-8d3e-759f47e20a05 2024-04-15T01:59:05.682506915Z [2024-04-15T01:59:05.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:59:05.682864616Z [2024-04-15T01:59:05.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:58:00+00:00, run_id=scheduled__2024-04-15T01:58:00+00:00, run_start_date=2024-04-15 01:59:00.477281+00:00, run_end_date=2024-04-15 01:59:05.682529+00:00, run_duration=5.205248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:58:00+00:00, data_interval_end=2024-04-15 01:59:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T01:59:05.691076671Z [2024-04-15T01:59:05.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:05.697276485Z [2024-04-15T01:59:05.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:59:05.697669428Z [2024-04-15T01:59:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:58:00+00:00, run_id=scheduled__2024-04-15T01:58:00+00:00, run_start_date=2024-04-15 01:59:00.479484+00:00, run_end_date=2024-04-15 01:59:05.697303+00:00, run_duration=5.217819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:58:00+00:00, data_interval_end=2024-04-15 01:59:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T01:59:05.712402261Z [2024-04-15T01:59:05.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:05.752838167Z [2024-04-15T01:59:05.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status success for try_number 1 2024-04-15T01:59:05.752862439Z [2024-04-15T01:59:05.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status success for try_number 1 2024-04-15T01:59:05.763528944Z [2024-04-15T01:59:05.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:58:00+00:00, map_index=-1, run_start_date=2024-04-15 01:59:03.125139+00:00, run_end_date=2024-04-15 01:59:04.540527+00:00, run_duration=1.415388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:59:00.521418+00:00, queued_by_job_id=2, pid=2674 2024-04-15T01:59:05.763602957Z [2024-04-15T01:59:05.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:58:00+00:00, map_index=-1, run_start_date=2024-04-15 01:59:03.089706+00:00, run_end_date=2024-04-15 01:59:04.967483+00:00, run_duration=1.877777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:59:00.521418+00:00, queued_by_job_id=2, pid=2673 2024-04-15T02:00:00.290754084Z [2024-04-15T02:00:00.290+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:00:00.310282184Z [2024-04-15T02:00:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:00.326504610Z [2024-04-15T02:00:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:00:00.332807139Z [2024-04-15T02:00:00.332+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:00:00.413616629Z [2024-04-15T02:00:00.413+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:00:00.413644415Z 2024-04-15T02:00:00.413652382Z 2024-04-15T02:00:00.413660253Z 2024-04-15T02:00:00.413667172Z 2024-04-15T02:00:00.413707354Z [2024-04-15T02:00:00.413+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:00:00.414310250Z [2024-04-15T02:00:00.414+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:00:00.414649716Z [2024-04-15T02:00:00.414+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:00:00.414812642Z [2024-04-15T02:00:00.414+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:00:00.415410622Z [2024-04-15T02:00:00.415+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:00.415421764Z 2024-04-15T02:00:00.415425807Z 2024-04-15T02:00:00.415429679Z 2024-04-15T02:00:00.415432797Z 2024-04-15T02:00:00.419683339Z [2024-04-15T02:00:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:00:00.419914587Z [2024-04-15T02:00:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:00.420905032Z [2024-04-15T02:00:00.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:00.421179215Z [2024-04-15T02:00:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:00:00.421704139Z [2024-04-15T02:00:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:00.421815957Z [2024-04-15T02:00:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:00:00.422177941Z [2024-04-15T02:00:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:00.422376172Z [2024-04-15T02:00:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:00:00.829685144Z [2024-04-15T02:00:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:00.829720101Z [2024-04-15T02:00:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:00.829777100Z [2024-04-15T02:00:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:00.830483497Z [2024-04-15T02:00:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:00.888433991Z [2024-04-15T02:00:00.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48b47537-6435-45a3-91da-5b4f51beb793 2024-04-15T02:00:00.888446578Z [2024-04-15T02:00:00.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to b08d87fc-cbe0-4842-9051-41e7db7947b4 2024-04-15T02:00:00.888450134Z [2024-04-15T02:00:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e71d03f-ed43-47a9-aea7-6c2c86fec0a1 2024-04-15T02:00:00.888453401Z [2024-04-15T02:00:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4d1b317-2d14-4ac3-aa07-39b2ea9dae57 2024-04-15T02:00:03.269228834Z [2024-04-15T02:00:03.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:03.269884617Z [2024-04-15T02:00:03.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:58:00+00:00, run_id=scheduled__2024-04-15T01:58:00+00:00, run_start_date=2024-04-15 02:00:00.342364+00:00, run_end_date=2024-04-15 02:00:03.269163+00:00, run_duration=2.926799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:58:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:00:03.279839862Z [2024-04-15T02:00:03.279+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:00:03.435093809Z [2024-04-15T02:00:03.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:03.444514555Z [2024-04-15T02:00:03.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:58:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:01.705396+00:00, run_end_date=2024-04-15 02:00:02.350484+00:00, run_duration=0.645088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:00.416175+00:00, queued_by_job_id=2, pid=2710 2024-04-15T02:00:05.720745042Z [2024-04-15T02:00:05.720+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:00:05.720761553Z 2024-04-15T02:00:05.721455016Z [2024-04-15T02:00:05.720+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:00:05.722060182Z [2024-04-15T02:00:05.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:05.722072352Z 2024-04-15T02:00:05.725148519Z [2024-04-15T02:00:05.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:00:05.725325704Z [2024-04-15T02:00:05.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:05.809992395Z [2024-04-15T02:00:05.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:05.810254069Z [2024-04-15T02:00:05.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:05.818410182Z [2024-04-15T02:00:05.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff081410-bee9-4edb-85fb-793127394b1f 2024-04-15T02:00:05.818656677Z [2024-04-15T02:00:05.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:04.488010+00:00, run_end_date=2024-04-15 02:00:04.998148+00:00, run_duration=0.510138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:00.416175+00:00, queued_by_job_id=2, pid=2761 2024-04-15T02:00:05.895718583Z [2024-04-15T02:00:05.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:05.896123287Z [2024-04-15T02:00:05.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:59:00+00:00, run_id=scheduled__2024-04-15T01:59:00+00:00, run_start_date=2024-04-15 02:00:00.343495+00:00, run_end_date=2024-04-15 02:00:05.895775+00:00, run_duration=5.55228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:59:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:00:05.912606760Z [2024-04-15T02:00:05.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:05.921831487Z [2024-04-15T02:00:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:05.922309554Z [2024-04-15T02:00:05.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:59:00+00:00, run_id=scheduled__2024-04-15T01:59:00+00:00, run_start_date=2024-04-15 02:00:00.345014+00:00, run_end_date=2024-04-15 02:00:05.921731+00:00, run_duration=5.576717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:59:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:00:05.935630553Z [2024-04-15T02:00:05.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:05.984932503Z [2024-04-15T02:00:05.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:05.985110263Z [2024-04-15T02:00:05.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:05.995013143Z [2024-04-15T02:00:05.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:59:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:04.222486+00:00, run_end_date=2024-04-15 02:00:05.634098+00:00, run_duration=1.411612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:00.416175+00:00, queued_by_job_id=2, pid=2751 2024-04-15T02:00:05.995982584Z [2024-04-15T02:00:05.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:59:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:03.714956+00:00, run_end_date=2024-04-15 02:00:05.667952+00:00, run_duration=1.952996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:00.416175+00:00, queued_by_job_id=2, pid=2736 2024-04-15T02:00:08.105106960Z [2024-04-15T02:00:08.104+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:00:08.105127759Z 2024-04-15T02:00:08.105346269Z [2024-04-15T02:00:08.105+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:00:08.106133551Z [2024-04-15T02:00:08.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:08.106145023Z 2024-04-15T02:00:08.108085753Z [2024-04-15T02:00:08.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:00:08.108234709Z [2024-04-15T02:00:08.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:00:08.158298324Z [2024-04-15T02:00:08.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:08.158645016Z [2024-04-15T02:00:08.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:08.167007555Z [2024-04-15T02:00:08.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92b06e20-8522-4e4f-8474-9331153e0b09 2024-04-15T02:00:08.168775913Z [2024-04-15T02:00:08.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:07.446939+00:00, run_end_date=2024-04-15 02:00:07.762669+00:00, run_duration=0.31573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:05.722412+00:00, queued_by_job_id=2, pid=2791 2024-04-15T02:00:10.722863184Z [2024-04-15T02:00:10.722+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:00:10.722879281Z 2024-04-15T02:00:10.723265332Z [2024-04-15T02:00:10.722+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:00:10.723926355Z [2024-04-15T02:00:10.723+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:10.723938465Z 2024-04-15T02:00:10.726434641Z [2024-04-15T02:00:10.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:10.726595245Z [2024-04-15T02:00:10.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:10.785169414Z [2024-04-15T02:00:10.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:10.787393843Z [2024-04-15T02:00:10.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:10.794019856Z [2024-04-15T02:00:10.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to d764ecbc-c8d9-4659-91fe-806db4b11edd 2024-04-15T02:00:10.794035052Z [2024-04-15T02:00:10.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=0, run_start_date=2024-04-15 02:00:09.946529+00:00, run_end_date=2024-04-15 02:00:10.410234+00:00, run_duration=0.463705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:08.106514+00:00, queued_by_job_id=2, pid=2803 2024-04-15T02:00:13.600660959Z [2024-04-15T02:00:13.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:13.601079202Z [2024-04-15T02:00:13.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 01:55:00+00:00, run_id=scheduled__2024-04-15T01:55:00+00:00, run_start_date=2024-04-15 02:00:00.341025+00:00, run_end_date=2024-04-15 02:00:13.600576+00:00, run_duration=13.259551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:55:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:00:13.608511258Z [2024-04-15T02:00:13.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:00:13.649139919Z [2024-04-15T02:00:13.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:13.659329165Z [2024-04-15T02:00:13.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:12.697194+00:00, run_end_date=2024-04-15 02:00:13.159652+00:00, run_duration=0.462458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:10.724239+00:00, queued_by_job_id=2, pid=2815 2024-04-15T02:00:40.301664712Z [2024-04-15T02:00:40.300+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:01:00.376784070Z [2024-04-15T02:01:00.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:00.386852667Z [2024-04-15T02:01:00.386+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:01:00.469272910Z [2024-04-15T02:01:00.468+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:01:00.469291047Z 2024-04-15T02:01:00.469295758Z 2024-04-15T02:01:00.470849884Z [2024-04-15T02:01:00.469+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:01:00.471091698Z [2024-04-15T02:01:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:01:00.471738440Z [2024-04-15T02:01:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:01:00.471756844Z 2024-04-15T02:01:00.471761545Z 2024-04-15T02:01:00.475089273Z [2024-04-15T02:01:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:01:00.475334748Z [2024-04-15T02:01:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:01:00.475684935Z [2024-04-15T02:01:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:01:00.475977477Z [2024-04-15T02:01:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:01:00.679163913Z [2024-04-15T02:01:00.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:01:00.680494606Z [2024-04-15T02:01:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:01:00.712411246Z [2024-04-15T02:01:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to e708ed92-c58c-47bf-a2f0-bb1bd988cf1b 2024-04-15T02:01:00.719613204Z [2024-04-15T02:01:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to b27a1b82-12ff-4bbd-8f92-125dfdde8959 2024-04-15T02:01:05.506683817Z [2024-04-15T02:01:05.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:01:05.507058690Z [2024-04-15T02:01:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:01:00.403571+00:00, run_end_date=2024-04-15 02:01:05.506659+00:00, run_duration=5.103088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:01:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:01:05.515600924Z [2024-04-15T02:01:05.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:05.559787055Z [2024-04-15T02:01:05.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:01:05.565868231Z [2024-04-15T02:01:05.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:01:02.939130+00:00, run_end_date=2024-04-15 02:01:05.238049+00:00, run_duration=2.298919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:01:00.472526+00:00, queued_by_job_id=2, pid=2850 2024-04-15T02:01:06.616383877Z [2024-04-15T02:01:06.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:01:06.616565273Z [2024-04-15T02:01:06.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:01:00.405077+00:00, run_end_date=2024-04-15 02:01:06.616330+00:00, run_duration=6.211253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:01:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:01:06.627665134Z [2024-04-15T02:01:06.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:06.669117824Z [2024-04-15T02:01:06.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:01:06.676748464Z [2024-04-15T02:01:06.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:01:03.055046+00:00, run_end_date=2024-04-15 02:01:06.043021+00:00, run_duration=2.987975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:01:00.472526+00:00, queued_by_job_id=2, pid=2851 2024-04-15T02:02:00.177161408Z [2024-04-15T02:02:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:00.185671413Z [2024-04-15T02:02:00.185+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:02:00.195984242Z [2024-04-15T02:02:00.195+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:02:00.266654768Z [2024-04-15T02:02:00.266+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:02:00.266703383Z 2024-04-15T02:02:00.266707914Z 2024-04-15T02:02:00.266711275Z 2024-04-15T02:02:00.266724404Z [2024-04-15T02:02:00.266+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:02:00.266841498Z [2024-04-15T02:02:00.266+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:02:00.267034192Z [2024-04-15T02:02:00.266+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:02:00.267868567Z [2024-04-15T02:02:00.267+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:02:00.267880252Z 2024-04-15T02:02:00.267883904Z 2024-04-15T02:02:00.267887045Z 2024-04-15T02:02:00.271400313Z [2024-04-15T02:02:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:02:00.271605133Z [2024-04-15T02:02:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:02:00.271974162Z [2024-04-15T02:02:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:02:00.272145714Z [2024-04-15T02:02:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:02:00.272439113Z [2024-04-15T02:02:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:02:00.272602536Z [2024-04-15T02:02:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:02:00.512860175Z [2024-04-15T02:02:00.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:02:00.513293128Z [2024-04-15T02:02:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status queued for try_number 1 2024-04-15T02:02:00.513723775Z [2024-04-15T02:02:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status queued for try_number 1 2024-04-15T02:02:00.525034384Z [2024-04-15T02:02:00.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 682cf948-5f2e-40cd-aaf3-5fa9a8c98966 2024-04-15T02:02:00.525309480Z [2024-04-15T02:02:00.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5ef3069-1bee-4d69-8ffd-34906d8f4d7b 2024-04-15T02:02:00.525691673Z [2024-04-15T02:02:00.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1db94506-0206-4807-9809-5a7637f7152d 2024-04-15T02:02:01.744198339Z [2024-04-15T02:02:01.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:02:01.744661810Z [2024-04-15T02:02:01.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:02:00.209055+00:00, run_end_date=2024-04-15 02:02:01.744302+00:00, run_duration=1.535247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:02:01.753118252Z [2024-04-15T02:02:01.752+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:02:01.877615055Z [2024-04-15T02:02:01.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:02:01.887564878Z [2024-04-15T02:02:01.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:02:01.188147+00:00, run_end_date=2024-04-15 02:02:01.604102+00:00, run_duration=0.415955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:02:00.268847+00:00, queued_by_job_id=2, pid=2886 2024-04-15T02:02:05.235051319Z [2024-04-15T02:02:05.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:02:05.235492688Z [2024-04-15T02:02:05.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:01:00+00:00, run_id=scheduled__2024-04-15T02:01:00+00:00, run_start_date=2024-04-15 02:02:00.210390+00:00, run_end_date=2024-04-15 02:02:05.235147+00:00, run_duration=5.024757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:01:00+00:00, data_interval_end=2024-04-15 02:02:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:02:05.246664952Z [2024-04-15T02:02:05.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:05.291138308Z [2024-04-15T02:02:05.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status success for try_number 1 2024-04-15T02:02:05.309218045Z [2024-04-15T02:02:05.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:01:00+00:00, map_index=-1, run_start_date=2024-04-15 02:02:03.126330+00:00, run_end_date=2024-04-15 02:02:04.309000+00:00, run_duration=1.18267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:02:00.268847+00:00, queued_by_job_id=2, pid=2916 2024-04-15T02:02:05.605499627Z [2024-04-15T02:02:05.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:02:05.605997002Z [2024-04-15T02:02:05.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:01:00+00:00, run_id=scheduled__2024-04-15T02:01:00+00:00, run_start_date=2024-04-15 02:02:00.211368+00:00, run_end_date=2024-04-15 02:02:05.605451+00:00, run_duration=5.394083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:01:00+00:00, data_interval_end=2024-04-15 02:02:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:02:05.616831722Z [2024-04-15T02:02:05.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:05.654662784Z [2024-04-15T02:02:05.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status success for try_number 1 2024-04-15T02:02:05.662046970Z [2024-04-15T02:02:05.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:01:00+00:00, map_index=-1, run_start_date=2024-04-15 02:02:03.200523+00:00, run_end_date=2024-04-15 02:02:05.270030+00:00, run_duration=2.069507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:02:00.268847+00:00, queued_by_job_id=2, pid=2917 2024-04-15T02:03:00.848566475Z [2024-04-15T02:03:00.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:00.862422562Z [2024-04-15T02:03:00.862+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:03:00.914455920Z [2024-04-15T02:03:00.914+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:03:00.914471856Z 2024-04-15T02:03:00.914475280Z 2024-04-15T02:03:00.914478274Z [2024-04-15T02:03:00.914+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:03:00.914523836Z [2024-04-15T02:03:00.914+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:03:00.916189953Z [2024-04-15T02:03:00.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:03:00.916201848Z 2024-04-15T02:03:00.916205021Z 2024-04-15T02:03:00.919584835Z [2024-04-15T02:03:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:03:00.919674792Z [2024-04-15T02:03:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:03:00.919922894Z [2024-04-15T02:03:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:03:00.920006952Z [2024-04-15T02:03:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:03:01.191668753Z [2024-04-15T02:03:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status queued for try_number 1 2024-04-15T02:03:01.191933767Z [2024-04-15T02:03:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status queued for try_number 1 2024-04-15T02:03:01.201703252Z [2024-04-15T02:03:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c2c657a-6082-440b-96ab-cfd09ba76c58 2024-04-15T02:03:01.202038917Z [2024-04-15T02:03:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13f44473-2f04-496d-8799-3ee795ac7f10 2024-04-15T02:03:05.880781750Z [2024-04-15T02:03:05.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:03:05.881400286Z [2024-04-15T02:03:05.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:02:00+00:00, run_id=scheduled__2024-04-15T02:02:00+00:00, run_start_date=2024-04-15 02:03:00.872944+00:00, run_end_date=2024-04-15 02:03:05.880697+00:00, run_duration=5.007753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:02:00+00:00, data_interval_end=2024-04-15 02:03:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:03:05.892109479Z [2024-04-15T02:03:05.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:05.943806565Z [2024-04-15T02:03:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status success for try_number 1 2024-04-15T02:03:05.950742506Z [2024-04-15T02:03:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:02:00+00:00, map_index=-1, run_start_date=2024-04-15 02:03:03.388509+00:00, run_end_date=2024-04-15 02:03:05.705141+00:00, run_duration=2.316632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:03:00.916628+00:00, queued_by_job_id=2, pid=2971 2024-04-15T02:03:06.574070203Z [2024-04-15T02:03:06.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:03:06.574268955Z [2024-04-15T02:03:06.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:02:00+00:00, run_id=scheduled__2024-04-15T02:02:00+00:00, run_start_date=2024-04-15 02:03:00.871804+00:00, run_end_date=2024-04-15 02:03:06.574006+00:00, run_duration=5.702202, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:02:00+00:00, data_interval_end=2024-04-15 02:03:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:03:06.583435064Z [2024-04-15T02:03:06.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:06.616588454Z [2024-04-15T02:03:06.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status success for try_number 1 2024-04-15T02:03:06.621414743Z [2024-04-15T02:03:06.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:02:00+00:00, map_index=-1, run_start_date=2024-04-15 02:03:03.239024+00:00, run_end_date=2024-04-15 02:03:06.142125+00:00, run_duration=2.903101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:03:00.916628+00:00, queued_by_job_id=2, pid=2970 2024-04-15T02:04:00.160722971Z [2024-04-15T02:04:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:04:00.173315774Z [2024-04-15T02:04:00.173+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:04:00.196394979Z [2024-04-15T02:04:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:00.271487159Z [2024-04-15T02:04:00.271+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:04:00.271501370Z 2024-04-15T02:04:00.271505101Z 2024-04-15T02:04:00.271508201Z 2024-04-15T02:04:00.272372836Z [2024-04-15T02:04:00.272+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:04:00.281231515Z [2024-04-15T02:04:00.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:04:00.281496987Z [2024-04-15T02:04:00.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:04:00.290567751Z [2024-04-15T02:04:00.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:04:00.290584941Z 2024-04-15T02:04:00.290589196Z 2024-04-15T02:04:00.290592508Z 2024-04-15T02:04:00.298156732Z [2024-04-15T02:04:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:04:00.301998746Z [2024-04-15T02:04:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:04:00.302566361Z [2024-04-15T02:04:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:04:00.305011493Z [2024-04-15T02:04:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:04:00.305359102Z [2024-04-15T02:04:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:04:00.305568938Z [2024-04-15T02:04:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:04:00.732361436Z [2024-04-15T02:04:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status queued for try_number 1 2024-04-15T02:04:00.732465104Z [2024-04-15T02:04:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status queued for try_number 1 2024-04-15T02:04:00.732521124Z [2024-04-15T02:04:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status queued for try_number 1 2024-04-15T02:04:00.739699962Z [2024-04-15T02:04:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79c12507-058e-47a6-98dd-75b153d082ac 2024-04-15T02:04:00.739767332Z [2024-04-15T02:04:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 579bc06f-ba3f-4d43-8c31-bb339e48a2ab 2024-04-15T02:04:00.740408179Z [2024-04-15T02:04:00.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 155a2f98-7afa-46d6-be4d-db9909ae3045 2024-04-15T02:04:01.945294067Z [2024-04-15T02:04:01.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:04:01.945681851Z [2024-04-15T02:04:01.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:02:00+00:00, run_id=scheduled__2024-04-15T02:02:00+00:00, run_start_date=2024-04-15 02:04:00.207641+00:00, run_end_date=2024-04-15 02:04:01.945269+00:00, run_duration=1.737628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:02:00+00:00, data_interval_end=2024-04-15 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:04:01.961118657Z [2024-04-15T02:04:01.960+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:04:02.538712151Z [2024-04-15T02:04:02.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status success for try_number 1 2024-04-15T02:04:02.551453705Z [2024-04-15T02:04:02.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:02:00+00:00, map_index=-1, run_start_date=2024-04-15 02:04:01.452935+00:00, run_end_date=2024-04-15 02:04:01.897066+00:00, run_duration=0.444131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:04:00.291587+00:00, queued_by_job_id=2, pid=3005 2024-04-15T02:04:05.846739112Z [2024-04-15T02:04:05.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:04:05.847079765Z [2024-04-15T02:04:05.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:03:00+00:00, run_id=scheduled__2024-04-15T02:03:00+00:00, run_start_date=2024-04-15 02:04:00.208921+00:00, run_end_date=2024-04-15 02:04:05.846696+00:00, run_duration=5.637775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:03:00+00:00, data_interval_end=2024-04-15 02:04:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:04:05.856435060Z [2024-04-15T02:04:05.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:05.863847453Z [2024-04-15T02:04:05.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:04:05.864546649Z [2024-04-15T02:04:05.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:03:00+00:00, run_id=scheduled__2024-04-15T02:03:00+00:00, run_start_date=2024-04-15 02:04:00.209871+00:00, run_end_date=2024-04-15 02:04:05.863737+00:00, run_duration=5.653866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:03:00+00:00, data_interval_end=2024-04-15 02:04:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:04:05.875473198Z [2024-04-15T02:04:05.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:05.920238724Z [2024-04-15T02:04:05.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status success for try_number 1 2024-04-15T02:04:05.920714055Z [2024-04-15T02:04:05.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status success for try_number 1 2024-04-15T02:04:05.929710557Z [2024-04-15T02:04:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:03:00+00:00, map_index=-1, run_start_date=2024-04-15 02:04:03.203522+00:00, run_end_date=2024-04-15 02:04:05.417710+00:00, run_duration=2.214188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:04:00.291587+00:00, queued_by_job_id=2, pid=3035 2024-04-15T02:04:05.930095209Z [2024-04-15T02:04:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:03:00+00:00, map_index=-1, run_start_date=2024-04-15 02:04:03.303541+00:00, run_end_date=2024-04-15 02:04:04.979709+00:00, run_duration=1.676168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:04:00.291587+00:00, queued_by_job_id=2, pid=3036 2024-04-15T02:05:00.547152640Z [2024-04-15T02:05:00.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:05:00.562692211Z [2024-04-15T02:05:00.562+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:05:00.576626202Z [2024-04-15T02:05:00.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:00.659317344Z [2024-04-15T02:05:00.657+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:05:00.659328782Z 2024-04-15T02:05:00.659332810Z 2024-04-15T02:05:00.659336353Z 2024-04-15T02:05:00.659564491Z [2024-04-15T02:05:00.659+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:05:00.660200998Z [2024-04-15T02:05:00.660+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:05:00.660665197Z [2024-04-15T02:05:00.660+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:05:00.662643341Z [2024-04-15T02:05:00.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:00.662654786Z 2024-04-15T02:05:00.662658743Z 2024-04-15T02:05:00.662662131Z 2024-04-15T02:05:00.671481507Z [2024-04-15T02:05:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:05:00.671716921Z [2024-04-15T02:05:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:00.672966182Z [2024-04-15T02:05:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:05:00.673307657Z [2024-04-15T02:05:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:05:00.673708425Z [2024-04-15T02:05:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:05:00.673875809Z [2024-04-15T02:05:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:05:01.128412672Z [2024-04-15T02:05:01.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:01.128481289Z [2024-04-15T02:05:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:01.128520152Z [2024-04-15T02:05:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:01.139312936Z [2024-04-15T02:05:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14b5a4f4-881e-496a-9909-6070678c4499 2024-04-15T02:05:01.139360331Z [2024-04-15T02:05:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cac04ea-d06e-4f93-b07f-a12f9c69a7f7 2024-04-15T02:05:01.139480034Z [2024-04-15T02:05:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ae66130-9950-41ab-b043-d8b58d511ba4 2024-04-15T02:05:05.927552768Z [2024-04-15T02:05:05.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:05:05.927945520Z [2024-04-15T02:05:05.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:04:00+00:00, run_id=scheduled__2024-04-15T02:04:00+00:00, run_start_date=2024-04-15 02:05:00.588875+00:00, run_end_date=2024-04-15 02:05:05.927477+00:00, run_duration=5.338602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:04:00+00:00, data_interval_end=2024-04-15 02:05:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:05:05.940178139Z [2024-04-15T02:05:05.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:05.974675491Z [2024-04-15T02:05:05.974+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:05:05.974694805Z 2024-04-15T02:05:05.974890414Z [2024-04-15T02:05:05.974+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:05:05.975414699Z [2024-04-15T02:05:05.975+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:05.975426468Z 2024-04-15T02:05:05.977448678Z [2024-04-15T02:05:05.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:05:05.977665496Z [2024-04-15T02:05:05.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:06.034150209Z [2024-04-15T02:05:06.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:06.034338298Z [2024-04-15T02:05:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:06.034505318Z [2024-04-15T02:05:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:06.051443282Z [2024-04-15T02:05:06.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61a9d98f-36a7-4d34-9e4f-54b6197bf08f 2024-04-15T02:05:06.051703446Z [2024-04-15T02:05:06.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:03.979132+00:00, run_end_date=2024-04-15 02:05:04.917612+00:00, run_duration=0.93848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:00.664767+00:00, queued_by_job_id=2, pid=3093 2024-04-15T02:05:06.052063586Z [2024-04-15T02:05:06.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:04:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:03.883238+00:00, run_end_date=2024-04-15 02:05:05.642921+00:00, run_duration=1.759683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:00.664767+00:00, queued_by_job_id=2, pid=3092 2024-04-15T02:05:07.201679585Z [2024-04-15T02:05:07.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:05:07.202228222Z [2024-04-15T02:05:07.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:04:00+00:00, run_id=scheduled__2024-04-15T02:04:00+00:00, run_start_date=2024-04-15 02:05:00.587854+00:00, run_end_date=2024-04-15 02:05:07.201599+00:00, run_duration=6.613745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:04:00+00:00, data_interval_end=2024-04-15 02:05:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:05:07.212363741Z [2024-04-15T02:05:07.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:07.254011958Z [2024-04-15T02:05:07.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:07.258885100Z [2024-04-15T02:05:07.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:04:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:04.401609+00:00, run_end_date=2024-04-15 02:05:06.130213+00:00, run_duration=1.728604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:00.664767+00:00, queued_by_job_id=2, pid=3112 2024-04-15T02:05:08.336414868Z [2024-04-15T02:05:08.336+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:05:08.336432955Z 2024-04-15T02:05:08.336698834Z [2024-04-15T02:05:08.336+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:05:08.337388505Z [2024-04-15T02:05:08.337+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:08.337396029Z 2024-04-15T02:05:08.340271448Z [2024-04-15T02:05:08.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:05:08.340443975Z [2024-04-15T02:05:08.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:05:08.391297232Z [2024-04-15T02:05:08.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:08.391530386Z [2024-04-15T02:05:08.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:08.397166524Z [2024-04-15T02:05:08.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5deb2ebc-4875-48ea-bfae-f6f8b498c851 2024-04-15T02:05:08.397447996Z [2024-04-15T02:05:08.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:07.847634+00:00, run_end_date=2024-04-15 02:05:08.176717+00:00, run_duration=0.329083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:05.975744+00:00, queued_by_job_id=2, pid=3142 2024-04-15T02:05:12.118402776Z [2024-04-15T02:05:12.116+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:05:12.118420526Z 2024-04-15T02:05:12.118424680Z [2024-04-15T02:05:12.116+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:05:12.118428402Z [2024-04-15T02:05:12.117+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:12.118431931Z 2024-04-15T02:05:12.123894732Z [2024-04-15T02:05:12.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:05:12.124120373Z [2024-04-15T02:05:12.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:12.196630653Z [2024-04-15T02:05:12.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:12.196660156Z [2024-04-15T02:05:12.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:12.207064734Z [2024-04-15T02:05:12.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4417a12b-7bf8-4dd9-914f-194d2887c43d 2024-04-15T02:05:12.207204107Z [2024-04-15T02:05:12.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=0, run_start_date=2024-04-15 02:05:10.336601+00:00, run_end_date=2024-04-15 02:05:10.692254+00:00, run_duration=0.355653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:08.338394+00:00, queued_by_job_id=2, pid=3154 2024-04-15T02:05:14.870974476Z [2024-04-15T02:05:14.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:05:14.871475798Z [2024-04-15T02:05:14.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:05:00.586752+00:00, run_end_date=2024-04-15 02:05:14.871008+00:00, run_duration=14.284256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:05:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:05:14.877764801Z [2024-04-15T02:05:14.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:05:14.917049913Z [2024-04-15T02:05:14.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:14.925668761Z [2024-04-15T02:05:14.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:14.163246+00:00, run_end_date=2024-04-15 02:05:14.549131+00:00, run_duration=0.385885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:12.117514+00:00, queued_by_job_id=2, pid=3166 2024-04-15T02:05:40.360631379Z [2024-04-15T02:05:40.359+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:06:00.568937703Z [2024-04-15T02:06:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:00.576543830Z [2024-04-15T02:06:00.576+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:06:00.584733395Z [2024-04-15T02:06:00.584+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:06:00.652953444Z [2024-04-15T02:06:00.652+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:06:00.652975960Z 2024-04-15T02:06:00.652983902Z 2024-04-15T02:06:00.652990098Z 2024-04-15T02:06:00.653015338Z [2024-04-15T02:06:00.652+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:06:00.653149618Z [2024-04-15T02:06:00.653+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:06:00.653301330Z [2024-04-15T02:06:00.653+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:06:00.653876777Z [2024-04-15T02:06:00.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:06:00.653887897Z 2024-04-15T02:06:00.653892225Z 2024-04-15T02:06:00.653895154Z 2024-04-15T02:06:00.657067872Z [2024-04-15T02:06:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:06:00.657730470Z [2024-04-15T02:06:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:06:00.658110918Z [2024-04-15T02:06:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:06:00.658293251Z [2024-04-15T02:06:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:06:00.658538717Z [2024-04-15T02:06:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:06:00.658713024Z [2024-04-15T02:06:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:06:01.062606089Z [2024-04-15T02:06:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status queued for try_number 1 2024-04-15T02:06:01.062680751Z [2024-04-15T02:06:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:06:01.062735260Z [2024-04-15T02:06:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:06:01.078820299Z [2024-04-15T02:06:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4dc481a-37d4-4f0d-a8b0-2bc943a717fa 2024-04-15T02:06:01.078899945Z [2024-04-15T02:06:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bd7a2fb-0089-4112-988b-f6f959536493 2024-04-15T02:06:01.079007125Z [2024-04-15T02:06:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35248ffe-32f3-4519-919d-93be02a007f2 2024-04-15T02:06:03.412091621Z [2024-04-15T02:06:03.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:06:03.412332434Z [2024-04-15T02:06:03.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:04:00+00:00, run_id=scheduled__2024-04-15T02:04:00+00:00, run_start_date=2024-04-15 02:06:00.595682+00:00, run_end_date=2024-04-15 02:06:03.412046+00:00, run_duration=2.816364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:04:00+00:00, data_interval_end=2024-04-15 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:06:03.427151904Z [2024-04-15T02:06:03.426+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:06:03.512802210Z [2024-04-15T02:06:03.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status success for try_number 1 2024-04-15T02:06:03.518614823Z [2024-04-15T02:06:03.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:04:00+00:00, map_index=-1, run_start_date=2024-04-15 02:06:01.768513+00:00, run_end_date=2024-04-15 02:06:02.334057+00:00, run_duration=0.565544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:06:00.654657+00:00, queued_by_job_id=2, pid=3183 2024-04-15T02:06:06.784730521Z [2024-04-15T02:06:06.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:06:06.785133467Z [2024-04-15T02:06:06.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:05:00+00:00, run_id=scheduled__2024-04-15T02:05:00+00:00, run_start_date=2024-04-15 02:06:00.598719+00:00, run_end_date=2024-04-15 02:06:06.784630+00:00, run_duration=6.185911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:05:00+00:00, data_interval_end=2024-04-15 02:06:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:06:06.795632115Z [2024-04-15T02:06:06.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:06.804300609Z [2024-04-15T02:06:06.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:06:06.804724419Z [2024-04-15T02:06:06.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:05:00+00:00, run_id=scheduled__2024-04-15T02:05:00+00:00, run_start_date=2024-04-15 02:06:00.597223+00:00, run_end_date=2024-04-15 02:06:06.804220+00:00, run_duration=6.206997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:05:00+00:00, data_interval_end=2024-04-15 02:06:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:06:06.818247153Z [2024-04-15T02:06:06.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:06.850059971Z [2024-04-15T02:06:06.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:06:06.850299713Z [2024-04-15T02:06:06.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:06:06.859858730Z [2024-04-15T02:06:06.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:06:03.518904+00:00, run_end_date=2024-04-15 02:06:06.548245+00:00, run_duration=3.029341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:06:00.654657+00:00, queued_by_job_id=2, pid=3204 2024-04-15T02:06:06.859949487Z [2024-04-15T02:06:06.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:06:04.134439+00:00, run_end_date=2024-04-15 02:06:05.743106+00:00, run_duration=1.608667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:06:00.654657+00:00, queued_by_job_id=2, pid=3223 2024-04-15T02:07:00.211789288Z [2024-04-15T02:07:00.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:00.221607108Z [2024-04-15T02:07:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:07:00.278244152Z [2024-04-15T02:07:00.277+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:07:00.278258498Z 2024-04-15T02:07:00.278262169Z 2024-04-15T02:07:00.278443743Z [2024-04-15T02:07:00.278+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:07:00.278709249Z [2024-04-15T02:07:00.278+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:07:00.279340110Z [2024-04-15T02:07:00.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:07:00.279363096Z 2024-04-15T02:07:00.279366908Z 2024-04-15T02:07:00.282024140Z [2024-04-15T02:07:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:07:00.282216225Z [2024-04-15T02:07:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:07:00.282498944Z [2024-04-15T02:07:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:07:00.282652908Z [2024-04-15T02:07:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:07:00.456315592Z [2024-04-15T02:07:00.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status queued for try_number 1 2024-04-15T02:07:00.456568877Z [2024-04-15T02:07:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status queued for try_number 1 2024-04-15T02:07:00.462467757Z [2024-04-15T02:07:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to c62e5b11-3761-475a-b25e-4ac1f8f016b6 2024-04-15T02:07:00.462557782Z [2024-04-15T02:07:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d871427-974a-4973-b184-fbdde8beb057 2024-04-15T02:07:04.993239956Z [2024-04-15T02:07:04.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:07:04.993477201Z [2024-04-15T02:07:04.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:06:00+00:00, run_id=scheduled__2024-04-15T02:06:00+00:00, run_start_date=2024-04-15 02:07:00.230755+00:00, run_end_date=2024-04-15 02:07:04.993186+00:00, run_duration=4.762431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:06:00+00:00, data_interval_end=2024-04-15 02:07:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:07:05.006195789Z [2024-04-15T02:07:05.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:05.014594245Z [2024-04-15T02:07:05.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:07:05.014740955Z [2024-04-15T02:07:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:06:00+00:00, run_id=scheduled__2024-04-15T02:06:00+00:00, run_start_date=2024-04-15 02:07:00.233226+00:00, run_end_date=2024-04-15 02:07:05.014500+00:00, run_duration=4.781274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:06:00+00:00, data_interval_end=2024-04-15 02:07:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:07:05.024423176Z [2024-04-15T02:07:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:05.062679016Z [2024-04-15T02:07:05.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status success for try_number 1 2024-04-15T02:07:05.062691120Z [2024-04-15T02:07:05.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status success for try_number 1 2024-04-15T02:07:05.068534025Z [2024-04-15T02:07:05.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:06:00+00:00, map_index=-1, run_start_date=2024-04-15 02:07:02.460159+00:00, run_end_date=2024-04-15 02:07:03.881211+00:00, run_duration=1.421052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:07:00.279910+00:00, queued_by_job_id=2, pid=3268 2024-04-15T02:07:05.068934402Z [2024-04-15T02:07:05.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:06:00+00:00, map_index=-1, run_start_date=2024-04-15 02:07:02.236916+00:00, run_end_date=2024-04-15 02:07:03.994029+00:00, run_duration=1.757113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:07:00.279910+00:00, queued_by_job_id=2, pid=3267 2024-04-15T02:08:00.659840527Z [2024-04-15T02:08:00.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:00.665687303Z [2024-04-15T02:08:00.665+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:08:00.670576317Z [2024-04-15T02:08:00.670+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:08:00.728976351Z [2024-04-15T02:08:00.728+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:08:00.728990345Z 2024-04-15T02:08:00.729036408Z 2024-04-15T02:08:00.729039983Z 2024-04-15T02:08:00.729269823Z [2024-04-15T02:08:00.729+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:08:00.729373764Z [2024-04-15T02:08:00.729+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:08:00.729537693Z [2024-04-15T02:08:00.729+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:08:00.730153979Z [2024-04-15T02:08:00.729+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:08:00.730165502Z 2024-04-15T02:08:00.730169162Z 2024-04-15T02:08:00.730172418Z 2024-04-15T02:08:00.733540479Z [2024-04-15T02:08:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:08:00.733798020Z [2024-04-15T02:08:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:08:00.735387969Z [2024-04-15T02:08:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:08:00.735478554Z [2024-04-15T02:08:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:08:00.735655633Z [2024-04-15T02:08:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:08:00.735836719Z [2024-04-15T02:08:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:08:01.130567309Z [2024-04-15T02:08:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status queued for try_number 1 2024-04-15T02:08:01.130813702Z [2024-04-15T02:08:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status queued for try_number 1 2024-04-15T02:08:01.130951928Z [2024-04-15T02:08:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status queued for try_number 1 2024-04-15T02:08:01.142638883Z [2024-04-15T02:08:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d0d6f49-3143-4dc2-bb34-4e82052e0805 2024-04-15T02:08:01.143808899Z [2024-04-15T02:08:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87703644-ca4f-4f02-ad60-748ad5b247b9 2024-04-15T02:08:01.146384831Z [2024-04-15T02:08:01.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to 110b3b75-3b89-400f-8996-71c6592d645c 2024-04-15T02:08:03.484009380Z [2024-04-15T02:08:03.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:08:03.484058864Z [2024-04-15T02:08:03.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:06:00+00:00, run_id=scheduled__2024-04-15T02:06:00+00:00, run_start_date=2024-04-15 02:08:00.682866+00:00, run_end_date=2024-04-15 02:08:03.483743+00:00, run_duration=2.800877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:06:00+00:00, data_interval_end=2024-04-15 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:08:03.501364088Z [2024-04-15T02:08:03.501+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:08:03.580886131Z [2024-04-15T02:08:03.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status success for try_number 1 2024-04-15T02:08:03.587274140Z [2024-04-15T02:08:03.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:06:00+00:00, map_index=-1, run_start_date=2024-04-15 02:08:01.697085+00:00, run_end_date=2024-04-15 02:08:02.447441+00:00, run_duration=0.750356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:08:00.731066+00:00, queued_by_job_id=2, pid=3303 2024-04-15T02:08:05.766686586Z [2024-04-15T02:08:05.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:08:05.767024491Z [2024-04-15T02:08:05.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:07:00+00:00, run_id=scheduled__2024-04-15T02:07:00+00:00, run_start_date=2024-04-15 02:08:00.684050+00:00, run_end_date=2024-04-15 02:08:05.766726+00:00, run_duration=5.082676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:07:00+00:00, data_interval_end=2024-04-15 02:08:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:08:05.778392715Z [2024-04-15T02:08:05.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:05.786026461Z [2024-04-15T02:08:05.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:08:05.787026436Z [2024-04-15T02:08:05.786+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:07:00+00:00, run_id=scheduled__2024-04-15T02:07:00+00:00, run_start_date=2024-04-15 02:08:00.685130+00:00, run_end_date=2024-04-15 02:08:05.786721+00:00, run_duration=5.101591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:07:00+00:00, data_interval_end=2024-04-15 02:08:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:08:05.798209171Z [2024-04-15T02:08:05.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:05.850767269Z [2024-04-15T02:08:05.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status success for try_number 1 2024-04-15T02:08:05.850924692Z [2024-04-15T02:08:05.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status success for try_number 1 2024-04-15T02:08:05.857835214Z [2024-04-15T02:08:05.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:07:00+00:00, map_index=-1, run_start_date=2024-04-15 02:08:03.387425+00:00, run_end_date=2024-04-15 02:08:05.258192+00:00, run_duration=1.870767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:08:00.731066+00:00, queued_by_job_id=2, pid=3324 2024-04-15T02:08:05.858340589Z [2024-04-15T02:08:05.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:07:00+00:00, map_index=-1, run_start_date=2024-04-15 02:08:03.821702+00:00, run_end_date=2024-04-15 02:08:05.557089+00:00, run_duration=1.735387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:08:00.731066+00:00, queued_by_job_id=2, pid=3343 2024-04-15T02:09:01.030654015Z [2024-04-15T02:09:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:01.034552386Z [2024-04-15T02:09:01.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:09:01.085388868Z [2024-04-15T02:09:01.085+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:09:01.085417394Z 2024-04-15T02:09:01.085421586Z 2024-04-15T02:09:01.085431448Z [2024-04-15T02:09:01.085+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:09:01.085480355Z [2024-04-15T02:09:01.085+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:09:01.085977715Z [2024-04-15T02:09:01.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:09:01.085993204Z 2024-04-15T02:09:01.085996501Z 2024-04-15T02:09:01.093280513Z [2024-04-15T02:09:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:09:01.093363406Z [2024-04-15T02:09:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:09:01.093591323Z [2024-04-15T02:09:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:09:01.093646084Z [2024-04-15T02:09:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:09:01.346890191Z [2024-04-15T02:09:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status queued for try_number 1 2024-04-15T02:09:01.347468590Z [2024-04-15T02:09:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status queued for try_number 1 2024-04-15T02:09:01.357128482Z [2024-04-15T02:09:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c6e2cda-f38a-4ab7-b7d1-6382efd71396 2024-04-15T02:09:01.357142048Z [2024-04-15T02:09:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6673d4f8-15b6-47a1-bc44-faaaadcf20a4 2024-04-15T02:09:05.484143688Z [2024-04-15T02:09:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:09:05.484392016Z [2024-04-15T02:09:05.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:08:00+00:00, run_id=scheduled__2024-04-15T02:08:00+00:00, run_start_date=2024-04-15 02:09:01.044903+00:00, run_end_date=2024-04-15 02:09:05.484104+00:00, run_duration=4.439201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:08:00+00:00, data_interval_end=2024-04-15 02:09:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:09:05.492312474Z [2024-04-15T02:09:05.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:05.499447180Z [2024-04-15T02:09:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:09:05.499968654Z [2024-04-15T02:09:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:08:00+00:00, run_id=scheduled__2024-04-15T02:08:00+00:00, run_start_date=2024-04-15 02:09:01.046669+00:00, run_end_date=2024-04-15 02:09:05.499424+00:00, run_duration=4.452755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:08:00+00:00, data_interval_end=2024-04-15 02:09:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:09:05.525865032Z [2024-04-15T02:09:05.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:05.563746086Z [2024-04-15T02:09:05.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status success for try_number 1 2024-04-15T02:09:05.573944754Z [2024-04-15T02:09:05.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:08:00+00:00, map_index=-1, run_start_date=2024-04-15 02:09:03.535056+00:00, run_end_date=2024-04-15 02:09:04.919056+00:00, run_duration=1.384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:09:01.086441+00:00, queued_by_job_id=2, pid=3387 2024-04-15T02:09:06.658548232Z [2024-04-15T02:09:06.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status success for try_number 1 2024-04-15T02:09:06.663968226Z [2024-04-15T02:09:06.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:08:00+00:00, map_index=-1, run_start_date=2024-04-15 02:09:03.683475+00:00, run_end_date=2024-04-15 02:09:05.383280+00:00, run_duration=1.699805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:09:01.086441+00:00, queued_by_job_id=2, pid=3388 2024-04-15T02:10:00.080113812Z [2024-04-15T02:10:00.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:10:00.091249523Z [2024-04-15T02:10:00.090+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:10:00.109433126Z [2024-04-15T02:10:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:00.121144945Z [2024-04-15T02:10:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:10:00.227573436Z [2024-04-15T02:10:00.227+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:10:00.227590726Z 2024-04-15T02:10:00.227594155Z 2024-04-15T02:10:00.227597874Z 2024-04-15T02:10:00.227601311Z 2024-04-15T02:10:00.227711434Z [2024-04-15T02:10:00.227+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:10:00.227951215Z [2024-04-15T02:10:00.227+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:10:00.228113858Z [2024-04-15T02:10:00.227+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:10:00.228268621Z [2024-04-15T02:10:00.228+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:10:00.229074681Z [2024-04-15T02:10:00.228+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:00.229087931Z 2024-04-15T02:10:00.229092893Z 2024-04-15T02:10:00.229126645Z 2024-04-15T02:10:00.229129798Z 2024-04-15T02:10:00.237538445Z [2024-04-15T02:10:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:10:00.237752527Z [2024-04-15T02:10:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:00.239108284Z [2024-04-15T02:10:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:00.239308449Z [2024-04-15T02:10:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:10:00.239696202Z [2024-04-15T02:10:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:00.240064263Z [2024-04-15T02:10:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:10:00.240910816Z [2024-04-15T02:10:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:00.241254175Z [2024-04-15T02:10:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:10:00.742528335Z [2024-04-15T02:10:00.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.742565551Z [2024-04-15T02:10:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.742736346Z [2024-04-15T02:10:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.744135592Z [2024-04-15T02:10:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.757374890Z [2024-04-15T02:10:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fd3890d-6007-4eab-9477-90399a29d8d5 2024-04-15T02:10:00.757933474Z [2024-04-15T02:10:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65c37729-0f71-4384-a555-bb06cfa95076 2024-04-15T02:10:00.758116618Z [2024-04-15T02:10:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to a267581a-fd60-43cf-9cba-fa2158b9f828 2024-04-15T02:10:00.758251055Z [2024-04-15T02:10:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97521446-f4b4-42f0-9a93-a764d7f44eeb 2024-04-15T02:10:03.062729322Z [2024-04-15T02:10:03.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:03.063283286Z [2024-04-15T02:10:03.063+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:08:00+00:00, run_id=scheduled__2024-04-15T02:08:00+00:00, run_start_date=2024-04-15 02:10:00.134100+00:00, run_end_date=2024-04-15 02:10:03.062912+00:00, run_duration=2.928812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:08:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:10:03.074631995Z [2024-04-15T02:10:03.074+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:10:03.189042320Z [2024-04-15T02:10:03.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:03.196966528Z [2024-04-15T02:10:03.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:08:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:01.727352+00:00, run_end_date=2024-04-15 02:10:02.712332+00:00, run_duration=0.98498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.232904+00:00, queued_by_job_id=2, pid=3425 2024-04-15T02:10:04.359310612Z [2024-04-15T02:10:04.359+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:10:04.359330032Z 2024-04-15T02:10:04.359494588Z [2024-04-15T02:10:04.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:10:04.360244689Z [2024-04-15T02:10:04.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:04.360260808Z 2024-04-15T02:10:04.363492478Z [2024-04-15T02:10:04.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:10:04.363732348Z [2024-04-15T02:10:04.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:04.432182418Z [2024-04-15T02:10:04.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:04.432424666Z [2024-04-15T02:10:04.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:04.438795741Z [2024-04-15T02:10:04.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea1e5e06-c268-4d22-b836-63b266092588 2024-04-15T02:10:04.439363494Z [2024-04-15T02:10:04.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:03.345449+00:00, run_end_date=2024-04-15 02:10:03.838156+00:00, run_duration=0.492707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.232904+00:00, queued_by_job_id=2, pid=3455 2024-04-15T02:10:05.651694109Z [2024-04-15T02:10:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:05.652102726Z [2024-04-15T02:10:05.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:09:00+00:00, run_id=scheduled__2024-04-15T02:09:00+00:00, run_start_date=2024-04-15 02:10:00.135108+00:00, run_end_date=2024-04-15 02:10:05.651796+00:00, run_duration=5.516688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:09:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:10:05.661148757Z [2024-04-15T02:10:05.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:05.712382311Z [2024-04-15T02:10:05.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:05.717212961Z [2024-04-15T02:10:05.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:09:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:03.545300+00:00, run_end_date=2024-04-15 02:10:05.164983+00:00, run_duration=1.619683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.232904+00:00, queued_by_job_id=2, pid=3465 2024-04-15T02:10:06.766821665Z [2024-04-15T02:10:06.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:06.767359545Z [2024-04-15T02:10:06.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:09:00+00:00, run_id=scheduled__2024-04-15T02:09:00+00:00, run_start_date=2024-04-15 02:10:00.136090+00:00, run_end_date=2024-04-15 02:10:06.767059+00:00, run_duration=6.630969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:09:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:10:06.779538522Z [2024-04-15T02:10:06.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:06.795749973Z [2024-04-15T02:10:06.795+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:10:06.795765770Z 2024-04-15T02:10:06.796211849Z [2024-04-15T02:10:06.795+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:10:06.796733336Z [2024-04-15T02:10:06.796+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:06.796776404Z 2024-04-15T02:10:06.798967752Z [2024-04-15T02:10:06.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:10:06.799211429Z [2024-04-15T02:10:06.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:10:06.859087685Z [2024-04-15T02:10:06.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:06.861659924Z [2024-04-15T02:10:06.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:06.865572212Z [2024-04-15T02:10:06.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:06.884983175Z [2024-04-15T02:10:06.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f22d97d-c814-4049-820c-a3c390449485 2024-04-15T02:10:06.885108594Z [2024-04-15T02:10:06.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:06.267530+00:00, run_end_date=2024-04-15 02:10:06.610354+00:00, run_duration=0.342824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:04.360498+00:00, queued_by_job_id=2, pid=3505 2024-04-15T02:10:06.885253620Z [2024-04-15T02:10:06.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:09:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:03.823366+00:00, run_end_date=2024-04-15 02:10:05.903397+00:00, run_duration=2.080031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.232904+00:00, queued_by_job_id=2, pid=3475 2024-04-15T02:10:09.448223044Z [2024-04-15T02:10:09.447+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:10:09.448240028Z 2024-04-15T02:10:09.448489639Z [2024-04-15T02:10:09.448+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:10:09.449950804Z [2024-04-15T02:10:09.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:09.449969873Z 2024-04-15T02:10:09.455312389Z [2024-04-15T02:10:09.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:09.456042318Z [2024-04-15T02:10:09.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:09.599085318Z [2024-04-15T02:10:09.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:09.599191301Z [2024-04-15T02:10:09.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:09.626707959Z [2024-04-15T02:10:09.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 386dabf3-5c71-41ab-b7ec-20bbc979c316 2024-04-15T02:10:09.626826059Z [2024-04-15T02:10:09.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=0, run_start_date=2024-04-15 02:10:08.571157+00:00, run_end_date=2024-04-15 02:10:08.883164+00:00, run_duration=0.312007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:06.797205+00:00, queued_by_job_id=2, pid=3517 2024-04-15T02:10:11.933132858Z [2024-04-15T02:10:11.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:11.933328268Z [2024-04-15T02:10:11.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:05:00+00:00, run_id=scheduled__2024-04-15T02:05:00+00:00, run_start_date=2024-04-15 02:10:00.132709+00:00, run_end_date=2024-04-15 02:10:11.933092+00:00, run_duration=11.800383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:05:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:10:11.939248228Z [2024-04-15T02:10:11.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:10:11.996987339Z [2024-04-15T02:10:11.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:12.002502861Z [2024-04-15T02:10:12.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:11.429650+00:00, run_end_date=2024-04-15 02:10:11.760280+00:00, run_duration=0.33063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:09.450361+00:00, queued_by_job_id=2, pid=3528 2024-04-15T02:10:40.416997582Z [2024-04-15T02:10:40.416+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:11:00.061948723Z [2024-04-15T02:11:00.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:11:00.075058585Z [2024-04-15T02:11:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:00.144392828Z [2024-04-15T02:11:00.144+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:11:00.144408284Z 2024-04-15T02:11:00.144412402Z 2024-04-15T02:11:00.144426360Z [2024-04-15T02:11:00.144+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:11:00.144539377Z [2024-04-15T02:11:00.144+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:11:00.145021799Z [2024-04-15T02:11:00.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:11:00.145032821Z 2024-04-15T02:11:00.145036235Z 2024-04-15T02:11:00.147905460Z [2024-04-15T02:11:00.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:11:00.147967405Z [2024-04-15T02:11:00.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:11:00.148177360Z [2024-04-15T02:11:00.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:11:00.148240270Z [2024-04-15T02:11:00.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:11:00.396728926Z [2024-04-15T02:11:00.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:11:00.396919128Z [2024-04-15T02:11:00.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:11:00.406091865Z [2024-04-15T02:11:00.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d6db426-f66f-48e5-86bb-2bf4fdf35536 2024-04-15T02:11:00.406410460Z [2024-04-15T02:11:00.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to d43674d0-fd0f-4726-8b55-4db56252126a 2024-04-15T02:11:05.205339630Z [2024-04-15T02:11:05.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:11:05.205727799Z [2024-04-15T02:11:05.205+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:11:00.084478+00:00, run_end_date=2024-04-15 02:11:05.205230+00:00, run_duration=5.120752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:11:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:11:05.217372584Z [2024-04-15T02:11:05.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:05.227435281Z [2024-04-15T02:11:05.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:11:05.227827758Z [2024-04-15T02:11:05.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:11:00.086538+00:00, run_end_date=2024-04-15 02:11:05.227349+00:00, run_duration=5.140811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:11:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:11:05.238776883Z [2024-04-15T02:11:05.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:05.276735913Z [2024-04-15T02:11:05.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:11:05.277838140Z [2024-04-15T02:11:05.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:11:05.317551763Z [2024-04-15T02:11:05.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:11:02.636323+00:00, run_end_date=2024-04-15 02:11:04.907909+00:00, run_duration=2.271586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:11:00.145479+00:00, queued_by_job_id=2, pid=3566 2024-04-15T02:11:05.318004007Z [2024-04-15T02:11:05.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:11:02.882920+00:00, run_end_date=2024-04-15 02:11:04.425725+00:00, run_duration=1.542805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:11:00.145479+00:00, queued_by_job_id=2, pid=3567 2024-04-15T02:12:00.966035336Z [2024-04-15T02:12:00.965+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:12:00.976960474Z [2024-04-15T02:12:00.976+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:12:00.992976371Z [2024-04-15T02:12:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:01.143604262Z [2024-04-15T02:12:01.143+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:12:01.143640346Z 2024-04-15T02:12:01.143644875Z 2024-04-15T02:12:01.143648078Z 2024-04-15T02:12:01.143657901Z [2024-04-15T02:12:01.143+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:12:01.143757720Z [2024-04-15T02:12:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:12:01.143931429Z [2024-04-15T02:12:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:12:01.145107977Z [2024-04-15T02:12:01.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:12:01.145131543Z 2024-04-15T02:12:01.145136258Z 2024-04-15T02:12:01.145140322Z 2024-04-15T02:12:01.149878137Z [2024-04-15T02:12:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:12:01.150163469Z [2024-04-15T02:12:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:12:01.150409248Z [2024-04-15T02:12:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:12:01.150588970Z [2024-04-15T02:12:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:12:01.150986180Z [2024-04-15T02:12:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:12:01.151179285Z [2024-04-15T02:12:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:12:01.446253685Z [2024-04-15T02:12:01.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:12:01.446284214Z [2024-04-15T02:12:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status queued for try_number 1 2024-04-15T02:12:01.448702505Z [2024-04-15T02:12:01.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status queued for try_number 1 2024-04-15T02:12:01.472065186Z [2024-04-15T02:12:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4eab48ce-9d72-4ac1-9447-b6dec3f6b6b5 2024-04-15T02:12:01.472271770Z [2024-04-15T02:12:01.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee9b34ad-661b-42ad-a5d9-b93366fb977e 2024-04-15T02:12:01.472668645Z [2024-04-15T02:12:01.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb896d22-f068-49d2-8bcb-008dc985ced1 2024-04-15T02:12:03.951559010Z [2024-04-15T02:12:03.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:12:03.951864870Z [2024-04-15T02:12:03.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:12:01.019397+00:00, run_end_date=2024-04-15 02:12:03.951520+00:00, run_duration=2.932123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:12:03.958997797Z [2024-04-15T02:12:03.958+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:12:04.010281658Z [2024-04-15T02:12:04.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:12:04.016637705Z [2024-04-15T02:12:04.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:12:02.522599+00:00, run_end_date=2024-04-15 02:12:03.141597+00:00, run_duration=0.618998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:12:01.146059+00:00, queued_by_job_id=2, pid=3602 2024-04-15T02:12:06.060574255Z [2024-04-15T02:12:06.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:12:06.060748935Z [2024-04-15T02:12:06.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:11:00+00:00, run_id=scheduled__2024-04-15T02:11:00+00:00, run_start_date=2024-04-15 02:12:01.023015+00:00, run_end_date=2024-04-15 02:12:06.060485+00:00, run_duration=5.03747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:11:00+00:00, data_interval_end=2024-04-15 02:12:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:12:06.071909499Z [2024-04-15T02:12:06.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:06.101587517Z [2024-04-15T02:12:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status success for try_number 1 2024-04-15T02:12:06.107273796Z [2024-04-15T02:12:06.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:11:00+00:00, map_index=-1, run_start_date=2024-04-15 02:12:04.354304+00:00, run_end_date=2024-04-15 02:12:05.661883+00:00, run_duration=1.307579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:12:01.146059+00:00, queued_by_job_id=2, pid=3632 2024-04-15T02:12:07.160342260Z [2024-04-15T02:12:07.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:12:07.160718607Z [2024-04-15T02:12:07.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:11:00+00:00, run_id=scheduled__2024-04-15T02:11:00+00:00, run_start_date=2024-04-15 02:12:01.027952+00:00, run_end_date=2024-04-15 02:12:07.160212+00:00, run_duration=6.13226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:11:00+00:00, data_interval_end=2024-04-15 02:12:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:12:07.169677748Z [2024-04-15T02:12:07.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:07.201048286Z [2024-04-15T02:12:07.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status success for try_number 1 2024-04-15T02:12:07.205838918Z [2024-04-15T02:12:07.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:11:00+00:00, map_index=-1, run_start_date=2024-04-15 02:12:04.432222+00:00, run_end_date=2024-04-15 02:12:05.992554+00:00, run_duration=1.560332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:12:01.146059+00:00, queued_by_job_id=2, pid=3633 2024-04-15T02:13:00.799821715Z [2024-04-15T02:13:00.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:00.804013874Z [2024-04-15T02:13:00.802+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:13:00.853308421Z [2024-04-15T02:13:00.853+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:13:00.853322380Z 2024-04-15T02:13:00.853325520Z 2024-04-15T02:13:00.853429175Z [2024-04-15T02:13:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:13:00.853501265Z [2024-04-15T02:13:00.853+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:13:00.853941994Z [2024-04-15T02:13:00.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:13:00.853950734Z 2024-04-15T02:13:00.853953740Z 2024-04-15T02:13:00.856144451Z [2024-04-15T02:13:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:13:00.856301637Z [2024-04-15T02:13:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:13:00.856498224Z [2024-04-15T02:13:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:13:00.856651716Z [2024-04-15T02:13:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:13:01.123148772Z [2024-04-15T02:13:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status queued for try_number 1 2024-04-15T02:13:01.123458622Z [2024-04-15T02:13:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status queued for try_number 1 2024-04-15T02:13:01.142098208Z [2024-04-15T02:13:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30eea77f-ac84-427b-84ab-e2b6f4a95a29 2024-04-15T02:13:01.145212945Z [2024-04-15T02:13:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 372d698c-c37e-48db-aeae-efac482d169e 2024-04-15T02:13:05.346816562Z [2024-04-15T02:13:05.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:13:05.347156246Z [2024-04-15T02:13:05.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:12:00+00:00, run_id=scheduled__2024-04-15T02:12:00+00:00, run_start_date=2024-04-15 02:13:00.811273+00:00, run_end_date=2024-04-15 02:13:05.346866+00:00, run_duration=4.535593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:12:00+00:00, data_interval_end=2024-04-15 02:13:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:13:05.356210285Z [2024-04-15T02:13:05.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:05.393352840Z [2024-04-15T02:13:05.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status success for try_number 1 2024-04-15T02:13:05.398979929Z [2024-04-15T02:13:05.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:12:00+00:00, map_index=-1, run_start_date=2024-04-15 02:13:03.451639+00:00, run_end_date=2024-04-15 02:13:05.153727+00:00, run_duration=1.702088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:13:00.854397+00:00, queued_by_job_id=2, pid=3688 2024-04-15T02:13:06.247657554Z [2024-04-15T02:13:06.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:13:06.248259006Z [2024-04-15T02:13:06.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:12:00+00:00, run_id=scheduled__2024-04-15T02:12:00+00:00, run_start_date=2024-04-15 02:13:00.812589+00:00, run_end_date=2024-04-15 02:13:06.247750+00:00, run_duration=5.435161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:12:00+00:00, data_interval_end=2024-04-15 02:13:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:13:06.257879630Z [2024-04-15T02:13:06.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:06.290364250Z [2024-04-15T02:13:06.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status success for try_number 1 2024-04-15T02:13:06.295102879Z [2024-04-15T02:13:06.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:12:00+00:00, map_index=-1, run_start_date=2024-04-15 02:13:03.439201+00:00, run_end_date=2024-04-15 02:13:05.372619+00:00, run_duration=1.933418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:13:00.854397+00:00, queued_by_job_id=2, pid=3687 2024-04-15T02:14:00.274361285Z [2024-04-15T02:14:00.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:00.282022940Z [2024-04-15T02:14:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:14:00.289406435Z [2024-04-15T02:14:00.289+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:14:00.355418066Z [2024-04-15T02:14:00.355+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:14:00.355430643Z 2024-04-15T02:14:00.355434399Z 2024-04-15T02:14:00.355437282Z 2024-04-15T02:14:00.355589533Z [2024-04-15T02:14:00.355+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:14:00.355810457Z [2024-04-15T02:14:00.355+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:14:00.355968533Z [2024-04-15T02:14:00.355+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:14:00.356568421Z [2024-04-15T02:14:00.356+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:14:00.356578538Z 2024-04-15T02:14:00.356582074Z 2024-04-15T02:14:00.356585658Z 2024-04-15T02:14:00.360427955Z [2024-04-15T02:14:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:14:00.360662251Z [2024-04-15T02:14:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:14:00.361016963Z [2024-04-15T02:14:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:14:00.361250051Z [2024-04-15T02:14:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:14:00.361623040Z [2024-04-15T02:14:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:14:00.361802112Z [2024-04-15T02:14:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:14:00.589439616Z [2024-04-15T02:14:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status queued for try_number 1 2024-04-15T02:14:00.589856933Z [2024-04-15T02:14:00.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status queued for try_number 1 2024-04-15T02:14:00.590157435Z [2024-04-15T02:14:00.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status queued for try_number 1 2024-04-15T02:14:00.597829767Z [2024-04-15T02:14:00.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to b428750f-1b11-46fa-adf1-dc463eda06a7 2024-04-15T02:14:00.598648305Z [2024-04-15T02:14:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8512eec5-73ff-4664-958f-af1a46ced946 2024-04-15T02:14:00.598863629Z [2024-04-15T02:14:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ee19320-a63f-4d41-abf9-b6f3dca65b08 2024-04-15T02:14:02.259892556Z [2024-04-15T02:14:02.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:14:02.264218301Z [2024-04-15T02:14:02.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:12:00+00:00, run_id=scheduled__2024-04-15T02:12:00+00:00, run_start_date=2024-04-15 02:14:00.299152+00:00, run_end_date=2024-04-15 02:14:02.263746+00:00, run_duration=1.964594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:12:00+00:00, data_interval_end=2024-04-15 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:14:02.274012130Z [2024-04-15T02:14:02.273+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:14:02.674080453Z [2024-04-15T02:14:02.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status success for try_number 1 2024-04-15T02:14:02.679218672Z [2024-04-15T02:14:02.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:12:00+00:00, map_index=-1, run_start_date=2024-04-15 02:14:01.382339+00:00, run_end_date=2024-04-15 02:14:02.035283+00:00, run_duration=0.652944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:14:00.357546+00:00, queued_by_job_id=2, pid=3723 2024-04-15T02:14:04.910515436Z [2024-04-15T02:14:04.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:14:04.910804492Z [2024-04-15T02:14:04.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:13:00+00:00, run_id=scheduled__2024-04-15T02:13:00+00:00, run_start_date=2024-04-15 02:14:00.300335+00:00, run_end_date=2024-04-15 02:14:04.910524+00:00, run_duration=4.610189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:13:00+00:00, data_interval_end=2024-04-15 02:14:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:14:04.921786132Z [2024-04-15T02:14:04.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:06.021647175Z [2024-04-15T02:14:06.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:14:06.022103030Z [2024-04-15T02:14:06.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:13:00+00:00, run_id=scheduled__2024-04-15T02:13:00+00:00, run_start_date=2024-04-15 02:14:00.301729+00:00, run_end_date=2024-04-15 02:14:06.021722+00:00, run_duration=5.719993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:13:00+00:00, data_interval_end=2024-04-15 02:14:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:14:06.032643658Z [2024-04-15T02:14:06.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:06.069778697Z [2024-04-15T02:14:06.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status success for try_number 1 2024-04-15T02:14:06.070172401Z [2024-04-15T02:14:06.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status success for try_number 1 2024-04-15T02:14:06.079210000Z [2024-04-15T02:14:06.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:13:00+00:00, map_index=-1, run_start_date=2024-04-15 02:14:03.336267+00:00, run_end_date=2024-04-15 02:14:04.886155+00:00, run_duration=1.549888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:14:00.357546+00:00, queued_by_job_id=2, pid=3744 2024-04-15T02:14:06.079693495Z [2024-04-15T02:14:06.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:13:00+00:00, map_index=-1, run_start_date=2024-04-15 02:14:03.824233+00:00, run_end_date=2024-04-15 02:14:05.565965+00:00, run_duration=1.741732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:14:00.357546+00:00, queued_by_job_id=2, pid=3762 2024-04-15T02:15:00.305485438Z [2024-04-15T02:15:00.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:15:00.311749734Z [2024-04-15T02:15:00.311+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:15:00.322238442Z [2024-04-15T02:15:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:00.401249166Z [2024-04-15T02:15:00.400+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:15:00.401296144Z 2024-04-15T02:15:00.401305708Z 2024-04-15T02:15:00.401310700Z 2024-04-15T02:15:00.401345465Z [2024-04-15T02:15:00.401+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:15:00.401687201Z [2024-04-15T02:15:00.401+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:15:00.401768980Z [2024-04-15T02:15:00.401+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:15:00.402452958Z [2024-04-15T02:15:00.402+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:00.402470779Z 2024-04-15T02:15:00.402476787Z 2024-04-15T02:15:00.402481689Z 2024-04-15T02:15:00.405650067Z [2024-04-15T02:15:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:15:00.406101730Z [2024-04-15T02:15:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:00.407396501Z [2024-04-15T02:15:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:00.407413084Z [2024-04-15T02:15:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:15:00.407729830Z [2024-04-15T02:15:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:00.407955785Z [2024-04-15T02:15:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:15:00.796265997Z [2024-04-15T02:15:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:00.796275251Z [2024-04-15T02:15:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:00.796278563Z [2024-04-15T02:15:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:00.810128929Z [2024-04-15T02:15:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1d910f1-a071-42a4-a898-200fe68e1ced 2024-04-15T02:15:00.810141643Z [2024-04-15T02:15:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to df53a60a-e287-4438-998e-eec2ab337776 2024-04-15T02:15:00.810144908Z [2024-04-15T02:15:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15b854fb-f83e-4f06-acb2-758cd242602b 2024-04-15T02:15:05.458001787Z [2024-04-15T02:15:05.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:05.458029840Z [2024-04-15T02:15:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:15:00.334778+00:00, run_end_date=2024-04-15 02:15:05.457528+00:00, run_duration=5.12275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:15:05.467592112Z [2024-04-15T02:15:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:05.492976673Z [2024-04-15T02:15:05.492+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:15:05.492997084Z 2024-04-15T02:15:05.493176030Z [2024-04-15T02:15:05.492+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:15:05.493826419Z [2024-04-15T02:15:05.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:05.493836616Z 2024-04-15T02:15:05.496899082Z [2024-04-15T02:15:05.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:15:05.497111171Z [2024-04-15T02:15:05.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:05.558121904Z [2024-04-15T02:15:05.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:05.558315552Z [2024-04-15T02:15:05.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:05.558458727Z [2024-04-15T02:15:05.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:05.566788272Z [2024-04-15T02:15:05.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:04.008610+00:00, run_end_date=2024-04-15 02:15:04.501632+00:00, run_duration=0.493022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:00.403145+00:00, queued_by_job_id=2, pid=3828 2024-04-15T02:15:05.567085280Z [2024-04-15T02:15:05.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a07ef77-2763-488b-bb53-1227e1d02eeb 2024-04-15T02:15:05.567280823Z [2024-04-15T02:15:05.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:03.452468+00:00, run_end_date=2024-04-15 02:15:05.179396+00:00, run_duration=1.726928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:00.403145+00:00, queued_by_job_id=2, pid=3799 2024-04-15T02:15:06.690147556Z [2024-04-15T02:15:06.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:06.690373877Z [2024-04-15T02:15:06.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:15:00.333676+00:00, run_end_date=2024-04-15 02:15:06.690083+00:00, run_duration=6.356407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:15:06.698588522Z [2024-04-15T02:15:06.698+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:06.774588708Z [2024-04-15T02:15:06.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:06.784207678Z [2024-04-15T02:15:06.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:03.886504+00:00, run_end_date=2024-04-15 02:15:05.739776+00:00, run_duration=1.853272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:00.403145+00:00, queued_by_job_id=2, pid=3818 2024-04-15T02:15:07.920902297Z [2024-04-15T02:15:07.920+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:15:07.920923752Z 2024-04-15T02:15:07.921287225Z [2024-04-15T02:15:07.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:15:07.923017745Z [2024-04-15T02:15:07.922+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:07.923030156Z 2024-04-15T02:15:07.929641029Z [2024-04-15T02:15:07.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:15:07.930126003Z [2024-04-15T02:15:07.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:15:07.992768026Z [2024-04-15T02:15:07.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:07.992789150Z [2024-04-15T02:15:07.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:07.998807773Z [2024-04-15T02:15:07.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b12ccd9-bdf5-459b-9062-68ef54504d31 2024-04-15T02:15:07.999056125Z [2024-04-15T02:15:07.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:07.408020+00:00, run_end_date=2024-04-15 02:15:07.759343+00:00, run_duration=0.351323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:05.494192+00:00, queued_by_job_id=2, pid=3858 2024-04-15T02:15:10.496450766Z [2024-04-15T02:15:10.496+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:15:10.496480045Z 2024-04-15T02:15:10.496632838Z [2024-04-15T02:15:10.496+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:15:10.497207612Z [2024-04-15T02:15:10.497+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:10.497225054Z 2024-04-15T02:15:10.499828581Z [2024-04-15T02:15:10.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:10.499971211Z [2024-04-15T02:15:10.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:10.542885314Z [2024-04-15T02:15:10.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:10.542943966Z [2024-04-15T02:15:10.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:10.549104932Z [2024-04-15T02:15:10.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30906bf8-5463-47a2-ad54-bf0e2831e14b 2024-04-15T02:15:10.549373053Z [2024-04-15T02:15:10.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=0, run_start_date=2024-04-15 02:15:09.677083+00:00, run_end_date=2024-04-15 02:15:10.061363+00:00, run_duration=0.38428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:07.924218+00:00, queued_by_job_id=2, pid=3870 2024-04-15T02:15:13.150034369Z [2024-04-15T02:15:13.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:13.150544963Z [2024-04-15T02:15:13.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:15:00.332449+00:00, run_end_date=2024-04-15 02:15:13.149956+00:00, run_duration=12.817507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:15:13.159998546Z [2024-04-15T02:15:13.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:15:13.190069917Z [2024-04-15T02:15:13.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:13.196740382Z [2024-04-15T02:15:13.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:12.570805+00:00, run_end_date=2024-04-15 02:15:13.003544+00:00, run_duration=0.432739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:10.498209+00:00, queued_by_job_id=2, pid=3882 2024-04-15T02:15:40.468113147Z [2024-04-15T02:15:40.467+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:15:51.053837949Z [2024-04-15T02:15:51.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:51.095681337Z [2024-04-15T02:15:51.093+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:15:51.095714814Z 2024-04-15T02:15:51.098686312Z [2024-04-15T02:15:51.098+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 has 0/16 running and queued tasks 2024-04-15T02:15:51.101934294Z [2024-04-15T02:15:51.101+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:51.101946493Z 2024-04-15T02:15:51.104491883Z [2024-04-15T02:15:51.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:51.104840175Z [2024-04-15T02:15:51.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:15:51.169572039Z [2024-04-15T02:15:51.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:51.175120333Z [2024-04-15T02:15:51.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72e07d33-a090-4601-ab8f-04b75c7a70ca 2024-04-15T02:15:53.347858408Z [2024-04-15T02:15:53.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:53.348636364Z [2024-04-15T02:15:53.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:15:51.066022+00:00, run_end_date=2024-04-15 02:15:53.347820+00:00, run_duration=2.281798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=21d62d229600beba60ede84eca6a2c3c 2024-04-15T02:15:53.365859062Z [2024-04-15T02:15:53.365+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:53.401034140Z [2024-04-15T02:15:53.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:53.408658844Z [2024-04-15T02:15:53.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:51.906816+00:00, run_end_date=2024-04-15 02:15:52.306389+00:00, run_duration=0.399573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:51.102342+00:00, queued_by_job_id=2, pid=3905 2024-04-15T02:16:00.131749264Z [2024-04-15T02:16:00.131+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:16:00.139094330Z [2024-04-15T02:16:00.138+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:16:00.150302952Z [2024-04-15T02:16:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:00.163063943Z [2024-04-15T02:16:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:00.257312533Z [2024-04-15T02:16:00.256+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:16:00.257341166Z 2024-04-15T02:16:00.257345275Z 2024-04-15T02:16:00.257348222Z 2024-04-15T02:16:00.257351217Z 2024-04-15T02:16:00.257354587Z [2024-04-15T02:16:00.257+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:16:00.257556779Z [2024-04-15T02:16:00.257+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:16:00.257794161Z [2024-04-15T02:16:00.257+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:16:00.257959717Z [2024-04-15T02:16:00.257+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 has 0/16 running and queued tasks 2024-04-15T02:16:00.258612958Z [2024-04-15T02:16:00.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:16:00.258624187Z 2024-04-15T02:16:00.258627574Z 2024-04-15T02:16:00.258630531Z 2024-04-15T02:16:00.258633717Z 2024-04-15T02:16:00.261691642Z [2024-04-15T02:16:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:00.261844412Z [2024-04-15T02:16:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:16:00.262225963Z [2024-04-15T02:16:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:00.262435792Z [2024-04-15T02:16:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:16:00.262686607Z [2024-04-15T02:16:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:00.262815745Z [2024-04-15T02:16:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:16:00.263031690Z [2024-04-15T02:16:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:00.263147250Z [2024-04-15T02:16:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:16:00.620941443Z [2024-04-15T02:16:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:00.621153168Z [2024-04-15T02:16:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:00.621344325Z [2024-04-15T02:16:00.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:00.621454825Z [2024-04-15T02:16:00.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:00.633752389Z [2024-04-15T02:16:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1691584-937b-446a-bf2c-d0c123bc4838 2024-04-15T02:16:00.633915376Z [2024-04-15T02:16:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to c60361b2-a888-4895-9838-dba267338d3a 2024-04-15T02:16:00.634170126Z [2024-04-15T02:16:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62338402-e332-4ac9-ab95-d1946731a388 2024-04-15T02:16:00.634456934Z [2024-04-15T02:16:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ddb8b45-b779-4e0e-8dae-9967b2d012e9 2024-04-15T02:16:03.193490863Z [2024-04-15T02:16:03.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:03.194671274Z [2024-04-15T02:16:03.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:16:00.185414+00:00, run_end_date=2024-04-15 02:16:03.194242+00:00, run_duration=3.008828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:16:03.206324056Z [2024-04-15T02:16:03.206+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:16:03.213959302Z [2024-04-15T02:16:03.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:03.214897057Z [2024-04-15T02:16:03.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:16:00.185888+00:00, run_end_date=2024-04-15 02:16:03.214594+00:00, run_duration=3.028706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=21d62d229600beba60ede84eca6a2c3c 2024-04-15T02:16:03.237653142Z [2024-04-15T02:16:03.237+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:03.308809493Z [2024-04-15T02:16:03.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:03.309045891Z [2024-04-15T02:16:03.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:03.315364595Z [2024-04-15T02:16:03.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:01.350246+00:00, run_end_date=2024-04-15 02:16:02.246258+00:00, run_duration=0.896012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:00.259466+00:00, queued_by_job_id=2, pid=3928 2024-04-15T02:16:03.315577864Z [2024-04-15T02:16:03.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:01.771789+00:00, run_end_date=2024-04-15 02:16:02.325558+00:00, run_duration=0.553769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:00.259466+00:00, queued_by_job_id=2, pid=3929 2024-04-15T02:16:06.392020507Z [2024-04-15T02:16:06.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:06.392985283Z [2024-04-15T02:16:06.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:16:00.186854+00:00, run_end_date=2024-04-15 02:16:06.392158+00:00, run_duration=6.205304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:16:06.405617057Z [2024-04-15T02:16:06.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:06.411439325Z [2024-04-15T02:16:06.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:06.411810675Z [2024-04-15T02:16:06.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:16:00.187755+00:00, run_end_date=2024-04-15 02:16:06.411417+00:00, run_duration=6.223662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:16:06.422046479Z [2024-04-15T02:16:06.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:06.467728549Z [2024-04-15T02:16:06.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:06.467866188Z [2024-04-15T02:16:06.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:06.474182578Z [2024-04-15T02:16:06.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:03.331820+00:00, run_end_date=2024-04-15 02:16:05.585873+00:00, run_duration=2.254053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:00.259466+00:00, queued_by_job_id=2, pid=3968 2024-04-15T02:16:06.474413244Z [2024-04-15T02:16:06.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:03.371933+00:00, run_end_date=2024-04-15 02:16:06.009695+00:00, run_duration=2.637762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:00.259466+00:00, queued_by_job_id=2, pid=3969 2024-04-15T02:17:00.993794688Z [2024-04-15T02:17:00.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:01.021738581Z [2024-04-15T02:17:01.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:01.029838010Z [2024-04-15T02:17:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:17:01.099948138Z [2024-04-15T02:17:01.099+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:17:01.099990321Z 2024-04-15T02:17:01.100018821Z 2024-04-15T02:17:01.100022724Z 2024-04-15T02:17:01.100032652Z [2024-04-15T02:17:01.099+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 has 0/16 running and queued tasks 2024-04-15T02:17:01.100161003Z [2024-04-15T02:17:01.100+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:17:01.100269383Z [2024-04-15T02:17:01.100+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:17:01.100877879Z [2024-04-15T02:17:01.100+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:17:01.100888822Z 2024-04-15T02:17:01.100892196Z 2024-04-15T02:17:01.100895217Z 2024-04-15T02:17:01.104111500Z [2024-04-15T02:17:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:01.104275725Z [2024-04-15T02:17:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:17:01.104637234Z [2024-04-15T02:17:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:01.104814165Z [2024-04-15T02:17:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:17:01.105051452Z [2024-04-15T02:17:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:01.105149782Z [2024-04-15T02:17:01.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:17:01.422966512Z [2024-04-15T02:17:01.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:17:01.423231826Z [2024-04-15T02:17:01.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:17:01.423408153Z [2024-04-15T02:17:01.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:17:01.447181890Z [2024-04-15T02:17:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d161c39-1102-41fe-928c-a988cf3642e4 2024-04-15T02:17:01.447414576Z [2024-04-15T02:17:01.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4994b4a8-6458-4c43-a52a-6cf64fb5aed9 2024-04-15T02:17:01.447745738Z [2024-04-15T02:17:01.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9758cb5-d763-4dca-8db4-56b48e339655 2024-04-15T02:17:02.714938086Z [2024-04-15T02:17:02.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status failed for try_number 1 2024-04-15T02:17:02.720626314Z [2024-04-15T02:17:02.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:01.101483+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:17:02.721248060Z [2024-04-15T02:17:02.721+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:17:02.723825538Z [2024-04-15T02:17:02.723+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:17:02.749625403Z [2024-04-15T02:17:02.749+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240415T021600, start_date=, end_date=20240415T021702 2024-04-15T02:17:06.118430838Z [2024-04-15T02:17:06.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:17:06.118792628Z [2024-04-15T02:17:06.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:17:01.040209+00:00, run_end_date=2024-04-15 02:17:06.118359+00:00, run_duration=5.07815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:17:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:17:06.129152423Z [2024-04-15T02:17:06.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:06.136361958Z [2024-04-15T02:17:06.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:17:06.136976145Z [2024-04-15T02:17:06.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:17:01.041153+00:00, run_end_date=2024-04-15 02:17:06.136290+00:00, run_duration=5.095137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:17:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:17:06.145687641Z [2024-04-15T02:17:06.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:06.195249561Z [2024-04-15T02:17:06.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status success for try_number 1 2024-04-15T02:17:06.196560660Z [2024-04-15T02:17:06.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status success for try_number 1 2024-04-15T02:17:06.207976081Z [2024-04-15T02:17:06.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=2024-04-15 02:17:03.724004+00:00, run_end_date=2024-04-15 02:17:05.519769+00:00, run_duration=1.795765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:01.101483+00:00, queued_by_job_id=2, pid=4042 2024-04-15T02:17:06.208390099Z [2024-04-15T02:17:06.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=2024-04-15 02:17:03.599138+00:00, run_end_date=2024-04-15 02:17:05.622932+00:00, run_duration=2.023794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:01.101483+00:00, queued_by_job_id=2, pid=4041 2024-04-15T02:17:13.595474320Z [2024-04-15T02:17:13.595+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:17:13.595496004Z 2024-04-15T02:17:13.595778607Z [2024-04-15T02:17:13.595+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 has 0/16 running and queued tasks 2024-04-15T02:17:13.597015060Z [2024-04-15T02:17:13.596+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:17:13.597037326Z 2024-04-15T02:17:13.603827252Z [2024-04-15T02:17:13.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:13.605342099Z [2024-04-15T02:17:13.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:17:13.675624560Z [2024-04-15T02:17:13.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 2 2024-04-15T02:17:13.683714486Z [2024-04-15T02:17:13.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65114347-98cc-42c7-af64-ead7f0d25fb3 2024-04-15T02:17:15.288027527Z [2024-04-15T02:17:15.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_401daba8-8d62-4977-8378-2331cffeb528.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status failed for try_number 2 2024-04-15T02:17:15.296507412Z [2024-04-15T02:17:15.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 02:17:02.727813+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:13.599211+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:17:15.296950863Z [2024-04-15T02:17:15.296+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:17:15.302087248Z [2024-04-15T02:17:15.301+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:17:15.314602046Z [2024-04-15T02:17:15.314+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240415T021600, start_date=, end_date=20240415T021715 2024-04-15T02:17:16.383659626Z [2024-04-15T02:17:16.383+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T02:17:16.383784765Z [2024-04-15T02:17:16.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_401daba8-8d62-4977-8378-2331cffeb528, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:17:01.039028+00:00, run_end_date=2024-04-15 02:17:16.383488+00:00, run_duration=15.34446, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:17:00+00:00, dag_hash=21d62d229600beba60ede84eca6a2c3c 2024-04-15T02:17:16.392619391Z [2024-04-15T02:17:16.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:18:00.839877393Z [2024-04-15T02:18:00.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:00.847646647Z [2024-04-15T02:18:00.846+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:18:00.856767250Z [2024-04-15T02:18:00.856+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:18:00.930516865Z [2024-04-15T02:18:00.930+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:18:00.930532985Z 2024-04-15T02:18:00.930539412Z 2024-04-15T02:18:00.930542392Z 2024-04-15T02:18:00.930580736Z [2024-04-15T02:18:00.930+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:18:00.930693148Z [2024-04-15T02:18:00.930+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:18:00.930764351Z [2024-04-15T02:18:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:18:00.931344275Z [2024-04-15T02:18:00.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:18:00.931358670Z 2024-04-15T02:18:00.931362749Z 2024-04-15T02:18:00.931366143Z 2024-04-15T02:18:00.935976328Z [2024-04-15T02:18:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:18:00.935990079Z [2024-04-15T02:18:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:18:00.935995530Z [2024-04-15T02:18:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:18:00.936023048Z [2024-04-15T02:18:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:18:00.936026360Z [2024-04-15T02:18:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:18:00.936029668Z [2024-04-15T02:18:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:18:01.388379964Z [2024-04-15T02:18:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:18:01.391851278Z [2024-04-15T02:18:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status queued for try_number 1 2024-04-15T02:18:01.392014952Z [2024-04-15T02:18:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status queued for try_number 1 2024-04-15T02:18:01.412506028Z [2024-04-15T02:18:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9c4d266-45df-422a-b880-b3a26ea194b4 2024-04-15T02:18:01.413807146Z [2024-04-15T02:18:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to c156579a-9145-44da-9e82-741b5e55f6ff 2024-04-15T02:18:01.414713514Z [2024-04-15T02:18:01.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d12ffcf-5e4f-4380-bb3e-a139af40c0a7 2024-04-15T02:18:02.719355129Z [2024-04-15T02:18:02.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:18:02.719760961Z [2024-04-15T02:18:02.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:18:00.874689+00:00, run_end_date=2024-04-15 02:18:02.719404+00:00, run_duration=1.844715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:18:02.733192695Z [2024-04-15T02:18:02.732+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:18:03.953846449Z [2024-04-15T02:18:03.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status success for try_number 1 2024-04-15T02:18:03.961155458Z [2024-04-15T02:18:03.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=2024-04-15 02:18:02.145519+00:00, run_end_date=2024-04-15 02:18:02.619924+00:00, run_duration=0.474405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:18:00.932188+00:00, queued_by_job_id=2, pid=4096 2024-04-15T02:18:05.643875951Z [2024-04-15T02:18:05.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:18:05.644089146Z [2024-04-15T02:18:05.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:17:00+00:00, run_id=scheduled__2024-04-15T02:17:00+00:00, run_start_date=2024-04-15 02:18:00.876367+00:00, run_end_date=2024-04-15 02:18:05.643799+00:00, run_duration=4.767432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:17:00+00:00, data_interval_end=2024-04-15 02:18:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:18:05.654778253Z [2024-04-15T02:18:05.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:05.695335755Z [2024-04-15T02:18:05.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status success for try_number 1 2024-04-15T02:18:05.703503679Z [2024-04-15T02:18:05.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:17:00+00:00, map_index=-1, run_start_date=2024-04-15 02:18:03.681006+00:00, run_end_date=2024-04-15 02:18:05.132330+00:00, run_duration=1.451324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:18:00.932188+00:00, queued_by_job_id=2, pid=4117 2024-04-15T02:18:06.495729268Z [2024-04-15T02:18:06.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:18:06.495911119Z [2024-04-15T02:18:06.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:17:00+00:00, run_id=scheduled__2024-04-15T02:17:00+00:00, run_start_date=2024-04-15 02:18:00.877724+00:00, run_end_date=2024-04-15 02:18:06.495624+00:00, run_duration=5.6179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:17:00+00:00, data_interval_end=2024-04-15 02:18:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:18:06.503686546Z [2024-04-15T02:18:06.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:06.530663143Z [2024-04-15T02:18:06.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status success for try_number 1 2024-04-15T02:18:06.534727844Z [2024-04-15T02:18:06.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:17:00+00:00, map_index=-1, run_start_date=2024-04-15 02:18:04.096204+00:00, run_end_date=2024-04-15 02:18:05.746988+00:00, run_duration=1.650784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:18:00.932188+00:00, queued_by_job_id=2, pid=4136 2024-04-15T02:19:00.358131513Z [2024-04-15T02:19:00.357+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:19:00.370900820Z [2024-04-15T02:19:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:00.423967845Z [2024-04-15T02:19:00.423+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:19:00.423993609Z 2024-04-15T02:19:00.424002961Z 2024-04-15T02:19:00.424011533Z [2024-04-15T02:19:00.423+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:19:00.424082047Z [2024-04-15T02:19:00.423+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:19:00.424547881Z [2024-04-15T02:19:00.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:19:00.424563930Z 2024-04-15T02:19:00.424568291Z 2024-04-15T02:19:00.430815157Z [2024-04-15T02:19:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:19:00.430854546Z [2024-04-15T02:19:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:19:00.431146052Z [2024-04-15T02:19:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:19:00.431180259Z [2024-04-15T02:19:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:19:00.595423176Z [2024-04-15T02:19:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status queued for try_number 1 2024-04-15T02:19:00.595520256Z [2024-04-15T02:19:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status queued for try_number 1 2024-04-15T02:19:00.602679274Z [2024-04-15T02:19:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to d210331c-d1d5-448e-8ba2-47ac14967932 2024-04-15T02:19:00.602905180Z [2024-04-15T02:19:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b9e7aff-32e0-41c3-8ef3-dba11fe560e7 2024-04-15T02:19:04.505578251Z [2024-04-15T02:19:04.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:19:04.505884170Z [2024-04-15T02:19:04.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:18:00+00:00, run_id=scheduled__2024-04-15T02:18:00+00:00, run_start_date=2024-04-15 02:19:00.381798+00:00, run_end_date=2024-04-15 02:19:04.505481+00:00, run_duration=4.123683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:18:00+00:00, data_interval_end=2024-04-15 02:19:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:19:04.515089798Z [2024-04-15T02:19:04.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:04.575148211Z [2024-04-15T02:19:04.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status success for try_number 1 2024-04-15T02:19:04.584224887Z [2024-04-15T02:19:04.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:18:00+00:00, map_index=-1, run_start_date=2024-04-15 02:19:02.749387+00:00, run_end_date=2024-04-15 02:19:04.283615+00:00, run_duration=1.534228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:19:00.426437+00:00, queued_by_job_id=2, pid=4181 2024-04-15T02:19:06.145275643Z [2024-04-15T02:19:06.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:19:06.145883016Z [2024-04-15T02:19:06.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:18:00+00:00, run_id=scheduled__2024-04-15T02:18:00+00:00, run_start_date=2024-04-15 02:19:00.383378+00:00, run_end_date=2024-04-15 02:19:06.145527+00:00, run_duration=5.762149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:18:00+00:00, data_interval_end=2024-04-15 02:19:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:19:06.154800470Z [2024-04-15T02:19:06.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:06.186189578Z [2024-04-15T02:19:06.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status success for try_number 1 2024-04-15T02:19:06.196123398Z [2024-04-15T02:19:06.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:18:00+00:00, map_index=-1, run_start_date=2024-04-15 02:19:02.846549+00:00, run_end_date=2024-04-15 02:19:05.103262+00:00, run_duration=2.256713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:19:00.426437+00:00, queued_by_job_id=2, pid=4182 2024-04-15T02:20:00.280126546Z [2024-04-15T02:20:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:20:00.296131989Z [2024-04-15T02:20:00.295+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:20:00.317743968Z [2024-04-15T02:20:00.317+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:20:00.342446141Z [2024-04-15T02:20:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:00.452923969Z [2024-04-15T02:20:00.452+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:20:00.452938699Z 2024-04-15T02:20:00.452942181Z 2024-04-15T02:20:00.452946313Z 2024-04-15T02:20:00.452949330Z 2024-04-15T02:20:00.453460605Z [2024-04-15T02:20:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:20:00.453637979Z [2024-04-15T02:20:00.453+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:20:00.453932485Z [2024-04-15T02:20:00.453+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:20:00.454208599Z [2024-04-15T02:20:00.453+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:20:00.455031680Z [2024-04-15T02:20:00.454+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:00.455046789Z 2024-04-15T02:20:00.455052026Z 2024-04-15T02:20:00.455056868Z 2024-04-15T02:20:00.455076166Z 2024-04-15T02:20:00.459049896Z [2024-04-15T02:20:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:20:00.459170854Z [2024-04-15T02:20:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:00.459444703Z [2024-04-15T02:20:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:00.460215583Z [2024-04-15T02:20:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:20:00.460548511Z [2024-04-15T02:20:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:00.460795882Z [2024-04-15T02:20:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:20:00.461375735Z [2024-04-15T02:20:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:00.461512015Z [2024-04-15T02:20:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:20:00.745367120Z [2024-04-15T02:20:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.746287563Z [2024-04-15T02:20:00.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.746472844Z [2024-04-15T02:20:00.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.749566185Z [2024-04-15T02:20:00.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.762563451Z [2024-04-15T02:20:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01d4e27a-389a-4fbb-ae2c-3027f9be18dc 2024-04-15T02:20:00.762744917Z [2024-04-15T02:20:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd930016-886b-4149-9b56-b3baf196b292 2024-04-15T02:20:00.762914171Z [2024-04-15T02:20:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0ae9a57-1a3d-4095-8ef5-620d03e520f2 2024-04-15T02:20:00.763035456Z [2024-04-15T02:20:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3c48da3-7fb8-433e-b1cb-55e533eb0d40 2024-04-15T02:20:03.364727960Z [2024-04-15T02:20:03.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:03.379761396Z [2024-04-15T02:20:03.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:18:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:02.348248+00:00, run_end_date=2024-04-15 02:20:03.018049+00:00, run_duration=0.669801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.456294+00:00, queued_by_job_id=2, pid=4218 2024-04-15T02:20:04.457332162Z [2024-04-15T02:20:04.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:04.457993557Z [2024-04-15T02:20:04.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:18:00+00:00, run_id=scheduled__2024-04-15T02:18:00+00:00, run_start_date=2024-04-15 02:20:00.378233+00:00, run_end_date=2024-04-15 02:20:04.457484+00:00, run_duration=4.079251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:18:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:20:04.470519083Z [2024-04-15T02:20:04.470+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:20:05.472379760Z [2024-04-15T02:20:05.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:05.472708308Z [2024-04-15T02:20:05.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:19:00+00:00, run_id=scheduled__2024-04-15T02:19:00+00:00, run_start_date=2024-04-15 02:20:00.379561+00:00, run_end_date=2024-04-15 02:20:05.472297+00:00, run_duration=5.092736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:19:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:20:05.484128738Z [2024-04-15T02:20:05.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:05.511390597Z [2024-04-15T02:20:05.511+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:20:05.511403094Z 2024-04-15T02:20:05.511502548Z [2024-04-15T02:20:05.511+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:20:05.512087033Z [2024-04-15T02:20:05.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:05.512103114Z 2024-04-15T02:20:05.515211534Z [2024-04-15T02:20:05.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:20:05.515243711Z [2024-04-15T02:20:05.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:05.579297178Z [2024-04-15T02:20:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:05.579333588Z [2024-04-15T02:20:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:05.579391806Z [2024-04-15T02:20:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:05.585499371Z [2024-04-15T02:20:05.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7423bf4b-5e7f-4ff5-81c5-61a47e24f359 2024-04-15T02:20:05.585617799Z [2024-04-15T02:20:05.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:04.047535+00:00, run_end_date=2024-04-15 02:20:04.575448+00:00, run_duration=0.527913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.456294+00:00, queued_by_job_id=2, pid=4259 2024-04-15T02:20:05.585759307Z [2024-04-15T02:20:05.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:19:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:03.922085+00:00, run_end_date=2024-04-15 02:20:05.286648+00:00, run_duration=1.364563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.456294+00:00, queued_by_job_id=2, pid=4258 2024-04-15T02:20:07.865068561Z [2024-04-15T02:20:07.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:07.865268784Z [2024-04-15T02:20:07.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:19:00+00:00, run_id=scheduled__2024-04-15T02:19:00+00:00, run_start_date=2024-04-15 02:20:00.381725+00:00, run_end_date=2024-04-15 02:20:07.864978+00:00, run_duration=7.483253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:19:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:20:07.874293178Z [2024-04-15T02:20:07.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:07.907312116Z [2024-04-15T02:20:07.907+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:20:07.907326743Z 2024-04-15T02:20:07.907343614Z [2024-04-15T02:20:07.907+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:20:07.908059077Z [2024-04-15T02:20:07.907+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:07.908073550Z 2024-04-15T02:20:07.910400861Z [2024-04-15T02:20:07.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:20:07.910580072Z [2024-04-15T02:20:07.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:20:07.959527622Z [2024-04-15T02:20:07.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:07.959683474Z [2024-04-15T02:20:07.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:07.959701626Z [2024-04-15T02:20:07.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:07.967688479Z [2024-04-15T02:20:07.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc26174e-4332-4e2c-91df-8492e9c623cf 2024-04-15T02:20:07.967846130Z [2024-04-15T02:20:07.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:19:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:04.093414+00:00, run_end_date=2024-04-15 02:20:06.878625+00:00, run_duration=2.785211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.456294+00:00, queued_by_job_id=2, pid=4260 2024-04-15T02:20:07.968001752Z [2024-04-15T02:20:07.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:07.233521+00:00, run_end_date=2024-04-15 02:20:07.573453+00:00, run_duration=0.339932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:05.512401+00:00, queued_by_job_id=2, pid=4299 2024-04-15T02:20:10.716302346Z [2024-04-15T02:20:10.716+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:20:10.716353831Z 2024-04-15T02:20:10.716687529Z [2024-04-15T02:20:10.716+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:20:10.717309037Z [2024-04-15T02:20:10.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:10.717321944Z 2024-04-15T02:20:10.719747770Z [2024-04-15T02:20:10.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:10.719998677Z [2024-04-15T02:20:10.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:10.771848512Z [2024-04-15T02:20:10.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:10.771921300Z [2024-04-15T02:20:10.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:10.795450323Z [2024-04-15T02:20:10.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f4510c5-c234-48cb-9cf3-bf0ecdf4cdb8 2024-04-15T02:20:10.795547415Z [2024-04-15T02:20:10.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=0, run_start_date=2024-04-15 02:20:09.863473+00:00, run_end_date=2024-04-15 02:20:10.219264+00:00, run_duration=0.355791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:07.908466+00:00, queued_by_job_id=2, pid=4311 2024-04-15T02:20:13.273750416Z [2024-04-15T02:20:13.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:13.274087787Z [2024-04-15T02:20:13.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:20:00.366832+00:00, run_end_date=2024-04-15 02:20:13.273545+00:00, run_duration=12.906713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:20:13.280121013Z [2024-04-15T02:20:13.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:20:13.321662035Z [2024-04-15T02:20:13.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:13.329142656Z [2024-04-15T02:20:13.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:12.601689+00:00, run_end_date=2024-04-15 02:20:13.033326+00:00, run_duration=0.431637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:10.717733+00:00, queued_by_job_id=2, pid=4323 2024-04-15T02:20:40.523901333Z [2024-04-15T02:20:40.523+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:21:00.294745231Z [2024-04-15T02:21:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:00.302430488Z [2024-04-15T02:21:00.302+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:21:00.361395742Z [2024-04-15T02:21:00.361+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:21:00.361416674Z 2024-04-15T02:21:00.361421943Z 2024-04-15T02:21:00.361768598Z [2024-04-15T02:21:00.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:21:00.362153049Z [2024-04-15T02:21:00.361+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:21:00.362943318Z [2024-04-15T02:21:00.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:21:00.362956707Z 2024-04-15T02:21:00.362961189Z 2024-04-15T02:21:00.367206146Z [2024-04-15T02:21:00.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:21:00.367499160Z [2024-04-15T02:21:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:21:00.368607099Z [2024-04-15T02:21:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:21:00.368893084Z [2024-04-15T02:21:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:21:00.536877044Z [2024-04-15T02:21:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:21:00.538685275Z [2024-04-15T02:21:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:21:00.544513807Z [2024-04-15T02:21:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 744e5d1c-b302-4390-933b-37e810baef50 2024-04-15T02:21:00.544722835Z [2024-04-15T02:21:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3dd7a8c-3828-459d-b5a1-af8f05ef441c 2024-04-15T02:21:04.309460266Z [2024-04-15T02:21:04.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:21:04.310183981Z [2024-04-15T02:21:04.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:21:00.312682+00:00, run_end_date=2024-04-15 02:21:04.309623+00:00, run_duration=3.996941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:21:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:21:04.323948733Z [2024-04-15T02:21:04.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:04.381668361Z [2024-04-15T02:21:04.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:21:04.391514438Z [2024-04-15T02:21:04.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:21:02.739965+00:00, run_end_date=2024-04-15 02:21:04.122409+00:00, run_duration=1.382444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:21:00.363728+00:00, queued_by_job_id=2, pid=4360 2024-04-15T02:21:05.449302782Z [2024-04-15T02:21:05.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:21:05.449672224Z [2024-04-15T02:21:05.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:21:00.313855+00:00, run_end_date=2024-04-15 02:21:05.449376+00:00, run_duration=5.135521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:21:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:21:05.459884355Z [2024-04-15T02:21:05.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:05.489488145Z [2024-04-15T02:21:05.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:21:05.494019823Z [2024-04-15T02:21:05.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:21:02.682856+00:00, run_end_date=2024-04-15 02:21:04.589027+00:00, run_duration=1.906171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:21:00.363728+00:00, queued_by_job_id=2, pid=4359 2024-04-15T02:22:00.186311570Z [2024-04-15T02:22:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:00.226883094Z [2024-04-15T02:22:00.226+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:22:00.233625678Z [2024-04-15T02:22:00.233+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:22:00.330610185Z [2024-04-15T02:22:00.330+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:22:00.330622672Z 2024-04-15T02:22:00.330628554Z 2024-04-15T02:22:00.330631665Z 2024-04-15T02:22:00.330893332Z [2024-04-15T02:22:00.330+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:22:00.331107463Z [2024-04-15T02:22:00.330+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:22:00.331320817Z [2024-04-15T02:22:00.331+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:22:00.331865858Z [2024-04-15T02:22:00.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:22:00.331874456Z 2024-04-15T02:22:00.331879954Z 2024-04-15T02:22:00.331883099Z 2024-04-15T02:22:00.334914479Z [2024-04-15T02:22:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:22:00.335035936Z [2024-04-15T02:22:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:22:00.335220370Z [2024-04-15T02:22:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:22:00.335327505Z [2024-04-15T02:22:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:22:00.335526543Z [2024-04-15T02:22:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:22:00.335621799Z [2024-04-15T02:22:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:22:00.695267136Z [2024-04-15T02:22:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:22:00.695308600Z [2024-04-15T02:22:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status queued for try_number 1 2024-04-15T02:22:00.695384127Z [2024-04-15T02:22:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status queued for try_number 1 2024-04-15T02:22:00.721385371Z [2024-04-15T02:22:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3898e891-c38b-429f-b6d0-655c20e287df 2024-04-15T02:22:00.721539037Z [2024-04-15T02:22:00.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2664176a-8f06-46a6-ab6f-423515e3f0d6 2024-04-15T02:22:00.721636782Z [2024-04-15T02:22:00.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 285d2971-6f4b-4ddf-9a1a-29e68c85bbdb 2024-04-15T02:22:02.074556859Z [2024-04-15T02:22:02.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:22:02.074862634Z [2024-04-15T02:22:02.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:22:00.245452+00:00, run_end_date=2024-04-15 02:22:02.074570+00:00, run_duration=1.829118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:22:02.084358073Z [2024-04-15T02:22:02.084+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:22:03.308526341Z [2024-04-15T02:22:03.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:22:03.315060840Z [2024-04-15T02:22:03.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:22:01.493425+00:00, run_end_date=2024-04-15 02:22:02.037342+00:00, run_duration=0.543917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:22:00.332795+00:00, queued_by_job_id=2, pid=4395 2024-04-15T02:22:05.481455586Z [2024-04-15T02:22:05.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:22:05.481878350Z [2024-04-15T02:22:05.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:21:00+00:00, run_id=scheduled__2024-04-15T02:21:00+00:00, run_start_date=2024-04-15 02:22:00.247296+00:00, run_end_date=2024-04-15 02:22:05.481550+00:00, run_duration=5.234254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:21:00+00:00, data_interval_end=2024-04-15 02:22:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:22:05.494085125Z [2024-04-15T02:22:05.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:05.501392472Z [2024-04-15T02:22:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:22:05.501731620Z [2024-04-15T02:22:05.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:21:00+00:00, run_id=scheduled__2024-04-15T02:21:00+00:00, run_start_date=2024-04-15 02:22:00.248564+00:00, run_end_date=2024-04-15 02:22:05.501445+00:00, run_duration=5.252881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:21:00+00:00, data_interval_end=2024-04-15 02:22:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:22:05.519817049Z [2024-04-15T02:22:05.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:05.557140683Z [2024-04-15T02:22:05.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status success for try_number 1 2024-04-15T02:22:05.566605947Z [2024-04-15T02:22:05.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:21:00+00:00, map_index=-1, run_start_date=2024-04-15 02:22:03.300569+00:00, run_end_date=2024-04-15 02:22:04.635200+00:00, run_duration=1.334631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:22:00.332795+00:00, queued_by_job_id=2, pid=4424 2024-04-15T02:22:05.834164173Z [2024-04-15T02:22:05.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status success for try_number 1 2024-04-15T02:22:05.840121527Z [2024-04-15T02:22:05.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:21:00+00:00, map_index=-1, run_start_date=2024-04-15 02:22:03.395102+00:00, run_end_date=2024-04-15 02:22:05.449811+00:00, run_duration=2.054709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:22:00.332795+00:00, queued_by_job_id=2, pid=4425 2024-04-15T02:23:00.056542892Z [2024-04-15T02:23:00.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:23:00.070468817Z [2024-04-15T02:23:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:00.119738537Z [2024-04-15T02:23:00.119+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:23:00.119760895Z 2024-04-15T02:23:00.119764428Z 2024-04-15T02:23:00.119988361Z [2024-04-15T02:23:00.119+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:23:00.120166446Z [2024-04-15T02:23:00.120+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:23:00.120850352Z [2024-04-15T02:23:00.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:23:00.120859264Z 2024-04-15T02:23:00.120875374Z 2024-04-15T02:23:00.123759139Z [2024-04-15T02:23:00.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:23:00.123962077Z [2024-04-15T02:23:00.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:23:00.124325859Z [2024-04-15T02:23:00.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:23:00.124500385Z [2024-04-15T02:23:00.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:23:00.357522216Z [2024-04-15T02:23:00.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status queued for try_number 1 2024-04-15T02:23:00.357620061Z [2024-04-15T02:23:00.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status queued for try_number 1 2024-04-15T02:23:00.370632503Z [2024-04-15T02:23:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to f56b6e99-ffd3-4987-8bd7-a194c8d7801a 2024-04-15T02:23:00.370829232Z [2024-04-15T02:23:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72343148-eb61-4cd5-b365-ff9de07ae078 2024-04-15T02:23:05.193541829Z [2024-04-15T02:23:05.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:23:05.194151671Z [2024-04-15T02:23:05.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:22:00+00:00, run_id=scheduled__2024-04-15T02:22:00+00:00, run_start_date=2024-04-15 02:23:00.078831+00:00, run_end_date=2024-04-15 02:23:05.193421+00:00, run_duration=5.11459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:22:00+00:00, data_interval_end=2024-04-15 02:23:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:23:05.205866292Z [2024-04-15T02:23:05.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:05.214160593Z [2024-04-15T02:23:05.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:23:05.214635484Z [2024-04-15T02:23:05.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:22:00+00:00, run_id=scheduled__2024-04-15T02:22:00+00:00, run_start_date=2024-04-15 02:23:00.079842+00:00, run_end_date=2024-04-15 02:23:05.214141+00:00, run_duration=5.134299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:22:00+00:00, data_interval_end=2024-04-15 02:23:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:23:05.225381251Z [2024-04-15T02:23:05.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:05.267012712Z [2024-04-15T02:23:05.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status success for try_number 1 2024-04-15T02:23:05.267368938Z [2024-04-15T02:23:05.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status success for try_number 1 2024-04-15T02:23:05.275760607Z [2024-04-15T02:23:05.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:22:00+00:00, map_index=-1, run_start_date=2024-04-15 02:23:02.353699+00:00, run_end_date=2024-04-15 02:23:04.067015+00:00, run_duration=1.713316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:23:00.121347+00:00, queued_by_job_id=2, pid=4479 2024-04-15T02:23:05.276428827Z [2024-04-15T02:23:05.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:22:00+00:00, map_index=-1, run_start_date=2024-04-15 02:23:02.381304+00:00, run_end_date=2024-04-15 02:23:04.547197+00:00, run_duration=2.165893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:23:00.121347+00:00, queued_by_job_id=2, pid=4480 2024-04-15T02:24:00.256286115Z [2024-04-15T02:24:00.255+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:24:00.269856009Z [2024-04-15T02:24:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:00.279070789Z [2024-04-15T02:24:00.278+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:24:00.350088731Z [2024-04-15T02:24:00.349+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:24:00.350108037Z 2024-04-15T02:24:00.350124483Z 2024-04-15T02:24:00.350137828Z 2024-04-15T02:24:00.350304572Z [2024-04-15T02:24:00.350+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:24:00.350390950Z [2024-04-15T02:24:00.350+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:24:00.350526012Z [2024-04-15T02:24:00.350+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:24:00.351081835Z [2024-04-15T02:24:00.350+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:24:00.351090095Z 2024-04-15T02:24:00.351093524Z 2024-04-15T02:24:00.351096445Z 2024-04-15T02:24:00.354280739Z [2024-04-15T02:24:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:24:00.354668860Z [2024-04-15T02:24:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:24:00.355028592Z [2024-04-15T02:24:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:24:00.355202281Z [2024-04-15T02:24:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:24:00.355452873Z [2024-04-15T02:24:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:24:00.355939313Z [2024-04-15T02:24:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:24:00.676557224Z [2024-04-15T02:24:00.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status queued for try_number 1 2024-04-15T02:24:00.677035941Z [2024-04-15T02:24:00.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status queued for try_number 1 2024-04-15T02:24:00.677226566Z [2024-04-15T02:24:00.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status queued for try_number 1 2024-04-15T02:24:00.688088113Z [2024-04-15T02:24:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to eae1d988-fda1-44f3-985c-979ec6d11f07 2024-04-15T02:24:00.688684207Z [2024-04-15T02:24:00.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69e51fff-3827-4c34-9924-b3c40db650bc 2024-04-15T02:24:00.691034774Z [2024-04-15T02:24:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f636a9f-1398-48ef-a4cc-1f1e4f839617 2024-04-15T02:24:02.009136569Z [2024-04-15T02:24:02.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:24:02.009153318Z [2024-04-15T02:24:02.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:22:00+00:00, run_id=scheduled__2024-04-15T02:22:00+00:00, run_start_date=2024-04-15 02:24:00.291356+00:00, run_end_date=2024-04-15 02:24:02.008552+00:00, run_duration=1.717196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:22:00+00:00, data_interval_end=2024-04-15 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:24:02.020689879Z [2024-04-15T02:24:02.019+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:24:02.640396926Z [2024-04-15T02:24:02.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status success for try_number 1 2024-04-15T02:24:02.649633565Z [2024-04-15T02:24:02.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:22:00+00:00, map_index=-1, run_start_date=2024-04-15 02:24:01.362981+00:00, run_end_date=2024-04-15 02:24:01.909891+00:00, run_duration=0.54691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:24:00.351922+00:00, queued_by_job_id=2, pid=4516 2024-04-15T02:24:04.847203229Z [2024-04-15T02:24:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:24:04.847226488Z [2024-04-15T02:24:04.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:23:00+00:00, run_id=scheduled__2024-04-15T02:23:00+00:00, run_start_date=2024-04-15 02:24:00.292695+00:00, run_end_date=2024-04-15 02:24:04.846841+00:00, run_duration=4.554146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:23:00+00:00, data_interval_end=2024-04-15 02:24:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:24:04.883897936Z [2024-04-15T02:24:04.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:04.923758428Z [2024-04-15T02:24:04.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status success for try_number 1 2024-04-15T02:24:04.928230674Z [2024-04-15T02:24:04.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:23:00+00:00, map_index=-1, run_start_date=2024-04-15 02:24:03.064077+00:00, run_end_date=2024-04-15 02:24:04.322806+00:00, run_duration=1.258729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:24:00.351922+00:00, queued_by_job_id=2, pid=4546 2024-04-15T02:24:05.972882984Z [2024-04-15T02:24:05.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:24:05.973039901Z [2024-04-15T02:24:05.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:23:00+00:00, run_id=scheduled__2024-04-15T02:23:00+00:00, run_start_date=2024-04-15 02:24:00.293774+00:00, run_end_date=2024-04-15 02:24:05.972799+00:00, run_duration=5.679025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:23:00+00:00, data_interval_end=2024-04-15 02:24:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:24:05.982380282Z [2024-04-15T02:24:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:06.042782474Z [2024-04-15T02:24:06.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status success for try_number 1 2024-04-15T02:24:06.050730571Z [2024-04-15T02:24:06.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:23:00+00:00, map_index=-1, run_start_date=2024-04-15 02:24:02.722264+00:00, run_end_date=2024-04-15 02:24:05.368406+00:00, run_duration=2.646142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:24:00.351922+00:00, queued_by_job_id=2, pid=4545 2024-04-15T02:25:00.602717503Z [2024-04-15T02:25:00.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:25:00.623276303Z [2024-04-15T02:25:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:00.636626119Z [2024-04-15T02:25:00.636+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:25:00.721585816Z [2024-04-15T02:25:00.721+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:25:00.721602916Z 2024-04-15T02:25:00.721606919Z 2024-04-15T02:25:00.721622109Z 2024-04-15T02:25:00.725241466Z [2024-04-15T02:25:00.725+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:25:00.727666223Z [2024-04-15T02:25:00.727+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:25:00.730315248Z [2024-04-15T02:25:00.730+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:25:00.731291159Z [2024-04-15T02:25:00.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:00.731298860Z 2024-04-15T02:25:00.731302425Z 2024-04-15T02:25:00.731305480Z 2024-04-15T02:25:00.737076514Z [2024-04-15T02:25:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:25:00.737560724Z [2024-04-15T02:25:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:00.737949858Z [2024-04-15T02:25:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:25:00.738105480Z [2024-04-15T02:25:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:25:00.738432049Z [2024-04-15T02:25:00.738+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:25:00.739082116Z [2024-04-15T02:25:00.738+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:25:01.158928229Z [2024-04-15T02:25:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:01.159039051Z [2024-04-15T02:25:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:01.159184610Z [2024-04-15T02:25:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:01.172677090Z [2024-04-15T02:25:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d695780-3d23-485b-b008-0c436c0feccb 2024-04-15T02:25:01.172873698Z [2024-04-15T02:25:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to af529fbf-71c4-4112-9bdf-c524c1c6367d 2024-04-15T02:25:01.173073322Z [2024-04-15T02:25:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to db55352b-ce07-4b70-b57f-efed72b10c2e 2024-04-15T02:25:04.777719549Z [2024-04-15T02:25:04.777+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:25:04.777733928Z 2024-04-15T02:25:04.778028556Z [2024-04-15T02:25:04.777+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:25:04.778772408Z [2024-04-15T02:25:04.778+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:04.778781536Z 2024-04-15T02:25:04.781185076Z [2024-04-15T02:25:04.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:25:04.781332278Z [2024-04-15T02:25:04.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:04.895368271Z [2024-04-15T02:25:04.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:04.895389719Z [2024-04-15T02:25:04.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:04.899904970Z [2024-04-15T02:25:04.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6a6d875-9542-41b0-b9bd-63fc32460e7d 2024-04-15T02:25:04.900163286Z [2024-04-15T02:25:04.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:04.080328+00:00, run_end_date=2024-04-15 02:25:04.535469+00:00, run_duration=0.455141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:00.732846+00:00, queued_by_job_id=2, pid=4622 2024-04-15T02:25:06.041459403Z [2024-04-15T02:25:06.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:25:06.041689501Z [2024-04-15T02:25:06.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:24:00+00:00, run_id=scheduled__2024-04-15T02:24:00+00:00, run_start_date=2024-04-15 02:25:00.647939+00:00, run_end_date=2024-04-15 02:25:06.041389+00:00, run_duration=5.39345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:24:00+00:00, data_interval_end=2024-04-15 02:25:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:25:06.050413332Z [2024-04-15T02:25:06.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:06.055712192Z [2024-04-15T02:25:06.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:25:06.055878487Z [2024-04-15T02:25:06.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:24:00+00:00, run_id=scheduled__2024-04-15T02:24:00+00:00, run_start_date=2024-04-15 02:25:00.648858+00:00, run_end_date=2024-04-15 02:25:06.055636+00:00, run_duration=5.406778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:24:00+00:00, data_interval_end=2024-04-15 02:25:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:25:06.075727833Z [2024-04-15T02:25:06.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:06.117874943Z [2024-04-15T02:25:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:06.118218145Z [2024-04-15T02:25:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:06.124072612Z [2024-04-15T02:25:06.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:24:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:03.539455+00:00, run_end_date=2024-04-15 02:25:05.065422+00:00, run_duration=1.525967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:00.732846+00:00, queued_by_job_id=2, pid=4593 2024-04-15T02:25:06.124199434Z [2024-04-15T02:25:06.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:24:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:03.823941+00:00, run_end_date=2024-04-15 02:25:05.586284+00:00, run_duration=1.762343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:00.732846+00:00, queued_by_job_id=2, pid=4603 2024-04-15T02:25:07.184688995Z [2024-04-15T02:25:07.184+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:25:07.184723326Z 2024-04-15T02:25:07.190045827Z [2024-04-15T02:25:07.184+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:25:07.192632455Z [2024-04-15T02:25:07.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:07.192648630Z 2024-04-15T02:25:07.197026377Z [2024-04-15T02:25:07.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:25:07.197267518Z [2024-04-15T02:25:07.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:25:07.255206678Z [2024-04-15T02:25:07.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:07.256137844Z [2024-04-15T02:25:07.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:07.267446427Z [2024-04-15T02:25:07.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7e83959-336d-4058-ba16-5472e5bf4bfc 2024-04-15T02:25:07.267921868Z [2024-04-15T02:25:07.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:06.603620+00:00, run_end_date=2024-04-15 02:25:06.957041+00:00, run_duration=0.353421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:04.779252+00:00, queued_by_job_id=2, pid=4652 2024-04-15T02:25:09.926075900Z [2024-04-15T02:25:09.925+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:25:09.926092461Z 2024-04-15T02:25:09.926127563Z [2024-04-15T02:25:09.926+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:25:09.926788000Z [2024-04-15T02:25:09.926+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:09.926801417Z 2024-04-15T02:25:09.928795076Z [2024-04-15T02:25:09.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:25:09.928888286Z [2024-04-15T02:25:09.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:10.005501568Z [2024-04-15T02:25:10.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:10.005823108Z [2024-04-15T02:25:10.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:10.024238857Z [2024-04-15T02:25:10.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e20eb8b-1246-4c94-a922-0b76bd839ead 2024-04-15T02:25:10.024965585Z [2024-04-15T02:25:10.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=0, run_start_date=2024-04-15 02:25:08.944788+00:00, run_end_date=2024-04-15 02:25:09.333717+00:00, run_duration=0.388929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:07.193281+00:00, queued_by_job_id=2, pid=4664 2024-04-15T02:25:13.467150673Z [2024-04-15T02:25:13.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:25:13.467312358Z [2024-04-15T02:25:13.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:25:00.646858+00:00, run_end_date=2024-04-15 02:25:13.467100+00:00, run_duration=12.820242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:25:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:25:13.472569656Z [2024-04-15T02:25:13.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:25:13.504333346Z [2024-04-15T02:25:13.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:13.509007878Z [2024-04-15T02:25:13.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:12.402906+00:00, run_end_date=2024-04-15 02:25:12.835289+00:00, run_duration=0.432383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:09.927180+00:00, queued_by_job_id=2, pid=4676 2024-04-15T02:25:40.584079040Z [2024-04-15T02:25:40.583+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:26:00.484646561Z [2024-04-15T02:26:00.483+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:26:00.497372125Z [2024-04-15T02:26:00.497+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:26:00.511947980Z [2024-04-15T02:26:00.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:00.573495973Z [2024-04-15T02:26:00.573+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:26:00.573517701Z 2024-04-15T02:26:00.573525962Z 2024-04-15T02:26:00.573532805Z 2024-04-15T02:26:00.573555455Z [2024-04-15T02:26:00.573+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:26:00.573727423Z [2024-04-15T02:26:00.573+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:26:00.573819667Z [2024-04-15T02:26:00.573+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:26:00.574491685Z [2024-04-15T02:26:00.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:26:00.574508344Z 2024-04-15T02:26:00.574515206Z 2024-04-15T02:26:00.574521902Z 2024-04-15T02:26:00.578139242Z [2024-04-15T02:26:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:00.578292524Z [2024-04-15T02:26:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:26:00.578574925Z [2024-04-15T02:26:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:00.578678617Z [2024-04-15T02:26:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:26:00.578927533Z [2024-04-15T02:26:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:00.579585115Z [2024-04-15T02:26:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:26:00.895793861Z [2024-04-15T02:26:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status queued for try_number 1 2024-04-15T02:26:00.896328263Z [2024-04-15T02:26:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:26:00.896472240Z [2024-04-15T02:26:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:26:00.914539722Z [2024-04-15T02:26:00.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21544d85-8f20-4fe4-a07c-94e4a7807a17 2024-04-15T02:26:00.915032764Z [2024-04-15T02:26:00.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b51edc8-f8a3-4ff6-a129-a200f00e1c3a 2024-04-15T02:26:00.915224379Z [2024-04-15T02:26:00.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 893918e9-426a-4cfd-ab58-fabd9ac25926 2024-04-15T02:26:03.251197751Z [2024-04-15T02:26:03.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:03.252164362Z [2024-04-15T02:26:03.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:24:00+00:00, run_id=scheduled__2024-04-15T02:24:00+00:00, run_start_date=2024-04-15 02:26:00.521401+00:00, run_end_date=2024-04-15 02:26:03.251134+00:00, run_duration=2.729733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:24:00+00:00, data_interval_end=2024-04-15 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:26:03.261213742Z [2024-04-15T02:26:03.260+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:26:03.350757127Z [2024-04-15T02:26:03.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status success for try_number 1 2024-04-15T02:26:03.366905138Z [2024-04-15T02:26:03.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:24:00+00:00, map_index=-1, run_start_date=2024-04-15 02:26:01.805510+00:00, run_end_date=2024-04-15 02:26:02.519435+00:00, run_duration=0.713925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:00.575275+00:00, queued_by_job_id=2, pid=4693 2024-04-15T02:26:05.547827070Z [2024-04-15T02:26:05.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:05.548255953Z [2024-04-15T02:26:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:25:00+00:00, run_id=scheduled__2024-04-15T02:25:00+00:00, run_start_date=2024-04-15 02:26:00.522547+00:00, run_end_date=2024-04-15 02:26:05.547752+00:00, run_duration=5.025205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:25:00+00:00, data_interval_end=2024-04-15 02:26:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:26:05.556719111Z [2024-04-15T02:26:05.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:05.610135747Z [2024-04-15T02:26:05.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:26:05.617744576Z [2024-04-15T02:26:05.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:26:03.592590+00:00, run_end_date=2024-04-15 02:26:05.009802+00:00, run_duration=1.417212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:00.575275+00:00, queued_by_job_id=2, pid=4714 2024-04-15T02:26:06.663014857Z [2024-04-15T02:26:06.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:06.663382031Z [2024-04-15T02:26:06.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:25:00+00:00, run_id=scheduled__2024-04-15T02:25:00+00:00, run_start_date=2024-04-15 02:26:00.523864+00:00, run_end_date=2024-04-15 02:26:06.663047+00:00, run_duration=6.139183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:25:00+00:00, data_interval_end=2024-04-15 02:26:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:26:06.680105433Z [2024-04-15T02:26:06.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:06.725606279Z [2024-04-15T02:26:06.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:26:06.732598746Z [2024-04-15T02:26:06.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:26:03.939066+00:00, run_end_date=2024-04-15 02:26:05.692212+00:00, run_duration=1.753146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:00.575275+00:00, queued_by_job_id=2, pid=4732 2024-04-15T02:27:00.283070688Z [2024-04-15T02:27:00.282+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:27:00.295791759Z [2024-04-15T02:27:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:00.349413455Z [2024-04-15T02:27:00.349+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:27:00.349427692Z 2024-04-15T02:27:00.349431133Z 2024-04-15T02:27:00.349649129Z [2024-04-15T02:27:00.349+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:27:00.349859965Z [2024-04-15T02:27:00.349+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:27:00.350500079Z [2024-04-15T02:27:00.350+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:27:00.350511885Z 2024-04-15T02:27:00.350515305Z 2024-04-15T02:27:00.352934616Z [2024-04-15T02:27:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:27:00.353202936Z [2024-04-15T02:27:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:27:00.353560217Z [2024-04-15T02:27:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:27:00.353782769Z [2024-04-15T02:27:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:27:00.520099604Z [2024-04-15T02:27:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status queued for try_number 1 2024-04-15T02:27:00.520318598Z [2024-04-15T02:27:00.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status queued for try_number 1 2024-04-15T02:27:00.528960461Z [2024-04-15T02:27:00.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87048418-de78-4110-889b-e067ca5a25c8 2024-04-15T02:27:00.529228657Z [2024-04-15T02:27:00.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf048ea-cf42-4849-a50e-69559b3d0fd3 2024-04-15T02:27:05.060128237Z [2024-04-15T02:27:05.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:27:05.061318454Z [2024-04-15T02:27:05.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:26:00+00:00, run_id=scheduled__2024-04-15T02:26:00+00:00, run_start_date=2024-04-15 02:27:00.306962+00:00, run_end_date=2024-04-15 02:27:05.060909+00:00, run_duration=4.753947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:26:00+00:00, data_interval_end=2024-04-15 02:27:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:27:05.073356833Z [2024-04-15T02:27:05.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:05.129788909Z [2024-04-15T02:27:05.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status success for try_number 1 2024-04-15T02:27:05.134965527Z [2024-04-15T02:27:05.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:26:00+00:00, map_index=-1, run_start_date=2024-04-15 02:27:02.661241+00:00, run_end_date=2024-04-15 02:27:04.469517+00:00, run_duration=1.808276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:27:00.351038+00:00, queued_by_job_id=2, pid=4779 2024-04-15T02:27:05.613129726Z [2024-04-15T02:27:05.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:27:05.613478383Z [2024-04-15T02:27:05.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:26:00+00:00, run_id=scheduled__2024-04-15T02:26:00+00:00, run_start_date=2024-04-15 02:27:00.308212+00:00, run_end_date=2024-04-15 02:27:05.613081+00:00, run_duration=5.304869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:26:00+00:00, data_interval_end=2024-04-15 02:27:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:27:05.621610061Z [2024-04-15T02:27:05.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:05.653072192Z [2024-04-15T02:27:05.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status success for try_number 1 2024-04-15T02:27:05.658962125Z [2024-04-15T02:27:05.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:26:00+00:00, map_index=-1, run_start_date=2024-04-15 02:27:02.631229+00:00, run_end_date=2024-04-15 02:27:05.190841+00:00, run_duration=2.559612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:27:00.351038+00:00, queued_by_job_id=2, pid=4778 2024-04-15T02:28:00.178636442Z [2024-04-15T02:28:00.178+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:28:00.185535234Z [2024-04-15T02:28:00.185+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:28:00.202397969Z [2024-04-15T02:28:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:00.269961553Z [2024-04-15T02:28:00.269+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:28:00.269977609Z 2024-04-15T02:28:00.269981634Z 2024-04-15T02:28:00.269984928Z 2024-04-15T02:28:00.270195801Z [2024-04-15T02:28:00.269+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:28:00.270412033Z [2024-04-15T02:28:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:28:00.270594475Z [2024-04-15T02:28:00.270+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:28:00.271492512Z [2024-04-15T02:28:00.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:28:00.271512797Z 2024-04-15T02:28:00.271519500Z 2024-04-15T02:28:00.271525123Z 2024-04-15T02:28:00.280277074Z [2024-04-15T02:28:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:28:00.280846180Z [2024-04-15T02:28:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:28:00.281200759Z [2024-04-15T02:28:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:28:00.281385877Z [2024-04-15T02:28:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:28:00.281669934Z [2024-04-15T02:28:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:28:00.281745083Z [2024-04-15T02:28:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:28:00.507477829Z [2024-04-15T02:28:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status queued for try_number 1 2024-04-15T02:28:00.507729866Z [2024-04-15T02:28:00.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status queued for try_number 1 2024-04-15T02:28:00.507914621Z [2024-04-15T02:28:00.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status queued for try_number 1 2024-04-15T02:28:00.518250130Z [2024-04-15T02:28:00.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5182ed0-80a0-4208-afcf-461902930132 2024-04-15T02:28:00.518323967Z [2024-04-15T02:28:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to f740f772-c976-4c45-a820-39c1328a458d 2024-04-15T02:28:00.518427686Z [2024-04-15T02:28:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3ef7acd-7e1f-4e76-9b7f-c51cce802cb9 2024-04-15T02:28:02.651972645Z [2024-04-15T02:28:02.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:28:02.652180958Z [2024-04-15T02:28:02.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:26:00+00:00, run_id=scheduled__2024-04-15T02:26:00+00:00, run_start_date=2024-04-15 02:28:00.215154+00:00, run_end_date=2024-04-15 02:28:02.651896+00:00, run_duration=2.436742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:26:00+00:00, data_interval_end=2024-04-15 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:28:02.669388556Z [2024-04-15T02:28:02.669+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:28:02.770096176Z [2024-04-15T02:28:02.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status success for try_number 1 2024-04-15T02:28:02.778803513Z [2024-04-15T02:28:02.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:26:00+00:00, map_index=-1, run_start_date=2024-04-15 02:28:01.431245+00:00, run_end_date=2024-04-15 02:28:02.106065+00:00, run_duration=0.67482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:28:00.272700+00:00, queued_by_job_id=2, pid=4814 2024-04-15T02:28:05.003431952Z [2024-04-15T02:28:05.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:28:05.003962419Z [2024-04-15T02:28:05.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:27:00+00:00, run_id=scheduled__2024-04-15T02:27:00+00:00, run_start_date=2024-04-15 02:28:00.216413+00:00, run_end_date=2024-04-15 02:28:05.003383+00:00, run_duration=4.78697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:27:00+00:00, data_interval_end=2024-04-15 02:28:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:28:05.013635652Z [2024-04-15T02:28:05.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:05.050778689Z [2024-04-15T02:28:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status success for try_number 1 2024-04-15T02:28:05.055212556Z [2024-04-15T02:28:05.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:27:00+00:00, map_index=-1, run_start_date=2024-04-15 02:28:03.409725+00:00, run_end_date=2024-04-15 02:28:04.863807+00:00, run_duration=1.454082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:28:00.272700+00:00, queued_by_job_id=2, pid=4835 2024-04-15T02:28:06.118867711Z [2024-04-15T02:28:06.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:28:06.119246556Z [2024-04-15T02:28:06.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:27:00+00:00, run_id=scheduled__2024-04-15T02:27:00+00:00, run_start_date=2024-04-15 02:28:00.217534+00:00, run_end_date=2024-04-15 02:28:06.118718+00:00, run_duration=5.901184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:27:00+00:00, data_interval_end=2024-04-15 02:28:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:28:06.128366779Z [2024-04-15T02:28:06.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:06.167343466Z [2024-04-15T02:28:06.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status success for try_number 1 2024-04-15T02:28:06.171690636Z [2024-04-15T02:28:06.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:27:00+00:00, map_index=-1, run_start_date=2024-04-15 02:28:03.784915+00:00, run_end_date=2024-04-15 02:28:05.578093+00:00, run_duration=1.793178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:28:00.272700+00:00, queued_by_job_id=2, pid=4854 2024-04-15T02:29:00.382793126Z [2024-04-15T02:29:00.382+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:29:00.394568189Z [2024-04-15T02:29:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:00.462392507Z [2024-04-15T02:29:00.462+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:29:00.462420105Z 2024-04-15T02:29:00.462429254Z 2024-04-15T02:29:00.462437809Z [2024-04-15T02:29:00.462+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:29:00.462848678Z [2024-04-15T02:29:00.462+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:29:00.463380009Z [2024-04-15T02:29:00.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:29:00.463399921Z 2024-04-15T02:29:00.463408906Z 2024-04-15T02:29:00.469589787Z [2024-04-15T02:29:00.468+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:29:00.469790411Z [2024-04-15T02:29:00.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:29:00.470274298Z [2024-04-15T02:29:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:29:00.470513529Z [2024-04-15T02:29:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:29:00.636922684Z [2024-04-15T02:29:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status queued for try_number 1 2024-04-15T02:29:00.637057643Z [2024-04-15T02:29:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status queued for try_number 1 2024-04-15T02:29:00.643261702Z [2024-04-15T02:29:00.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52422288-6b1f-4e79-b3e4-3f86533b80ea 2024-04-15T02:29:00.643396863Z [2024-04-15T02:29:00.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6ea14b9-863b-4bb2-bcf3-bd414a5ca3db 2024-04-15T02:29:05.779558400Z [2024-04-15T02:29:05.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:29:05.780040241Z [2024-04-15T02:29:05.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:28:00+00:00, run_id=scheduled__2024-04-15T02:28:00+00:00, run_start_date=2024-04-15 02:29:00.418822+00:00, run_end_date=2024-04-15 02:29:05.779492+00:00, run_duration=5.36067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:28:00+00:00, data_interval_end=2024-04-15 02:29:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:29:05.800604462Z [2024-04-15T02:29:05.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:05.810099366Z [2024-04-15T02:29:05.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:29:05.810698419Z [2024-04-15T02:29:05.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:28:00+00:00, run_id=scheduled__2024-04-15T02:28:00+00:00, run_start_date=2024-04-15 02:29:00.414262+00:00, run_end_date=2024-04-15 02:29:05.810034+00:00, run_duration=5.395772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:28:00+00:00, data_interval_end=2024-04-15 02:29:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:29:05.823640887Z [2024-04-15T02:29:05.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:05.851486084Z [2024-04-15T02:29:05.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status success for try_number 1 2024-04-15T02:29:05.851506337Z [2024-04-15T02:29:05.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status success for try_number 1 2024-04-15T02:29:05.858229468Z [2024-04-15T02:29:05.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:28:00+00:00, map_index=-1, run_start_date=2024-04-15 02:29:02.667510+00:00, run_end_date=2024-04-15 02:29:05.225553+00:00, run_duration=2.558043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:29:00.463967+00:00, queued_by_job_id=2, pid=4897 2024-04-15T02:29:05.858833146Z [2024-04-15T02:29:05.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:28:00+00:00, map_index=-1, run_start_date=2024-04-15 02:29:02.962084+00:00, run_end_date=2024-04-15 02:29:05.022414+00:00, run_duration=2.06033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:29:00.463967+00:00, queued_by_job_id=2, pid=4898 2024-04-15T02:30:00.609378832Z [2024-04-15T02:30:00.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:00.623874030Z [2024-04-15T02:30:00.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:30:00.634846475Z [2024-04-15T02:30:00.634+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:30:00.642583242Z [2024-04-15T02:30:00.642+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:30:00.722271614Z [2024-04-15T02:30:00.721+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:30:00.722284137Z 2024-04-15T02:30:00.722287109Z 2024-04-15T02:30:00.722290511Z 2024-04-15T02:30:00.722293209Z 2024-04-15T02:30:00.722353224Z [2024-04-15T02:30:00.722+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:30:00.722459650Z [2024-04-15T02:30:00.722+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:30:00.722560775Z [2024-04-15T02:30:00.722+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:30:00.722652796Z [2024-04-15T02:30:00.722+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:30:00.723289377Z [2024-04-15T02:30:00.723+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:00.723300114Z 2024-04-15T02:30:00.723303296Z 2024-04-15T02:30:00.723306388Z 2024-04-15T02:30:00.723320435Z 2024-04-15T02:30:00.727419511Z [2024-04-15T02:30:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:30:00.727567936Z [2024-04-15T02:30:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:00.727794750Z [2024-04-15T02:30:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:00.727903892Z [2024-04-15T02:30:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:30:00.728099736Z [2024-04-15T02:30:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:00.728196416Z [2024-04-15T02:30:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:30:00.728638184Z [2024-04-15T02:30:00.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:00.728720736Z [2024-04-15T02:30:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:30:01.176886293Z [2024-04-15T02:30:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.176976426Z [2024-04-15T02:30:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.177047103Z [2024-04-15T02:30:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.177092348Z [2024-04-15T02:30:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.215762049Z [2024-04-15T02:30:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0bffee8-4eba-4d28-8e94-cdba4af8318a 2024-04-15T02:30:01.215834941Z [2024-04-15T02:30:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33c62b33-9c42-4518-b177-ea817573dfa6 2024-04-15T02:30:01.215948245Z [2024-04-15T02:30:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ca488e8-d7a8-473f-8cad-826d1e748089 2024-04-15T02:30:01.216034027Z [2024-04-15T02:30:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74e22b96-8f5f-4c4b-a02d-2fef4cbf10e5 2024-04-15T02:30:03.419245381Z [2024-04-15T02:30:03.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:03.419605169Z [2024-04-15T02:30:03.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:28:00+00:00, run_id=scheduled__2024-04-15T02:28:00+00:00, run_start_date=2024-04-15 02:30:00.654029+00:00, run_end_date=2024-04-15 02:30:03.419230+00:00, run_duration=2.765201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:28:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:30:03.430854236Z [2024-04-15T02:30:03.430+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:30:03.550947107Z [2024-04-15T02:30:03.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:03.566299364Z [2024-04-15T02:30:03.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:28:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:02.203591+00:00, run_end_date=2024-04-15 02:30:02.990451+00:00, run_duration=0.78686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.724273+00:00, queued_by_job_id=2, pid=4934 2024-04-15T02:30:05.861436057Z [2024-04-15T02:30:05.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:05.861844556Z [2024-04-15T02:30:05.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:29:00+00:00, run_id=scheduled__2024-04-15T02:29:00+00:00, run_start_date=2024-04-15 02:30:00.655098+00:00, run_end_date=2024-04-15 02:30:05.861370+00:00, run_duration=5.206272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:29:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:30:05.872610952Z [2024-04-15T02:30:05.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:05.916844070Z [2024-04-15T02:30:05.916+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:30:05.916861342Z 2024-04-15T02:30:05.916998548Z [2024-04-15T02:30:05.916+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:30:05.917539153Z [2024-04-15T02:30:05.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:05.917550654Z 2024-04-15T02:30:05.919778757Z [2024-04-15T02:30:05.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:30:05.919884244Z [2024-04-15T02:30:05.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:05.967032156Z [2024-04-15T02:30:05.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:05.967076945Z [2024-04-15T02:30:05.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:05.967206909Z [2024-04-15T02:30:05.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:05.972987886Z [2024-04-15T02:30:05.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:04.601561+00:00, run_end_date=2024-04-15 02:30:05.198606+00:00, run_duration=0.597045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.724273+00:00, queued_by_job_id=2, pid=4984 2024-04-15T02:30:05.973257752Z [2024-04-15T02:30:05.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:29:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:04.001051+00:00, run_end_date=2024-04-15 02:30:05.505019+00:00, run_duration=1.503968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.724273+00:00, queued_by_job_id=2, pid=4956 2024-04-15T02:30:05.973527965Z [2024-04-15T02:30:05.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c4fe240-c9b2-40ce-96cf-7440e8f49f05 2024-04-15T02:30:07.139124993Z [2024-04-15T02:30:07.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:07.139336935Z [2024-04-15T02:30:07.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:29:00+00:00, run_id=scheduled__2024-04-15T02:29:00+00:00, run_start_date=2024-04-15 02:30:00.656016+00:00, run_end_date=2024-04-15 02:30:07.139062+00:00, run_duration=6.483046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:29:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:30:07.150049163Z [2024-04-15T02:30:07.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:07.202598909Z [2024-04-15T02:30:07.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:07.208161518Z [2024-04-15T02:30:07.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:29:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:04.640580+00:00, run_end_date=2024-04-15 02:30:06.421874+00:00, run_duration=1.781294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.724273+00:00, queued_by_job_id=2, pid=4985 2024-04-15T02:30:08.249243038Z [2024-04-15T02:30:08.248+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:30:08.249302543Z 2024-04-15T02:30:08.249347677Z [2024-04-15T02:30:08.249+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:30:08.249833316Z [2024-04-15T02:30:08.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:08.249877219Z 2024-04-15T02:30:08.252546669Z [2024-04-15T02:30:08.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:30:08.252869814Z [2024-04-15T02:30:08.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:30:08.318858577Z [2024-04-15T02:30:08.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:08.325370283Z [2024-04-15T02:30:08.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to b76ee690-0b4d-453c-bd6c-3308106d773a 2024-04-15T02:30:08.429862152Z [2024-04-15T02:30:08.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:08.441605446Z [2024-04-15T02:30:08.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:07.667289+00:00, run_end_date=2024-04-15 02:30:08.044003+00:00, run_duration=0.376714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:05.917847+00:00, queued_by_job_id=2, pid=5015 2024-04-15T02:30:11.503258644Z [2024-04-15T02:30:11.502+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:30:11.503271727Z 2024-04-15T02:30:11.503642188Z [2024-04-15T02:30:11.503+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:30:11.505105524Z [2024-04-15T02:30:11.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:11.505116514Z 2024-04-15T02:30:11.509920235Z [2024-04-15T02:30:11.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:11.510104587Z [2024-04-15T02:30:11.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:11.590839574Z [2024-04-15T02:30:11.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:11.591113376Z [2024-04-15T02:30:11.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:11.605213750Z [2024-04-15T02:30:11.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c16e97f-64b1-49f6-8438-2f30c9014533 2024-04-15T02:30:11.606608500Z [2024-04-15T02:30:11.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=0, run_start_date=2024-04-15 02:30:10.428347+00:00, run_end_date=2024-04-15 02:30:10.784449+00:00, run_duration=0.356102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:08.250452+00:00, queued_by_job_id=2, pid=5027 2024-04-15T02:30:14.620626964Z [2024-04-15T02:30:14.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:14.620986707Z [2024-04-15T02:30:14.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:25:00+00:00, run_id=scheduled__2024-04-15T02:25:00+00:00, run_start_date=2024-04-15 02:30:00.652602+00:00, run_end_date=2024-04-15 02:30:14.620638+00:00, run_duration=13.968036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:25:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:30:14.629222301Z [2024-04-15T02:30:14.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:30:14.661317703Z [2024-04-15T02:30:14.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:14.670029926Z [2024-04-15T02:30:14.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:13.423279+00:00, run_end_date=2024-04-15 02:30:13.875190+00:00, run_duration=0.451911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:11.506276+00:00, queued_by_job_id=2, pid=5039 2024-04-15T02:30:40.664029696Z [2024-04-15T02:30:40.663+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:31:00.894659951Z [2024-04-15T02:31:00.894+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:31:00.911346609Z [2024-04-15T02:31:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:00.966926200Z [2024-04-15T02:31:00.966+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:31:00.966941690Z 2024-04-15T02:31:00.966944973Z 2024-04-15T02:31:00.967088755Z [2024-04-15T02:31:00.966+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:31:00.967377377Z [2024-04-15T02:31:00.967+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:31:00.967945827Z [2024-04-15T02:31:00.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:31:00.967956914Z 2024-04-15T02:31:00.967960408Z 2024-04-15T02:31:00.971790555Z [2024-04-15T02:31:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:31:00.972070678Z [2024-04-15T02:31:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:31:00.972500061Z [2024-04-15T02:31:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:31:00.972741301Z [2024-04-15T02:31:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:31:01.195951873Z [2024-04-15T02:31:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:31:01.196179389Z [2024-04-15T02:31:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:31:01.203340357Z [2024-04-15T02:31:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 820679ee-f769-4e42-afcd-18dc5a0ef6ca 2024-04-15T02:31:01.203897195Z [2024-04-15T02:31:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to a692f655-cc29-4216-a7af-6fbc81cdccbc 2024-04-15T02:31:05.688631350Z [2024-04-15T02:31:05.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:31:05.688662660Z [2024-04-15T02:31:05.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:31:00.921107+00:00, run_end_date=2024-04-15 02:31:05.687845+00:00, run_duration=4.766738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:31:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:31:05.703875373Z [2024-04-15T02:31:05.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:05.761511186Z [2024-04-15T02:31:05.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:31:05.771885200Z [2024-04-15T02:31:05.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:31:03.314559+00:00, run_end_date=2024-04-15 02:31:04.903524+00:00, run_duration=1.588965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:31:00.968615+00:00, queued_by_job_id=2, pid=5066 2024-04-15T02:31:06.825609883Z [2024-04-15T02:31:06.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:31:06.826107861Z [2024-04-15T02:31:06.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:31:00.922269+00:00, run_end_date=2024-04-15 02:31:06.825521+00:00, run_duration=5.903252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:31:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:31:06.835457752Z [2024-04-15T02:31:06.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:06.869302299Z [2024-04-15T02:31:06.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:31:06.874219309Z [2024-04-15T02:31:06.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:31:03.592058+00:00, run_end_date=2024-04-15 02:31:06.475095+00:00, run_duration=2.883037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:31:00.968615+00:00, queued_by_job_id=2, pid=5076 2024-04-15T02:32:00.104839659Z [2024-04-15T02:32:00.104+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:32:00.121933676Z [2024-04-15T02:32:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:00.131549915Z [2024-04-15T02:32:00.131+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:32:00.203921916Z [2024-04-15T02:32:00.203+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:32:00.203937123Z 2024-04-15T02:32:00.203941279Z 2024-04-15T02:32:00.203944561Z 2024-04-15T02:32:00.204173760Z [2024-04-15T02:32:00.203+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:32:00.204336839Z [2024-04-15T02:32:00.204+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:32:00.204744368Z [2024-04-15T02:32:00.204+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:32:00.205605385Z [2024-04-15T02:32:00.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:32:00.205613277Z 2024-04-15T02:32:00.205616930Z 2024-04-15T02:32:00.205619892Z 2024-04-15T02:32:00.212913314Z [2024-04-15T02:32:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:32:00.213926169Z [2024-04-15T02:32:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:32:00.214437649Z [2024-04-15T02:32:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:32:00.214732722Z [2024-04-15T02:32:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:32:00.215106946Z [2024-04-15T02:32:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:32:00.216249132Z [2024-04-15T02:32:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:32:00.444077081Z [2024-04-15T02:32:00.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:32:00.444734679Z [2024-04-15T02:32:00.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status queued for try_number 1 2024-04-15T02:32:00.444850623Z [2024-04-15T02:32:00.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status queued for try_number 1 2024-04-15T02:32:00.460974206Z [2024-04-15T02:32:00.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24b1132c-3ee2-4555-834d-caf17ecf0b59 2024-04-15T02:32:00.462377512Z [2024-04-15T02:32:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8895252f-d74e-48eb-b418-b7a67aa586e2 2024-04-15T02:32:00.462613301Z [2024-04-15T02:32:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5412744c-95b1-4336-ad08-3353e6336fa1 2024-04-15T02:32:02.779313357Z [2024-04-15T02:32:02.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:32:02.779602154Z [2024-04-15T02:32:02.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:32:00.143635+00:00, run_end_date=2024-04-15 02:32:02.779266+00:00, run_duration=2.635631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:32:02.788724904Z [2024-04-15T02:32:02.788+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:32:02.937626806Z [2024-04-15T02:32:02.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:32:02.940791969Z [2024-04-15T02:32:02.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:32:01.160180+00:00, run_end_date=2024-04-15 02:32:01.793225+00:00, run_duration=0.633045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:32:00.207227+00:00, queued_by_job_id=2, pid=5110 2024-04-15T02:32:05.123599127Z [2024-04-15T02:32:05.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:32:05.124274974Z [2024-04-15T02:32:05.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:31:00+00:00, run_id=scheduled__2024-04-15T02:31:00+00:00, run_start_date=2024-04-15 02:32:00.145224+00:00, run_end_date=2024-04-15 02:32:05.123573+00:00, run_duration=4.978349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:31:00+00:00, data_interval_end=2024-04-15 02:32:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:32:05.136090518Z [2024-04-15T02:32:05.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:05.147265986Z [2024-04-15T02:32:05.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:32:05.147613365Z [2024-04-15T02:32:05.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:31:00+00:00, run_id=scheduled__2024-04-15T02:31:00+00:00, run_start_date=2024-04-15 02:32:00.154281+00:00, run_end_date=2024-04-15 02:32:05.147295+00:00, run_duration=4.993014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:31:00+00:00, data_interval_end=2024-04-15 02:32:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:32:05.158189839Z [2024-04-15T02:32:05.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:05.197387373Z [2024-04-15T02:32:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status success for try_number 1 2024-04-15T02:32:05.197546934Z [2024-04-15T02:32:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status success for try_number 1 2024-04-15T02:32:05.203263194Z [2024-04-15T02:32:05.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:31:00+00:00, map_index=-1, run_start_date=2024-04-15 02:32:02.701486+00:00, run_end_date=2024-04-15 02:32:04.189765+00:00, run_duration=1.488279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:32:00.207227+00:00, queued_by_job_id=2, pid=5140 2024-04-15T02:32:05.203519768Z [2024-04-15T02:32:05.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:31:00+00:00, map_index=-1, run_start_date=2024-04-15 02:32:02.719105+00:00, run_end_date=2024-04-15 02:32:04.547713+00:00, run_duration=1.828608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:32:00.207227+00:00, queued_by_job_id=2, pid=5141 2024-04-15T02:33:00.396186637Z [2024-04-15T02:33:00.395+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:33:00.407537496Z [2024-04-15T02:33:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:00.460513519Z [2024-04-15T02:33:00.460+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:33:00.460528073Z 2024-04-15T02:33:00.460532801Z 2024-04-15T02:33:00.460764589Z [2024-04-15T02:33:00.460+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:33:00.461392511Z [2024-04-15T02:33:00.460+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:33:00.461615628Z [2024-04-15T02:33:00.461+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:33:00.461626275Z 2024-04-15T02:33:00.461640739Z 2024-04-15T02:33:00.463996751Z [2024-04-15T02:33:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:33:00.464163978Z [2024-04-15T02:33:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:33:00.464444114Z [2024-04-15T02:33:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:33:00.464709959Z [2024-04-15T02:33:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:33:00.629249956Z [2024-04-15T02:33:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status queued for try_number 1 2024-04-15T02:33:00.629423128Z [2024-04-15T02:33:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status queued for try_number 1 2024-04-15T02:33:00.637087250Z [2024-04-15T02:33:00.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49eb54db-6ea5-4920-bb25-79d084f10f3d 2024-04-15T02:33:00.637349172Z [2024-04-15T02:33:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 827b88f3-fd07-4fa6-be04-0cdd06b25a2f 2024-04-15T02:33:04.756534480Z [2024-04-15T02:33:04.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:33:04.756950912Z [2024-04-15T02:33:04.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:32:00+00:00, run_id=scheduled__2024-04-15T02:32:00+00:00, run_start_date=2024-04-15 02:33:00.421453+00:00, run_end_date=2024-04-15 02:33:04.756613+00:00, run_duration=4.33516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:32:00+00:00, data_interval_end=2024-04-15 02:33:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:33:04.769097385Z [2024-04-15T02:33:04.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:04.838327716Z [2024-04-15T02:33:04.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status success for try_number 1 2024-04-15T02:33:04.843517978Z [2024-04-15T02:33:04.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:32:00+00:00, map_index=-1, run_start_date=2024-04-15 02:33:02.826080+00:00, run_end_date=2024-04-15 02:33:04.212425+00:00, run_duration=1.386345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:33:00.462082+00:00, queued_by_job_id=2, pid=5195 2024-04-15T02:33:05.886432104Z [2024-04-15T02:33:05.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:33:05.886906195Z [2024-04-15T02:33:05.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:32:00+00:00, run_id=scheduled__2024-04-15T02:32:00+00:00, run_start_date=2024-04-15 02:33:00.423097+00:00, run_end_date=2024-04-15 02:33:05.886353+00:00, run_duration=5.463256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:32:00+00:00, data_interval_end=2024-04-15 02:33:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:33:05.900844509Z [2024-04-15T02:33:05.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:05.936780729Z [2024-04-15T02:33:05.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status success for try_number 1 2024-04-15T02:33:05.941164719Z [2024-04-15T02:33:05.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:32:00+00:00, map_index=-1, run_start_date=2024-04-15 02:33:03.069258+00:00, run_end_date=2024-04-15 02:33:05.124211+00:00, run_duration=2.054953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:33:00.462082+00:00, queued_by_job_id=2, pid=5196 2024-04-15T02:34:00.501018652Z [2024-04-15T02:34:00.500+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:34:00.510783940Z [2024-04-15T02:34:00.510+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:34:00.532202165Z [2024-04-15T02:34:00.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:00.607830910Z [2024-04-15T02:34:00.607+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:34:00.607844049Z 2024-04-15T02:34:00.607848368Z 2024-04-15T02:34:00.607862175Z 2024-04-15T02:34:00.608085736Z [2024-04-15T02:34:00.607+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:34:00.608293836Z [2024-04-15T02:34:00.608+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:34:00.608509944Z [2024-04-15T02:34:00.608+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:34:00.609114154Z [2024-04-15T02:34:00.608+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:34:00.609125353Z 2024-04-15T02:34:00.609128926Z 2024-04-15T02:34:00.609132259Z 2024-04-15T02:34:00.612500805Z [2024-04-15T02:34:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:34:00.612990903Z [2024-04-15T02:34:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:34:00.613332435Z [2024-04-15T02:34:00.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:34:00.613553005Z [2024-04-15T02:34:00.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:34:00.613938574Z [2024-04-15T02:34:00.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:34:00.614147632Z [2024-04-15T02:34:00.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:34:00.978941497Z [2024-04-15T02:34:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status queued for try_number 1 2024-04-15T02:34:00.979172482Z [2024-04-15T02:34:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status queued for try_number 1 2024-04-15T02:34:00.979308555Z [2024-04-15T02:34:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status queued for try_number 1 2024-04-15T02:34:00.994387041Z [2024-04-15T02:34:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36bd6783-11a5-43ef-bce9-32eb3cbc740f 2024-04-15T02:34:00.995221010Z [2024-04-15T02:34:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42a1b88f-01a2-466d-ab5c-355f669adac5 2024-04-15T02:34:00.995791275Z [2024-04-15T02:34:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50dac2b3-c7a8-4730-a93a-3fc16c8f2458 2024-04-15T02:34:03.466398089Z [2024-04-15T02:34:03.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:34:03.466615532Z [2024-04-15T02:34:03.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:32:00+00:00, run_id=scheduled__2024-04-15T02:32:00+00:00, run_start_date=2024-04-15 02:34:00.547190+00:00, run_end_date=2024-04-15 02:34:03.466344+00:00, run_duration=2.919154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:32:00+00:00, data_interval_end=2024-04-15 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:34:03.473540164Z [2024-04-15T02:34:03.473+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:34:03.565538641Z [2024-04-15T02:34:03.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status success for try_number 1 2024-04-15T02:34:03.572795332Z [2024-04-15T02:34:03.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:32:00+00:00, map_index=-1, run_start_date=2024-04-15 02:34:01.869827+00:00, run_end_date=2024-04-15 02:34:02.724849+00:00, run_duration=0.855022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:34:00.609874+00:00, queued_by_job_id=2, pid=5231 2024-04-15T02:34:05.735817266Z [2024-04-15T02:34:05.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:34:05.736974704Z [2024-04-15T02:34:05.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:33:00+00:00, run_id=scheduled__2024-04-15T02:33:00+00:00, run_start_date=2024-04-15 02:34:00.548442+00:00, run_end_date=2024-04-15 02:34:05.735894+00:00, run_duration=5.187452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:33:00+00:00, data_interval_end=2024-04-15 02:34:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:34:05.755463885Z [2024-04-15T02:34:05.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:05.769887986Z [2024-04-15T02:34:05.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:34:05.770283208Z [2024-04-15T02:34:05.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:33:00+00:00, run_id=scheduled__2024-04-15T02:33:00+00:00, run_start_date=2024-04-15 02:34:00.549546+00:00, run_end_date=2024-04-15 02:34:05.769935+00:00, run_duration=5.220389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:33:00+00:00, data_interval_end=2024-04-15 02:34:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:34:05.782161662Z [2024-04-15T02:34:05.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:05.821616128Z [2024-04-15T02:34:05.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status success for try_number 1 2024-04-15T02:34:05.821747765Z [2024-04-15T02:34:05.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status success for try_number 1 2024-04-15T02:34:05.828243430Z [2024-04-15T02:34:05.827+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:33:00+00:00, map_index=-1, run_start_date=2024-04-15 02:34:03.549821+00:00, run_end_date=2024-04-15 02:34:04.961685+00:00, run_duration=1.411864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:34:00.609874+00:00, queued_by_job_id=2, pid=5261 2024-04-15T02:34:05.828534094Z [2024-04-15T02:34:05.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:33:00+00:00, map_index=-1, run_start_date=2024-04-15 02:34:03.574598+00:00, run_end_date=2024-04-15 02:34:05.417254+00:00, run_duration=1.842656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:34:00.609874+00:00, queued_by_job_id=2, pid=5262 2024-04-15T02:35:00.331774401Z [2024-04-15T02:35:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:00.347636309Z [2024-04-15T02:35:00.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:35:00.358949006Z [2024-04-15T02:35:00.358+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:35:00.449430991Z [2024-04-15T02:35:00.449+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:35:00.449444475Z 2024-04-15T02:35:00.449448706Z 2024-04-15T02:35:00.449464222Z 2024-04-15T02:35:00.449652022Z [2024-04-15T02:35:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:35:00.449827820Z [2024-04-15T02:35:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:35:00.450035162Z [2024-04-15T02:35:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:35:00.450710702Z [2024-04-15T02:35:00.450+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:00.450720968Z 2024-04-15T02:35:00.450724436Z 2024-04-15T02:35:00.450727334Z 2024-04-15T02:35:00.455054055Z [2024-04-15T02:35:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:35:00.455234745Z [2024-04-15T02:35:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:00.455618248Z [2024-04-15T02:35:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:35:00.455806990Z [2024-04-15T02:35:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:35:00.456083555Z [2024-04-15T02:35:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:35:00.456232892Z [2024-04-15T02:35:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:35:00.681506425Z [2024-04-15T02:35:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:00.681552803Z [2024-04-15T02:35:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:00.681644967Z [2024-04-15T02:35:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:00.691241902Z [2024-04-15T02:35:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7550a345-8cdc-42fe-838c-3865d891f5c3 2024-04-15T02:35:00.691470884Z [2024-04-15T02:35:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 046844b7-ffe2-47a6-856e-a694c3060038 2024-04-15T02:35:00.691626215Z [2024-04-15T02:35:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17cab90c-cc6c-44ba-9cd3-bfc043c9b906 2024-04-15T02:35:04.650013700Z [2024-04-15T02:35:04.646+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:35:04.650048230Z 2024-04-15T02:35:04.651813611Z [2024-04-15T02:35:04.650+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:35:04.652612374Z [2024-04-15T02:35:04.652+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:04.652627745Z 2024-04-15T02:35:04.655916903Z [2024-04-15T02:35:04.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:35:04.656148295Z [2024-04-15T02:35:04.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:04.715927653Z [2024-04-15T02:35:04.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:04.716085644Z [2024-04-15T02:35:04.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:04.721227339Z [2024-04-15T02:35:04.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb395055-59eb-4d64-bcc4-57638858d8ac 2024-04-15T02:35:04.721572041Z [2024-04-15T02:35:04.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:03.644437+00:00, run_end_date=2024-04-15 02:35:04.194280+00:00, run_duration=0.549843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:00.451581+00:00, queued_by_job_id=2, pid=5329 2024-04-15T02:35:05.950413891Z [2024-04-15T02:35:05.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:35:05.950974079Z [2024-04-15T02:35:05.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:34:00+00:00, run_id=scheduled__2024-04-15T02:34:00+00:00, run_start_date=2024-04-15 02:35:00.373147+00:00, run_end_date=2024-04-15 02:35:05.950513+00:00, run_duration=5.577366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:34:00+00:00, data_interval_end=2024-04-15 02:35:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:35:05.961763536Z [2024-04-15T02:35:05.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:05.968361622Z [2024-04-15T02:35:05.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:35:05.968704505Z [2024-04-15T02:35:05.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:34:00+00:00, run_id=scheduled__2024-04-15T02:34:00+00:00, run_start_date=2024-04-15 02:35:00.375530+00:00, run_end_date=2024-04-15 02:35:05.968314+00:00, run_duration=5.592784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:34:00+00:00, data_interval_end=2024-04-15 02:35:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:35:05.978107136Z [2024-04-15T02:35:05.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:06.024686847Z [2024-04-15T02:35:06.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:06.025125914Z [2024-04-15T02:35:06.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:06.037604628Z [2024-04-15T02:35:06.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:34:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:03.496670+00:00, run_end_date=2024-04-15 02:35:05.024620+00:00, run_duration=1.52795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:00.451581+00:00, queued_by_job_id=2, pid=5327 2024-04-15T02:35:06.038012485Z [2024-04-15T02:35:06.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:34:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:03.650330+00:00, run_end_date=2024-04-15 02:35:05.674275+00:00, run_duration=2.023945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:00.451581+00:00, queued_by_job_id=2, pid=5328 2024-04-15T02:35:07.123569684Z [2024-04-15T02:35:07.123+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:35:07.123608935Z 2024-04-15T02:35:07.123869264Z [2024-04-15T02:35:07.123+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:35:07.124465378Z [2024-04-15T02:35:07.124+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:07.124477577Z 2024-04-15T02:35:07.126838808Z [2024-04-15T02:35:07.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:35:07.128002492Z [2024-04-15T02:35:07.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:35:07.183742533Z [2024-04-15T02:35:07.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:07.192042000Z [2024-04-15T02:35:07.189+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9893102c-92de-4cec-8e70-9461a79a2705 2024-04-15T02:35:07.254252572Z [2024-04-15T02:35:07.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:07.258370100Z [2024-04-15T02:35:07.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:06.684238+00:00, run_end_date=2024-04-15 02:35:07.041106+00:00, run_duration=0.356868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:04.653099+00:00, queued_by_job_id=2, pid=5368 2024-04-15T02:35:10.846750860Z [2024-04-15T02:35:10.846+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:35:10.846772000Z 2024-04-15T02:35:10.847591471Z [2024-04-15T02:35:10.847+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:35:10.848630500Z [2024-04-15T02:35:10.848+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:10.848637570Z 2024-04-15T02:35:10.852750025Z [2024-04-15T02:35:10.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:35:10.853502897Z [2024-04-15T02:35:10.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:10.912360816Z [2024-04-15T02:35:10.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:10.912458844Z [2024-04-15T02:35:10.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:10.917599632Z [2024-04-15T02:35:10.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb855d2b-27f2-4653-a1cb-b68729766f92 2024-04-15T02:35:10.917747529Z [2024-04-15T02:35:10.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=0, run_start_date=2024-04-15 02:35:09.289773+00:00, run_end_date=2024-04-15 02:35:09.672518+00:00, run_duration=0.382745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:07.124986+00:00, queued_by_job_id=2, pid=5380 2024-04-15T02:35:13.677323459Z [2024-04-15T02:35:13.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:35:13.677792132Z [2024-04-15T02:35:13.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:35:00.370810+00:00, run_end_date=2024-04-15 02:35:13.677406+00:00, run_duration=13.306596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:35:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:35:13.684961696Z [2024-04-15T02:35:13.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:35:13.708554603Z [2024-04-15T02:35:13.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:13.713815676Z [2024-04-15T02:35:13.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:13.001000+00:00, run_end_date=2024-04-15 02:35:13.360848+00:00, run_duration=0.359848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:10.849398+00:00, queued_by_job_id=2, pid=5390 2024-04-15T02:35:40.746653322Z [2024-04-15T02:35:40.746+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:36:00.510670930Z [2024-04-15T02:36:00.510+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:36:00.518709495Z [2024-04-15T02:36:00.518+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:36:00.532826775Z [2024-04-15T02:36:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:00.603388071Z [2024-04-15T02:36:00.602+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:36:00.603402663Z 2024-04-15T02:36:00.603407031Z 2024-04-15T02:36:00.603410237Z 2024-04-15T02:36:00.603631475Z [2024-04-15T02:36:00.603+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:36:00.603814499Z [2024-04-15T02:36:00.603+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:36:00.603986149Z [2024-04-15T02:36:00.603+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:36:00.604593345Z [2024-04-15T02:36:00.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:36:00.604603272Z 2024-04-15T02:36:00.604606534Z 2024-04-15T02:36:00.604609590Z 2024-04-15T02:36:00.609943498Z [2024-04-15T02:36:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:36:00.610183507Z [2024-04-15T02:36:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:36:00.610527106Z [2024-04-15T02:36:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:36:00.610690948Z [2024-04-15T02:36:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:36:00.610922514Z [2024-04-15T02:36:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:36:00.611423858Z [2024-04-15T02:36:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:36:01.071014397Z [2024-04-15T02:36:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status queued for try_number 1 2024-04-15T02:36:01.073860227Z [2024-04-15T02:36:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:36:01.074133798Z [2024-04-15T02:36:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:36:01.089978636Z [2024-04-15T02:36:01.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7bc6d8e-c54d-4f23-bfbf-16211033e738 2024-04-15T02:36:01.098480807Z [2024-04-15T02:36:01.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to eed0b38e-5494-484e-bc94-b7537144264d 2024-04-15T02:36:01.098682564Z [2024-04-15T02:36:01.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to 653db9c2-72ab-40da-a326-67c392b297bb 2024-04-15T02:36:02.875650668Z [2024-04-15T02:36:02.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:36:02.878449801Z [2024-04-15T02:36:02.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:34:00+00:00, run_id=scheduled__2024-04-15T02:34:00+00:00, run_start_date=2024-04-15 02:36:00.547302+00:00, run_end_date=2024-04-15 02:36:02.875520+00:00, run_duration=2.328218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:34:00+00:00, data_interval_end=2024-04-15 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:36:02.892337139Z [2024-04-15T02:36:02.890+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:36:03.065021143Z [2024-04-15T02:36:03.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status success for try_number 1 2024-04-15T02:36:03.071688813Z [2024-04-15T02:36:03.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:34:00+00:00, map_index=-1, run_start_date=2024-04-15 02:36:02.280974+00:00, run_end_date=2024-04-15 02:36:02.814513+00:00, run_duration=0.533539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:36:00.606263+00:00, queued_by_job_id=2, pid=5408 2024-04-15T02:36:05.681620266Z [2024-04-15T02:36:05.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:36:05.682461712Z [2024-04-15T02:36:05.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:35:00+00:00, run_id=scheduled__2024-04-15T02:35:00+00:00, run_start_date=2024-04-15 02:36:00.548395+00:00, run_end_date=2024-04-15 02:36:05.681592+00:00, run_duration=5.133197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:35:00+00:00, data_interval_end=2024-04-15 02:36:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:36:05.691002962Z [2024-04-15T02:36:05.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:05.697714855Z [2024-04-15T02:36:05.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:36:05.697962888Z [2024-04-15T02:36:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:35:00+00:00, run_id=scheduled__2024-04-15T02:35:00+00:00, run_start_date=2024-04-15 02:36:00.549318+00:00, run_end_date=2024-04-15 02:36:05.697628+00:00, run_duration=5.14831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:35:00+00:00, data_interval_end=2024-04-15 02:36:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:36:05.709189554Z [2024-04-15T02:36:05.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:05.759025963Z [2024-04-15T02:36:05.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:36:05.763866755Z [2024-04-15T02:36:05.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:36:03.645328+00:00, run_end_date=2024-04-15 02:36:05.162284+00:00, run_duration=1.516956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:36:00.606263+00:00, queued_by_job_id=2, pid=5437 2024-04-15T02:36:06.843665587Z [2024-04-15T02:36:06.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:36:06.849190162Z [2024-04-15T02:36:06.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:36:03.912126+00:00, run_end_date=2024-04-15 02:36:05.644260+00:00, run_duration=1.732134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:36:00.606263+00:00, queued_by_job_id=2, pid=5438 2024-04-15T02:37:00.366650071Z [2024-04-15T02:37:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:00.374337045Z [2024-04-15T02:37:00.374+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:37:00.440722043Z [2024-04-15T02:37:00.440+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:37:00.440768067Z 2024-04-15T02:37:00.440777248Z 2024-04-15T02:37:00.440785103Z [2024-04-15T02:37:00.440+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:37:00.440793370Z [2024-04-15T02:37:00.440+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:37:00.441272018Z [2024-04-15T02:37:00.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:37:00.441307990Z 2024-04-15T02:37:00.441318602Z 2024-04-15T02:37:00.444336378Z [2024-04-15T02:37:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:37:00.444372234Z [2024-04-15T02:37:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:37:00.444622683Z [2024-04-15T02:37:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:37:00.444689902Z [2024-04-15T02:37:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:37:00.666621654Z [2024-04-15T02:37:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status queued for try_number 1 2024-04-15T02:37:00.666660871Z [2024-04-15T02:37:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status queued for try_number 1 2024-04-15T02:37:00.677161417Z [2024-04-15T02:37:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0311fdc-b4f7-437c-8802-9946b558aea6 2024-04-15T02:37:00.677276640Z [2024-04-15T02:37:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3aa6ebe-6d8e-4343-8840-327c70efdffa 2024-04-15T02:37:05.520500332Z [2024-04-15T02:37:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:37:05.521097620Z [2024-04-15T02:37:05.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:36:00+00:00, run_id=scheduled__2024-04-15T02:36:00+00:00, run_start_date=2024-04-15 02:37:00.383345+00:00, run_end_date=2024-04-15 02:37:05.520548+00:00, run_duration=5.137203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:36:00+00:00, data_interval_end=2024-04-15 02:37:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:37:05.532904053Z [2024-04-15T02:37:05.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:05.541837152Z [2024-04-15T02:37:05.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:37:05.542133098Z [2024-04-15T02:37:05.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:36:00+00:00, run_id=scheduled__2024-04-15T02:36:00+00:00, run_start_date=2024-04-15 02:37:00.384449+00:00, run_end_date=2024-04-15 02:37:05.541777+00:00, run_duration=5.157328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:36:00+00:00, data_interval_end=2024-04-15 02:37:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:37:05.553315146Z [2024-04-15T02:37:05.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:05.591925774Z [2024-04-15T02:37:05.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status success for try_number 1 2024-04-15T02:37:05.592221050Z [2024-04-15T02:37:05.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status success for try_number 1 2024-04-15T02:37:05.599525577Z [2024-04-15T02:37:05.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:36:00+00:00, map_index=-1, run_start_date=2024-04-15 02:37:03.017673+00:00, run_end_date=2024-04-15 02:37:05.100636+00:00, run_duration=2.082963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:37:00.441719+00:00, queued_by_job_id=2, pid=5491 2024-04-15T02:37:05.599928359Z [2024-04-15T02:37:05.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:36:00+00:00, map_index=-1, run_start_date=2024-04-15 02:37:03.116468+00:00, run_end_date=2024-04-15 02:37:05.166176+00:00, run_duration=2.049708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:37:00.441719+00:00, queued_by_job_id=2, pid=5492 2024-04-15T02:38:00.770658070Z [2024-04-15T02:38:00.770+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:38:00.780041407Z [2024-04-15T02:38:00.779+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:38:00.802971320Z [2024-04-15T02:38:00.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:00.891419920Z [2024-04-15T02:38:00.890+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:38:00.891436216Z 2024-04-15T02:38:00.891440724Z 2024-04-15T02:38:00.891444116Z 2024-04-15T02:38:00.891654642Z [2024-04-15T02:38:00.891+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:38:00.891790567Z [2024-04-15T02:38:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:38:00.892917482Z [2024-04-15T02:38:00.891+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:38:00.892930502Z [2024-04-15T02:38:00.892+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:38:00.892934551Z 2024-04-15T02:38:00.892937249Z 2024-04-15T02:38:00.892940040Z 2024-04-15T02:38:00.895769422Z [2024-04-15T02:38:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:38:00.895967644Z [2024-04-15T02:38:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:38:00.896194403Z [2024-04-15T02:38:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:38:00.896338531Z [2024-04-15T02:38:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:38:00.896609655Z [2024-04-15T02:38:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:38:00.896772407Z [2024-04-15T02:38:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:38:01.358925523Z [2024-04-15T02:38:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status queued for try_number 1 2024-04-15T02:38:01.359365393Z [2024-04-15T02:38:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status queued for try_number 1 2024-04-15T02:38:01.359516251Z [2024-04-15T02:38:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status queued for try_number 1 2024-04-15T02:38:01.369358920Z [2024-04-15T02:38:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c58064-0e77-494a-8e84-a13aad90a4d0 2024-04-15T02:38:01.370783818Z [2024-04-15T02:38:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf45cc2c-87b5-4be6-a19e-e49d2c980b65 2024-04-15T02:38:01.370954969Z [2024-04-15T02:38:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75334c84-f041-42dd-b786-bdcaa06fa7ae 2024-04-15T02:38:03.648886410Z [2024-04-15T02:38:03.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:38:03.649328297Z [2024-04-15T02:38:03.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:36:00+00:00, run_id=scheduled__2024-04-15T02:36:00+00:00, run_start_date=2024-04-15 02:38:00.810103+00:00, run_end_date=2024-04-15 02:38:03.648958+00:00, run_duration=2.838855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:36:00+00:00, data_interval_end=2024-04-15 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:38:03.666278063Z [2024-04-15T02:38:03.665+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:38:03.733315515Z [2024-04-15T02:38:03.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status success for try_number 1 2024-04-15T02:38:03.744280363Z [2024-04-15T02:38:03.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:36:00+00:00, map_index=-1, run_start_date=2024-04-15 02:38:02.634377+00:00, run_end_date=2024-04-15 02:38:03.232352+00:00, run_duration=0.597975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:38:00.893372+00:00, queued_by_job_id=2, pid=5528 2024-04-15T02:38:05.971852679Z [2024-04-15T02:38:05.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:38:05.972355682Z [2024-04-15T02:38:05.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:37:00+00:00, run_id=scheduled__2024-04-15T02:37:00+00:00, run_start_date=2024-04-15 02:38:00.811460+00:00, run_end_date=2024-04-15 02:38:05.971937+00:00, run_duration=5.160477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:37:00+00:00, data_interval_end=2024-04-15 02:38:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:38:05.987088981Z [2024-04-15T02:38:05.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:06.900835489Z [2024-04-15T02:38:06.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:38:06.901557336Z [2024-04-15T02:38:06.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:37:00+00:00, run_id=scheduled__2024-04-15T02:37:00+00:00, run_start_date=2024-04-15 02:38:00.812489+00:00, run_end_date=2024-04-15 02:38:06.901159+00:00, run_duration=6.08867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:37:00+00:00, data_interval_end=2024-04-15 02:38:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:38:06.911024647Z [2024-04-15T02:38:06.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:06.956677841Z [2024-04-15T02:38:06.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status success for try_number 1 2024-04-15T02:38:06.957379282Z [2024-04-15T02:38:06.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status success for try_number 1 2024-04-15T02:38:06.971484962Z [2024-04-15T02:38:06.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:37:00+00:00, map_index=-1, run_start_date=2024-04-15 02:38:04.058402+00:00, run_end_date=2024-04-15 02:38:06.045022+00:00, run_duration=1.98662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:38:00.893372+00:00, queued_by_job_id=2, pid=5548 2024-04-15T02:38:06.971707102Z [2024-04-15T02:38:06.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:37:00+00:00, map_index=-1, run_start_date=2024-04-15 02:38:04.383492+00:00, run_end_date=2024-04-15 02:38:05.912028+00:00, run_duration=1.528536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:38:00.893372+00:00, queued_by_job_id=2, pid=5566 2024-04-15T02:39:00.812961568Z [2024-04-15T02:39:00.810+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:39:00.829989762Z [2024-04-15T02:39:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:00.945382437Z [2024-04-15T02:39:00.945+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:39:00.945398546Z 2024-04-15T02:39:00.945401860Z 2024-04-15T02:39:00.945488393Z [2024-04-15T02:39:00.945+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:39:00.945580102Z [2024-04-15T02:39:00.945+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:39:00.946553619Z [2024-04-15T02:39:00.946+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:39:00.946565151Z 2024-04-15T02:39:00.946568501Z 2024-04-15T02:39:00.948855247Z [2024-04-15T02:39:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:39:00.948985369Z [2024-04-15T02:39:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:39:00.949187344Z [2024-04-15T02:39:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:39:00.949259847Z [2024-04-15T02:39:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:39:01.255893038Z [2024-04-15T02:39:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status queued for try_number 1 2024-04-15T02:39:01.255944111Z [2024-04-15T02:39:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status queued for try_number 1 2024-04-15T02:39:01.268671152Z [2024-04-15T02:39:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55203c9f-de5b-4136-887d-c1451e365028 2024-04-15T02:39:01.268748453Z [2024-04-15T02:39:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fd145fa-f9f9-4d1c-9d97-be9daeeb4c6b 2024-04-15T02:39:06.333710521Z [2024-04-15T02:39:06.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:39:06.334157666Z [2024-04-15T02:39:06.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:38:00+00:00, run_id=scheduled__2024-04-15T02:38:00+00:00, run_start_date=2024-04-15 02:39:00.863840+00:00, run_end_date=2024-04-15 02:39:06.333558+00:00, run_duration=5.469718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:38:00+00:00, data_interval_end=2024-04-15 02:39:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:39:06.343682599Z [2024-04-15T02:39:06.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:06.354620782Z [2024-04-15T02:39:06.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:39:06.355237353Z [2024-04-15T02:39:06.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:38:00+00:00, run_id=scheduled__2024-04-15T02:38:00+00:00, run_start_date=2024-04-15 02:39:00.866643+00:00, run_end_date=2024-04-15 02:39:06.354613+00:00, run_duration=5.48797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:38:00+00:00, data_interval_end=2024-04-15 02:39:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:39:06.364203030Z [2024-04-15T02:39:06.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:06.403647215Z [2024-04-15T02:39:06.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status success for try_number 1 2024-04-15T02:39:06.403908677Z [2024-04-15T02:39:06.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status success for try_number 1 2024-04-15T02:39:06.410624478Z [2024-04-15T02:39:06.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:38:00+00:00, map_index=-1, run_start_date=2024-04-15 02:39:04.130680+00:00, run_end_date=2024-04-15 02:39:05.518166+00:00, run_duration=1.387486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:39:00.946942+00:00, queued_by_job_id=2, pid=5612 2024-04-15T02:39:06.410875290Z [2024-04-15T02:39:06.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:38:00+00:00, map_index=-1, run_start_date=2024-04-15 02:39:03.968657+00:00, run_end_date=2024-04-15 02:39:05.767108+00:00, run_duration=1.798451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:39:00.946942+00:00, queued_by_job_id=2, pid=5611 2024-04-15T02:40:00.869515969Z [2024-04-15T02:40:00.869+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:40:00.889961694Z [2024-04-15T02:40:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:40:00.898629911Z [2024-04-15T02:40:00.898+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:40:00.912822205Z [2024-04-15T02:40:00.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:01.036480275Z [2024-04-15T02:40:01.036+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:40:01.036496783Z 2024-04-15T02:40:01.036499963Z 2024-04-15T02:40:01.036503310Z 2024-04-15T02:40:01.036506210Z 2024-04-15T02:40:01.036751260Z [2024-04-15T02:40:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:40:01.036866173Z [2024-04-15T02:40:01.036+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:40:01.037091980Z [2024-04-15T02:40:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:40:01.037374251Z [2024-04-15T02:40:01.037+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:40:01.038177064Z [2024-04-15T02:40:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:01.038192512Z 2024-04-15T02:40:01.038197483Z 2024-04-15T02:40:01.038202052Z 2024-04-15T02:40:01.038219294Z 2024-04-15T02:40:01.042652581Z [2024-04-15T02:40:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:40:01.042941965Z [2024-04-15T02:40:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:01.043424355Z [2024-04-15T02:40:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:01.043941528Z [2024-04-15T02:40:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:40:01.044308827Z [2024-04-15T02:40:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:01.044528415Z [2024-04-15T02:40:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:40:01.044795015Z [2024-04-15T02:40:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:01.044940796Z [2024-04-15T02:40:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:40:01.523082430Z [2024-04-15T02:40:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.523108892Z [2024-04-15T02:40:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.523113044Z [2024-04-15T02:40:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.523116335Z [2024-04-15T02:40:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.541372083Z [2024-04-15T02:40:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39723026-ac5d-4cbe-bbd0-45f7522662f1 2024-04-15T02:40:01.544359810Z [2024-04-15T02:40:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea2fa78c-031f-47d1-b04d-fa779921c4e1 2024-04-15T02:40:01.547176733Z [2024-04-15T02:40:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e6fe664-6ba3-4b59-8878-3f75ddb6f28c 2024-04-15T02:40:01.547524567Z [2024-04-15T02:40:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2da9e3e-fe65-4bee-87a4-065c11d84823 2024-04-15T02:40:06.343142634Z [2024-04-15T02:40:06.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:06.344109128Z [2024-04-15T02:40:06.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:38:00+00:00, run_id=scheduled__2024-04-15T02:38:00+00:00, run_start_date=2024-04-15 02:40:00.930869+00:00, run_end_date=2024-04-15 02:40:06.343748+00:00, run_duration=5.412879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:38:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:40:06.354164699Z [2024-04-15T02:40:06.353+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:40:06.382646434Z [2024-04-15T02:40:06.382+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:40:06.382745729Z 2024-04-15T02:40:06.382763989Z [2024-04-15T02:40:06.382+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:40:06.383229635Z [2024-04-15T02:40:06.383+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:06.383271777Z 2024-04-15T02:40:06.385447481Z [2024-04-15T02:40:06.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:40:06.385604923Z [2024-04-15T02:40:06.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:06.486260711Z [2024-04-15T02:40:06.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:06.486298906Z [2024-04-15T02:40:06.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:06.486371354Z [2024-04-15T02:40:06.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:06.505546943Z [2024-04-15T02:40:06.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:38:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:04.211178+00:00, run_end_date=2024-04-15 02:40:05.174976+00:00, run_duration=0.963798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:01.039310+00:00, queued_by_job_id=2, pid=5669 2024-04-15T02:40:06.506049251Z [2024-04-15T02:40:06.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:04.535400+00:00, run_end_date=2024-04-15 02:40:05.326906+00:00, run_duration=0.791506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:01.039310+00:00, queued_by_job_id=2, pid=5670 2024-04-15T02:40:06.506525397Z [2024-04-15T02:40:06.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46ebae40-9450-4bfe-ad13-45bd8524d3c3 2024-04-15T02:40:06.594425993Z [2024-04-15T02:40:06.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:06.594678963Z [2024-04-15T02:40:06.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:39:00+00:00, run_id=scheduled__2024-04-15T02:39:00+00:00, run_start_date=2024-04-15 02:40:00.932311+00:00, run_end_date=2024-04-15 02:40:06.594406+00:00, run_duration=5.662095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:39:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:40:06.605731104Z [2024-04-15T02:40:06.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:06.657280476Z [2024-04-15T02:40:06.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:06.662691425Z [2024-04-15T02:40:06.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:39:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:04.845670+00:00, run_end_date=2024-04-15 02:40:06.428441+00:00, run_duration=1.582771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:01.039310+00:00, queued_by_job_id=2, pid=5680 2024-04-15T02:40:07.712712563Z [2024-04-15T02:40:07.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:07.712811570Z [2024-04-15T02:40:07.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:39:00+00:00, run_id=scheduled__2024-04-15T02:39:00+00:00, run_start_date=2024-04-15 02:40:00.933416+00:00, run_end_date=2024-04-15 02:40:07.712450+00:00, run_duration=6.779034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:39:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:40:07.724682659Z [2024-04-15T02:40:07.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:07.774536178Z [2024-04-15T02:40:07.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:07.785396891Z [2024-04-15T02:40:07.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:39:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:05.055919+00:00, run_end_date=2024-04-15 02:40:07.082888+00:00, run_duration=2.026969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:01.039310+00:00, queued_by_job_id=2, pid=5690 2024-04-15T02:40:09.202675638Z [2024-04-15T02:40:09.202+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:40:09.202691792Z 2024-04-15T02:40:09.203146033Z [2024-04-15T02:40:09.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:40:09.205054302Z [2024-04-15T02:40:09.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:09.205065599Z 2024-04-15T02:40:09.207470290Z [2024-04-15T02:40:09.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:40:09.207805957Z [2024-04-15T02:40:09.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:40:09.320134055Z [2024-04-15T02:40:09.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:09.320296743Z [2024-04-15T02:40:09.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:09.330253237Z [2024-04-15T02:40:09.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5977f4b1-1491-46aa-a881-98db596ecb11 2024-04-15T02:40:09.330455447Z [2024-04-15T02:40:09.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:08.585671+00:00, run_end_date=2024-04-15 02:40:08.951605+00:00, run_duration=0.365934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:06.383529+00:00, queued_by_job_id=2, pid=5729 2024-04-15T02:40:11.702425183Z [2024-04-15T02:40:11.702+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:40:11.702445517Z 2024-04-15T02:40:11.702809772Z [2024-04-15T02:40:11.702+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:40:11.703653793Z [2024-04-15T02:40:11.703+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:11.703662290Z 2024-04-15T02:40:11.706239841Z [2024-04-15T02:40:11.705+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:11.706503353Z [2024-04-15T02:40:11.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:11.768009538Z [2024-04-15T02:40:11.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:11.779127016Z [2024-04-15T02:40:11.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d125656-de76-4744-a7c3-98de3eeeb601 2024-04-15T02:40:11.936125626Z [2024-04-15T02:40:11.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:11.958777346Z [2024-04-15T02:40:11.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=0, run_start_date=2024-04-15 02:40:11.299107+00:00, run_end_date=2024-04-15 02:40:11.653412+00:00, run_duration=0.354305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:09.205683+00:00, queued_by_job_id=2, pid=5741 2024-04-15T02:40:15.592620441Z [2024-04-15T02:40:15.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:15.593081767Z [2024-04-15T02:40:15.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:35:00+00:00, run_id=scheduled__2024-04-15T02:35:00+00:00, run_start_date=2024-04-15 02:40:00.928365+00:00, run_end_date=2024-04-15 02:40:15.592550+00:00, run_duration=14.664185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:35:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:40:15.599133405Z [2024-04-15T02:40:15.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:40:15.634999158Z [2024-04-15T02:40:15.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:15.639145855Z [2024-04-15T02:40:15.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:13.997727+00:00, run_end_date=2024-04-15 02:40:14.348780+00:00, run_duration=0.351053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:11.704185+00:00, queued_by_job_id=2, pid=5753 2024-04-15T02:40:40.828871085Z [2024-04-15T02:40:40.827+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:41:00.154235486Z [2024-04-15T02:41:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:00.161842091Z [2024-04-15T02:41:00.161+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:41:00.213609760Z [2024-04-15T02:41:00.213+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:41:00.213626127Z 2024-04-15T02:41:00.213629505Z 2024-04-15T02:41:00.213800837Z [2024-04-15T02:41:00.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:41:00.214062490Z [2024-04-15T02:41:00.213+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:41:00.214755112Z [2024-04-15T02:41:00.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:41:00.214766030Z 2024-04-15T02:41:00.214769986Z 2024-04-15T02:41:00.219415793Z [2024-04-15T02:41:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:41:00.219650768Z [2024-04-15T02:41:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:41:00.220167417Z [2024-04-15T02:41:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:41:00.220323677Z [2024-04-15T02:41:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:41:00.386459530Z [2024-04-15T02:41:00.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:41:00.386629745Z [2024-04-15T02:41:00.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:41:00.393135177Z [2024-04-15T02:41:00.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to b45f1cc2-3bae-4a65-95a8-f08d59659d48 2024-04-15T02:41:00.393332901Z [2024-04-15T02:41:00.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 187f0c35-93aa-44eb-bb0e-9f129136feef 2024-04-15T02:41:05.254517982Z [2024-04-15T02:41:05.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:41:05.254939979Z [2024-04-15T02:41:05.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:41:00.170822+00:00, run_end_date=2024-04-15 02:41:05.254604+00:00, run_duration=5.083782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:41:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:41:05.266128492Z [2024-04-15T02:41:05.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:05.316688100Z [2024-04-15T02:41:05.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:41:05.324359344Z [2024-04-15T02:41:05.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:41:02.693629+00:00, run_end_date=2024-04-15 02:41:04.738569+00:00, run_duration=2.04494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:41:00.215280+00:00, queued_by_job_id=2, pid=5790 2024-04-15T02:41:05.471656999Z [2024-04-15T02:41:05.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:41:05.471973540Z [2024-04-15T02:41:05.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:41:00.172278+00:00, run_end_date=2024-04-15 02:41:05.471601+00:00, run_duration=5.299323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:41:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:41:05.484158444Z [2024-04-15T02:41:05.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:05.524567300Z [2024-04-15T02:41:05.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:41:05.530966256Z [2024-04-15T02:41:05.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:41:02.654409+00:00, run_end_date=2024-04-15 02:41:05.326390+00:00, run_duration=2.671981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:41:00.215280+00:00, queued_by_job_id=2, pid=5789 2024-04-15T02:42:00.486850237Z [2024-04-15T02:42:00.481+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:42:00.514009262Z [2024-04-15T02:42:00.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:00.523204748Z [2024-04-15T02:42:00.522+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:42:00.583483049Z [2024-04-15T02:42:00.583+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:42:00.583496506Z 2024-04-15T02:42:00.583500463Z 2024-04-15T02:42:00.583503914Z 2024-04-15T02:42:00.584141659Z [2024-04-15T02:42:00.583+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:42:00.584388927Z [2024-04-15T02:42:00.584+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:42:00.584644468Z [2024-04-15T02:42:00.584+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:42:00.585333823Z [2024-04-15T02:42:00.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:42:00.585345537Z 2024-04-15T02:42:00.585349576Z 2024-04-15T02:42:00.585353150Z 2024-04-15T02:42:00.588493607Z [2024-04-15T02:42:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:42:00.588869924Z [2024-04-15T02:42:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:42:00.589238271Z [2024-04-15T02:42:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:42:00.589473813Z [2024-04-15T02:42:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:42:00.589832563Z [2024-04-15T02:42:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:42:00.590112509Z [2024-04-15T02:42:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:42:00.869525930Z [2024-04-15T02:42:00.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:42:00.869543071Z [2024-04-15T02:42:00.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status queued for try_number 1 2024-04-15T02:42:00.869546763Z [2024-04-15T02:42:00.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status queued for try_number 1 2024-04-15T02:42:00.922170611Z [2024-04-15T02:42:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3f81b47-48c1-4c6a-8424-0df67dd35dbf 2024-04-15T02:42:00.922186751Z [2024-04-15T02:42:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to cec44f3d-a71a-428d-94db-00c4842e923c 2024-04-15T02:42:00.922200989Z [2024-04-15T02:42:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13c9af2c-25fe-4c64-8882-990a2fcc6e1e 2024-04-15T02:42:03.620165819Z [2024-04-15T02:42:03.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:42:03.620378377Z [2024-04-15T02:42:03.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:42:00.533496+00:00, run_end_date=2024-04-15 02:42:03.620114+00:00, run_duration=3.086618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:42:03.632934461Z [2024-04-15T02:42:03.632+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:42:03.741462949Z [2024-04-15T02:42:03.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:42:03.753942704Z [2024-04-15T02:42:03.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:42:01.977243+00:00, run_end_date=2024-04-15 02:42:02.581461+00:00, run_duration=0.604218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:42:00.586136+00:00, queued_by_job_id=2, pid=5825 2024-04-15T02:42:05.690057251Z [2024-04-15T02:42:05.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:42:05.690599885Z [2024-04-15T02:42:05.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:41:00+00:00, run_id=scheduled__2024-04-15T02:41:00+00:00, run_start_date=2024-04-15 02:42:00.534621+00:00, run_end_date=2024-04-15 02:42:05.689981+00:00, run_duration=5.15536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:41:00+00:00, data_interval_end=2024-04-15 02:42:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:42:05.702998990Z [2024-04-15T02:42:05.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:05.709703226Z [2024-04-15T02:42:05.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:42:05.710188683Z [2024-04-15T02:42:05.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:41:00+00:00, run_id=scheduled__2024-04-15T02:41:00+00:00, run_start_date=2024-04-15 02:42:00.536167+00:00, run_end_date=2024-04-15 02:42:05.709637+00:00, run_duration=5.17347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:41:00+00:00, data_interval_end=2024-04-15 02:42:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:42:05.719980309Z [2024-04-15T02:42:05.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:05.752158060Z [2024-04-15T02:42:05.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status success for try_number 1 2024-04-15T02:42:05.761819321Z [2024-04-15T02:42:05.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:41:00+00:00, map_index=-1, run_start_date=2024-04-15 02:42:03.343951+00:00, run_end_date=2024-04-15 02:42:04.970263+00:00, run_duration=1.626312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:42:00.586136+00:00, queued_by_job_id=2, pid=5846 2024-04-15T02:42:06.455312936Z [2024-04-15T02:42:06.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status success for try_number 1 2024-04-15T02:42:06.461747758Z [2024-04-15T02:42:06.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:41:00+00:00, map_index=-1, run_start_date=2024-04-15 02:42:03.590073+00:00, run_end_date=2024-04-15 02:42:05.623379+00:00, run_duration=2.033306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:42:00.586136+00:00, queued_by_job_id=2, pid=5856 2024-04-15T02:43:00.263054390Z [2024-04-15T02:43:00.262+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:43:00.278586296Z [2024-04-15T02:43:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:00.328207393Z [2024-04-15T02:43:00.327+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:43:00.328221210Z 2024-04-15T02:43:00.328225125Z 2024-04-15T02:43:00.328439911Z [2024-04-15T02:43:00.328+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:43:00.328622407Z [2024-04-15T02:43:00.328+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:43:00.329246571Z [2024-04-15T02:43:00.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:43:00.329257185Z 2024-04-15T02:43:00.329273867Z 2024-04-15T02:43:00.331919129Z [2024-04-15T02:43:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:43:00.332146596Z [2024-04-15T02:43:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:43:00.332497276Z [2024-04-15T02:43:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:43:00.332809839Z [2024-04-15T02:43:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:43:00.519895364Z [2024-04-15T02:43:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status queued for try_number 1 2024-04-15T02:43:00.521414679Z [2024-04-15T02:43:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status queued for try_number 1 2024-04-15T02:43:00.531330743Z [2024-04-15T02:43:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to fab829d3-67f7-49d5-a0d8-27c3dfdb2755 2024-04-15T02:43:00.531429186Z [2024-04-15T02:43:00.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1463b56b-4c51-4e4a-be7a-04510cd83f66 2024-04-15T02:43:05.038602054Z [2024-04-15T02:43:05.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:43:05.038951389Z [2024-04-15T02:43:05.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:42:00+00:00, run_id=scheduled__2024-04-15T02:42:00+00:00, run_start_date=2024-04-15 02:43:00.288962+00:00, run_end_date=2024-04-15 02:43:05.038505+00:00, run_duration=4.749543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:42:00+00:00, data_interval_end=2024-04-15 02:43:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:43:05.048153711Z [2024-04-15T02:43:05.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:05.096613670Z [2024-04-15T02:43:05.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status success for try_number 1 2024-04-15T02:43:05.102035976Z [2024-04-15T02:43:05.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:42:00+00:00, map_index=-1, run_start_date=2024-04-15 02:43:02.742713+00:00, run_end_date=2024-04-15 02:43:04.505579+00:00, run_duration=1.762866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:43:00.329788+00:00, queued_by_job_id=2, pid=5909 2024-04-15T02:43:06.159275660Z [2024-04-15T02:43:06.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:43:06.159447584Z [2024-04-15T02:43:06.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:42:00+00:00, run_id=scheduled__2024-04-15T02:42:00+00:00, run_start_date=2024-04-15 02:43:00.290569+00:00, run_end_date=2024-04-15 02:43:06.159165+00:00, run_duration=5.868596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:42:00+00:00, data_interval_end=2024-04-15 02:43:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:43:06.167723021Z [2024-04-15T02:43:06.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:06.202709517Z [2024-04-15T02:43:06.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status success for try_number 1 2024-04-15T02:43:06.208077252Z [2024-04-15T02:43:06.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:42:00+00:00, map_index=-1, run_start_date=2024-04-15 02:43:02.898699+00:00, run_end_date=2024-04-15 02:43:05.248050+00:00, run_duration=2.349351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:43:00.329788+00:00, queued_by_job_id=2, pid=5910 2024-04-15T02:44:00.114199903Z [2024-04-15T02:44:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:00.121216733Z [2024-04-15T02:44:00.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:44:00.127149967Z [2024-04-15T02:44:00.126+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:44:00.192670193Z [2024-04-15T02:44:00.192+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:44:00.192686890Z 2024-04-15T02:44:00.192692588Z 2024-04-15T02:44:00.192714817Z 2024-04-15T02:44:00.192792700Z [2024-04-15T02:44:00.192+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:44:00.193009965Z [2024-04-15T02:44:00.192+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:44:00.193150091Z [2024-04-15T02:44:00.193+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:44:00.193842047Z [2024-04-15T02:44:00.193+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:44:00.193854650Z 2024-04-15T02:44:00.193859196Z 2024-04-15T02:44:00.193862931Z 2024-04-15T02:44:00.196878306Z [2024-04-15T02:44:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:44:00.197175833Z [2024-04-15T02:44:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:44:00.197497110Z [2024-04-15T02:44:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:44:00.197684256Z [2024-04-15T02:44:00.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:44:00.198310019Z [2024-04-15T02:44:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:44:00.198785022Z [2024-04-15T02:44:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:44:00.449374065Z [2024-04-15T02:44:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status queued for try_number 1 2024-04-15T02:44:00.449558964Z [2024-04-15T02:44:00.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status queued for try_number 1 2024-04-15T02:44:00.449679678Z [2024-04-15T02:44:00.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status queued for try_number 1 2024-04-15T02:44:00.462519461Z [2024-04-15T02:44:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca966a5d-2ebf-49b4-95cd-4774aab37b68 2024-04-15T02:44:00.464803378Z [2024-04-15T02:44:00.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95abe8e7-4db8-4b24-bd16-85c832789b41 2024-04-15T02:44:00.465720254Z [2024-04-15T02:44:00.464+0000] {scheduler_job.py:635} INFO - Setting external_id for to c29c32cd-ee04-43b8-b230-8034da5d82df 2024-04-15T02:44:02.834134199Z [2024-04-15T02:44:02.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:44:02.834166417Z [2024-04-15T02:44:02.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:42:00+00:00, run_id=scheduled__2024-04-15T02:42:00+00:00, run_start_date=2024-04-15 02:44:00.139694+00:00, run_end_date=2024-04-15 02:44:02.832292+00:00, run_duration=2.692598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:42:00+00:00, data_interval_end=2024-04-15 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:44:02.840867968Z [2024-04-15T02:44:02.839+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:44:02.977604437Z [2024-04-15T02:44:02.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status success for try_number 1 2024-04-15T02:44:03.003890568Z [2024-04-15T02:44:02.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:42:00+00:00, map_index=-1, run_start_date=2024-04-15 02:44:01.265423+00:00, run_end_date=2024-04-15 02:44:01.930441+00:00, run_duration=0.665018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:44:00.194599+00:00, queued_by_job_id=2, pid=5945 2024-04-15T02:44:05.458855817Z [2024-04-15T02:44:05.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:44:05.459174517Z [2024-04-15T02:44:05.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:43:00+00:00, run_id=scheduled__2024-04-15T02:43:00+00:00, run_start_date=2024-04-15 02:44:00.140851+00:00, run_end_date=2024-04-15 02:44:05.458809+00:00, run_duration=5.317958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:43:00+00:00, data_interval_end=2024-04-15 02:44:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:44:05.479806761Z [2024-04-15T02:44:05.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:05.531845442Z [2024-04-15T02:44:05.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status success for try_number 1 2024-04-15T02:44:05.537017476Z [2024-04-15T02:44:05.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:43:00+00:00, map_index=-1, run_start_date=2024-04-15 02:44:02.891225+00:00, run_end_date=2024-04-15 02:44:04.899646+00:00, run_duration=2.008421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:44:00.194599+00:00, queued_by_job_id=2, pid=5975 2024-04-15T02:44:06.581995986Z [2024-04-15T02:44:06.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:44:06.582529510Z [2024-04-15T02:44:06.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:43:00+00:00, run_id=scheduled__2024-04-15T02:43:00+00:00, run_start_date=2024-04-15 02:44:00.141803+00:00, run_end_date=2024-04-15 02:44:06.582125+00:00, run_duration=6.440322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:43:00+00:00, data_interval_end=2024-04-15 02:44:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:44:06.591973043Z [2024-04-15T02:44:06.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:06.631733316Z [2024-04-15T02:44:06.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status success for try_number 1 2024-04-15T02:44:06.638417587Z [2024-04-15T02:44:06.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:43:00+00:00, map_index=-1, run_start_date=2024-04-15 02:44:03.220063+00:00, run_end_date=2024-04-15 02:44:05.469879+00:00, run_duration=2.249816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:44:00.194599+00:00, queued_by_job_id=2, pid=5976 2024-04-15T02:45:00.996999189Z [2024-04-15T02:45:00.996+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:45:01.024630399Z [2024-04-15T02:45:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:01.040685584Z [2024-04-15T02:45:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:45:01.112443281Z [2024-04-15T02:45:01.112+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:45:01.112452255Z 2024-04-15T02:45:01.112456047Z 2024-04-15T02:45:01.112472575Z 2024-04-15T02:45:01.112512498Z [2024-04-15T02:45:01.112+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:45:01.112587893Z [2024-04-15T02:45:01.112+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:45:01.112660065Z [2024-04-15T02:45:01.112+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:45:01.113105602Z [2024-04-15T02:45:01.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:01.113112821Z 2024-04-15T02:45:01.113115971Z 2024-04-15T02:45:01.113118733Z 2024-04-15T02:45:01.118368444Z [2024-04-15T02:45:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:45:01.118452071Z [2024-04-15T02:45:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:01.118633383Z [2024-04-15T02:45:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:45:01.118706636Z [2024-04-15T02:45:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:45:01.118851215Z [2024-04-15T02:45:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:45:01.118907925Z [2024-04-15T02:45:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:45:01.582308833Z [2024-04-15T02:45:01.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:01.583706652Z [2024-04-15T02:45:01.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:01.583972904Z [2024-04-15T02:45:01.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:01.607163549Z [2024-04-15T02:45:01.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02a4f916-8152-4e5f-b5d2-f5cc263100b1 2024-04-15T02:45:01.610565472Z [2024-04-15T02:45:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15e38c0e-d2c0-447a-8bae-5e9aa41836bc 2024-04-15T02:45:01.612022534Z [2024-04-15T02:45:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03c3fe91-d171-44d5-b06b-840ec18d389a 2024-04-15T02:45:04.821680304Z [2024-04-15T02:45:04.819+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:45:04.821695402Z 2024-04-15T02:45:04.821705302Z [2024-04-15T02:45:04.820+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:45:04.821709379Z [2024-04-15T02:45:04.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:04.821712235Z 2024-04-15T02:45:04.824450012Z [2024-04-15T02:45:04.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:45:04.824463763Z [2024-04-15T02:45:04.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:04.919415075Z [2024-04-15T02:45:04.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:04.927999940Z [2024-04-15T02:45:04.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad1450f5-b593-43cb-a00a-ff8284b6e812 2024-04-15T02:45:05.029641466Z [2024-04-15T02:45:05.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:05.036670854Z [2024-04-15T02:45:05.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:04.122709+00:00, run_end_date=2024-04-15 02:45:04.670277+00:00, run_duration=0.547568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:01.113667+00:00, queued_by_job_id=2, pid=6042 2024-04-15T02:45:05.921531045Z [2024-04-15T02:45:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:45:05.921852268Z [2024-04-15T02:45:05.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:44:00+00:00, run_id=scheduled__2024-04-15T02:44:00+00:00, run_start_date=2024-04-15 02:45:01.060359+00:00, run_end_date=2024-04-15 02:45:05.921460+00:00, run_duration=4.861101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:44:00+00:00, data_interval_end=2024-04-15 02:45:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:45:05.934062779Z [2024-04-15T02:45:05.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:05.989875740Z [2024-04-15T02:45:05.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:05.998912061Z [2024-04-15T02:45:05.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:44:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:04.081332+00:00, run_end_date=2024-04-15 02:45:05.525682+00:00, run_duration=1.44435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:01.113667+00:00, queued_by_job_id=2, pid=6041 2024-04-15T02:45:07.087184245Z [2024-04-15T02:45:07.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:45:07.088044874Z [2024-04-15T02:45:07.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:44:00+00:00, run_id=scheduled__2024-04-15T02:44:00+00:00, run_start_date=2024-04-15 02:45:01.061368+00:00, run_end_date=2024-04-15 02:45:07.087130+00:00, run_duration=6.025762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:44:00+00:00, data_interval_end=2024-04-15 02:45:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:45:07.109209028Z [2024-04-15T02:45:07.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:07.198818150Z [2024-04-15T02:45:07.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:07.208569601Z [2024-04-15T02:45:07.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:44:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:04.229321+00:00, run_end_date=2024-04-15 02:45:06.251936+00:00, run_duration=2.022615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:01.113667+00:00, queued_by_job_id=2, pid=6043 2024-04-15T02:45:08.285291502Z [2024-04-15T02:45:08.284+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:45:08.285319572Z 2024-04-15T02:45:08.285340066Z [2024-04-15T02:45:08.285+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:45:08.285958025Z [2024-04-15T02:45:08.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:08.285990602Z 2024-04-15T02:45:08.288113366Z [2024-04-15T02:45:08.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:45:08.288212420Z [2024-04-15T02:45:08.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:45:08.328436502Z [2024-04-15T02:45:08.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:08.328510301Z [2024-04-15T02:45:08.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:08.333078787Z [2024-04-15T02:45:08.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74ab0bcf-4f38-4fd8-9f03-e30b6dd9ad9c 2024-04-15T02:45:08.333197596Z [2024-04-15T02:45:08.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:06.749079+00:00, run_end_date=2024-04-15 02:45:07.145970+00:00, run_duration=0.396891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:04.821275+00:00, queued_by_job_id=2, pid=6082 2024-04-15T02:45:11.331700389Z [2024-04-15T02:45:11.331+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:45:11.331715630Z 2024-04-15T02:45:11.332430656Z [2024-04-15T02:45:11.332+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:45:11.333207483Z [2024-04-15T02:45:11.333+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:11.333217974Z 2024-04-15T02:45:11.336154699Z [2024-04-15T02:45:11.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:45:11.336415615Z [2024-04-15T02:45:11.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:11.391493531Z [2024-04-15T02:45:11.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:11.391885964Z [2024-04-15T02:45:11.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:11.403235364Z [2024-04-15T02:45:11.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71c79dbe-6630-41f8-b81f-46029d702623 2024-04-15T02:45:11.403403763Z [2024-04-15T02:45:11.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=0, run_start_date=2024-04-15 02:45:10.251937+00:00, run_end_date=2024-04-15 02:45:10.633052+00:00, run_duration=0.381115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:08.286274+00:00, queued_by_job_id=2, pid=6094 2024-04-15T02:45:14.210851841Z [2024-04-15T02:45:14.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:45:14.211523750Z [2024-04-15T02:45:14.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:45:01.059150+00:00, run_end_date=2024-04-15 02:45:14.210776+00:00, run_duration=13.151626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:45:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:45:14.217365735Z [2024-04-15T02:45:14.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:45:14.244419224Z [2024-04-15T02:45:14.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:14.248527982Z [2024-04-15T02:45:14.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:13.382059+00:00, run_end_date=2024-04-15 02:45:13.755112+00:00, run_duration=0.373053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:11.333620+00:00, queued_by_job_id=2, pid=6106 2024-04-15T02:45:40.889857610Z [2024-04-15T02:45:40.889+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:46:00.889563453Z [2024-04-15T02:46:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:00.904030777Z [2024-04-15T02:46:00.903+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:46:00.911278495Z [2024-04-15T02:46:00.911+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:46:00.983517820Z [2024-04-15T02:46:00.983+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:46:00.983532075Z 2024-04-15T02:46:00.983536233Z 2024-04-15T02:46:00.983539475Z 2024-04-15T02:46:00.984194880Z [2024-04-15T02:46:00.983+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:46:00.984342262Z [2024-04-15T02:46:00.984+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:46:00.985295852Z [2024-04-15T02:46:00.985+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:46:00.986536794Z [2024-04-15T02:46:00.986+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:46:00.986549533Z 2024-04-15T02:46:00.986560159Z 2024-04-15T02:46:00.986563511Z 2024-04-15T02:46:01.018623280Z [2024-04-15T02:46:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:46:01.018836784Z [2024-04-15T02:46:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:46:01.023136586Z [2024-04-15T02:46:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:46:01.023904046Z [2024-04-15T02:46:01.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:46:01.025940790Z [2024-04-15T02:46:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:46:01.026075149Z [2024-04-15T02:46:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:46:01.486909266Z [2024-04-15T02:46:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status queued for try_number 1 2024-04-15T02:46:01.487233297Z [2024-04-15T02:46:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:46:01.487440092Z [2024-04-15T02:46:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:46:01.497913736Z [2024-04-15T02:46:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to dac7b67e-f357-4fea-b0c9-c5a3fbd8312b 2024-04-15T02:46:01.498150851Z [2024-04-15T02:46:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 036ad82d-e7b4-4cdb-9602-4b1144446e74 2024-04-15T02:46:01.498318481Z [2024-04-15T02:46:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b67cc33-8a11-4d7f-819d-ed68f8a94f7b 2024-04-15T02:46:02.727152386Z [2024-04-15T02:46:02.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:46:02.736610631Z [2024-04-15T02:46:02.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:44:00+00:00, run_id=scheduled__2024-04-15T02:44:00+00:00, run_start_date=2024-04-15 02:46:00.922932+00:00, run_end_date=2024-04-15 02:46:02.729691+00:00, run_duration=1.806759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:44:00+00:00, data_interval_end=2024-04-15 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:46:02.748558719Z [2024-04-15T02:46:02.748+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:46:04.029603238Z [2024-04-15T02:46:04.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status success for try_number 1 2024-04-15T02:46:04.043025669Z [2024-04-15T02:46:04.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:44:00+00:00, map_index=-1, run_start_date=2024-04-15 02:46:02.230515+00:00, run_end_date=2024-04-15 02:46:02.684570+00:00, run_duration=0.454055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:46:01.009139+00:00, queued_by_job_id=2, pid=6122 2024-04-15T02:46:06.272774404Z [2024-04-15T02:46:06.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:46:06.274529048Z [2024-04-15T02:46:06.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:45:00+00:00, run_id=scheduled__2024-04-15T02:45:00+00:00, run_start_date=2024-04-15 02:46:00.924940+00:00, run_end_date=2024-04-15 02:46:06.274078+00:00, run_duration=5.349138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:45:00+00:00, data_interval_end=2024-04-15 02:46:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:46:06.285710794Z [2024-04-15T02:46:06.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:06.293038182Z [2024-04-15T02:46:06.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:46:06.293406894Z [2024-04-15T02:46:06.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:45:00+00:00, run_id=scheduled__2024-04-15T02:45:00+00:00, run_start_date=2024-04-15 02:46:00.925978+00:00, run_end_date=2024-04-15 02:46:06.292984+00:00, run_duration=5.367006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:45:00+00:00, data_interval_end=2024-04-15 02:46:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:46:06.302382852Z [2024-04-15T02:46:06.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:06.335151349Z [2024-04-15T02:46:06.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:46:06.335204745Z [2024-04-15T02:46:06.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:46:06.340452069Z [2024-04-15T02:46:06.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:46:04.125128+00:00, run_end_date=2024-04-15 02:46:05.863817+00:00, run_duration=1.738689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:46:01.009139+00:00, queued_by_job_id=2, pid=6152 2024-04-15T02:46:06.340718511Z [2024-04-15T02:46:06.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:46:04.116344+00:00, run_end_date=2024-04-15 02:46:05.821140+00:00, run_duration=1.704796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:46:01.009139+00:00, queued_by_job_id=2, pid=6153 2024-04-15T02:47:00.684719387Z [2024-04-15T02:47:00.684+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:47:00.696968251Z [2024-04-15T02:47:00.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:00.754019722Z [2024-04-15T02:47:00.753+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:47:00.754046106Z 2024-04-15T02:47:00.754049899Z 2024-04-15T02:47:00.754233379Z [2024-04-15T02:47:00.753+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:47:00.754457781Z [2024-04-15T02:47:00.754+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:47:00.755613651Z [2024-04-15T02:47:00.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:47:00.755625240Z 2024-04-15T02:47:00.755628748Z 2024-04-15T02:47:00.761805266Z [2024-04-15T02:47:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:47:00.762221524Z [2024-04-15T02:47:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:47:00.762532847Z [2024-04-15T02:47:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:47:00.762662054Z [2024-04-15T02:47:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:47:01.077441033Z [2024-04-15T02:47:01.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status queued for try_number 1 2024-04-15T02:47:01.077591564Z [2024-04-15T02:47:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status queued for try_number 1 2024-04-15T02:47:01.084961619Z [2024-04-15T02:47:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb1e72fe-3637-44d5-9c77-77824663f5c2 2024-04-15T02:47:01.086193747Z [2024-04-15T02:47:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1457c34-0b30-4d06-890e-f92a3b733dc0 2024-04-15T02:47:05.453332946Z [2024-04-15T02:47:05.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:47:05.453567808Z [2024-04-15T02:47:05.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:46:00+00:00, run_id=scheduled__2024-04-15T02:46:00+00:00, run_start_date=2024-04-15 02:47:00.709505+00:00, run_end_date=2024-04-15 02:47:05.453259+00:00, run_duration=4.743754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:46:00+00:00, data_interval_end=2024-04-15 02:47:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:47:05.464944347Z [2024-04-15T02:47:05.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:05.472058966Z [2024-04-15T02:47:05.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:47:05.472218787Z [2024-04-15T02:47:05.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:46:00+00:00, run_id=scheduled__2024-04-15T02:46:00+00:00, run_start_date=2024-04-15 02:47:00.708006+00:00, run_end_date=2024-04-15 02:47:05.472015+00:00, run_duration=4.764009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:46:00+00:00, data_interval_end=2024-04-15 02:47:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:47:05.483660916Z [2024-04-15T02:47:05.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:05.521048448Z [2024-04-15T02:47:05.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status success for try_number 1 2024-04-15T02:47:05.521433875Z [2024-04-15T02:47:05.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status success for try_number 1 2024-04-15T02:47:05.526530133Z [2024-04-15T02:47:05.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:46:00+00:00, map_index=-1, run_start_date=2024-04-15 02:47:03.061820+00:00, run_end_date=2024-04-15 02:47:04.949600+00:00, run_duration=1.88778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:47:00.757725+00:00, queued_by_job_id=2, pid=6198 2024-04-15T02:47:05.526839429Z [2024-04-15T02:47:05.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:46:00+00:00, map_index=-1, run_start_date=2024-04-15 02:47:03.657796+00:00, run_end_date=2024-04-15 02:47:05.149419+00:00, run_duration=1.491623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:47:00.757725+00:00, queued_by_job_id=2, pid=6216 2024-04-15T02:48:00.338919145Z [2024-04-15T02:48:00.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:00.351846802Z [2024-04-15T02:48:00.351+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:48:00.365150532Z [2024-04-15T02:48:00.364+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:48:00.425353561Z [2024-04-15T02:48:00.424+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:48:00.425374131Z 2024-04-15T02:48:00.425378985Z 2024-04-15T02:48:00.425383062Z 2024-04-15T02:48:00.425652158Z [2024-04-15T02:48:00.425+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:48:00.425875830Z [2024-04-15T02:48:00.425+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:48:00.426264458Z [2024-04-15T02:48:00.426+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:48:00.427304279Z [2024-04-15T02:48:00.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:48:00.427312709Z 2024-04-15T02:48:00.427316216Z 2024-04-15T02:48:00.427319476Z 2024-04-15T02:48:00.432318649Z [2024-04-15T02:48:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:48:00.432679298Z [2024-04-15T02:48:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:48:00.433119564Z [2024-04-15T02:48:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:48:00.433447947Z [2024-04-15T02:48:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:48:00.434147136Z [2024-04-15T02:48:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:48:00.434478117Z [2024-04-15T02:48:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:48:00.648651009Z [2024-04-15T02:48:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status queued for try_number 1 2024-04-15T02:48:00.648796822Z [2024-04-15T02:48:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status queued for try_number 1 2024-04-15T02:48:00.648929663Z [2024-04-15T02:48:00.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status queued for try_number 1 2024-04-15T02:48:00.656566727Z [2024-04-15T02:48:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 851141ec-cf61-4a04-877a-e88858097d90 2024-04-15T02:48:00.656782837Z [2024-04-15T02:48:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31d29273-5736-44fb-ac4b-098e1d7bcb8a 2024-04-15T02:48:00.656968212Z [2024-04-15T02:48:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 369da96c-269b-43b2-83cf-3a46d51cfd4c 2024-04-15T02:48:03.058859362Z [2024-04-15T02:48:03.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:48:03.059253895Z [2024-04-15T02:48:03.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:46:00+00:00, run_id=scheduled__2024-04-15T02:46:00+00:00, run_start_date=2024-04-15 02:48:00.376382+00:00, run_end_date=2024-04-15 02:48:03.058915+00:00, run_duration=2.682533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:46:00+00:00, data_interval_end=2024-04-15 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:48:03.068229767Z [2024-04-15T02:48:03.067+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:48:03.132821287Z [2024-04-15T02:48:03.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status success for try_number 1 2024-04-15T02:48:03.138836152Z [2024-04-15T02:48:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:46:00+00:00, map_index=-1, run_start_date=2024-04-15 02:48:01.395269+00:00, run_end_date=2024-04-15 02:48:02.124112+00:00, run_duration=0.728843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:48:00.428867+00:00, queued_by_job_id=2, pid=6242 2024-04-15T02:48:05.305026118Z [2024-04-15T02:48:05.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:48:05.305495884Z [2024-04-15T02:48:05.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:47:00+00:00, run_id=scheduled__2024-04-15T02:47:00+00:00, run_start_date=2024-04-15 02:48:00.377525+00:00, run_end_date=2024-04-15 02:48:05.305106+00:00, run_duration=4.927581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:47:00+00:00, data_interval_end=2024-04-15 02:48:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:48:05.314413341Z [2024-04-15T02:48:05.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:05.354814000Z [2024-04-15T02:48:05.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status success for try_number 1 2024-04-15T02:48:05.359970115Z [2024-04-15T02:48:05.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:47:00+00:00, map_index=-1, run_start_date=2024-04-15 02:48:03.351540+00:00, run_end_date=2024-04-15 02:48:04.745146+00:00, run_duration=1.393606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:48:00.428867+00:00, queued_by_job_id=2, pid=6282 2024-04-15T02:48:05.746116916Z [2024-04-15T02:48:05.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:48:05.746383082Z [2024-04-15T02:48:05.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:47:00+00:00, run_id=scheduled__2024-04-15T02:47:00+00:00, run_start_date=2024-04-15 02:48:00.378460+00:00, run_end_date=2024-04-15 02:48:05.746081+00:00, run_duration=5.367621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:47:00+00:00, data_interval_end=2024-04-15 02:48:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:48:05.755684854Z [2024-04-15T02:48:05.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:05.786798707Z [2024-04-15T02:48:05.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status success for try_number 1 2024-04-15T02:48:05.796478604Z [2024-04-15T02:48:05.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:47:00+00:00, map_index=-1, run_start_date=2024-04-15 02:48:02.845398+00:00, run_end_date=2024-04-15 02:48:05.560552+00:00, run_duration=2.715154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:48:00.428867+00:00, queued_by_job_id=2, pid=6263 2024-04-15T02:49:00.881233208Z [2024-04-15T02:49:00.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:49:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:49:00.889234899Z [2024-04-15T02:49:00.888+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:49:00.965348291Z [2024-04-15T02:49:00.965+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:49:00.965361477Z 2024-04-15T02:49:00.965374834Z 2024-04-15T02:49:00.965720019Z [2024-04-15T02:49:00.965+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:49:00.965940077Z [2024-04-15T02:49:00.965+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:49:00.966510796Z [2024-04-15T02:49:00.966+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:49:00.966521183Z 2024-04-15T02:49:00.966524369Z 2024-04-15T02:49:00.968965834Z [2024-04-15T02:49:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:49:00.969177106Z [2024-04-15T02:49:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:49:00.969469666Z [2024-04-15T02:49:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:49:00.969644224Z [2024-04-15T02:49:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:49:01.230942393Z [2024-04-15T02:49:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:48:00+00:00 exited with status queued for try_number 1 2024-04-15T02:49:01.230982257Z [2024-04-15T02:49:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:48:00+00:00 exited with status queued for try_number 1 2024-04-15T02:49:01.246155700Z [2024-04-15T02:49:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1454a0b7-d67b-4434-9e6e-e19ebd18faa8 2024-04-15T02:49:01.246213998Z [2024-04-15T02:49:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c0008bd-f989-43e7-a581-cc5ed9256482 2024-04-15T02:49:04.948515036Z [2024-04-15T02:49:04.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:49:04.948901625Z [2024-04-15T02:49:04.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:48:00+00:00, run_id=scheduled__2024-04-15T02:48:00+00:00, run_start_date=2024-04-15 02:49:00.900777+00:00, run_end_date=2024-04-15 02:49:04.948552+00:00, run_duration=4.047775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:48:00+00:00, data_interval_end=2024-04-15 02:49:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:49:04.958097891Z [2024-04-15T02:49:04.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:49:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:49:04.963369222Z [2024-04-15T02:49:04.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:49:04.963667006Z [2024-04-15T02:49:04.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:48:00+00:00, run_id=scheduled__2024-04-15T02:48:00+00:00, run_start_date=2024-04-15 02:49:00.903214+00:00, run_end_date=2024-04-15 02:49:04.963378+00:00, run_duration=4.060164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:48:00+00:00, data_interval_end=2024-04-15 02:49:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:49:04.972533945Z [2024-04-15T02:49:04.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:49:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:49:04.999647659Z [2024-04-15T02:49:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:48:00+00:00 exited with status success for try_number 1 2024-04-15T02:49:05.005358879Z [2024-04-15T02:49:05.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:48:00+00:00, map_index=-1, run_start_date=2024-04-15 02:49:03.259501+00:00, run_end_date=2024-04-15 02:49:04.520020+00:00, run_duration=1.260519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:49:00.967090+00:00, queued_by_job_id=2, pid=6326 2024-04-15T02:49:06.049813539Z [2024-04-15T02:49:06.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:48:00+00:00 exited with status success for try_number 1 2024-04-15T02:49:06.057382031Z [2024-04-15T02:49:06.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:48:00+00:00, map_index=-1, run_start_date=2024-04-15 02:49:03.282892+00:00, run_end_date=2024-04-15 02:49:04.898883+00:00, run_duration=1.615991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:49:00.967090+00:00, queued_by_job_id=2, pid=6327 2024-04-15T02:50:00.548074954Z [2024-04-15T02:50:00.547+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:50:00.564697957Z [2024-04-15T02:50:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:51:00+00:00 2024-04-15T02:50:00.579490431Z [2024-04-15T02:50:00.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:50:00.586566544Z [2024-04-15T02:50:00.586+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:50:00.681204099Z [2024-04-15T02:50:00.680+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:50:00.681261926Z 2024-04-15T02:50:00.681281691Z 2024-04-15T02:50:00.681286525Z 2024-04-15T02:50:00.681290740Z 2024-04-15T02:50:00.681466015Z [2024-04-15T02:50:00.681+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:50:00.681774557Z [2024-04-15T02:50:00.681+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:50:00.682239688Z [2024-04-15T02:50:00.681+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:50:00.682283588Z [2024-04-15T02:50:00.682+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:50:00.684144293Z [2024-04-15T02:50:00.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:50:00.684158760Z 2024-04-15T02:50:00.684163893Z 2024-04-15T02:50:00.684168845Z 2024-04-15T02:50:00.684207621Z 2024-04-15T02:50:00.689658894Z [2024-04-15T02:50:00.688+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:50:00.689681361Z [2024-04-15T02:50:00.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:50:00.691979774Z [2024-04-15T02:50:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:50:00.692260727Z [2024-04-15T02:50:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:50:00.692716690Z [2024-04-15T02:50:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:50:00.692994273Z [2024-04-15T02:50:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:50:00.693348033Z [2024-04-15T02:50:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:50:00.693484541Z [2024-04-15T02:50:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:50:01.144266222Z [2024-04-15T02:50:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:50:01.152589788Z [2024-04-15T02:50:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:48:00+00:00 exited with status queued for try_number 1 2024-04-15T02:50:01.152721290Z [2024-04-15T02:50:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:49:00+00:00 exited with status queued for try_number 1 2024-04-15T02:50:01.152830451Z [2024-04-15T02:50:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:49:00+00:00 exited with status queued for try_number 1 2024-04-15T02:50:01.200373921Z [2024-04-15T02:50:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aea3dc3-d59c-40f7-b7b8-b17f4dd15105 2024-04-15T02:50:01.203912943Z [2024-04-15T02:50:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1362e934-dd82-4d61-9337-122592b5da71 2024-04-15T02:50:01.206033361Z [2024-04-15T02:50:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75fa4dc4-8a86-48a4-88eb-70680f5644ba 2024-04-15T02:50:01.206450166Z [2024-04-15T02:50:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to a38f4735-507c-4866-9690-42f32a08e6a2 2024-04-15T02:50:03.485576687Z [2024-04-15T02:50:03.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:50:03.485929405Z [2024-04-15T02:50:03.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:48:00+00:00, run_id=scheduled__2024-04-15T02:48:00+00:00, run_start_date=2024-04-15 02:50:00.597452+00:00, run_end_date=2024-04-15 02:50:03.485570+00:00, run_duration=2.888118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:48:00+00:00, data_interval_end=2024-04-15 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:50:03.498032253Z [2024-04-15T02:50:03.497+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:52:00+00:00 2024-04-15T02:50:03.608054472Z [2024-04-15T02:50:03.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:48:00+00:00 exited with status success for try_number 1 2024-04-15T02:50:03.616989754Z [2024-04-15T02:50:03.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:48:00+00:00, map_index=-1, run_start_date=2024-04-15 02:50:01.791027+00:00, run_end_date=2024-04-15 02:50:02.637799+00:00, run_duration=0.846772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:00.685591+00:00, queued_by_job_id=2, pid=6363 2024-04-15T02:50:04.721071271Z [2024-04-15T02:50:04.720+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:50:04.721085009Z 2024-04-15T02:50:04.721308306Z [2024-04-15T02:50:04.721+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:50:04.721973512Z [2024-04-15T02:50:04.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:50:04.721980552Z 2024-04-15T02:50:04.724175266Z [2024-04-15T02:50:04.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:50:04.724235381Z [2024-04-15T02:50:04.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:50:04.796677917Z [2024-04-15T02:50:04.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:50:04.796695925Z [2024-04-15T02:50:04.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:50:04.806871735Z [2024-04-15T02:50:04.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 458ad121-5cf8-4679-b27a-02084f9a3877 2024-04-15T02:50:04.806880389Z [2024-04-15T02:50:04.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:50:03.619954+00:00, run_end_date=2024-04-15 02:50:04.070949+00:00, run_duration=0.450995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:00.685591+00:00, queued_by_job_id=2, pid=6397 2024-04-15T02:50:06.035220284Z [2024-04-15T02:50:06.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:50:06.035523933Z [2024-04-15T02:50:06.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:49:00+00:00, run_id=scheduled__2024-04-15T02:49:00+00:00, run_start_date=2024-04-15 02:50:00.599401+00:00, run_end_date=2024-04-15 02:50:06.035258+00:00, run_duration=5.435857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:49:00+00:00, data_interval_end=2024-04-15 02:50:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:50:06.045584418Z [2024-04-15T02:50:06.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:51:00+00:00 2024-04-15T02:50:06.053683434Z [2024-04-15T02:50:06.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:50:06.054330833Z [2024-04-15T02:50:06.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:49:00+00:00, run_id=scheduled__2024-04-15T02:49:00+00:00, run_start_date=2024-04-15 02:50:00.598428+00:00, run_end_date=2024-04-15 02:50:06.053761+00:00, run_duration=5.455333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:49:00+00:00, data_interval_end=2024-04-15 02:50:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:50:06.067339831Z [2024-04-15T02:50:06.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:51:00+00:00 2024-04-15T02:50:06.126893084Z [2024-04-15T02:50:06.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:49:00+00:00 exited with status success for try_number 1 2024-04-15T02:50:06.127918641Z [2024-04-15T02:50:06.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:49:00+00:00 exited with status success for try_number 1 2024-04-15T02:50:06.133630864Z [2024-04-15T02:50:06.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:49:00+00:00, map_index=-1, run_start_date=2024-04-15 02:50:03.299841+00:00, run_end_date=2024-04-15 02:50:04.972742+00:00, run_duration=1.672901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:00.685591+00:00, queued_by_job_id=2, pid=6390 2024-04-15T02:50:06.134000288Z [2024-04-15T02:50:06.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:49:00+00:00, map_index=-1, run_start_date=2024-04-15 02:50:04.041639+00:00, run_end_date=2024-04-15 02:50:05.362341+00:00, run_duration=1.320702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:00.685591+00:00, queued_by_job_id=2, pid=6423 2024-04-15T02:50:07.409588175Z [2024-04-15T02:50:07.409+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:50:07.409612558Z 2024-04-15T02:50:07.409646410Z [2024-04-15T02:50:07.409+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:50:07.410173782Z [2024-04-15T02:50:07.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:50:07.410186176Z 2024-04-15T02:50:07.412068641Z [2024-04-15T02:50:07.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:50:07.412091751Z [2024-04-15T02:50:07.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:50:07.454340738Z [2024-04-15T02:50:07.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:50:07.454364245Z [2024-04-15T02:50:07.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:50:07.460347445Z [2024-04-15T02:50:07.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to be381803-3f54-434e-ad07-f90881df1b60 2024-04-15T02:50:07.460486839Z [2024-04-15T02:50:07.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:50:06.528494+00:00, run_end_date=2024-04-15 02:50:06.842378+00:00, run_duration=0.313884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:04.722310+00:00, queued_by_job_id=2, pid=6444 2024-04-15T02:50:09.779548011Z [2024-04-15T02:50:09.779+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:50:09.779559360Z 2024-04-15T02:50:09.779806121Z [2024-04-15T02:50:09.779+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:50:09.780382095Z [2024-04-15T02:50:09.780+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:50:09.780393040Z 2024-04-15T02:50:09.782829357Z [2024-04-15T02:50:09.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:50:09.784203345Z [2024-04-15T02:50:09.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:50:09.832428573Z [2024-04-15T02:50:09.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:50:09.832506552Z [2024-04-15T02:50:09.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:50:09.837989209Z [2024-04-15T02:50:09.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7eb5d42-c674-40c7-be46-30fa800defa6 2024-04-15T02:50:09.838566092Z [2024-04-15T02:50:09.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=0, run_start_date=2024-04-15 02:50:09.071274+00:00, run_end_date=2024-04-15 02:50:09.370667+00:00, run_duration=0.299393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:07.410413+00:00, queued_by_job_id=2, pid=6456 2024-04-15T02:50:12.061201131Z [2024-04-15T02:50:12.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:50:12.061695942Z [2024-04-15T02:50:12.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:45:00+00:00, run_id=scheduled__2024-04-15T02:45:00+00:00, run_start_date=2024-04-15 02:50:00.596233+00:00, run_end_date=2024-04-15 02:50:12.061380+00:00, run_duration=11.465147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:45:00+00:00, data_interval_end=2024-04-15 02:50:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:50:12.071509053Z [2024-04-15T02:50:12.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:50:12.122833799Z [2024-04-15T02:50:12.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:50:12.129088656Z [2024-04-15T02:50:12.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:50:11.532124+00:00, run_end_date=2024-04-15 02:50:11.896473+00:00, run_duration=0.364349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:09.780855+00:00, queued_by_job_id=2, pid=6468 2024-04-15T02:50:24.994733545Z [2024-04-15T02:50:24.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:50:24.994754030Z 2024-04-15T02:50:24.994889361Z [2024-04-15T02:50:24.994+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-15T02:50:24.995413621Z [2024-04-15T02:50:24.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:50:24.995429322Z 2024-04-15T02:50:24.997347576Z [2024-04-15T02:50:24.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240415025023_554907', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:50:24.997533626Z [2024-04-15T02:50:24.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240415025023_554907', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-15T02:50:25.056812386Z [2024-04-15T02:50:25.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415025023_554907 exited with status queued for try_number 1 2024-04-15T02:50:25.066152178Z [2024-04-15T02:50:25.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 594732e9-e296-4832-93f3-c02f190ffb17 2024-04-15T02:50:26.163775456Z [2024-04-15T02:50:26.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:50:26.164180140Z [2024-04-15T02:50:26.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-15 02:50:23.862801+00:00, run_id=vdu_down_20240415025023_554907, run_start_date=2024-04-15 02:50:24.973522+00:00, run_end_date=2024-04-15 02:50:26.163718+00:00, run_duration=1.190196, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 02:50:23.862801+00:00, data_interval_end=2024-04-15 02:50:23.862801+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-15T02:50:26.168070567Z [2024-04-15T02:50:26.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-15T02:50:26.196390782Z [2024-04-15T02:50:26.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415025023_554907 exited with status success for try_number 1 2024-04-15T02:50:26.201482626Z [2024-04-15T02:50:26.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240415025023_554907, map_index=-1, run_start_date=2024-04-15 02:50:25.629218+00:00, run_end_date=2024-04-15 02:50:26.014828+00:00, run_duration=0.38561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:50:24.995783+00:00, queued_by_job_id=2, pid=6483 2024-04-15T02:50:40.938238337Z [2024-04-15T02:50:40.937+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:51:00.362096638Z [2024-04-15T02:51:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:51:00.374541874Z [2024-04-15T02:51:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:51:00+00:00, run_after=2024-04-15T02:52:00+00:00 2024-04-15T02:51:00.424905000Z [2024-04-15T02:51:00.424+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:51:00.424922465Z 2024-04-15T02:51:00.424925731Z 2024-04-15T02:51:00.425276137Z [2024-04-15T02:51:00.425+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:51:00.425562656Z [2024-04-15T02:51:00.425+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:51:00.427169189Z [2024-04-15T02:51:00.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:51:00.427180209Z 2024-04-15T02:51:00.427183892Z 2024-04-15T02:51:00.430277260Z [2024-04-15T02:51:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:51:00.430512940Z [2024-04-15T02:51:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:51:00.430865517Z [2024-04-15T02:51:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:51:00.431458408Z [2024-04-15T02:51:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:51:00.596949402Z [2024-04-15T02:51:00.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:51:00.597094899Z [2024-04-15T02:51:00.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:51:00.602639874Z [2024-04-15T02:51:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27b83160-cbac-45ac-9162-e47d68f7e0da 2024-04-15T02:51:00.602869269Z [2024-04-15T02:51:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33b0b5b5-4980-46d0-b4d5-599e1e73dd10 2024-04-15T02:51:05.487344731Z [2024-04-15T02:51:05.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:51:05.487850190Z [2024-04-15T02:51:05.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:50:00+00:00, run_id=scheduled__2024-04-15T02:50:00+00:00, run_start_date=2024-04-15 02:51:00.385178+00:00, run_end_date=2024-04-15 02:51:05.487168+00:00, run_duration=5.10199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:50:00+00:00, data_interval_end=2024-04-15 02:51:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:51:05.495517943Z [2024-04-15T02:51:05.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:51:00+00:00, run_after=2024-04-15T02:52:00+00:00 2024-04-15T02:51:05.500644641Z [2024-04-15T02:51:05.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:51:05.500908390Z [2024-04-15T02:51:05.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:50:00+00:00, run_id=scheduled__2024-04-15T02:50:00+00:00, run_start_date=2024-04-15 02:51:00.386328+00:00, run_end_date=2024-04-15 02:51:05.500586+00:00, run_duration=5.114258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:50:00+00:00, data_interval_end=2024-04-15 02:51:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:51:05.509056159Z [2024-04-15T02:51:05.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:51:00+00:00, run_after=2024-04-15T02:52:00+00:00 2024-04-15T02:51:05.552350895Z [2024-04-15T02:51:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:51:05.552596256Z [2024-04-15T02:51:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:51:05.564952318Z [2024-04-15T02:51:05.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:51:02.650892+00:00, run_end_date=2024-04-15 02:51:04.427242+00:00, run_duration=1.77635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:51:00.427966+00:00, queued_by_job_id=2, pid=6516 2024-04-15T02:51:05.566429212Z [2024-04-15T02:51:05.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:51:02.783514+00:00, run_end_date=2024-04-15 02:51:04.848184+00:00, run_duration=2.06467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:51:00.427966+00:00, queued_by_job_id=2, pid=6517 2024-04-15T02:51:51.159994874Z [2024-04-15T02:51:51.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:51:00+00:00, run_after=2024-04-15T02:52:00+00:00 2024-04-15T02:51:51.244143036Z [2024-04-15T02:51:51.243+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:51:51.244158073Z 2024-04-15T02:51:51.244181325Z [2024-04-15T02:51:51.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:51:51.249863101Z [2024-04-15T02:51:51.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:51:51.249877198Z 2024-04-15T02:51:51.261543137Z [2024-04-15T02:51:51.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:51:51.261805603Z [2024-04-15T02:51:51.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:51:51.420830389Z [2024-04-15T02:51:51.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:51:51.437595351Z [2024-04-15T02:51:51.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34350364-dddb-49a7-b3f5-c7a89c7b3791 2024-04-15T02:51:54.002638504Z [2024-04-15T02:51:54.001+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:51:54.053714158Z [2024-04-15T02:51:54.053+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:51:54.053730440Z 2024-04-15T02:51:54.054356002Z [2024-04-15T02:51:54.054+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:51:54.055550155Z [2024-04-15T02:51:54.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:51:54.055561414Z 2024-04-15T02:51:54.060031206Z [2024-04-15T02:51:54.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:51:54.060277123Z [2024-04-15T02:51:54.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:51:54.142884109Z [2024-04-15T02:51:54.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:51:54.152580785Z [2024-04-15T02:51:54.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69096336-aa1b-472e-81e3-9574ac63b8bc 2024-04-15T02:51:56.282548524Z [2024-04-15T02:51:56.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:51:56.285151382Z [2024-04-15T02:51:56.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, execution_date=2024-04-15 02:50:00+00:00, run_id=scheduled__2024-04-15T02:50:00+00:00, run_start_date=2024-04-15 02:51:51.187837+00:00, run_end_date=2024-04-15 02:51:56.282391+00:00, run_duration=5.094554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:50:00+00:00, data_interval_end=2024-04-15 02:51:00+00:00, dag_hash=4945b62b2f7b9a70fdebd018396058b2 2024-04-15T02:51:56.341828989Z [2024-04-15T02:51:56.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:51:00+00:00, run_after=2024-04-15T02:52:00+00:00 2024-04-15T02:51:56.557413907Z [2024-04-15T02:51:56.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:51:56.579608230Z [2024-04-15T02:51:56.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:51:54.291466+00:00, run_end_date=2024-04-15 02:51:55.468427+00:00, run_duration=1.176961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:51:51.250431+00:00, queued_by_job_id=2, pid=6561 2024-04-15T02:51:58.680110901Z [2024-04-15T02:51:58.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:51:58.680345765Z [2024-04-15T02:51:58.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, execution_date=2024-04-15 02:50:00+00:00, run_id=scheduled__2024-04-15T02:50:00+00:00, run_start_date=2024-04-15 02:51:54.012897+00:00, run_end_date=2024-04-15 02:51:58.680058+00:00, run_duration=4.667161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:50:00+00:00, data_interval_end=2024-04-15 02:51:00+00:00, dag_hash=9d41812d65fc8696c974bf6eb371a574 2024-04-15T02:51:58.689072506Z [2024-04-15T02:51:58.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:51:00+00:00, run_after=2024-04-15T02:52:00+00:00 2024-04-15T02:51:58.718447034Z [2024-04-15T02:51:58.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:51:58.724244372Z [2024-04-15T02:51:58.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:51:56.167793+00:00, run_end_date=2024-04-15 02:51:58.007186+00:00, run_duration=1.839393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:51:54.057173+00:00, queued_by_job_id=2, pid=6581 2024-04-15T02:52:00.254381905Z [2024-04-15T02:52:00.254+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:52:00.268035766Z [2024-04-15T02:52:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:52:00+00:00, run_after=2024-04-15T02:53:00+00:00 2024-04-15T02:52:00.284586663Z [2024-04-15T02:52:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:52:00.301747196Z [2024-04-15T02:52:00.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:52:00+00:00, run_after=2024-04-15T02:53:00+00:00 2024-04-15T02:52:00.309453793Z [2024-04-15T02:52:00.309+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:52:00.408065253Z [2024-04-15T02:52:00.407+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T02:52:00.408094798Z 2024-04-15T02:52:00.408100625Z 2024-04-15T02:52:00.408122887Z 2024-04-15T02:52:00.408127357Z 2024-04-15T02:52:00.408131656Z 2024-04-15T02:52:00.408311488Z [2024-04-15T02:52:00.407+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:52:00.408463424Z [2024-04-15T02:52:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:52:00.408624083Z [2024-04-15T02:52:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:52:00.408747596Z [2024-04-15T02:52:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:52:00.408871548Z [2024-04-15T02:52:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:52:00.409498147Z [2024-04-15T02:52:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:52:00.409507488Z 2024-04-15T02:52:00.409512410Z 2024-04-15T02:52:00.409516482Z 2024-04-15T02:52:00.409520560Z 2024-04-15T02:52:00.409524890Z 2024-04-15T02:52:00.413156083Z [2024-04-15T02:52:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:52:00.413310987Z [2024-04-15T02:52:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:52:00.413610842Z [2024-04-15T02:52:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:52:00.413742428Z [2024-04-15T02:52:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:52:00.414013930Z [2024-04-15T02:52:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:52:00.414153664Z [2024-04-15T02:52:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:52:00.414470200Z [2024-04-15T02:52:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:52:00.414634377Z [2024-04-15T02:52:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:52:00.415283640Z [2024-04-15T02:52:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:52:00.415431995Z [2024-04-15T02:52:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:52:00.982643637Z [2024-04-15T02:52:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:00.982665152Z [2024-04-15T02:52:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:00.982750018Z [2024-04-15T02:52:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:00.982796630Z [2024-04-15T02:52:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:00.982858687Z [2024-04-15T02:52:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:00.998325005Z [2024-04-15T02:52:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69e3dca1-94eb-4a3d-8601-7f1c6af8b8da 2024-04-15T02:52:00.998358714Z [2024-04-15T02:52:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6222330-cdca-49e4-9d87-e2a776b675ec 2024-04-15T02:52:00.998730419Z [2024-04-15T02:52:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to f19089de-8f35-4cb6-8c73-f0919ad2a4aa 2024-04-15T02:52:00.998845484Z [2024-04-15T02:52:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6202ab1-db4c-48cd-9ec1-d2ef43e0b7f7 2024-04-15T02:52:00.998997823Z [2024-04-15T02:52:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to 540b615e-0f3a-49de-a553-79dc839bb9cf 2024-04-15T02:52:03.611641294Z [2024-04-15T02:52:03.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:52:03.611968496Z [2024-04-15T02:52:03.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:50:00+00:00, run_id=scheduled__2024-04-15T02:50:00+00:00, run_start_date=2024-04-15 02:52:00.321237+00:00, run_end_date=2024-04-15 02:52:03.611540+00:00, run_duration=3.290303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:50:00+00:00, data_interval_end=2024-04-15 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:52:03.626759010Z [2024-04-15T02:52:03.618+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:52:00+00:00, run_after=2024-04-15T02:54:00+00:00 2024-04-15T02:52:03.702640377Z [2024-04-15T02:52:03.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:03.713725852Z [2024-04-15T02:52:03.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:02.102336+00:00, run_end_date=2024-04-15 02:52:03.135110+00:00, run_duration=1.032774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:00.410638+00:00, queued_by_job_id=2, pid=6596 2024-04-15T02:52:04.782798597Z [2024-04-15T02:52:04.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:52:04.941473155Z [2024-04-15T02:52:04.940+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:52:04.941497184Z 2024-04-15T02:52:04.941747868Z [2024-04-15T02:52:04.941+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:52:04.942478846Z [2024-04-15T02:52:04.942+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:52:04.942489572Z 2024-04-15T02:52:04.945645259Z [2024-04-15T02:52:04.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:52:04.945826845Z [2024-04-15T02:52:04.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:52:05.038794671Z [2024-04-15T02:52:05.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:05.047876382Z [2024-04-15T02:52:05.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to a816db43-4026-42e3-bbf0-69f4dd3485e7 2024-04-15T02:52:06.077695892Z [2024-04-15T02:52:06.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:52:06.078076421Z [2024-04-15T02:52:06.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:51:00+00:00, run_id=scheduled__2024-04-15T02:51:00+00:00, run_start_date=2024-04-15 02:52:00.324694+00:00, run_end_date=2024-04-15 02:52:06.077651+00:00, run_duration=5.752957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:51:00+00:00, data_interval_end=2024-04-15 02:52:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:52:06.094471611Z [2024-04-15T02:52:06.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:52:00+00:00, run_after=2024-04-15T02:53:00+00:00 2024-04-15T02:52:06.154301455Z [2024-04-15T02:52:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:06.154319230Z [2024-04-15T02:52:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:06.159570483Z [2024-04-15T02:52:06.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:51:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:04.597239+00:00, run_end_date=2024-04-15 02:52:05.963832+00:00, run_duration=1.366593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:00.410638+00:00, queued_by_job_id=2, pid=6642 2024-04-15T02:52:06.159696993Z [2024-04-15T02:52:06.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:51:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:04.243363+00:00, run_end_date=2024-04-15 02:52:05.621330+00:00, run_duration=1.377967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:00.410638+00:00, queued_by_job_id=2, pid=6619 2024-04-15T02:52:06.870870239Z [2024-04-15T02:52:06.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:52:06.871182910Z [2024-04-15T02:52:06.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, execution_date=2024-04-15 02:51:00+00:00, run_id=scheduled__2024-04-15T02:51:00+00:00, run_start_date=2024-04-15 02:52:00.322340+00:00, run_end_date=2024-04-15 02:52:06.870852+00:00, run_duration=6.548512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:51:00+00:00, data_interval_end=2024-04-15 02:52:00+00:00, dag_hash=4945b62b2f7b9a70fdebd018396058b2 2024-04-15T02:52:06.881985413Z [2024-04-15T02:52:06.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:52:00+00:00, run_after=2024-04-15T02:53:00+00:00 2024-04-15T02:52:06.889233437Z [2024-04-15T02:52:06.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:52:06.889611001Z [2024-04-15T02:52:06.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, execution_date=2024-04-15 02:51:00+00:00, run_id=scheduled__2024-04-15T02:51:00+00:00, run_start_date=2024-04-15 02:52:00.325556+00:00, run_end_date=2024-04-15 02:52:06.889343+00:00, run_duration=6.563787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:51:00+00:00, data_interval_end=2024-04-15 02:52:00+00:00, dag_hash=9d41812d65fc8696c974bf6eb371a574 2024-04-15T02:52:06.897846055Z [2024-04-15T02:52:06.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:52:00+00:00, run_after=2024-04-15T02:53:00+00:00 2024-04-15T02:52:06.904571759Z [2024-04-15T02:52:06.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:52:06.904885830Z [2024-04-15T02:52:06.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:51:00+00:00, run_id=scheduled__2024-04-15T02:51:00+00:00, run_start_date=2024-04-15 02:52:00.330440+00:00, run_end_date=2024-04-15 02:52:06.904599+00:00, run_duration=6.574159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:51:00+00:00, data_interval_end=2024-04-15 02:52:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:52:06.921662324Z [2024-04-15T02:52:06.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:52:00+00:00, run_after=2024-04-15T02:53:00+00:00 2024-04-15T02:52:06.963995433Z [2024-04-15T02:52:06.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:06.964021201Z [2024-04-15T02:52:06.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:51:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:06.970409622Z [2024-04-15T02:52:06.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:51:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:04.649874+00:00, run_end_date=2024-04-15 02:52:06.418703+00:00, run_duration=1.768829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:00.410638+00:00, queued_by_job_id=2, pid=6649 2024-04-15T02:52:06.970598920Z [2024-04-15T02:52:06.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:51:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:05.037471+00:00, run_end_date=2024-04-15 02:52:06.606598+00:00, run_duration=1.569127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:00.410638+00:00, queued_by_job_id=2, pid=6668 2024-04-15T02:52:08.051729165Z [2024-04-15T02:52:08.051+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:52:08.051768417Z 2024-04-15T02:52:08.051851722Z [2024-04-15T02:52:08.051+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:52:08.052384835Z [2024-04-15T02:52:08.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:52:08.052399095Z 2024-04-15T02:52:08.055364496Z [2024-04-15T02:52:08.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='split_metrics', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:52:08.055436318Z [2024-04-15T02:52:08.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'split_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:52:08.107393726Z [2024-04-15T02:52:08.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.split_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:08.107544159Z [2024-04-15T02:52:08.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:08.115444243Z [2024-04-15T02:52:08.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca2c3b37-636c-4062-8ec1-9c5d17f6282a 2024-04-15T02:52:08.115642264Z [2024-04-15T02:52:08.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:06.835233+00:00, run_end_date=2024-04-15 02:52:07.160272+00:00, run_duration=0.325039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:04.942904+00:00, queued_by_job_id=2, pid=6697 2024-04-15T02:52:11.047521520Z [2024-04-15T02:52:11.047+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:52:11.047568184Z 2024-04-15T02:52:11.047610951Z [2024-04-15T02:52:11.047+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:52:11.048352264Z [2024-04-15T02:52:11.048+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:52:11.048363586Z 2024-04-15T02:52:11.055163911Z [2024-04-15T02:52:11.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:52:11.055281246Z [2024-04-15T02:52:11.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'collect_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:52:11.098593443Z [2024-04-15T02:52:11.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.collect_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:11.098628698Z [2024-04-15T02:52:11.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.split_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:11.106078704Z [2024-04-15T02:52:11.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4016ddf-dfaa-43d7-9de7-5090fb55cc56 2024-04-15T02:52:11.106091401Z [2024-04-15T02:52:11.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=split_metrics, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:09.788309+00:00, run_end_date=2024-04-15 02:52:10.159833+00:00, run_duration=0.371524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:08.052701+00:00, queued_by_job_id=2, pid=6717 2024-04-15T02:52:13.378857101Z [2024-04-15T02:52:13.378+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:52:13.378878117Z 2024-04-15T02:52:13.379059844Z [2024-04-15T02:52:13.378+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:52:13.379622871Z [2024-04-15T02:52:13.379+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:52:13.379642040Z 2024-04-15T02:52:13.381524774Z [2024-04-15T02:52:13.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:52:13.381741247Z [2024-04-15T02:52:13.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'send_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:52:13.444191258Z [2024-04-15T02:52:13.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.send_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:52:13.449206819Z [2024-04-15T02:52:13.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56dba0ee-357e-43f2-bf07-a0feacd3623b 2024-04-15T02:52:13.548885476Z [2024-04-15T02:52:13.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.collect_metrics run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:13.553788561Z [2024-04-15T02:52:13.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=0, run_start_date=2024-04-15 02:52:13.019400+00:00, run_end_date=2024-04-15 02:52:13.322625+00:00, run_duration=0.303225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:11.048751+00:00, queued_by_job_id=2, pid=6729 2024-04-15T02:52:15.669376065Z [2024-04-15T02:52:15.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:52:15.669754711Z [2024-04-15T02:52:15.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, execution_date=2024-04-15 02:45:00+00:00, run_id=scheduled__2024-04-15T02:45:00+00:00, run_start_date=2024-04-15 02:52:04.822675+00:00, run_end_date=2024-04-15 02:52:15.669274+00:00, run_duration=10.846599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:45:00+00:00, data_interval_end=2024-04-15 02:50:00+00:00, dag_hash=3c3a90888a44b455e0acdedfb31b91fb 2024-04-15T02:52:15.675638818Z [2024-04-15T02:52:15.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:50:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:52:15.711430348Z [2024-04-15T02:52:15.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.send_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:52:15.716214037Z [2024-04-15T02:52:15.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:52:15.173993+00:00, run_end_date=2024-04-15 02:52:15.482215+00:00, run_duration=0.308222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:52:13.379959+00:00, queued_by_job_id=2, pid=6741 2024-04-15T02:53:00.205201641Z [2024-04-15T02:53:00.204+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:53:00.212920102Z [2024-04-15T02:53:00.212+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:53:00.224566430Z [2024-04-15T02:53:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:53:00+00:00, run_after=2024-04-15T02:54:00+00:00 2024-04-15T02:53:00.246408764Z [2024-04-15T02:53:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:53:00+00:00, run_after=2024-04-15T02:54:00+00:00 2024-04-15T02:53:00.313621252Z [2024-04-15T02:53:00.313+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:53:00.313642655Z 2024-04-15T02:53:00.313646893Z 2024-04-15T02:53:00.313650171Z 2024-04-15T02:53:00.313653420Z 2024-04-15T02:53:00.313859747Z [2024-04-15T02:53:00.313+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:53:00.314131905Z [2024-04-15T02:53:00.313+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:53:00.314347468Z [2024-04-15T02:53:00.314+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:53:00.314544815Z [2024-04-15T02:53:00.314+0000] {scheduler_job.py:425} INFO - DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:53:00.315748209Z [2024-04-15T02:53:00.315+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:53:00.315754944Z 2024-04-15T02:53:00.315758443Z 2024-04-15T02:53:00.315761460Z 2024-04-15T02:53:00.315764467Z 2024-04-15T02:53:00.322110015Z [2024-04-15T02:53:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:53:00.322273134Z [2024-04-15T02:53:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:53:00.322576218Z [2024-04-15T02:53:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:53:00.322731049Z [2024-04-15T02:53:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:53:00.323038123Z [2024-04-15T02:53:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:53:00.323146337Z [2024-04-15T02:53:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:53:00.323603417Z [2024-04-15T02:53:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:53:00.323718146Z [2024-04-15T02:53:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:53:00.566976048Z [2024-04-15T02:53:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status queued for try_number 1 2024-04-15T02:53:00.567184539Z [2024-04-15T02:53:00.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status queued for try_number 1 2024-04-15T02:53:00.567299929Z [2024-04-15T02:53:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status queued for try_number 1 2024-04-15T02:53:00.567431970Z [2024-04-15T02:53:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status queued for try_number 1 2024-04-15T02:53:00.582884906Z [2024-04-15T02:53:00.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to b89cca8d-8126-4e6a-910b-7ddc316bd775 2024-04-15T02:53:00.583039759Z [2024-04-15T02:53:00.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8a8522b-501e-4b8a-aefe-e502920697eb 2024-04-15T02:53:00.583225928Z [2024-04-15T02:53:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b9705f7-312e-49d9-9377-0ee0b888a09f 2024-04-15T02:53:00.583522388Z [2024-04-15T02:53:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44d6c796-4c18-4f0b-96a1-ab1ac1107c5b 2024-04-15T02:53:03.195715265Z [2024-04-15T02:53:03.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status failed for try_number 1 2024-04-15T02:53:03.197466136Z [2024-04-15T02:53:03.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status failed for try_number 1 2024-04-15T02:53:03.202809522Z [2024-04-15T02:53:03.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:52:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:53:00.317715+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:53:03.203566642Z [2024-04-15T02:53:03.203+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:03.205613655Z [2024-04-15T02:53:03.205+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:03.216383099Z [2024-04-15T02:53:03.216+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T025200, start_date=, end_date=20240415T025303 2024-04-15T02:53:03.223039349Z [2024-04-15T02:53:03.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:52:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:53:00.317715+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:53:03.223386023Z [2024-04-15T02:53:03.223+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:03.225028343Z [2024-04-15T02:53:03.224+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:03.239412548Z [2024-04-15T02:53:03.239+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T025200, start_date=, end_date=20240415T025303 2024-04-15T02:53:05.417999881Z [2024-04-15T02:53:05.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:53:05.418261133Z [2024-04-15T02:53:05.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:52:00+00:00, run_id=scheduled__2024-04-15T02:52:00+00:00, run_start_date=2024-04-15 02:53:00.261958+00:00, run_end_date=2024-04-15 02:53:05.417761+00:00, run_duration=5.155803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:52:00+00:00, data_interval_end=2024-04-15 02:53:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:53:05.426197338Z [2024-04-15T02:53:05.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:53:00+00:00, run_after=2024-04-15T02:54:00+00:00 2024-04-15T02:53:05.431084504Z [2024-04-15T02:53:05.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:53:05.431323428Z [2024-04-15T02:53:05.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:52:00+00:00, run_id=scheduled__2024-04-15T02:52:00+00:00, run_start_date=2024-04-15 02:53:00.264574+00:00, run_end_date=2024-04-15 02:53:05.431000+00:00, run_duration=5.166426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:52:00+00:00, data_interval_end=2024-04-15 02:53:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:53:05.438652164Z [2024-04-15T02:53:05.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:53:00+00:00, run_after=2024-04-15T02:54:00+00:00 2024-04-15T02:53:05.498184949Z [2024-04-15T02:53:05.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status success for try_number 1 2024-04-15T02:53:05.498431402Z [2024-04-15T02:53:05.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status success for try_number 1 2024-04-15T02:53:05.508183288Z [2024-04-15T02:53:05.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:52:00+00:00, map_index=-1, run_start_date=2024-04-15 02:53:03.232979+00:00, run_end_date=2024-04-15 02:53:04.776127+00:00, run_duration=1.543148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:53:00.317715+00:00, queued_by_job_id=2, pid=6821 2024-04-15T02:53:05.508623590Z [2024-04-15T02:53:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:52:00+00:00, map_index=-1, run_start_date=2024-04-15 02:53:02.922006+00:00, run_end_date=2024-04-15 02:53:04.899173+00:00, run_duration=1.977167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:53:00.317715+00:00, queued_by_job_id=2, pid=6796 2024-04-15T02:53:13.451418224Z [2024-04-15T02:53:13.450+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:53:13.451467695Z 2024-04-15T02:53:13.451511184Z 2024-04-15T02:53:13.451551909Z [2024-04-15T02:53:13.451+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:53:13.451885037Z [2024-04-15T02:53:13.451+0000] {scheduler_job.py:425} INFO - DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:53:13.452977287Z [2024-04-15T02:53:13.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:53:13.462838773Z 2024-04-15T02:53:13.462855191Z 2024-04-15T02:53:13.468122036Z [2024-04-15T02:53:13.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:52:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:53:13.468149388Z [2024-04-15T02:53:13.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:53:13.468154235Z [2024-04-15T02:53:13.467+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:52:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:53:13.468158558Z [2024-04-15T02:53:13.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:53:13.645767176Z [2024-04-15T02:53:13.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status queued for try_number 2 2024-04-15T02:53:13.645811575Z [2024-04-15T02:53:13.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status queued for try_number 2 2024-04-15T02:53:13.653275843Z [2024-04-15T02:53:13.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12d1198b-b63c-4597-bb52-da462f37fc7f 2024-04-15T02:53:13.653346348Z [2024-04-15T02:53:13.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 667a8212-5c2a-465f-b20c-6e255027a5b7 2024-04-15T02:53:16.009634630Z [2024-04-15T02:53:16.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status failed for try_number 2 2024-04-15T02:53:16.010211183Z [2024-04-15T02:53:16.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status failed for try_number 2 2024-04-15T02:53:16.024138404Z [2024-04-15T02:53:16.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:52:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 02:53:03.207636+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:53:13.453799+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:53:16.025323779Z [2024-04-15T02:53:16.024+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:16.029628135Z [2024-04-15T02:53:16.029+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:16.052900056Z [2024-04-15T02:53:16.052+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T025200, start_date=, end_date=20240415T025316 2024-04-15T02:53:16.062315330Z [2024-04-15T02:53:16.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:52:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 02:53:03.227276+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:53:13.453799+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:53:16.062785437Z [2024-04-15T02:53:16.062+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:16.065372089Z [2024-04-15T02:53:16.065+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:53:16.077853410Z [2024-04-15T02:53:16.077+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T025200, start_date=, end_date=20240415T025316 2024-04-15T02:53:17.140507574Z [2024-04-15T02:53:17.140+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T02:53:17.141127346Z [2024-04-15T02:53:17.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, execution_date=2024-04-15 02:52:00+00:00, run_id=scheduled__2024-04-15T02:52:00+00:00, run_start_date=2024-04-15 02:53:00.260564+00:00, run_end_date=2024-04-15 02:53:17.140603+00:00, run_duration=16.880039, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:52:00+00:00, data_interval_end=2024-04-15 02:53:00+00:00, dag_hash=4945b62b2f7b9a70fdebd018396058b2 2024-04-15T02:53:17.149744894Z [2024-04-15T02:53:17.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:53:00+00:00, run_after=2024-04-15T02:54:00+00:00 2024-04-15T02:53:17.156454157Z [2024-04-15T02:53:17.156+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T02:53:17.156644792Z [2024-04-15T02:53:17.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, execution_date=2024-04-15 02:52:00+00:00, run_id=scheduled__2024-04-15T02:52:00+00:00, run_start_date=2024-04-15 02:53:00.263343+00:00, run_end_date=2024-04-15 02:53:17.156294+00:00, run_duration=16.892951, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:52:00+00:00, data_interval_end=2024-04-15 02:53:00+00:00, dag_hash=9d41812d65fc8696c974bf6eb371a574 2024-04-15T02:53:17.165057841Z [2024-04-15T02:53:17.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:53:00+00:00, run_after=2024-04-15T02:54:00+00:00 2024-04-15T02:54:00.623341223Z [2024-04-15T02:54:00.622+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:54:00.653256992Z [2024-04-15T02:54:00.652+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:54:00.667058938Z [2024-04-15T02:54:00.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:54:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:54:00.672919388Z [2024-04-15T02:54:00.672+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:54:00.683327575Z [2024-04-15T02:54:00.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 to 2024-04-15T02:54:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:54:00.799734769Z [2024-04-15T02:54:00.799+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T02:54:00.799754947Z 2024-04-15T02:54:00.799768717Z 2024-04-15T02:54:00.799772370Z 2024-04-15T02:54:00.799784734Z 2024-04-15T02:54:00.799788185Z 2024-04-15T02:54:00.799847805Z [2024-04-15T02:54:00.799+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:54:00.799875001Z [2024-04-15T02:54:00.799+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:54:00.799955651Z [2024-04-15T02:54:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:54:00.800035765Z [2024-04-15T02:54:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:54:00.800086954Z [2024-04-15T02:54:00.800+0000] {scheduler_job.py:425} INFO - DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 has 0/16 running and queued tasks 2024-04-15T02:54:00.800839421Z [2024-04-15T02:54:00.800+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:54:00.800845379Z 2024-04-15T02:54:00.800848557Z 2024-04-15T02:54:00.800851517Z 2024-04-15T02:54:00.800854443Z 2024-04-15T02:54:00.800857424Z 2024-04-15T02:54:00.805463791Z [2024-04-15T02:54:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:54:00.805481039Z [2024-04-15T02:54:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:54:00.805486586Z [2024-04-15T02:54:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:54:00.805490986Z [2024-04-15T02:54:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:54:00.808572647Z [2024-04-15T02:54:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:54:00.808674314Z [2024-04-15T02:54:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:54:00.810302438Z [2024-04-15T02:54:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:54:00.810458988Z [2024-04-15T02:54:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:54:00.810519769Z [2024-04-15T02:54:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:54:00.810599059Z [2024-04-15T02:54:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:54:01.257060808Z [2024-04-15T02:54:01.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status queued for try_number 1 2024-04-15T02:54:01.257736250Z [2024-04-15T02:54:01.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status queued for try_number 1 2024-04-15T02:54:01.257835612Z [2024-04-15T02:54:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status queued for try_number 1 2024-04-15T02:54:01.257893640Z [2024-04-15T02:54:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status queued for try_number 1 2024-04-15T02:54:01.258027124Z [2024-04-15T02:54:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status queued for try_number 1 2024-04-15T02:54:01.266320433Z [2024-04-15T02:54:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5fd20ce-087f-4794-8dbf-d3e3d3fe816e 2024-04-15T02:54:01.266385721Z [2024-04-15T02:54:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38e14ab2-281f-4d14-8b62-19a9617ee915 2024-04-15T02:54:01.266492360Z [2024-04-15T02:54:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dcd2c25-d991-4a61-bc3f-e162a222585b 2024-04-15T02:54:01.266580201Z [2024-04-15T02:54:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to b918498a-76ae-4db0-91ae-30cddecd3fc9 2024-04-15T02:54:01.266685595Z [2024-04-15T02:54:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42ac3ede-0909-4040-827c-913822b87401 2024-04-15T02:54:02.594094666Z [2024-04-15T02:54:02.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:54:02.594285441Z [2024-04-15T02:54:02.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:52:00+00:00, run_id=scheduled__2024-04-15T02:52:00+00:00, run_start_date=2024-04-15 02:54:00.693046+00:00, run_end_date=2024-04-15 02:54:02.593971+00:00, run_duration=1.900925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:52:00+00:00, data_interval_end=2024-04-15 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:54:02.606872044Z [2024-04-15T02:54:02.606+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:54:00+00:00, run_after=2024-04-15T02:56:00+00:00 2024-04-15T02:54:02.726607252Z [2024-04-15T02:54:02.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:52:00+00:00 exited with status success for try_number 1 2024-04-15T02:54:02.740946287Z [2024-04-15T02:54:02.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:52:00+00:00, map_index=-1, run_start_date=2024-04-15 02:54:01.731206+00:00, run_end_date=2024-04-15 02:54:02.336860+00:00, run_duration=0.605654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:54:00.801851+00:00, queued_by_job_id=2, pid=6894 2024-04-15T02:54:04.252724423Z [2024-04-15T02:54:04.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status failed for try_number 1 2024-04-15T02:54:04.252762036Z [2024-04-15T02:54:04.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status failed for try_number 1 2024-04-15T02:54:04.259449967Z [2024-04-15T02:54:04.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:53:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:54:00.801851+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:54:04.259789928Z [2024-04-15T02:54:04.259+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:54:04.261826311Z [2024-04-15T02:54:04.261+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:54:04.273965285Z [2024-04-15T02:54:04.273+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T025300, start_date=, end_date=20240415T025404 2024-04-15T02:54:04.280658471Z [2024-04-15T02:54:04.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:53:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:54:00.801851+00:00, queued_by_job_id=2, pid=None 2024-04-15T02:54:04.280966931Z [2024-04-15T02:54:04.280+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:54:04.282842268Z [2024-04-15T02:54:04.282+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T02:54:04.293700999Z [2024-04-15T02:54:04.293+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T025300, start_date=, end_date=20240415T025404 2024-04-15T02:54:05.363918503Z [2024-04-15T02:54:05.362+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:54:05.363973284Z [2024-04-15T02:54:05.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:53:00+00:00, run_id=scheduled__2024-04-15T02:53:00+00:00, run_start_date=2024-04-15 02:54:00.694265+00:00, run_end_date=2024-04-15 02:54:05.363333+00:00, run_duration=4.669068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:53:00+00:00, data_interval_end=2024-04-15 02:54:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:54:05.375133501Z [2024-04-15T02:54:05.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:54:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:54:05.438318761Z [2024-04-15T02:54:05.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status success for try_number 1 2024-04-15T02:54:05.445785167Z [2024-04-15T02:54:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:53:00+00:00, map_index=-1, run_start_date=2024-04-15 02:54:03.805414+00:00, run_end_date=2024-04-15 02:54:05.189758+00:00, run_duration=1.384344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:54:00.801851+00:00, queued_by_job_id=2, pid=6935 2024-04-15T02:54:06.504604169Z [2024-04-15T02:54:06.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:54:06.505086350Z [2024-04-15T02:54:06.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:53:00+00:00, run_id=scheduled__2024-04-15T02:53:00+00:00, run_start_date=2024-04-15 02:54:00.699039+00:00, run_end_date=2024-04-15 02:54:06.504546+00:00, run_duration=5.805507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:53:00+00:00, data_interval_end=2024-04-15 02:54:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:54:06.519073783Z [2024-04-15T02:54:06.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:54:00+00:00, run_after=2024-04-15T02:55:00+00:00 2024-04-15T02:54:06.584090877Z [2024-04-15T02:54:06.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:53:00+00:00 exited with status success for try_number 1 2024-04-15T02:54:06.590090836Z [2024-04-15T02:54:06.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:53:00+00:00, map_index=-1, run_start_date=2024-04-15 02:54:04.150790+00:00, run_end_date=2024-04-15 02:54:05.762006+00:00, run_duration=1.611216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:54:00.801851+00:00, queued_by_job_id=2, pid=6963 2024-04-15T02:54:24.556868044Z [2024-04-15T02:54:24.556+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:54:24.556896384Z 2024-04-15T02:54:24.557117904Z [2024-04-15T02:54:24.556+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-15T02:54:24.557745192Z [2024-04-15T02:54:24.557+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:54:24.557757809Z 2024-04-15T02:54:24.560134441Z [2024-04-15T02:54:24.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240415025423_621756', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:54:24.560666590Z [2024-04-15T02:54:24.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240415025423_621756', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-15T02:54:24.637119777Z [2024-04-15T02:54:24.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415025423_621756 exited with status queued for try_number 1 2024-04-15T02:54:24.642409067Z [2024-04-15T02:54:24.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9369ac20-9a2c-4f9f-a24f-4b3df9351b59 2024-04-15T02:54:25.771119055Z [2024-04-15T02:54:25.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:54:25.771344003Z [2024-04-15T02:54:25.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-15 02:54:23.802494+00:00, run_id=vdu_down_20240415025423_621756, run_start_date=2024-04-15 02:54:24.517720+00:00, run_end_date=2024-04-15 02:54:25.771061+00:00, run_duration=1.253341, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 02:54:23.802494+00:00, data_interval_end=2024-04-15 02:54:23.802494+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-15T02:54:25.773980137Z [2024-04-15T02:54:25.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-15T02:54:26.863317307Z [2024-04-15T02:54:26.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415025423_621756 exited with status success for try_number 1 2024-04-15T02:54:26.869215505Z [2024-04-15T02:54:26.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240415025423_621756, map_index=-1, run_start_date=2024-04-15 02:54:25.280173+00:00, run_end_date=2024-04-15 02:54:25.644304+00:00, run_duration=0.364131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:54:24.558215+00:00, queued_by_job_id=2, pid=6996 2024-04-15T02:55:00.963296219Z [2024-04-15T02:55:00.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:55:00+00:00, run_after=2024-04-15T03:00:00+00:00 2024-04-15T02:55:00.976651781Z [2024-04-15T02:55:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:55:00+00:00, run_after=2024-04-15T02:56:00+00:00 2024-04-15T02:55:00.984994087Z [2024-04-15T02:55:00.984+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:55:01.094649758Z [2024-04-15T02:55:01.094+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:55:01.094670573Z 2024-04-15T02:55:01.094674162Z 2024-04-15T02:55:01.094676986Z 2024-04-15T02:55:01.094712921Z [2024-04-15T02:55:01.094+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:55:01.094853783Z [2024-04-15T02:55:01.094+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:55:01.095037549Z [2024-04-15T02:55:01.094+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:55:01.095725832Z [2024-04-15T02:55:01.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:55:01.095736269Z 2024-04-15T02:55:01.095739872Z 2024-04-15T02:55:01.095755010Z 2024-04-15T02:55:01.102646226Z [2024-04-15T02:55:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:55:01.103005631Z [2024-04-15T02:55:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:55:01.103345019Z [2024-04-15T02:55:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:55:01.103461446Z [2024-04-15T02:55:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:55:01.103694662Z [2024-04-15T02:55:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:55:01.103806886Z [2024-04-15T02:55:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:55:01.489050348Z [2024-04-15T02:55:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:55:01.489133373Z [2024-04-15T02:55:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:54:00+00:00 exited with status queued for try_number 1 2024-04-15T02:55:01.489151292Z [2024-04-15T02:55:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:54:00+00:00 exited with status queued for try_number 1 2024-04-15T02:55:01.498578717Z [2024-04-15T02:55:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5f13c39-c89f-42c9-ae54-98c54e9f7aaa 2024-04-15T02:55:01.498604549Z [2024-04-15T02:55:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to a490281e-0cab-4707-8561-b35512aba81c 2024-04-15T02:55:01.498720660Z [2024-04-15T02:55:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbf76807-81fa-4f87-b462-9097b8306a41 2024-04-15T02:55:05.300201750Z [2024-04-15T02:55:05.299+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:55:05.300240391Z 2024-04-15T02:55:05.300398294Z [2024-04-15T02:55:05.300+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:55:05.301383838Z [2024-04-15T02:55:05.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:55:05.301405208Z 2024-04-15T02:55:05.304528990Z [2024-04-15T02:55:05.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:55:05.304772415Z [2024-04-15T02:55:05.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:55:05.382162096Z [2024-04-15T02:55:05.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:55:05.382532062Z [2024-04-15T02:55:05.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:55:05.388017045Z [2024-04-15T02:55:05.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33412841-5f94-4c5f-a3e5-1504a002257f 2024-04-15T02:55:05.388332470Z [2024-04-15T02:55:05.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:55:03.781226+00:00, run_end_date=2024-04-15 02:55:04.241243+00:00, run_duration=0.460017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:55:01.096720+00:00, queued_by_job_id=2, pid=7031 2024-04-15T02:55:05.429350628Z [2024-04-15T02:55:05.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:55:05.429957586Z [2024-04-15T02:55:05.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:54:00+00:00, run_id=scheduled__2024-04-15T02:54:00+00:00, run_start_date=2024-04-15 02:55:00.999258+00:00, run_end_date=2024-04-15 02:55:05.429563+00:00, run_duration=4.430305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:54:00+00:00, data_interval_end=2024-04-15 02:55:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:55:05.439608888Z [2024-04-15T02:55:05.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:55:00+00:00, run_after=2024-04-15T02:56:00+00:00 2024-04-15T02:55:06.569661286Z [2024-04-15T02:55:06.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:55:06.570457122Z [2024-04-15T02:55:06.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:54:00+00:00, run_id=scheduled__2024-04-15T02:54:00+00:00, run_start_date=2024-04-15 02:55:01.002096+00:00, run_end_date=2024-04-15 02:55:06.569518+00:00, run_duration=5.567422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:54:00+00:00, data_interval_end=2024-04-15 02:55:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:55:06.583883222Z [2024-04-15T02:55:06.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:55:00+00:00, run_after=2024-04-15T02:56:00+00:00 2024-04-15T02:55:06.622332256Z [2024-04-15T02:55:06.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:54:00+00:00 exited with status success for try_number 1 2024-04-15T02:55:06.622366916Z [2024-04-15T02:55:06.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:54:00+00:00 exited with status success for try_number 1 2024-04-15T02:55:06.627074034Z [2024-04-15T02:55:06.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:54:00+00:00, map_index=-1, run_start_date=2024-04-15 02:55:04.076257+00:00, run_end_date=2024-04-15 02:55:05.368065+00:00, run_duration=1.291808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:55:01.096720+00:00, queued_by_job_id=2, pid=7041 2024-04-15T02:55:06.627189722Z [2024-04-15T02:55:06.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:54:00+00:00, map_index=-1, run_start_date=2024-04-15 02:55:04.012829+00:00, run_end_date=2024-04-15 02:55:05.611431+00:00, run_duration=1.598602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:55:01.096720+00:00, queued_by_job_id=2, pid=7040 2024-04-15T02:55:07.708086741Z [2024-04-15T02:55:07.707+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:55:07.708138192Z 2024-04-15T02:55:07.708308959Z [2024-04-15T02:55:07.708+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:55:07.709153968Z [2024-04-15T02:55:07.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:55:07.709171814Z 2024-04-15T02:55:07.712477941Z [2024-04-15T02:55:07.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:55:07.712823634Z [2024-04-15T02:55:07.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:55:07.767758231Z [2024-04-15T02:55:07.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:55:07.769578964Z [2024-04-15T02:55:07.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:55:07.775568319Z [2024-04-15T02:55:07.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to d842264f-04d8-4d5e-bc42-40eed20c5ba4 2024-04-15T02:55:07.776336200Z [2024-04-15T02:55:07.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:55:06.825473+00:00, run_end_date=2024-04-15 02:55:07.247681+00:00, run_duration=0.422208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:55:05.301788+00:00, queued_by_job_id=2, pid=7079 2024-04-15T02:55:09.984147508Z [2024-04-15T02:55:09.983+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:55:09.984167845Z 2024-04-15T02:55:09.984183790Z [2024-04-15T02:55:09.984+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:55:09.985028607Z [2024-04-15T02:55:09.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:55:09.985039218Z 2024-04-15T02:55:09.986748233Z [2024-04-15T02:55:09.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:55:09.986812399Z [2024-04-15T02:55:09.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:55:10.026908137Z [2024-04-15T02:55:10.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status queued for try_number 1 2024-04-15T02:55:10.026928269Z [2024-04-15T02:55:10.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:55:10.032198568Z [2024-04-15T02:55:10.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 872db7a1-5084-4a64-a710-4677efe2c42f 2024-04-15T02:55:10.032294790Z [2024-04-15T02:55:10.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=0, run_start_date=2024-04-15 02:55:09.141596+00:00, run_end_date=2024-04-15 02:55:09.449773+00:00, run_duration=0.308177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:55:07.709721+00:00, queued_by_job_id=2, pid=7090 2024-04-15T02:55:12.251299930Z [2024-04-15T02:55:12.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:55:12.251905053Z [2024-04-15T02:55:12.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:50:00+00:00, run_id=scheduled__2024-04-15T02:50:00+00:00, run_start_date=2024-04-15 02:55:00.998040+00:00, run_end_date=2024-04-15 02:55:12.251482+00:00, run_duration=11.253442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:50:00+00:00, data_interval_end=2024-04-15 02:55:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T02:55:12.259532877Z [2024-04-15T02:55:12.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:55:00+00:00, run_after=2024-04-15T03:00:00+00:00 2024-04-15T02:55:12.295490138Z [2024-04-15T02:55:12.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:50:00+00:00 exited with status success for try_number 1 2024-04-15T02:55:12.301966844Z [2024-04-15T02:55:12.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:50:00+00:00, map_index=-1, run_start_date=2024-04-15 02:55:11.358912+00:00, run_end_date=2024-04-15 02:55:11.668826+00:00, run_duration=0.309914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:55:09.985236+00:00, queued_by_job_id=2, pid=7102 2024-04-15T02:55:41.012145367Z [2024-04-15T02:55:41.011+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:56:00.037604453Z [2024-04-15T02:56:00.037+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:56:00.054838129Z [2024-04-15T02:56:00.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:56:00.072407629Z [2024-04-15T02:56:00.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:56:00+00:00, run_after=2024-04-15T02:57:00+00:00 2024-04-15T02:56:00.128274649Z [2024-04-15T02:56:00.127+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:56:00.128312941Z 2024-04-15T02:56:00.128349953Z 2024-04-15T02:56:00.128359050Z 2024-04-15T02:56:00.128368628Z [2024-04-15T02:56:00.128+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:56:00.128392412Z [2024-04-15T02:56:00.128+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:56:00.128401489Z [2024-04-15T02:56:00.128+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:56:00.128876434Z [2024-04-15T02:56:00.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:56:00.128895559Z 2024-04-15T02:56:00.128905566Z 2024-04-15T02:56:00.128913879Z 2024-04-15T02:56:00.131202642Z [2024-04-15T02:56:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:56:00.131235833Z [2024-04-15T02:56:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:56:00.131423600Z [2024-04-15T02:56:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:56:00.131529237Z [2024-04-15T02:56:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:56:00.131741306Z [2024-04-15T02:56:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:56:00.131762585Z [2024-04-15T02:56:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:56:00.412721210Z [2024-04-15T02:56:00.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:54:00+00:00 exited with status queued for try_number 1 2024-04-15T02:56:00.415210944Z [2024-04-15T02:56:00.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:56:00.415984787Z [2024-04-15T02:56:00.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:56:00.430416681Z [2024-04-15T02:56:00.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdb7c8f4-b472-42d2-9183-91d85931b102 2024-04-15T02:56:00.431088208Z [2024-04-15T02:56:00.430+0000] {scheduler_job.py:635} INFO - Setting external_id for to b651217a-1d83-4000-9ae3-e25cee516a99 2024-04-15T02:56:00.431399192Z [2024-04-15T02:56:00.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to 682c3dce-b5db-4818-a921-5f82a1c92650 2024-04-15T02:56:01.592566318Z [2024-04-15T02:56:01.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:56:01.592953172Z [2024-04-15T02:56:01.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:54:00+00:00, run_id=scheduled__2024-04-15T02:54:00+00:00, run_start_date=2024-04-15 02:56:00.084356+00:00, run_end_date=2024-04-15 02:56:01.592639+00:00, run_duration=1.508283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:54:00+00:00, data_interval_end=2024-04-15 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:56:01.602991764Z [2024-04-15T02:56:01.602+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:56:00+00:00, run_after=2024-04-15T02:58:00+00:00 2024-04-15T02:56:01.662105143Z [2024-04-15T02:56:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:54:00+00:00 exited with status success for try_number 1 2024-04-15T02:56:01.668891898Z [2024-04-15T02:56:01.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:54:00+00:00, map_index=-1, run_start_date=2024-04-15 02:56:00.767418+00:00, run_end_date=2024-04-15 02:56:01.155258+00:00, run_duration=0.38784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:56:00.129355+00:00, queued_by_job_id=2, pid=7119 2024-04-15T02:56:03.851867349Z [2024-04-15T02:56:03.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:56:03.851897816Z [2024-04-15T02:56:03.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:55:00+00:00, run_id=scheduled__2024-04-15T02:55:00+00:00, run_start_date=2024-04-15 02:56:00.085399+00:00, run_end_date=2024-04-15 02:56:03.846849+00:00, run_duration=3.76145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:55:00+00:00, data_interval_end=2024-04-15 02:56:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:56:03.862982863Z [2024-04-15T02:56:03.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:56:00+00:00, run_after=2024-04-15T02:57:00+00:00 2024-04-15T02:56:03.934663659Z [2024-04-15T02:56:03.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:56:03.942178736Z [2024-04-15T02:56:03.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:56:02.240285+00:00, run_end_date=2024-04-15 02:56:03.482255+00:00, run_duration=1.24197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:56:00.129355+00:00, queued_by_job_id=2, pid=7150 2024-04-15T02:56:04.983037675Z [2024-04-15T02:56:04.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:56:04.983204882Z [2024-04-15T02:56:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:55:00+00:00, run_id=scheduled__2024-04-15T02:55:00+00:00, run_start_date=2024-04-15 02:56:00.086362+00:00, run_end_date=2024-04-15 02:56:04.982951+00:00, run_duration=4.896589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:55:00+00:00, data_interval_end=2024-04-15 02:56:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:56:04.992177249Z [2024-04-15T02:56:04.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:56:00+00:00, run_after=2024-04-15T02:57:00+00:00 2024-04-15T02:56:05.034350680Z [2024-04-15T02:56:05.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:56:05.043025799Z [2024-04-15T02:56:05.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:56:02.034613+00:00, run_end_date=2024-04-15 02:56:03.828883+00:00, run_duration=1.79427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:56:00.129355+00:00, queued_by_job_id=2, pid=7149 2024-04-15T02:57:00.538049909Z [2024-04-15T02:57:00.536+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:57:00.561820095Z [2024-04-15T02:57:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:57:00+00:00, run_after=2024-04-15T02:58:00+00:00 2024-04-15T02:57:00.629186609Z [2024-04-15T02:57:00.628+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:57:00.629209615Z 2024-04-15T02:57:00.629213811Z 2024-04-15T02:57:00.629574524Z [2024-04-15T02:57:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:57:00.629795694Z [2024-04-15T02:57:00.629+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:57:00.630471225Z [2024-04-15T02:57:00.630+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:57:00.630484543Z 2024-04-15T02:57:00.630488520Z 2024-04-15T02:57:00.633569963Z [2024-04-15T02:57:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:57:00.633849163Z [2024-04-15T02:57:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:57:00.634249430Z [2024-04-15T02:57:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:57:00.634485649Z [2024-04-15T02:57:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:57:00.881210333Z [2024-04-15T02:57:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:56:00+00:00 exited with status queued for try_number 1 2024-04-15T02:57:00.881407818Z [2024-04-15T02:57:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:56:00+00:00 exited with status queued for try_number 1 2024-04-15T02:57:00.891708243Z [2024-04-15T02:57:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5f83022-7249-4392-a315-2bb6b37fa8c5 2024-04-15T02:57:00.891994389Z [2024-04-15T02:57:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to abc45d45-9f9d-4086-89fb-4e3cf3c1ffbc 2024-04-15T02:57:04.705209063Z [2024-04-15T02:57:04.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:57:04.706134210Z [2024-04-15T02:57:04.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:56:00+00:00, run_id=scheduled__2024-04-15T02:56:00+00:00, run_start_date=2024-04-15 02:57:00.579362+00:00, run_end_date=2024-04-15 02:57:04.705624+00:00, run_duration=4.126262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:56:00+00:00, data_interval_end=2024-04-15 02:57:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:57:04.729358869Z [2024-04-15T02:57:04.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:57:00+00:00, run_after=2024-04-15T02:58:00+00:00 2024-04-15T02:57:04.742492305Z [2024-04-15T02:57:04.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:57:04.743333613Z [2024-04-15T02:57:04.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:56:00+00:00, run_id=scheduled__2024-04-15T02:56:00+00:00, run_start_date=2024-04-15 02:57:00.577327+00:00, run_end_date=2024-04-15 02:57:04.742646+00:00, run_duration=4.165319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:56:00+00:00, data_interval_end=2024-04-15 02:57:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:57:04.762502786Z [2024-04-15T02:57:04.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:57:00+00:00, run_after=2024-04-15T02:58:00+00:00 2024-04-15T02:57:04.821022169Z [2024-04-15T02:57:04.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:56:00+00:00 exited with status success for try_number 1 2024-04-15T02:57:04.821048382Z [2024-04-15T02:57:04.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:56:00+00:00 exited with status success for try_number 1 2024-04-15T02:57:04.840412573Z [2024-04-15T02:57:04.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:56:00+00:00, map_index=-1, run_start_date=2024-04-15 02:57:02.687633+00:00, run_end_date=2024-04-15 02:57:04.256081+00:00, run_duration=1.568448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:57:00.631104+00:00, queued_by_job_id=2, pid=7205 2024-04-15T02:57:04.840430562Z [2024-04-15T02:57:04.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:56:00+00:00, map_index=-1, run_start_date=2024-04-15 02:57:02.690039+00:00, run_end_date=2024-04-15 02:57:03.914447+00:00, run_duration=1.224408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:57:00.631104+00:00, queued_by_job_id=2, pid=7204 2024-04-15T02:58:00.529310529Z [2024-04-15T02:58:00.528+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:58:00.545961375Z [2024-04-15T02:58:00.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:58:00+00:00, run_after=2024-04-15T02:59:00+00:00 2024-04-15T02:58:00.554709303Z [2024-04-15T02:58:00.554+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:58:00.634941849Z [2024-04-15T02:58:00.634+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:58:00.634971625Z 2024-04-15T02:58:00.634982069Z 2024-04-15T02:58:00.634988159Z 2024-04-15T02:58:00.635485114Z [2024-04-15T02:58:00.635+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:58:00.635912955Z [2024-04-15T02:58:00.635+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:58:00.636232314Z [2024-04-15T02:58:00.635+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:58:00.637754031Z [2024-04-15T02:58:00.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:58:00.637771273Z 2024-04-15T02:58:00.637781292Z 2024-04-15T02:58:00.637789971Z 2024-04-15T02:58:00.646937403Z [2024-04-15T02:58:00.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:58:00.647521405Z [2024-04-15T02:58:00.647+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:58:00.648550640Z [2024-04-15T02:58:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:58:00.649140493Z [2024-04-15T02:58:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:58:00.654045958Z [2024-04-15T02:58:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:58:00.655496900Z [2024-04-15T02:58:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:58:00.938942192Z [2024-04-15T02:58:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:56:00+00:00 exited with status queued for try_number 1 2024-04-15T02:58:00.939009872Z [2024-04-15T02:58:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:57:00+00:00 exited with status queued for try_number 1 2024-04-15T02:58:00.939943490Z [2024-04-15T02:58:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:57:00+00:00 exited with status queued for try_number 1 2024-04-15T02:58:00.949950803Z [2024-04-15T02:58:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad1befb6-5b5e-45a2-a7d0-5085ccb56310 2024-04-15T02:58:00.950095584Z [2024-04-15T02:58:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c5bffdb-ee4d-4920-8023-6b1238dab2e3 2024-04-15T02:58:00.950232031Z [2024-04-15T02:58:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 289df3da-9692-4a9c-8487-234683af6856 2024-04-15T02:58:02.408509817Z [2024-04-15T02:58:02.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:58:02.409493251Z [2024-04-15T02:58:02.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:56:00+00:00, run_id=scheduled__2024-04-15T02:56:00+00:00, run_start_date=2024-04-15 02:58:00.562926+00:00, run_end_date=2024-04-15 02:58:02.408429+00:00, run_duration=1.845503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:56:00+00:00, data_interval_end=2024-04-15 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:58:02.416663051Z [2024-04-15T02:58:02.416+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:58:00+00:00, run_after=2024-04-15T03:00:00+00:00 2024-04-15T02:58:02.486654374Z [2024-04-15T02:58:02.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:56:00+00:00 exited with status success for try_number 1 2024-04-15T02:58:02.502202964Z [2024-04-15T02:58:02.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:56:00+00:00, map_index=-1, run_start_date=2024-04-15 02:58:01.438326+00:00, run_end_date=2024-04-15 02:58:01.773889+00:00, run_duration=0.335563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:58:00.639384+00:00, queued_by_job_id=2, pid=7240 2024-04-15T02:58:04.702144404Z [2024-04-15T02:58:04.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:58:04.702619625Z [2024-04-15T02:58:04.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:57:00+00:00, run_id=scheduled__2024-04-15T02:57:00+00:00, run_start_date=2024-04-15 02:58:00.563971+00:00, run_end_date=2024-04-15 02:58:04.702026+00:00, run_duration=4.138055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:57:00+00:00, data_interval_end=2024-04-15 02:58:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:58:04.714655734Z [2024-04-15T02:58:04.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:58:00+00:00, run_after=2024-04-15T02:59:00+00:00 2024-04-15T02:58:04.759278259Z [2024-04-15T02:58:04.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:57:00+00:00 exited with status success for try_number 1 2024-04-15T02:58:04.764098240Z [2024-04-15T02:58:04.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:57:00+00:00, map_index=-1, run_start_date=2024-04-15 02:58:02.581041+00:00, run_end_date=2024-04-15 02:58:04.208475+00:00, run_duration=1.627434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:58:00.639384+00:00, queued_by_job_id=2, pid=7260 2024-04-15T02:58:05.805626063Z [2024-04-15T02:58:05.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:58:05.805857338Z [2024-04-15T02:58:05.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:57:00+00:00, run_id=scheduled__2024-04-15T02:57:00+00:00, run_start_date=2024-04-15 02:58:00.565016+00:00, run_end_date=2024-04-15 02:58:05.805493+00:00, run_duration=5.240477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:57:00+00:00, data_interval_end=2024-04-15 02:58:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:58:05.815715907Z [2024-04-15T02:58:05.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:58:00+00:00, run_after=2024-04-15T02:59:00+00:00 2024-04-15T02:58:06.938311886Z [2024-04-15T02:58:06.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:57:00+00:00 exited with status success for try_number 1 2024-04-15T02:58:06.944189187Z [2024-04-15T02:58:06.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:57:00+00:00, map_index=-1, run_start_date=2024-04-15 02:58:02.860732+00:00, run_end_date=2024-04-15 02:58:05.765807+00:00, run_duration=2.905075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:58:00.639384+00:00, queued_by_job_id=2, pid=7279 2024-04-15T02:59:00.436186294Z [2024-04-15T02:59:00.435+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:59:00.455567106Z [2024-04-15T02:59:00.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:59:00+00:00, run_after=2024-04-15T03:00:00+00:00 2024-04-15T02:59:00.520361004Z [2024-04-15T02:59:00.519+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T02:59:00.520429832Z 2024-04-15T02:59:00.520446603Z 2024-04-15T02:59:00.520836359Z [2024-04-15T02:59:00.520+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:59:00.521262838Z [2024-04-15T02:59:00.520+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T02:59:00.522768156Z [2024-04-15T02:59:00.522+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:59:00.522794958Z 2024-04-15T02:59:00.522803930Z 2024-04-15T02:59:00.527556947Z [2024-04-15T02:59:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:59:00.528190282Z [2024-04-15T02:59:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:59:00.528712869Z [2024-04-15T02:59:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:59:00.528898138Z [2024-04-15T02:59:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:59:00.712068741Z [2024-04-15T02:59:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:58:00+00:00 exited with status queued for try_number 1 2024-04-15T02:59:00.712454723Z [2024-04-15T02:59:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:58:00+00:00 exited with status queued for try_number 1 2024-04-15T02:59:00.723191775Z [2024-04-15T02:59:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98d84efa-f6a3-4d16-a45d-ebf3cac3da63 2024-04-15T02:59:00.723540138Z [2024-04-15T02:59:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8c290ac-783a-4062-9a0e-0972f84d8419 2024-04-15T02:59:04.526515667Z [2024-04-15T02:59:04.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:59:04.526905430Z [2024-04-15T02:59:04.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:58:00+00:00, run_id=scheduled__2024-04-15T02:58:00+00:00, run_start_date=2024-04-15 02:59:00.469577+00:00, run_end_date=2024-04-15 02:59:04.526363+00:00, run_duration=4.056786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:58:00+00:00, data_interval_end=2024-04-15 02:59:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T02:59:04.542515653Z [2024-04-15T02:59:04.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:59:00+00:00, run_after=2024-04-15T03:00:00+00:00 2024-04-15T02:59:04.597830954Z [2024-04-15T02:59:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:58:00+00:00 exited with status success for try_number 1 2024-04-15T02:59:04.604620938Z [2024-04-15T02:59:04.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:58:00+00:00, map_index=-1, run_start_date=2024-04-15 02:59:02.555289+00:00, run_end_date=2024-04-15 02:59:04.266364+00:00, run_duration=1.711075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:59:00.523920+00:00, queued_by_job_id=2, pid=7324 2024-04-15T02:59:05.672683929Z [2024-04-15T02:59:05.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:59:05.673190435Z [2024-04-15T02:59:05.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:58:00+00:00, run_id=scheduled__2024-04-15T02:58:00+00:00, run_start_date=2024-04-15 02:59:00.471021+00:00, run_end_date=2024-04-15 02:59:05.672674+00:00, run_duration=5.201653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:58:00+00:00, data_interval_end=2024-04-15 02:59:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T02:59:05.688581809Z [2024-04-15T02:59:05.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T02:59:00+00:00, run_after=2024-04-15T03:00:00+00:00 2024-04-15T02:59:05.728732765Z [2024-04-15T02:59:05.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:58:00+00:00 exited with status success for try_number 1 2024-04-15T02:59:05.735256164Z [2024-04-15T02:59:05.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:58:00+00:00, map_index=-1, run_start_date=2024-04-15 02:59:02.417787+00:00, run_end_date=2024-04-15 02:59:04.599898+00:00, run_duration=2.182111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:59:00.523920+00:00, queued_by_job_id=2, pid=7323 2024-04-15T03:00:00.307452769Z [2024-04-15T03:00:00.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:00:00+00:00, run_after=2024-04-15T03:05:00+00:00 2024-04-15T03:00:00.322948526Z [2024-04-15T03:00:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:00:00+00:00, run_after=2024-04-15T03:01:00+00:00 2024-04-15T03:00:00.328777119Z [2024-04-15T03:00:00.328+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:00:00.333785307Z [2024-04-15T03:00:00.333+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:00:00.410760687Z [2024-04-15T03:00:00.410+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T03:00:00.410816133Z 2024-04-15T03:00:00.410830296Z 2024-04-15T03:00:00.410844420Z 2024-04-15T03:00:00.410857002Z 2024-04-15T03:00:00.410869454Z [2024-04-15T03:00:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:00:00.410905280Z [2024-04-15T03:00:00.410+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:00:00.410919925Z [2024-04-15T03:00:00.410+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:00:00.411004301Z [2024-04-15T03:00:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:00:00.411871828Z [2024-04-15T03:00:00.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:00:00.411897314Z 2024-04-15T03:00:00.411907958Z 2024-04-15T03:00:00.411917383Z 2024-04-15T03:00:00.411926371Z 2024-04-15T03:00:00.416872523Z [2024-04-15T03:00:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:00:00.416915440Z [2024-04-15T03:00:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:00:00.417171241Z [2024-04-15T03:00:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:00:00.417268920Z [2024-04-15T03:00:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:00:00.417484413Z [2024-04-15T03:00:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:00:00.417509468Z [2024-04-15T03:00:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:00:00.417739726Z [2024-04-15T03:00:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:00:00.417983687Z [2024-04-15T03:00:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:00:00.687696012Z [2024-04-15T03:00:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status queued for try_number 1 2024-04-15T03:00:00.687866218Z [2024-04-15T03:00:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:58:00+00:00 exited with status queued for try_number 1 2024-04-15T03:00:00.688109203Z [2024-04-15T03:00:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:59:00+00:00 exited with status queued for try_number 1 2024-04-15T03:00:00.688250457Z [2024-04-15T03:00:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:59:00+00:00 exited with status queued for try_number 1 2024-04-15T03:00:00.698285344Z [2024-04-15T03:00:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad1349a1-6d1e-4c9c-a59e-ef0a4494adde 2024-04-15T03:00:00.698476349Z [2024-04-15T03:00:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe159fa0-c36f-491b-81f2-ea46576a5f3c 2024-04-15T03:00:00.698658561Z [2024-04-15T03:00:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01ac3ed5-bf37-49e5-98ef-2aae749bd3bf 2024-04-15T03:00:00.698802633Z [2024-04-15T03:00:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fb62cf3-a9e5-4382-aada-66f507a0f36c 2024-04-15T03:00:02.191715002Z [2024-04-15T03:00:02.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:00:02.193689632Z [2024-04-15T03:00:02.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:58:00+00:00, run_id=scheduled__2024-04-15T02:58:00+00:00, run_start_date=2024-04-15 03:00:00.347098+00:00, run_end_date=2024-04-15 03:00:02.193240+00:00, run_duration=1.846142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:58:00+00:00, data_interval_end=2024-04-15 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:00:02.201625676Z [2024-04-15T03:00:02.201+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:00:00+00:00, run_after=2024-04-15T03:02:00+00:00 2024-04-15T03:00:03.352933264Z [2024-04-15T03:00:03.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:58:00+00:00 exited with status success for try_number 1 2024-04-15T03:00:03.359316684Z [2024-04-15T03:00:03.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:58:00+00:00, map_index=-1, run_start_date=2024-04-15 03:00:01.626887+00:00, run_end_date=2024-04-15 03:00:02.129100+00:00, run_duration=0.502213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:00:00.412681+00:00, queued_by_job_id=2, pid=7359 2024-04-15T03:00:04.330077777Z [2024-04-15T03:00:04.329+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:00:04.330161337Z 2024-04-15T03:00:04.330187656Z [2024-04-15T03:00:04.329+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:00:04.331081062Z [2024-04-15T03:00:04.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:00:04.331122613Z 2024-04-15T03:00:04.334840596Z [2024-04-15T03:00:04.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:00:04.335137423Z [2024-04-15T03:00:04.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:00:04.402401352Z [2024-04-15T03:00:04.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status queued for try_number 1 2024-04-15T03:00:04.402710729Z [2024-04-15T03:00:04.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status success for try_number 1 2024-04-15T03:00:04.408348279Z [2024-04-15T03:00:04.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to f48e9fa8-ec70-4753-9424-f05ca3818917 2024-04-15T03:00:04.408653180Z [2024-04-15T03:00:04.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:55:00+00:00, map_index=-1, run_start_date=2024-04-15 03:00:03.066510+00:00, run_end_date=2024-04-15 03:00:03.417043+00:00, run_duration=0.350533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:00:00.412681+00:00, queued_by_job_id=2, pid=7390 2024-04-15T03:00:05.580935859Z [2024-04-15T03:00:05.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:00:05.581208715Z [2024-04-15T03:00:05.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:59:00+00:00, run_id=scheduled__2024-04-15T02:59:00+00:00, run_start_date=2024-04-15 03:00:00.349232+00:00, run_end_date=2024-04-15 03:00:05.580746+00:00, run_duration=5.231514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:59:00+00:00, data_interval_end=2024-04-15 03:00:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:00:05.605392122Z [2024-04-15T03:00:05.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:00:00+00:00, run_after=2024-04-15T03:01:00+00:00 2024-04-15T03:00:05.617723557Z [2024-04-15T03:00:05.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:00:05.618625916Z [2024-04-15T03:00:05.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:59:00+00:00, run_id=scheduled__2024-04-15T02:59:00+00:00, run_start_date=2024-04-15 03:00:00.348159+00:00, run_end_date=2024-04-15 03:00:05.617866+00:00, run_duration=5.269707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:59:00+00:00, data_interval_end=2024-04-15 03:00:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:00:05.639609567Z [2024-04-15T03:00:05.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:00:00+00:00, run_after=2024-04-15T03:01:00+00:00 2024-04-15T03:00:05.701091638Z [2024-04-15T03:00:05.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:59:00+00:00 exited with status success for try_number 1 2024-04-15T03:00:05.701548540Z [2024-04-15T03:00:05.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:59:00+00:00 exited with status success for try_number 1 2024-04-15T03:00:05.710906438Z [2024-04-15T03:00:05.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:59:00+00:00, map_index=-1, run_start_date=2024-04-15 03:00:03.145383+00:00, run_end_date=2024-04-15 03:00:04.820008+00:00, run_duration=1.674625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:00:00.412681+00:00, queued_by_job_id=2, pid=7400 2024-04-15T03:00:05.711339154Z [2024-04-15T03:00:05.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:59:00+00:00, map_index=-1, run_start_date=2024-04-15 03:00:03.273334+00:00, run_end_date=2024-04-15 03:00:04.495524+00:00, run_duration=1.22219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:00:00.412681+00:00, queued_by_job_id=2, pid=7401 2024-04-15T03:00:06.797950827Z [2024-04-15T03:00:06.797+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:00:06.797976212Z 2024-04-15T03:00:06.798116109Z [2024-04-15T03:00:06.797+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:00:06.798721089Z [2024-04-15T03:00:06.798+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:00:06.798752060Z 2024-04-15T03:00:06.802615428Z [2024-04-15T03:00:06.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:00:06.803179523Z [2024-04-15T03:00:06.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:00:06.850926905Z [2024-04-15T03:00:06.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status queued for try_number 1 2024-04-15T03:00:06.850970094Z [2024-04-15T03:00:06.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status success for try_number 1 2024-04-15T03:00:06.859001745Z [2024-04-15T03:00:06.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dcfb5dc-1fc0-45d2-983e-83d833704fb5 2024-04-15T03:00:06.859060953Z [2024-04-15T03:00:06.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T02:55:00+00:00, map_index=-1, run_start_date=2024-04-15 03:00:05.964446+00:00, run_end_date=2024-04-15 03:00:06.340032+00:00, run_duration=0.375586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:00:04.331922+00:00, queued_by_job_id=2, pid=7440 2024-04-15T03:00:09.066369305Z [2024-04-15T03:00:09.066+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:00:09.066416889Z 2024-04-15T03:00:09.066454870Z [2024-04-15T03:00:09.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:00:09.067050452Z [2024-04-15T03:00:09.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:00:09.067067045Z 2024-04-15T03:00:09.069237790Z [2024-04-15T03:00:09.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:00:09.069329623Z [2024-04-15T03:00:09.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:00:09.118759086Z [2024-04-15T03:00:09.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status queued for try_number 1 2024-04-15T03:00:09.120634577Z [2024-04-15T03:00:09.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status success for try_number 1 2024-04-15T03:00:09.130378340Z [2024-04-15T03:00:09.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b98f779-8b39-48b6-b39c-b1aa4b745923 2024-04-15T03:00:09.130919825Z [2024-04-15T03:00:09.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:55:00+00:00, map_index=0, run_start_date=2024-04-15 03:00:08.361841+00:00, run_end_date=2024-04-15 03:00:08.747715+00:00, run_duration=0.385874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:00:06.799300+00:00, queued_by_job_id=2, pid=7451 2024-04-15T03:00:11.678926834Z [2024-04-15T03:00:11.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:00:11.679385109Z [2024-04-15T03:00:11.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 02:55:00+00:00, run_id=scheduled__2024-04-15T02:55:00+00:00, run_start_date=2024-04-15 03:00:00.345129+00:00, run_end_date=2024-04-15 03:00:11.678982+00:00, run_duration=11.333853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:55:00+00:00, data_interval_end=2024-04-15 03:00:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:00:11.684984710Z [2024-04-15T03:00:11.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:00:00+00:00, run_after=2024-04-15T03:05:00+00:00 2024-04-15T03:00:11.720888548Z [2024-04-15T03:00:11.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T02:55:00+00:00 exited with status success for try_number 1 2024-04-15T03:00:11.725488118Z [2024-04-15T03:00:11.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:55:00+00:00, map_index=-1, run_start_date=2024-04-15 03:00:10.931895+00:00, run_end_date=2024-04-15 03:00:11.285192+00:00, run_duration=0.353297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:00:09.067431+00:00, queued_by_job_id=2, pid=7462 2024-04-15T03:00:41.061571092Z [2024-04-15T03:00:41.061+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:01:00.169156426Z [2024-04-15T03:01:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:01:00+00:00, run_after=2024-04-15T03:02:00+00:00 2024-04-15T03:01:00.177699751Z [2024-04-15T03:01:00.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:01:00.243410384Z [2024-04-15T03:01:00.243+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:01:00.243441951Z 2024-04-15T03:01:00.243463547Z 2024-04-15T03:01:00.243629179Z [2024-04-15T03:01:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:01:00.243825833Z [2024-04-15T03:01:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:01:00.245106384Z [2024-04-15T03:01:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:01:00.245119866Z 2024-04-15T03:01:00.245124733Z 2024-04-15T03:01:00.249743183Z [2024-04-15T03:01:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:01:00.252116797Z [2024-04-15T03:01:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:01:00.252129523Z [2024-04-15T03:01:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:01:00.252133171Z [2024-04-15T03:01:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:01:00.429056165Z [2024-04-15T03:01:00.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status queued for try_number 1 2024-04-15T03:01:00.429270974Z [2024-04-15T03:01:00.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status queued for try_number 1 2024-04-15T03:01:00.436587002Z [2024-04-15T03:01:00.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23969336-69bb-41f1-90b3-6b0f6f3d578d 2024-04-15T03:01:00.436765408Z [2024-04-15T03:01:00.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b904b83-cebe-45fc-a59f-31235bb8aff2 2024-04-15T03:01:03.768071972Z [2024-04-15T03:01:03.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:01:03.768570928Z [2024-04-15T03:01:03.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:00:00+00:00, run_id=scheduled__2024-04-15T03:00:00+00:00, run_start_date=2024-04-15 03:01:00.189788+00:00, run_end_date=2024-04-15 03:01:03.767964+00:00, run_duration=3.578176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:00:00+00:00, data_interval_end=2024-04-15 03:01:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:01:03.780523267Z [2024-04-15T03:01:03.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:01:00+00:00, run_after=2024-04-15T03:02:00+00:00 2024-04-15T03:01:03.839628541Z [2024-04-15T03:01:03.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status success for try_number 1 2024-04-15T03:01:03.844056089Z [2024-04-15T03:01:03.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:00:00+00:00, map_index=-1, run_start_date=2024-04-15 03:01:01.987314+00:00, run_end_date=2024-04-15 03:01:03.270225+00:00, run_duration=1.282911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:01:00.245493+00:00, queued_by_job_id=2, pid=7498 2024-04-15T03:01:04.881647226Z [2024-04-15T03:01:04.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:01:04.881869594Z [2024-04-15T03:01:04.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:00:00+00:00, run_id=scheduled__2024-04-15T03:00:00+00:00, run_start_date=2024-04-15 03:01:00.191474+00:00, run_end_date=2024-04-15 03:01:04.881599+00:00, run_duration=4.690125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:00:00+00:00, data_interval_end=2024-04-15 03:01:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:01:04.888841955Z [2024-04-15T03:01:04.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:01:00+00:00, run_after=2024-04-15T03:02:00+00:00 2024-04-15T03:01:04.918723881Z [2024-04-15T03:01:04.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status success for try_number 1 2024-04-15T03:01:04.923201216Z [2024-04-15T03:01:04.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:00:00+00:00, map_index=-1, run_start_date=2024-04-15 03:01:02.197704+00:00, run_end_date=2024-04-15 03:01:03.852185+00:00, run_duration=1.654481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:01:00.245493+00:00, queued_by_job_id=2, pid=7499 2024-04-15T03:02:00.535612952Z [2024-04-15T03:02:00.534+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:02:00.556627076Z [2024-04-15T03:02:00.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:02:00+00:00, run_after=2024-04-15T03:03:00+00:00 2024-04-15T03:02:00.563946351Z [2024-04-15T03:02:00.563+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:02:00.653068137Z [2024-04-15T03:02:00.652+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:02:00.653117110Z 2024-04-15T03:02:00.653131881Z 2024-04-15T03:02:00.653144112Z 2024-04-15T03:02:00.653433974Z [2024-04-15T03:02:00.653+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:02:00.653511153Z [2024-04-15T03:02:00.653+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:02:00.653660868Z [2024-04-15T03:02:00.653+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:02:00.654280595Z [2024-04-15T03:02:00.654+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:02:00.654304316Z 2024-04-15T03:02:00.654309390Z 2024-04-15T03:02:00.654313430Z 2024-04-15T03:02:00.658396799Z [2024-04-15T03:02:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:02:00.658738308Z [2024-04-15T03:02:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:02:00.659128136Z [2024-04-15T03:02:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:02:00.659386569Z [2024-04-15T03:02:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:02:00.659797120Z [2024-04-15T03:02:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:02:00.660045071Z [2024-04-15T03:02:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:02:01.102759588Z [2024-04-15T03:02:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status queued for try_number 1 2024-04-15T03:02:01.103067613Z [2024-04-15T03:02:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:01:00+00:00 exited with status queued for try_number 1 2024-04-15T03:02:01.103235942Z [2024-04-15T03:02:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:01:00+00:00 exited with status queued for try_number 1 2024-04-15T03:02:01.119035467Z [2024-04-15T03:02:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdf8c663-72b8-40b3-bceb-c4a0c1a0c27c 2024-04-15T03:02:01.119278837Z [2024-04-15T03:02:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c8badab-c1ce-4cff-b28b-4a1cf1a5f564 2024-04-15T03:02:01.119515337Z [2024-04-15T03:02:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e32b42e-747e-4157-8b42-6ef5cceda313 2024-04-15T03:02:02.394862139Z [2024-04-15T03:02:02.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:02:02.395294450Z [2024-04-15T03:02:02.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:00:00+00:00, run_id=scheduled__2024-04-15T03:00:00+00:00, run_start_date=2024-04-15 03:02:00.579158+00:00, run_end_date=2024-04-15 03:02:02.394780+00:00, run_duration=1.815622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:00:00+00:00, data_interval_end=2024-04-15 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:02:02.403738422Z [2024-04-15T03:02:02.403+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:02:00+00:00, run_after=2024-04-15T03:04:00+00:00 2024-04-15T03:02:02.447977232Z [2024-04-15T03:02:02.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status success for try_number 1 2024-04-15T03:02:02.452654238Z [2024-04-15T03:02:02.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:00:00+00:00, map_index=-1, run_start_date=2024-04-15 03:02:01.904844+00:00, run_end_date=2024-04-15 03:02:02.210617+00:00, run_duration=0.305773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:02:00.655139+00:00, queued_by_job_id=2, pid=7534 2024-04-15T03:02:05.379142667Z [2024-04-15T03:02:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:02:05.379331780Z [2024-04-15T03:02:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:01:00+00:00, run_id=scheduled__2024-04-15T03:01:00+00:00, run_start_date=2024-04-15 03:02:00.583556+00:00, run_end_date=2024-04-15 03:02:05.378868+00:00, run_duration=4.795312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:01:00+00:00, data_interval_end=2024-04-15 03:02:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:02:05.391616835Z [2024-04-15T03:02:05.391+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:02:00+00:00, run_after=2024-04-15T03:03:00+00:00 2024-04-15T03:02:05.399332712Z [2024-04-15T03:02:05.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:02:05.400118188Z [2024-04-15T03:02:05.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:01:00+00:00, run_id=scheduled__2024-04-15T03:01:00+00:00, run_start_date=2024-04-15 03:02:00.581494+00:00, run_end_date=2024-04-15 03:02:05.399162+00:00, run_duration=4.817668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:01:00+00:00, data_interval_end=2024-04-15 03:02:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:02:05.410395530Z [2024-04-15T03:02:05.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:02:00+00:00, run_after=2024-04-15T03:03:00+00:00 2024-04-15T03:02:05.461522651Z [2024-04-15T03:02:05.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:01:00+00:00 exited with status success for try_number 1 2024-04-15T03:02:05.462597801Z [2024-04-15T03:02:05.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:01:00+00:00 exited with status success for try_number 1 2024-04-15T03:02:05.473462781Z [2024-04-15T03:02:05.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:01:00+00:00, map_index=-1, run_start_date=2024-04-15 03:02:02.841266+00:00, run_end_date=2024-04-15 03:02:04.658483+00:00, run_duration=1.817217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:02:00.655139+00:00, queued_by_job_id=2, pid=7556 2024-04-15T03:02:05.473997795Z [2024-04-15T03:02:05.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:01:00+00:00, map_index=-1, run_start_date=2024-04-15 03:02:03.096972+00:00, run_end_date=2024-04-15 03:02:04.401595+00:00, run_duration=1.304623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:02:00.655139+00:00, queued_by_job_id=2, pid=7564 2024-04-15T03:03:00.449147073Z [2024-04-15T03:03:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:03:00+00:00, run_after=2024-04-15T03:04:00+00:00 2024-04-15T03:03:00.487168335Z [2024-04-15T03:03:00.486+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:03:00.487190188Z 2024-04-15T03:03:00.487226310Z [2024-04-15T03:03:00.487+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:03:00.487673007Z [2024-04-15T03:03:00.487+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:03:00.487680393Z 2024-04-15T03:03:00.489684635Z [2024-04-15T03:03:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:03:00.489760592Z [2024-04-15T03:03:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:03:00.538730250Z [2024-04-15T03:03:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:02:00+00:00 exited with status queued for try_number 1 2024-04-15T03:03:00.542863443Z [2024-04-15T03:03:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9092252c-491e-47a3-98de-caf2cb044576 2024-04-15T03:03:00.581663952Z [2024-04-15T03:03:00.581+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:03:00.620606765Z [2024-04-15T03:03:00.620+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:03:00.620622225Z 2024-04-15T03:03:00.620812661Z [2024-04-15T03:03:00.620+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:03:00.621370988Z [2024-04-15T03:03:00.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:03:00.621381450Z 2024-04-15T03:03:00.623475771Z [2024-04-15T03:03:00.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:03:00.623758005Z [2024-04-15T03:03:00.623+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:03:00.702677894Z [2024-04-15T03:03:00.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:02:00+00:00 exited with status queued for try_number 1 2024-04-15T03:03:00.708957415Z [2024-04-15T03:03:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e0fc336-351b-4cea-8604-db6847ce1709 2024-04-15T03:03:04.740064190Z [2024-04-15T03:03:04.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:03:04.740351658Z [2024-04-15T03:03:04.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:02:00+00:00, run_id=scheduled__2024-04-15T03:02:00+00:00, run_start_date=2024-04-15 03:03:00.461031+00:00, run_end_date=2024-04-15 03:03:04.739908+00:00, run_duration=4.278877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:02:00+00:00, data_interval_end=2024-04-15 03:03:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:03:04.749534385Z [2024-04-15T03:03:04.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:03:00+00:00, run_after=2024-04-15T03:04:00+00:00 2024-04-15T03:03:04.756971775Z [2024-04-15T03:03:04.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:03:04.757126416Z [2024-04-15T03:03:04.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:02:00+00:00, run_id=scheduled__2024-04-15T03:02:00+00:00, run_start_date=2024-04-15 03:03:00.591930+00:00, run_end_date=2024-04-15 03:03:04.756863+00:00, run_duration=4.164933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:02:00+00:00, data_interval_end=2024-04-15 03:03:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:03:04.767137551Z [2024-04-15T03:03:04.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:03:00+00:00, run_after=2024-04-15T03:04:00+00:00 2024-04-15T03:03:04.825357569Z [2024-04-15T03:03:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:02:00+00:00 exited with status success for try_number 1 2024-04-15T03:03:04.825381138Z [2024-04-15T03:03:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:02:00+00:00 exited with status success for try_number 1 2024-04-15T03:03:04.825385493Z [2024-04-15T03:03:04.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:02:00+00:00, map_index=-1, run_start_date=2024-04-15 03:03:02.421301+00:00, run_end_date=2024-04-15 03:03:03.937743+00:00, run_duration=1.516442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:03:00.487956+00:00, queued_by_job_id=2, pid=7618 2024-04-15T03:03:04.825389208Z [2024-04-15T03:03:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:02:00+00:00, map_index=-1, run_start_date=2024-04-15 03:03:02.581984+00:00, run_end_date=2024-04-15 03:03:04.177230+00:00, run_duration=1.595246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:03:00.621695+00:00, queued_by_job_id=2, pid=7619 2024-04-15T03:04:00.335404508Z [2024-04-15T03:04:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:04:00+00:00, run_after=2024-04-15T03:05:00+00:00 2024-04-15T03:04:00.342255265Z [2024-04-15T03:04:00.341+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:04:00.348129897Z [2024-04-15T03:04:00.347+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:04:00.405816516Z [2024-04-15T03:04:00.404+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:04:00.405856722Z 2024-04-15T03:04:00.405982749Z 2024-04-15T03:04:00.405996753Z 2024-04-15T03:04:00.406689673Z [2024-04-15T03:04:00.406+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:04:00.407272261Z [2024-04-15T03:04:00.406+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:04:00.407951373Z [2024-04-15T03:04:00.407+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:04:00.409465821Z [2024-04-15T03:04:00.408+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:04:00.409523236Z 2024-04-15T03:04:00.409562872Z 2024-04-15T03:04:00.409603962Z 2024-04-15T03:04:00.415292681Z [2024-04-15T03:04:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:04:00.415648671Z [2024-04-15T03:04:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:04:00.417740699Z [2024-04-15T03:04:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:04:00.418059050Z [2024-04-15T03:04:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:04:00.418612485Z [2024-04-15T03:04:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:04:00.418774556Z [2024-04-15T03:04:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:04:00.598315097Z [2024-04-15T03:04:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:02:00+00:00 exited with status queued for try_number 1 2024-04-15T03:04:00.598463034Z [2024-04-15T03:04:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:03:00+00:00 exited with status queued for try_number 1 2024-04-15T03:04:00.598612772Z [2024-04-15T03:04:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:03:00+00:00 exited with status queued for try_number 1 2024-04-15T03:04:00.605770485Z [2024-04-15T03:04:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 007a2363-fa75-4a0d-85e0-541d6fdd0a17 2024-04-15T03:04:00.605955540Z [2024-04-15T03:04:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b430603-0eb6-42c7-89e1-2bf1b9bc17d5 2024-04-15T03:04:00.606168543Z [2024-04-15T03:04:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8de04c6-8b49-4acc-b63f-9f28b1848f44 2024-04-15T03:04:02.901322393Z [2024-04-15T03:04:02.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:04:02.901679994Z [2024-04-15T03:04:02.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:02:00+00:00, run_id=scheduled__2024-04-15T03:02:00+00:00, run_start_date=2024-04-15 03:04:00.356375+00:00, run_end_date=2024-04-15 03:04:02.901357+00:00, run_duration=2.544982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:02:00+00:00, data_interval_end=2024-04-15 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:04:02.910402034Z [2024-04-15T03:04:02.908+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:04:00+00:00, run_after=2024-04-15T03:06:00+00:00 2024-04-15T03:04:02.965325301Z [2024-04-15T03:04:02.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:02:00+00:00 exited with status success for try_number 1 2024-04-15T03:04:02.982171935Z [2024-04-15T03:04:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:02:00+00:00, map_index=-1, run_start_date=2024-04-15 03:04:01.273353+00:00, run_end_date=2024-04-15 03:04:01.731169+00:00, run_duration=0.457816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:04:00.411407+00:00, queued_by_job_id=2, pid=7654 2024-04-15T03:04:05.191963474Z [2024-04-15T03:04:05.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:04:05.192297039Z [2024-04-15T03:04:05.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:03:00+00:00, run_id=scheduled__2024-04-15T03:03:00+00:00, run_start_date=2024-04-15 03:04:00.358374+00:00, run_end_date=2024-04-15 03:04:05.191865+00:00, run_duration=4.833491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:03:00+00:00, data_interval_end=2024-04-15 03:04:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:04:05.202945539Z [2024-04-15T03:04:05.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:04:00+00:00, run_after=2024-04-15T03:05:00+00:00 2024-04-15T03:04:05.210697959Z [2024-04-15T03:04:05.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:04:05.211393486Z [2024-04-15T03:04:05.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:03:00+00:00, run_id=scheduled__2024-04-15T03:03:00+00:00, run_start_date=2024-04-15 03:04:00.357443+00:00, run_end_date=2024-04-15 03:04:05.211040+00:00, run_duration=4.853597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:03:00+00:00, data_interval_end=2024-04-15 03:04:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:04:05.222136334Z [2024-04-15T03:04:05.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:04:00+00:00, run_after=2024-04-15T03:05:00+00:00 2024-04-15T03:04:05.259058400Z [2024-04-15T03:04:05.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:03:00+00:00 exited with status success for try_number 1 2024-04-15T03:04:05.259236466Z [2024-04-15T03:04:05.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:03:00+00:00 exited with status success for try_number 1 2024-04-15T03:04:05.264618471Z [2024-04-15T03:04:05.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:03:00+00:00, map_index=-1, run_start_date=2024-04-15 03:04:02.381730+00:00, run_end_date=2024-04-15 03:04:04.085849+00:00, run_duration=1.704119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:04:00.411407+00:00, queued_by_job_id=2, pid=7675 2024-04-15T03:04:05.264928682Z [2024-04-15T03:04:05.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:03:00+00:00, map_index=-1, run_start_date=2024-04-15 03:04:02.796199+00:00, run_end_date=2024-04-15 03:04:04.237844+00:00, run_duration=1.441645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:04:00.411407+00:00, queued_by_job_id=2, pid=7694 2024-04-15T03:05:00.269983018Z [2024-04-15T03:05:00.268+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:05:00.293569228Z [2024-04-15T03:05:00.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:05:00+00:00, run_after=2024-04-15T03:10:00+00:00 2024-04-15T03:05:00.320144478Z [2024-04-15T03:05:00.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:05:00+00:00, run_after=2024-04-15T03:06:00+00:00 2024-04-15T03:05:00.403570348Z [2024-04-15T03:05:00.403+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:05:00.403612255Z 2024-04-15T03:05:00.403622892Z 2024-04-15T03:05:00.403631852Z 2024-04-15T03:05:00.403641227Z [2024-04-15T03:05:00.403+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:05:00.403676129Z [2024-04-15T03:05:00.403+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:05:00.403899182Z [2024-04-15T03:05:00.403+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:05:00.404443872Z [2024-04-15T03:05:00.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:05:00.404508350Z 2024-04-15T03:05:00.404519371Z 2024-04-15T03:05:00.404527965Z 2024-04-15T03:05:00.407497381Z [2024-04-15T03:05:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:05:00.407810982Z [2024-04-15T03:05:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:05:00.408255042Z [2024-04-15T03:05:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:05:00.408395147Z [2024-04-15T03:05:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:05:00.408675660Z [2024-04-15T03:05:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:05:00.408911550Z [2024-04-15T03:05:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:05:00.634199849Z [2024-04-15T03:05:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status queued for try_number 1 2024-04-15T03:05:00.634682540Z [2024-04-15T03:05:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:04:00+00:00 exited with status queued for try_number 1 2024-04-15T03:05:00.634904807Z [2024-04-15T03:05:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:04:00+00:00 exited with status queued for try_number 1 2024-04-15T03:05:00.642648916Z [2024-04-15T03:05:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3da26f6a-6a23-4db6-a3fc-0c34ae0b9998 2024-04-15T03:05:00.642868553Z [2024-04-15T03:05:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to c47feaae-15b0-48e1-802f-df4e6d108104 2024-04-15T03:05:00.643004442Z [2024-04-15T03:05:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 476809c4-8d89-445e-8b2b-ff057eff424f 2024-04-15T03:05:04.071811212Z [2024-04-15T03:05:04.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:05:04.072095737Z [2024-04-15T03:05:04.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:04:00+00:00, run_id=scheduled__2024-04-15T03:04:00+00:00, run_start_date=2024-04-15 03:05:00.339338+00:00, run_end_date=2024-04-15 03:05:04.071699+00:00, run_duration=3.732361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:04:00+00:00, data_interval_end=2024-04-15 03:05:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:05:04.084454452Z [2024-04-15T03:05:04.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:05:00+00:00, run_after=2024-04-15T03:06:00+00:00 2024-04-15T03:05:04.111181440Z [2024-04-15T03:05:04.110+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:05:04.111219228Z 2024-04-15T03:05:04.111245112Z [2024-04-15T03:05:04.111+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:05:04.111860097Z [2024-04-15T03:05:04.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:05:04.111882406Z 2024-04-15T03:05:04.114321292Z [2024-04-15T03:05:04.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:05:04.114366966Z [2024-04-15T03:05:04.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:05:04.183427715Z [2024-04-15T03:05:04.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status queued for try_number 1 2024-04-15T03:05:04.185127414Z [2024-04-15T03:05:04.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status success for try_number 1 2024-04-15T03:05:04.185142102Z [2024-04-15T03:05:04.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:04:00+00:00 exited with status success for try_number 1 2024-04-15T03:05:04.221549885Z [2024-04-15T03:05:04.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:00:00+00:00, map_index=-1, run_start_date=2024-04-15 03:05:02.616691+00:00, run_end_date=2024-04-15 03:05:03.053130+00:00, run_duration=0.436439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:05:00.405071+00:00, queued_by_job_id=2, pid=7741 2024-04-15T03:05:04.224438043Z [2024-04-15T03:05:04.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:04:00+00:00, map_index=-1, run_start_date=2024-04-15 03:05:02.627387+00:00, run_end_date=2024-04-15 03:05:03.994777+00:00, run_duration=1.36739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:05:00.405071+00:00, queued_by_job_id=2, pid=7742 2024-04-15T03:05:04.224796158Z [2024-04-15T03:05:04.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43f44144-0025-4740-889b-d8d3720dbe30 2024-04-15T03:05:04.540146048Z [2024-04-15T03:05:04.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:05:04.540602496Z [2024-04-15T03:05:04.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:04:00+00:00, run_id=scheduled__2024-04-15T03:04:00+00:00, run_start_date=2024-04-15 03:05:00.340725+00:00, run_end_date=2024-04-15 03:05:04.540253+00:00, run_duration=4.199528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:04:00+00:00, data_interval_end=2024-04-15 03:05:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:05:04.549409090Z [2024-04-15T03:05:04.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:05:00+00:00, run_after=2024-04-15T03:06:00+00:00 2024-04-15T03:05:05.710598848Z [2024-04-15T03:05:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:04:00+00:00 exited with status success for try_number 1 2024-04-15T03:05:05.715451997Z [2024-04-15T03:05:05.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:04:00+00:00, map_index=-1, run_start_date=2024-04-15 03:05:02.837199+00:00, run_end_date=2024-04-15 03:05:04.443742+00:00, run_duration=1.606543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:05:00.405071+00:00, queued_by_job_id=2, pid=7752 2024-04-15T03:05:06.792359802Z [2024-04-15T03:05:06.791+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:05:06.792391097Z 2024-04-15T03:05:06.792722474Z [2024-04-15T03:05:06.792+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:05:06.793502634Z [2024-04-15T03:05:06.793+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:05:06.793545810Z 2024-04-15T03:05:06.795720221Z [2024-04-15T03:05:06.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:05:06.796600975Z [2024-04-15T03:05:06.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:05:06.865212317Z [2024-04-15T03:05:06.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status queued for try_number 1 2024-04-15T03:05:06.865411183Z [2024-04-15T03:05:06.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status success for try_number 1 2024-04-15T03:05:06.871269711Z [2024-04-15T03:05:06.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to ead9d613-5b64-4f5c-b44b-a17fca85d4de 2024-04-15T03:05:06.871533965Z [2024-04-15T03:05:06.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:00:00+00:00, map_index=-1, run_start_date=2024-04-15 03:05:05.866654+00:00, run_end_date=2024-04-15 03:05:06.243049+00:00, run_duration=0.376395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:05:04.112116+00:00, queued_by_job_id=2, pid=7790 2024-04-15T03:05:09.076373523Z [2024-04-15T03:05:09.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:05:09.076396552Z 2024-04-15T03:05:09.076868801Z [2024-04-15T03:05:09.076+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:05:09.077426595Z [2024-04-15T03:05:09.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:05:09.077437920Z 2024-04-15T03:05:09.079579400Z [2024-04-15T03:05:09.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:05:09.079720989Z [2024-04-15T03:05:09.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:05:09.169412901Z [2024-04-15T03:05:09.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status queued for try_number 1 2024-04-15T03:05:09.169696833Z [2024-04-15T03:05:09.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status success for try_number 1 2024-04-15T03:05:09.177295958Z [2024-04-15T03:05:09.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to c572ce40-2e4e-4997-9bd0-832332c6a6cf 2024-04-15T03:05:09.177632686Z [2024-04-15T03:05:09.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:00:00+00:00, map_index=0, run_start_date=2024-04-15 03:05:08.325583+00:00, run_end_date=2024-04-15 03:05:08.659662+00:00, run_duration=0.334079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:05:06.793974+00:00, queued_by_job_id=2, pid=7802 2024-04-15T03:05:11.500188558Z [2024-04-15T03:05:11.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:05:11.500786843Z [2024-04-15T03:05:11.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:00:00+00:00, run_id=scheduled__2024-04-15T03:00:00+00:00, run_start_date=2024-04-15 03:05:00.337577+00:00, run_end_date=2024-04-15 03:05:11.500094+00:00, run_duration=11.162517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:00:00+00:00, data_interval_end=2024-04-15 03:05:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:05:11.508356242Z [2024-04-15T03:05:11.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:05:00+00:00, run_after=2024-04-15T03:10:00+00:00 2024-04-15T03:05:11.555248774Z [2024-04-15T03:05:11.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:00:00+00:00 exited with status success for try_number 1 2024-04-15T03:05:11.566071616Z [2024-04-15T03:05:11.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:00:00+00:00, map_index=-1, run_start_date=2024-04-15 03:05:10.784990+00:00, run_end_date=2024-04-15 03:05:11.216404+00:00, run_duration=0.431414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:05:09.077896+00:00, queued_by_job_id=2, pid=7814 2024-04-15T03:05:41.116163338Z [2024-04-15T03:05:41.115+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:06:00.167160171Z [2024-04-15T03:06:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:06:00+00:00, run_after=2024-04-15T03:07:00+00:00 2024-04-15T03:06:00.175775561Z [2024-04-15T03:06:00.175+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:06:00.183875124Z [2024-04-15T03:06:00.183+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:06:00.290793113Z [2024-04-15T03:06:00.290+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:06:00.290828554Z 2024-04-15T03:06:00.290835650Z 2024-04-15T03:06:00.290841923Z 2024-04-15T03:06:00.291087906Z [2024-04-15T03:06:00.290+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:06:00.291380145Z [2024-04-15T03:06:00.291+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:06:00.291823722Z [2024-04-15T03:06:00.291+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:06:00.292891188Z [2024-04-15T03:06:00.292+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:06:00.292910315Z 2024-04-15T03:06:00.292917311Z 2024-04-15T03:06:00.292923136Z 2024-04-15T03:06:00.301726273Z [2024-04-15T03:06:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:06:00.301941937Z [2024-04-15T03:06:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:06:00.302402071Z [2024-04-15T03:06:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:06:00.302582821Z [2024-04-15T03:06:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:06:00.302985816Z [2024-04-15T03:06:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:06:00.303232496Z [2024-04-15T03:06:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:06:00.571020956Z [2024-04-15T03:06:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:04:00+00:00 exited with status queued for try_number 1 2024-04-15T03:06:00.571182100Z [2024-04-15T03:06:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status queued for try_number 1 2024-04-15T03:06:00.571334538Z [2024-04-15T03:06:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status queued for try_number 1 2024-04-15T03:06:00.583676691Z [2024-04-15T03:06:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b00f458-7e23-4834-8705-a7cfa217d10c 2024-04-15T03:06:00.583855946Z [2024-04-15T03:06:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5244d036-8b52-49c4-9f5e-60608f695768 2024-04-15T03:06:00.584058617Z [2024-04-15T03:06:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15af0e92-89f6-4eb6-91d0-a8d14743012b 2024-04-15T03:06:01.736264319Z [2024-04-15T03:06:01.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:06:01.736514045Z [2024-04-15T03:06:01.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:04:00+00:00, run_id=scheduled__2024-04-15T03:04:00+00:00, run_start_date=2024-04-15 03:06:00.198825+00:00, run_end_date=2024-04-15 03:06:01.736182+00:00, run_duration=1.537357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:04:00+00:00, data_interval_end=2024-04-15 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:06:01.756251373Z [2024-04-15T03:06:01.755+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:06:00+00:00, run_after=2024-04-15T03:08:00+00:00 2024-04-15T03:06:01.858083957Z [2024-04-15T03:06:01.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:04:00+00:00 exited with status success for try_number 1 2024-04-15T03:06:01.878558051Z [2024-04-15T03:06:01.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:04:00+00:00, map_index=-1, run_start_date=2024-04-15 03:06:01.009092+00:00, run_end_date=2024-04-15 03:06:01.325296+00:00, run_duration=0.316204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:06:00.298436+00:00, queued_by_job_id=2, pid=7831 2024-04-15T03:06:04.015546029Z [2024-04-15T03:06:04.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:06:04.015627609Z [2024-04-15T03:06:04.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:05:00+00:00, run_id=scheduled__2024-04-15T03:05:00+00:00, run_start_date=2024-04-15 03:06:00.200285+00:00, run_end_date=2024-04-15 03:06:04.015387+00:00, run_duration=3.815102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:05:00+00:00, data_interval_end=2024-04-15 03:06:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:06:04.024533422Z [2024-04-15T03:06:04.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:06:00+00:00, run_after=2024-04-15T03:07:00+00:00 2024-04-15T03:06:04.075302748Z [2024-04-15T03:06:04.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status success for try_number 1 2024-04-15T03:06:04.084383716Z [2024-04-15T03:06:04.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:05:00+00:00, map_index=-1, run_start_date=2024-04-15 03:06:02.423821+00:00, run_end_date=2024-04-15 03:06:03.668591+00:00, run_duration=1.24477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:06:00.298436+00:00, queued_by_job_id=2, pid=7861 2024-04-15T03:06:05.034505622Z [2024-04-15T03:06:05.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:06:05.034779719Z [2024-04-15T03:06:05.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:05:00+00:00, run_id=scheduled__2024-04-15T03:05:00+00:00, run_start_date=2024-04-15 03:06:00.201419+00:00, run_end_date=2024-04-15 03:06:05.034304+00:00, run_duration=4.832885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:05:00+00:00, data_interval_end=2024-04-15 03:06:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:06:05.046093126Z [2024-04-15T03:06:05.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:06:00+00:00, run_after=2024-04-15T03:07:00+00:00 2024-04-15T03:06:05.089705760Z [2024-04-15T03:06:05.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status success for try_number 1 2024-04-15T03:06:05.096049604Z [2024-04-15T03:06:05.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:05:00+00:00, map_index=-1, run_start_date=2024-04-15 03:06:02.475756+00:00, run_end_date=2024-04-15 03:06:04.108052+00:00, run_duration=1.632296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:06:00.298436+00:00, queued_by_job_id=2, pid=7862 2024-04-15T03:07:00.676389856Z [2024-04-15T03:07:00.675+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:07:00.690659957Z [2024-04-15T03:07:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:07:00+00:00, run_after=2024-04-15T03:08:00+00:00 2024-04-15T03:07:00.773554377Z [2024-04-15T03:07:00.773+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:07:00.773590089Z 2024-04-15T03:07:00.773615455Z 2024-04-15T03:07:00.774030985Z [2024-04-15T03:07:00.773+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:07:00.776042191Z [2024-04-15T03:07:00.774+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:07:00.778615667Z [2024-04-15T03:07:00.777+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:07:00.778643328Z 2024-04-15T03:07:00.778653707Z 2024-04-15T03:07:00.795201446Z [2024-04-15T03:07:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:07:00.795344052Z [2024-04-15T03:07:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:07:00.795783418Z [2024-04-15T03:07:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:07:00.795801514Z [2024-04-15T03:07:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:07:01.021957920Z [2024-04-15T03:07:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:06:00+00:00 exited with status queued for try_number 1 2024-04-15T03:07:01.026155247Z [2024-04-15T03:07:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:06:00+00:00 exited with status queued for try_number 1 2024-04-15T03:07:01.053773684Z [2024-04-15T03:07:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2d5e3ce-2634-4dcf-a363-2310d9b0fd11 2024-04-15T03:07:01.053962066Z [2024-04-15T03:07:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2ec5beb-72d9-49f3-90fe-93446a1e3c19 2024-04-15T03:07:04.846062933Z [2024-04-15T03:07:04.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:07:04.846092730Z [2024-04-15T03:07:04.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:06:00+00:00, run_id=scheduled__2024-04-15T03:06:00+00:00, run_start_date=2024-04-15 03:07:00.704364+00:00, run_end_date=2024-04-15 03:07:04.843973+00:00, run_duration=4.139609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:06:00+00:00, data_interval_end=2024-04-15 03:07:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:07:04.854661894Z [2024-04-15T03:07:04.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:07:00+00:00, run_after=2024-04-15T03:08:00+00:00 2024-04-15T03:07:04.866249053Z [2024-04-15T03:07:04.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:07:04.866278379Z [2024-04-15T03:07:04.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:06:00+00:00, run_id=scheduled__2024-04-15T03:06:00+00:00, run_start_date=2024-04-15 03:07:00.705615+00:00, run_end_date=2024-04-15 03:07:04.864196+00:00, run_duration=4.158581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:06:00+00:00, data_interval_end=2024-04-15 03:07:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:07:04.874314823Z [2024-04-15T03:07:04.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:07:00+00:00, run_after=2024-04-15T03:08:00+00:00 2024-04-15T03:07:04.905631940Z [2024-04-15T03:07:04.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:06:00+00:00 exited with status success for try_number 1 2024-04-15T03:07:04.910096156Z [2024-04-15T03:07:04.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:06:00+00:00, map_index=-1, run_start_date=2024-04-15 03:07:02.800692+00:00, run_end_date=2024-04-15 03:07:04.241537+00:00, run_duration=1.440845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:07:00.787380+00:00, queued_by_job_id=2, pid=7918 2024-04-15T03:07:05.489102981Z [2024-04-15T03:07:05.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:06:00+00:00 exited with status success for try_number 1 2024-04-15T03:07:05.495001808Z [2024-04-15T03:07:05.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:06:00+00:00, map_index=-1, run_start_date=2024-04-15 03:07:02.779016+00:00, run_end_date=2024-04-15 03:07:04.754361+00:00, run_duration=1.975345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:07:00.787380+00:00, queued_by_job_id=2, pid=7917 2024-04-15T03:08:00.492353533Z [2024-04-15T03:08:00.491+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:08:00.499475502Z [2024-04-15T03:08:00.499+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:08:00.510815053Z [2024-04-15T03:08:00.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:08:00+00:00, run_after=2024-04-15T03:09:00+00:00 2024-04-15T03:08:00.579806974Z [2024-04-15T03:08:00.579+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:08:00.579835471Z 2024-04-15T03:08:00.579870264Z 2024-04-15T03:08:00.579874955Z 2024-04-15T03:08:00.579937610Z [2024-04-15T03:08:00.579+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:08:00.580194239Z [2024-04-15T03:08:00.579+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:08:00.580394255Z [2024-04-15T03:08:00.580+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:08:00.581397643Z [2024-04-15T03:08:00.581+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:08:00.581410090Z 2024-04-15T03:08:00.581414882Z 2024-04-15T03:08:00.581418910Z 2024-04-15T03:08:00.585803569Z [2024-04-15T03:08:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:08:00.586168820Z [2024-04-15T03:08:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:08:00.586630967Z [2024-04-15T03:08:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:08:00.586832958Z [2024-04-15T03:08:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:08:00.587303894Z [2024-04-15T03:08:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:08:00.587546345Z [2024-04-15T03:08:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:08:00.809457460Z [2024-04-15T03:08:00.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:06:00+00:00 exited with status queued for try_number 1 2024-04-15T03:08:00.809482310Z [2024-04-15T03:08:00.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:07:00+00:00 exited with status queued for try_number 1 2024-04-15T03:08:00.809485861Z [2024-04-15T03:08:00.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:07:00+00:00 exited with status queued for try_number 1 2024-04-15T03:08:00.827558008Z [2024-04-15T03:08:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9012f5b-03af-4ed0-bc03-750d806b2ef3 2024-04-15T03:08:00.827590122Z [2024-04-15T03:08:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to d66bc385-31e5-46d4-96f6-84c099de6738 2024-04-15T03:08:00.829886597Z [2024-04-15T03:08:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec680d54-d80f-4e5f-ac24-56b7f67f2c76 2024-04-15T03:08:02.083938274Z [2024-04-15T03:08:02.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:08:02.084194901Z [2024-04-15T03:08:02.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:06:00+00:00, run_id=scheduled__2024-04-15T03:06:00+00:00, run_start_date=2024-04-15 03:08:00.519376+00:00, run_end_date=2024-04-15 03:08:02.083876+00:00, run_duration=1.5645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:06:00+00:00, data_interval_end=2024-04-15 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:08:02.095984857Z [2024-04-15T03:08:02.095+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:08:00+00:00, run_after=2024-04-15T03:10:00+00:00 2024-04-15T03:08:02.458854835Z [2024-04-15T03:08:02.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:06:00+00:00 exited with status success for try_number 1 2024-04-15T03:08:02.463494801Z [2024-04-15T03:08:02.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:06:00+00:00, map_index=-1, run_start_date=2024-04-15 03:08:01.515280+00:00, run_end_date=2024-04-15 03:08:01.990026+00:00, run_duration=0.474746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:08:00.582523+00:00, queued_by_job_id=2, pid=7953 2024-04-15T03:08:04.641576646Z [2024-04-15T03:08:04.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:08:04.641773862Z [2024-04-15T03:08:04.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:07:00+00:00, run_id=scheduled__2024-04-15T03:07:00+00:00, run_start_date=2024-04-15 03:08:00.520877+00:00, run_end_date=2024-04-15 03:08:04.641383+00:00, run_duration=4.120506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:07:00+00:00, data_interval_end=2024-04-15 03:08:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:08:04.654087970Z [2024-04-15T03:08:04.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:08:00+00:00, run_after=2024-04-15T03:09:00+00:00 2024-04-15T03:08:04.704508100Z [2024-04-15T03:08:04.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:07:00+00:00 exited with status success for try_number 1 2024-04-15T03:08:04.712349561Z [2024-04-15T03:08:04.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:07:00+00:00, map_index=-1, run_start_date=2024-04-15 03:08:02.798462+00:00, run_end_date=2024-04-15 03:08:04.500812+00:00, run_duration=1.70235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:08:00.582523+00:00, queued_by_job_id=2, pid=7984 2024-04-15T03:08:05.780981734Z [2024-04-15T03:08:05.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:08:05.781127593Z [2024-04-15T03:08:05.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:07:00+00:00, run_id=scheduled__2024-04-15T03:07:00+00:00, run_start_date=2024-04-15 03:08:00.522014+00:00, run_end_date=2024-04-15 03:08:05.780717+00:00, run_duration=5.258703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:07:00+00:00, data_interval_end=2024-04-15 03:08:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:08:05.792743935Z [2024-04-15T03:08:05.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:08:00+00:00, run_after=2024-04-15T03:09:00+00:00 2024-04-15T03:08:05.835605397Z [2024-04-15T03:08:05.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:07:00+00:00 exited with status success for try_number 1 2024-04-15T03:08:05.844734294Z [2024-04-15T03:08:05.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:07:00+00:00, map_index=-1, run_start_date=2024-04-15 03:08:02.758804+00:00, run_end_date=2024-04-15 03:08:05.078708+00:00, run_duration=2.319904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:08:00.582523+00:00, queued_by_job_id=2, pid=7983 2024-04-15T03:09:00.509034441Z [2024-04-15T03:09:00.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:09:00+00:00, run_after=2024-04-15T03:10:00+00:00 2024-04-15T03:09:00.518812062Z [2024-04-15T03:09:00.518+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:09:00.585921005Z [2024-04-15T03:09:00.585+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:09:00.585967309Z 2024-04-15T03:09:00.585973700Z 2024-04-15T03:09:00.586071342Z [2024-04-15T03:09:00.585+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:09:00.586276163Z [2024-04-15T03:09:00.586+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:09:00.587105069Z [2024-04-15T03:09:00.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:09:00.587121343Z 2024-04-15T03:09:00.587147294Z 2024-04-15T03:09:00.591638142Z [2024-04-15T03:09:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:09:00.591793762Z [2024-04-15T03:09:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:09:00.592134457Z [2024-04-15T03:09:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:09:00.592245700Z [2024-04-15T03:09:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:09:00.767907672Z [2024-04-15T03:09:00.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:08:00+00:00 exited with status queued for try_number 1 2024-04-15T03:09:00.768178854Z [2024-04-15T03:09:00.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:08:00+00:00 exited with status queued for try_number 1 2024-04-15T03:09:00.776948030Z [2024-04-15T03:09:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0afc98b4-1d47-427c-bcd8-f1c9692f4ec3 2024-04-15T03:09:00.776965738Z [2024-04-15T03:09:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86a05b2b-f8b8-47b0-a642-e8776f3a270f 2024-04-15T03:09:04.581547849Z [2024-04-15T03:09:04.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:09:04.581938006Z [2024-04-15T03:09:04.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:08:00+00:00, run_id=scheduled__2024-04-15T03:08:00+00:00, run_start_date=2024-04-15 03:09:00.531695+00:00, run_end_date=2024-04-15 03:09:04.581383+00:00, run_duration=4.049688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:08:00+00:00, data_interval_end=2024-04-15 03:09:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:09:04.595243121Z [2024-04-15T03:09:04.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:09:00+00:00, run_after=2024-04-15T03:10:00+00:00 2024-04-15T03:09:04.603810175Z [2024-04-15T03:09:04.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:09:04.604017877Z [2024-04-15T03:09:04.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:08:00+00:00, run_id=scheduled__2024-04-15T03:08:00+00:00, run_start_date=2024-04-15 03:09:00.533102+00:00, run_end_date=2024-04-15 03:09:04.603651+00:00, run_duration=4.070549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:08:00+00:00, data_interval_end=2024-04-15 03:09:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:09:04.613320781Z [2024-04-15T03:09:04.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:09:00+00:00, run_after=2024-04-15T03:10:00+00:00 2024-04-15T03:09:04.663216147Z [2024-04-15T03:09:04.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:08:00+00:00 exited with status success for try_number 1 2024-04-15T03:09:04.664025441Z [2024-04-15T03:09:04.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:08:00+00:00 exited with status success for try_number 1 2024-04-15T03:09:04.672830630Z [2024-04-15T03:09:04.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:08:00+00:00, map_index=-1, run_start_date=2024-04-15 03:09:02.559340+00:00, run_end_date=2024-04-15 03:09:03.847469+00:00, run_duration=1.288129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:09:00.587887+00:00, queued_by_job_id=2, pid=8040 2024-04-15T03:09:04.673389296Z [2024-04-15T03:09:04.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:08:00+00:00, map_index=-1, run_start_date=2024-04-15 03:09:02.379362+00:00, run_end_date=2024-04-15 03:09:03.990664+00:00, run_duration=1.611302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:09:00.587887+00:00, queued_by_job_id=2, pid=8039 2024-04-15T03:10:00.447874162Z [2024-04-15T03:10:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:10:00.462767416Z [2024-04-15T03:10:00.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:10:00+00:00, run_after=2024-04-15T03:15:00+00:00 2024-04-15T03:10:00.478155998Z [2024-04-15T03:10:00.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:10:00+00:00, run_after=2024-04-15T03:11:00+00:00 2024-04-15T03:10:00.492471624Z [2024-04-15T03:10:00.491+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:10:00.619192478Z [2024-04-15T03:10:00.618+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T03:10:00.619249658Z 2024-04-15T03:10:00.619259771Z 2024-04-15T03:10:00.619269380Z 2024-04-15T03:10:00.619278342Z 2024-04-15T03:10:00.619442770Z [2024-04-15T03:10:00.619+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:10:00.619801499Z [2024-04-15T03:10:00.619+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:10:00.620043522Z [2024-04-15T03:10:00.619+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:10:00.620333635Z [2024-04-15T03:10:00.620+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:10:00.621574599Z [2024-04-15T03:10:00.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:10:00.621600097Z 2024-04-15T03:10:00.621611571Z 2024-04-15T03:10:00.621621315Z 2024-04-15T03:10:00.621630259Z 2024-04-15T03:10:00.628461426Z [2024-04-15T03:10:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:10:00.628660275Z [2024-04-15T03:10:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:10:00.629056945Z [2024-04-15T03:10:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:10:00.629246125Z [2024-04-15T03:10:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:10:00.629588828Z [2024-04-15T03:10:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:10:00.629779151Z [2024-04-15T03:10:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:10:00.630479094Z [2024-04-15T03:10:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:10:00.630728933Z [2024-04-15T03:10:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:10:00.978732414Z [2024-04-15T03:10:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status queued for try_number 1 2024-04-15T03:10:00.978771312Z [2024-04-15T03:10:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:08:00+00:00 exited with status queued for try_number 1 2024-04-15T03:10:00.978817254Z [2024-04-15T03:10:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:09:00+00:00 exited with status queued for try_number 1 2024-04-15T03:10:00.978898653Z [2024-04-15T03:10:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:09:00+00:00 exited with status queued for try_number 1 2024-04-15T03:10:00.987238238Z [2024-04-15T03:10:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1dc57f8-6695-455a-b26d-ba9e2f0d7493 2024-04-15T03:10:00.987275826Z [2024-04-15T03:10:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4960e4c5-cc33-4fd0-851f-2caef2003bf7 2024-04-15T03:10:00.987405890Z [2024-04-15T03:10:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1970b157-b791-4cda-b812-22534ca8a418 2024-04-15T03:10:00.987489943Z [2024-04-15T03:10:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ed68aef-506e-4ecb-ad16-a25ee647fa97 2024-04-15T03:10:03.392444040Z [2024-04-15T03:10:03.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:10:03.393005161Z [2024-04-15T03:10:03.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:08:00+00:00, run_id=scheduled__2024-04-15T03:08:00+00:00, run_start_date=2024-04-15 03:10:00.513098+00:00, run_end_date=2024-04-15 03:10:03.392630+00:00, run_duration=2.879532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:08:00+00:00, data_interval_end=2024-04-15 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:10:03.400102033Z [2024-04-15T03:10:03.399+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:10:00+00:00, run_after=2024-04-15T03:12:00+00:00 2024-04-15T03:10:03.465331029Z [2024-04-15T03:10:03.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:08:00+00:00 exited with status success for try_number 1 2024-04-15T03:10:03.471894054Z [2024-04-15T03:10:03.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:08:00+00:00, map_index=-1, run_start_date=2024-04-15 03:10:01.964124+00:00, run_end_date=2024-04-15 03:10:02.424108+00:00, run_duration=0.459984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:10:00.623248+00:00, queued_by_job_id=2, pid=8076 2024-04-15T03:10:04.471536371Z [2024-04-15T03:10:04.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:10:04.472001554Z [2024-04-15T03:10:04.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:09:00+00:00, run_id=scheduled__2024-04-15T03:09:00+00:00, run_start_date=2024-04-15 03:10:00.515231+00:00, run_end_date=2024-04-15 03:10:04.471482+00:00, run_duration=3.956251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:09:00+00:00, data_interval_end=2024-04-15 03:10:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:10:04.482169869Z [2024-04-15T03:10:04.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:10:00+00:00, run_after=2024-04-15T03:11:00+00:00 2024-04-15T03:10:04.526531607Z [2024-04-15T03:10:04.526+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:10:04.526572022Z 2024-04-15T03:10:04.526597083Z [2024-04-15T03:10:04.526+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:10:04.527753858Z [2024-04-15T03:10:04.527+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:10:04.527770552Z 2024-04-15T03:10:04.530393169Z [2024-04-15T03:10:04.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:10:04.530460564Z [2024-04-15T03:10:04.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:10:04.605972801Z [2024-04-15T03:10:04.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status queued for try_number 1 2024-04-15T03:10:04.606338399Z [2024-04-15T03:10:04.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status success for try_number 1 2024-04-15T03:10:04.606527431Z [2024-04-15T03:10:04.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:09:00+00:00 exited with status success for try_number 1 2024-04-15T03:10:04.613026930Z [2024-04-15T03:10:04.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:05:00+00:00, map_index=-1, run_start_date=2024-04-15 03:10:03.636589+00:00, run_end_date=2024-04-15 03:10:04.008495+00:00, run_duration=0.371906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:10:00.623248+00:00, queued_by_job_id=2, pid=8127 2024-04-15T03:10:04.613386485Z [2024-04-15T03:10:04.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80e361ea-d008-4f30-a4a4-27669a2563cd 2024-04-15T03:10:04.613649138Z [2024-04-15T03:10:04.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:09:00+00:00, map_index=-1, run_start_date=2024-04-15 03:10:03.193056+00:00, run_end_date=2024-04-15 03:10:04.426504+00:00, run_duration=1.233448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:10:00.623248+00:00, queued_by_job_id=2, pid=8098 2024-04-15T03:10:05.793358125Z [2024-04-15T03:10:05.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:10:05.793590028Z [2024-04-15T03:10:05.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:09:00+00:00, run_id=scheduled__2024-04-15T03:09:00+00:00, run_start_date=2024-04-15 03:10:00.516799+00:00, run_end_date=2024-04-15 03:10:05.793128+00:00, run_duration=5.276329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:09:00+00:00, data_interval_end=2024-04-15 03:10:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:10:05.804734403Z [2024-04-15T03:10:05.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:10:00+00:00, run_after=2024-04-15T03:11:00+00:00 2024-04-15T03:10:05.862422106Z [2024-04-15T03:10:05.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:09:00+00:00 exited with status success for try_number 1 2024-04-15T03:10:05.875793753Z [2024-04-15T03:10:05.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:09:00+00:00, map_index=-1, run_start_date=2024-04-15 03:10:03.420808+00:00, run_end_date=2024-04-15 03:10:04.995293+00:00, run_duration=1.574485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:10:00.623248+00:00, queued_by_job_id=2, pid=8108 2024-04-15T03:10:06.732079511Z [2024-04-15T03:10:06.731+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:10:06.732120556Z 2024-04-15T03:10:06.732382536Z [2024-04-15T03:10:06.731+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:10:06.733034032Z [2024-04-15T03:10:06.732+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:10:06.733045680Z 2024-04-15T03:10:06.735232415Z [2024-04-15T03:10:06.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:10:06.735467696Z [2024-04-15T03:10:06.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:10:06.784410303Z [2024-04-15T03:10:06.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status queued for try_number 1 2024-04-15T03:10:06.784623082Z [2024-04-15T03:10:06.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status success for try_number 1 2024-04-15T03:10:06.791658624Z [2024-04-15T03:10:06.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to 703aa24b-1d5e-4233-890b-df24a0e180d8 2024-04-15T03:10:06.791763551Z [2024-04-15T03:10:06.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:05:00+00:00, map_index=-1, run_start_date=2024-04-15 03:10:06.137961+00:00, run_end_date=2024-04-15 03:10:06.477617+00:00, run_duration=0.339656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:10:04.528083+00:00, queued_by_job_id=2, pid=8156 2024-04-15T03:10:09.706513111Z [2024-04-15T03:10:09.706+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:10:09.706543826Z 2024-04-15T03:10:09.706871702Z [2024-04-15T03:10:09.706+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:10:09.707407216Z [2024-04-15T03:10:09.707+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:10:09.707419432Z 2024-04-15T03:10:09.709540019Z [2024-04-15T03:10:09.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:10:09.709746831Z [2024-04-15T03:10:09.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:10:09.768282332Z [2024-04-15T03:10:09.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status queued for try_number 1 2024-04-15T03:10:09.769083984Z [2024-04-15T03:10:09.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status success for try_number 1 2024-04-15T03:10:09.780541348Z [2024-04-15T03:10:09.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to 774c00dd-387d-45ce-8b3c-eb450f60c19b 2024-04-15T03:10:09.781144572Z [2024-04-15T03:10:09.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:05:00+00:00, map_index=0, run_start_date=2024-04-15 03:10:08.196785+00:00, run_end_date=2024-04-15 03:10:09.494224+00:00, run_duration=1.297439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:10:06.733419+00:00, queued_by_job_id=2, pid=8167 2024-04-15T03:10:12.603515094Z [2024-04-15T03:10:12.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:10:12.604024857Z [2024-04-15T03:10:12.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:05:00+00:00, run_id=scheduled__2024-04-15T03:05:00+00:00, run_start_date=2024-04-15 03:10:00.510930+00:00, run_end_date=2024-04-15 03:10:12.603426+00:00, run_duration=12.092496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:05:00+00:00, data_interval_end=2024-04-15 03:10:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:10:12.614410474Z [2024-04-15T03:10:12.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:10:00+00:00, run_after=2024-04-15T03:15:00+00:00 2024-04-15T03:10:12.651173091Z [2024-04-15T03:10:12.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:05:00+00:00 exited with status success for try_number 1 2024-04-15T03:10:12.657397302Z [2024-04-15T03:10:12.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:05:00+00:00, map_index=-1, run_start_date=2024-04-15 03:10:11.241001+00:00, run_end_date=2024-04-15 03:10:11.597835+00:00, run_duration=0.356834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:10:09.707843+00:00, queued_by_job_id=2, pid=8188 2024-04-15T03:10:41.174863609Z [2024-04-15T03:10:41.174+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:11:00.369613467Z [2024-04-15T03:11:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:11:00+00:00, run_after=2024-04-15T03:12:00+00:00 2024-04-15T03:11:00.377575790Z [2024-04-15T03:11:00.377+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:11:00.438323441Z [2024-04-15T03:11:00.437+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:11:00.438347959Z 2024-04-15T03:11:00.438352298Z 2024-04-15T03:11:00.438454728Z [2024-04-15T03:11:00.438+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:11:00.438657115Z [2024-04-15T03:11:00.438+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:11:00.439382499Z [2024-04-15T03:11:00.439+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:11:00.439390852Z 2024-04-15T03:11:00.439395484Z 2024-04-15T03:11:00.442842651Z [2024-04-15T03:11:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:11:00.443093916Z [2024-04-15T03:11:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:11:00.443421982Z [2024-04-15T03:11:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:11:00.443551324Z [2024-04-15T03:11:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:11:00.601005663Z [2024-04-15T03:11:00.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status queued for try_number 1 2024-04-15T03:11:00.601185525Z [2024-04-15T03:11:00.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status queued for try_number 1 2024-04-15T03:11:00.612818301Z [2024-04-15T03:11:00.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to a963a7d2-acca-4b8e-b746-a769cced3711 2024-04-15T03:11:00.613107011Z [2024-04-15T03:11:00.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6cd04f8-1e8b-4f27-9f9c-47d840bd7df8 2024-04-15T03:11:04.037821944Z [2024-04-15T03:11:04.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:11:04.038434206Z [2024-04-15T03:11:04.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:10:00+00:00, run_id=scheduled__2024-04-15T03:10:00+00:00, run_start_date=2024-04-15 03:11:00.387101+00:00, run_end_date=2024-04-15 03:11:04.037978+00:00, run_duration=3.650877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:10:00+00:00, data_interval_end=2024-04-15 03:11:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:11:04.050653069Z [2024-04-15T03:11:04.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:11:00+00:00, run_after=2024-04-15T03:12:00+00:00 2024-04-15T03:11:04.101805567Z [2024-04-15T03:11:04.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status success for try_number 1 2024-04-15T03:11:04.108079561Z [2024-04-15T03:11:04.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:10:00+00:00, map_index=-1, run_start_date=2024-04-15 03:11:02.298936+00:00, run_end_date=2024-04-15 03:11:03.725080+00:00, run_duration=1.426144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:11:00.440160+00:00, queued_by_job_id=2, pid=8224 2024-04-15T03:11:05.168395938Z [2024-04-15T03:11:05.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:11:05.168669735Z [2024-04-15T03:11:05.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:10:00+00:00, run_id=scheduled__2024-04-15T03:10:00+00:00, run_start_date=2024-04-15 03:11:00.388337+00:00, run_end_date=2024-04-15 03:11:05.168276+00:00, run_duration=4.779939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:10:00+00:00, data_interval_end=2024-04-15 03:11:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:11:05.180633525Z [2024-04-15T03:11:05.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:11:00+00:00, run_after=2024-04-15T03:12:00+00:00 2024-04-15T03:11:05.227721083Z [2024-04-15T03:11:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status success for try_number 1 2024-04-15T03:11:05.236601893Z [2024-04-15T03:11:05.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:10:00+00:00, map_index=-1, run_start_date=2024-04-15 03:11:02.451617+00:00, run_end_date=2024-04-15 03:11:04.724431+00:00, run_duration=2.272814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:11:00.440160+00:00, queued_by_job_id=2, pid=8225 2024-04-15T03:12:00.749695984Z [2024-04-15T03:12:00.749+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:12:00.762989863Z [2024-04-15T03:12:00.762+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:12:00.785454155Z [2024-04-15T03:12:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:12:00+00:00, run_after=2024-04-15T03:13:00+00:00 2024-04-15T03:12:00.872012701Z [2024-04-15T03:12:00.871+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:12:00.872034671Z 2024-04-15T03:12:00.872041747Z 2024-04-15T03:12:00.872046178Z 2024-04-15T03:12:00.872821590Z [2024-04-15T03:12:00.872+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:12:00.873773685Z [2024-04-15T03:12:00.872+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:12:00.873786319Z [2024-04-15T03:12:00.873+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:12:00.875255704Z [2024-04-15T03:12:00.875+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:12:00.875270780Z 2024-04-15T03:12:00.875276892Z 2024-04-15T03:12:00.875281532Z 2024-04-15T03:12:00.880779669Z [2024-04-15T03:12:00.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:12:00.882088171Z [2024-04-15T03:12:00.880+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:12:00.882118728Z [2024-04-15T03:12:00.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:12:00.882365265Z [2024-04-15T03:12:00.881+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:12:00.882732015Z [2024-04-15T03:12:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:12:00.883019004Z [2024-04-15T03:12:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:12:01.368557294Z [2024-04-15T03:12:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status queued for try_number 1 2024-04-15T03:12:01.368814287Z [2024-04-15T03:12:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:11:00+00:00 exited with status queued for try_number 1 2024-04-15T03:12:01.369069943Z [2024-04-15T03:12:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:11:00+00:00 exited with status queued for try_number 1 2024-04-15T03:12:01.381861959Z [2024-04-15T03:12:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96f9b699-3239-4acf-9e4f-3598003ace32 2024-04-15T03:12:01.382064900Z [2024-04-15T03:12:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77ec6149-97d2-42d7-bde3-208c1b58051e 2024-04-15T03:12:01.382234687Z [2024-04-15T03:12:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2436b486-b35d-44d7-b6de-7f86dbdd208c 2024-04-15T03:12:02.641632020Z [2024-04-15T03:12:02.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:12:02.641920167Z [2024-04-15T03:12:02.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:10:00+00:00, run_id=scheduled__2024-04-15T03:10:00+00:00, run_start_date=2024-04-15 03:12:00.796371+00:00, run_end_date=2024-04-15 03:12:02.641579+00:00, run_duration=1.845208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:10:00+00:00, data_interval_end=2024-04-15 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:12:02.657889593Z [2024-04-15T03:12:02.657+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:12:00+00:00, run_after=2024-04-15T03:14:00+00:00 2024-04-15T03:12:02.724113576Z [2024-04-15T03:12:02.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status success for try_number 1 2024-04-15T03:12:02.729029945Z [2024-04-15T03:12:02.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:10:00+00:00, map_index=-1, run_start_date=2024-04-15 03:12:01.925884+00:00, run_end_date=2024-04-15 03:12:02.327413+00:00, run_duration=0.401529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:12:00.876618+00:00, queued_by_job_id=2, pid=8261 2024-04-15T03:12:04.888008595Z [2024-04-15T03:12:04.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:12:04.888302475Z [2024-04-15T03:12:04.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:11:00+00:00, run_id=scheduled__2024-04-15T03:11:00+00:00, run_start_date=2024-04-15 03:12:00.798079+00:00, run_end_date=2024-04-15 03:12:04.887985+00:00, run_duration=4.089906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:11:00+00:00, data_interval_end=2024-04-15 03:12:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:12:04.896131637Z [2024-04-15T03:12:04.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:12:00+00:00, run_after=2024-04-15T03:13:00+00:00 2024-04-15T03:12:04.944557310Z [2024-04-15T03:12:04.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:11:00+00:00 exited with status success for try_number 1 2024-04-15T03:12:04.951614283Z [2024-04-15T03:12:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:11:00+00:00, map_index=-1, run_start_date=2024-04-15 03:12:03.130096+00:00, run_end_date=2024-04-15 03:12:04.434176+00:00, run_duration=1.30408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:12:00.876618+00:00, queued_by_job_id=2, pid=8291 2024-04-15T03:12:06.005632662Z [2024-04-15T03:12:06.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:12:06.006075897Z [2024-04-15T03:12:06.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:11:00+00:00, run_id=scheduled__2024-04-15T03:11:00+00:00, run_start_date=2024-04-15 03:12:00.799452+00:00, run_end_date=2024-04-15 03:12:06.005583+00:00, run_duration=5.206131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:11:00+00:00, data_interval_end=2024-04-15 03:12:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:12:06.015816978Z [2024-04-15T03:12:06.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:12:00+00:00, run_after=2024-04-15T03:13:00+00:00 2024-04-15T03:12:06.057536664Z [2024-04-15T03:12:06.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:11:00+00:00 exited with status success for try_number 1 2024-04-15T03:12:06.066701614Z [2024-04-15T03:12:06.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:11:00+00:00, map_index=-1, run_start_date=2024-04-15 03:12:03.288815+00:00, run_end_date=2024-04-15 03:12:05.219921+00:00, run_duration=1.931106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:12:00.876618+00:00, queued_by_job_id=2, pid=8292 2024-04-15T03:13:00.110654850Z [2024-04-15T03:13:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:13:00+00:00, run_after=2024-04-15T03:14:00+00:00 2024-04-15T03:13:00.117833739Z [2024-04-15T03:13:00.117+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:13:00.168169291Z [2024-04-15T03:13:00.167+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:13:00.168193812Z 2024-04-15T03:13:00.168198220Z 2024-04-15T03:13:00.168755040Z [2024-04-15T03:13:00.168+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:13:00.169182718Z [2024-04-15T03:13:00.168+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:13:00.171155175Z [2024-04-15T03:13:00.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:13:00.171167802Z 2024-04-15T03:13:00.171171057Z 2024-04-15T03:13:00.176424763Z [2024-04-15T03:13:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:13:00.178171171Z [2024-04-15T03:13:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:13:00.178762917Z [2024-04-15T03:13:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:13:00.179075972Z [2024-04-15T03:13:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:13:00.333725263Z [2024-04-15T03:13:00.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:12:00+00:00 exited with status queued for try_number 1 2024-04-15T03:13:00.333856752Z [2024-04-15T03:13:00.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:12:00+00:00 exited with status queued for try_number 1 2024-04-15T03:13:00.339775745Z [2024-04-15T03:13:00.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to b89b8fd6-74ec-4d76-b03b-48badbff2a2d 2024-04-15T03:13:00.339807295Z [2024-04-15T03:13:00.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65043bf2-db18-4e49-a113-a33f814f26ae 2024-04-15T03:13:04.832021040Z [2024-04-15T03:13:04.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:13:04.832044350Z [2024-04-15T03:13:04.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:12:00+00:00, run_id=scheduled__2024-04-15T03:12:00+00:00, run_start_date=2024-04-15 03:13:00.127080+00:00, run_end_date=2024-04-15 03:13:04.831585+00:00, run_duration=4.704505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:12:00+00:00, data_interval_end=2024-04-15 03:13:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:13:04.840695064Z [2024-04-15T03:13:04.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:13:00+00:00, run_after=2024-04-15T03:14:00+00:00 2024-04-15T03:13:04.846704628Z [2024-04-15T03:13:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:13:04.846847039Z [2024-04-15T03:13:04.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:12:00+00:00, run_id=scheduled__2024-04-15T03:12:00+00:00, run_start_date=2024-04-15 03:13:00.126035+00:00, run_end_date=2024-04-15 03:13:04.846624+00:00, run_duration=4.720589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:12:00+00:00, data_interval_end=2024-04-15 03:13:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:13:04.855186298Z [2024-04-15T03:13:04.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:13:00+00:00, run_after=2024-04-15T03:14:00+00:00 2024-04-15T03:13:04.888082284Z [2024-04-15T03:13:04.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:12:00+00:00 exited with status success for try_number 1 2024-04-15T03:13:04.888107074Z [2024-04-15T03:13:04.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:12:00+00:00 exited with status success for try_number 1 2024-04-15T03:13:04.893082802Z [2024-04-15T03:13:04.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:12:00+00:00, map_index=-1, run_start_date=2024-04-15 03:13:02.593113+00:00, run_end_date=2024-04-15 03:13:04.460183+00:00, run_duration=1.86707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:13:00.172528+00:00, queued_by_job_id=2, pid=8348 2024-04-15T03:13:04.893170056Z [2024-04-15T03:13:04.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:12:00+00:00, map_index=-1, run_start_date=2024-04-15 03:13:02.405512+00:00, run_end_date=2024-04-15 03:13:03.837788+00:00, run_duration=1.432276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:13:00.172528+00:00, queued_by_job_id=2, pid=8347 2024-04-15T03:14:00.634582096Z [2024-04-15T03:14:00.633+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:14:00.651941475Z [2024-04-15T03:14:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:14:00+00:00, run_after=2024-04-15T03:15:00+00:00 2024-04-15T03:14:00.657328149Z [2024-04-15T03:14:00.657+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:14:00.742875668Z [2024-04-15T03:14:00.740+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:14:00.742913701Z 2024-04-15T03:14:00.742924433Z 2024-04-15T03:14:00.742933234Z 2024-04-15T03:14:00.742942918Z [2024-04-15T03:14:00.741+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:14:00.742951570Z [2024-04-15T03:14:00.741+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:14:00.742960155Z [2024-04-15T03:14:00.741+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:14:00.744718907Z [2024-04-15T03:14:00.744+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:14:00.744743862Z 2024-04-15T03:14:00.744770460Z 2024-04-15T03:14:00.744776389Z 2024-04-15T03:14:00.752077683Z [2024-04-15T03:14:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:14:00.752789376Z [2024-04-15T03:14:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:14:00.754466634Z [2024-04-15T03:14:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:14:00.755860852Z [2024-04-15T03:14:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:14:00.756777661Z [2024-04-15T03:14:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:14:00.757140849Z [2024-04-15T03:14:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:14:01.098659870Z [2024-04-15T03:14:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:12:00+00:00 exited with status queued for try_number 1 2024-04-15T03:14:01.098685681Z [2024-04-15T03:14:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:13:00+00:00 exited with status queued for try_number 1 2024-04-15T03:14:01.098695081Z [2024-04-15T03:14:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:13:00+00:00 exited with status queued for try_number 1 2024-04-15T03:14:01.108810246Z [2024-04-15T03:14:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2778a525-0529-466f-912f-1df62926cb6e 2024-04-15T03:14:01.109742720Z [2024-04-15T03:14:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8fc096f-4557-4410-96b6-7e375108b3d6 2024-04-15T03:14:01.109758453Z [2024-04-15T03:14:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c57553b-5809-4096-a729-e0a88799dd42 2024-04-15T03:14:02.353166188Z [2024-04-15T03:14:02.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:14:02.353561298Z [2024-04-15T03:14:02.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:12:00+00:00, run_id=scheduled__2024-04-15T03:12:00+00:00, run_start_date=2024-04-15 03:14:00.670270+00:00, run_end_date=2024-04-15 03:14:02.353060+00:00, run_duration=1.68279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:12:00+00:00, data_interval_end=2024-04-15 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:14:02.365786120Z [2024-04-15T03:14:02.365+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:14:00+00:00, run_after=2024-04-15T03:16:00+00:00 2024-04-15T03:14:03.521159857Z [2024-04-15T03:14:03.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:12:00+00:00 exited with status success for try_number 1 2024-04-15T03:14:03.528964553Z [2024-04-15T03:14:03.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:12:00+00:00, map_index=-1, run_start_date=2024-04-15 03:14:01.747219+00:00, run_end_date=2024-04-15 03:14:02.301192+00:00, run_duration=0.553973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:14:00.746625+00:00, queued_by_job_id=2, pid=8383 2024-04-15T03:14:05.707699636Z [2024-04-15T03:14:05.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:14:05.707809292Z [2024-04-15T03:14:05.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:13:00+00:00, run_id=scheduled__2024-04-15T03:13:00+00:00, run_start_date=2024-04-15 03:14:00.672941+00:00, run_end_date=2024-04-15 03:14:05.707557+00:00, run_duration=5.034616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:13:00+00:00, data_interval_end=2024-04-15 03:14:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:14:05.722533609Z [2024-04-15T03:14:05.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:14:00+00:00, run_after=2024-04-15T03:15:00+00:00 2024-04-15T03:14:05.758054037Z [2024-04-15T03:14:05.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:13:00+00:00 exited with status success for try_number 1 2024-04-15T03:14:05.766327492Z [2024-04-15T03:14:05.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:13:00+00:00, map_index=-1, run_start_date=2024-04-15 03:14:03.155524+00:00, run_end_date=2024-04-15 03:14:04.650516+00:00, run_duration=1.494992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:14:00.746625+00:00, queued_by_job_id=2, pid=8404 2024-04-15T03:14:06.822195593Z [2024-04-15T03:14:06.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:14:06.822745802Z [2024-04-15T03:14:06.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:13:00+00:00, run_id=scheduled__2024-04-15T03:13:00+00:00, run_start_date=2024-04-15 03:14:00.675322+00:00, run_end_date=2024-04-15 03:14:06.822372+00:00, run_duration=6.14705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:13:00+00:00, data_interval_end=2024-04-15 03:14:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:14:06.834062721Z [2024-04-15T03:14:06.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:14:00+00:00, run_after=2024-04-15T03:15:00+00:00 2024-04-15T03:14:06.867988041Z [2024-04-15T03:14:06.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:13:00+00:00 exited with status success for try_number 1 2024-04-15T03:14:06.874778550Z [2024-04-15T03:14:06.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:13:00+00:00, map_index=-1, run_start_date=2024-04-15 03:14:03.416639+00:00, run_end_date=2024-04-15 03:14:05.790374+00:00, run_duration=2.373735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:14:00.746625+00:00, queued_by_job_id=2, pid=8423 2024-04-15T03:15:00.370491996Z [2024-04-15T03:15:00.369+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:15:00.383145052Z [2024-04-15T03:15:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:15:00+00:00, run_after=2024-04-15T03:16:00+00:00 2024-04-15T03:15:00.399364431Z [2024-04-15T03:15:00.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:15:00+00:00, run_after=2024-04-15T03:20:00+00:00 2024-04-15T03:15:00.511810309Z [2024-04-15T03:15:00.511+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:15:00.511852818Z 2024-04-15T03:15:00.511881963Z 2024-04-15T03:15:00.511891987Z 2024-04-15T03:15:00.513176729Z [2024-04-15T03:15:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:15:00.513575651Z [2024-04-15T03:15:00.513+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:15:00.513867371Z [2024-04-15T03:15:00.513+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:15:00.515138087Z [2024-04-15T03:15:00.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:15:00.515194953Z 2024-04-15T03:15:00.515202333Z 2024-04-15T03:15:00.515208517Z 2024-04-15T03:15:00.519928699Z [2024-04-15T03:15:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:15:00.519958927Z [2024-04-15T03:15:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:15:00.520203937Z [2024-04-15T03:15:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:15:00.520443626Z [2024-04-15T03:15:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:15:00.520681583Z [2024-04-15T03:15:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:15:00.520825006Z [2024-04-15T03:15:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:15:00.763388415Z [2024-04-15T03:15:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status queued for try_number 1 2024-04-15T03:15:00.763625716Z [2024-04-15T03:15:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:14:00+00:00 exited with status queued for try_number 1 2024-04-15T03:15:00.763687979Z [2024-04-15T03:15:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:14:00+00:00 exited with status queued for try_number 1 2024-04-15T03:15:00.771211074Z [2024-04-15T03:15:00.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44818714-d913-4a6b-a30e-0470aa31dbdd 2024-04-15T03:15:00.771575336Z [2024-04-15T03:15:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 774e8203-b49c-47b0-bab7-226f8cafb12c 2024-04-15T03:15:00.771767504Z [2024-04-15T03:15:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7361fa2-17e5-4cc1-afbd-f9fb2e2306b7 2024-04-15T03:15:04.200294521Z [2024-04-15T03:15:04.199+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:15:04.200357216Z 2024-04-15T03:15:04.200395723Z [2024-04-15T03:15:04.200+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:15:04.200952614Z [2024-04-15T03:15:04.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:15:04.200964901Z 2024-04-15T03:15:04.203193665Z [2024-04-15T03:15:04.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:15:04.203463881Z [2024-04-15T03:15:04.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:15:04.267047951Z [2024-04-15T03:15:04.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status queued for try_number 1 2024-04-15T03:15:04.267263571Z [2024-04-15T03:15:04.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status success for try_number 1 2024-04-15T03:15:04.274193314Z [2024-04-15T03:15:04.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40c9e0d9-98b8-4e7f-b5d1-f15adedeb6b4 2024-04-15T03:15:04.274727683Z [2024-04-15T03:15:04.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:10:00+00:00, map_index=-1, run_start_date=2024-04-15 03:15:03.016168+00:00, run_end_date=2024-04-15 03:15:03.422951+00:00, run_duration=0.406783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:15:00.516968+00:00, queued_by_job_id=2, pid=8479 2024-04-15T03:15:05.490137167Z [2024-04-15T03:15:05.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:15:05.490445110Z [2024-04-15T03:15:05.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:14:00+00:00, run_id=scheduled__2024-04-15T03:14:00+00:00, run_start_date=2024-04-15 03:15:00.419731+00:00, run_end_date=2024-04-15 03:15:05.490137+00:00, run_duration=5.070406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:14:00+00:00, data_interval_end=2024-04-15 03:15:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:15:05.499331924Z [2024-04-15T03:15:05.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:15:00+00:00, run_after=2024-04-15T03:16:00+00:00 2024-04-15T03:15:05.505358107Z [2024-04-15T03:15:05.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:15:05.505580173Z [2024-04-15T03:15:05.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:14:00+00:00, run_id=scheduled__2024-04-15T03:14:00+00:00, run_start_date=2024-04-15 03:15:00.418148+00:00, run_end_date=2024-04-15 03:15:05.505309+00:00, run_duration=5.087161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:14:00+00:00, data_interval_end=2024-04-15 03:15:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:15:05.514580054Z [2024-04-15T03:15:05.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:15:00+00:00, run_after=2024-04-15T03:16:00+00:00 2024-04-15T03:15:05.583718803Z [2024-04-15T03:15:05.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:14:00+00:00 exited with status success for try_number 1 2024-04-15T03:15:05.586196113Z [2024-04-15T03:15:05.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:14:00+00:00 exited with status success for try_number 1 2024-04-15T03:15:05.594709453Z [2024-04-15T03:15:05.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:14:00+00:00, map_index=-1, run_start_date=2024-04-15 03:15:02.739719+00:00, run_end_date=2024-04-15 03:15:04.434837+00:00, run_duration=1.695118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:15:00.516968+00:00, queued_by_job_id=2, pid=8460 2024-04-15T03:15:05.594891443Z [2024-04-15T03:15:05.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:14:00+00:00, map_index=-1, run_start_date=2024-04-15 03:15:03.039205+00:00, run_end_date=2024-04-15 03:15:04.395245+00:00, run_duration=1.35604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:15:00.516968+00:00, queued_by_job_id=2, pid=8480 2024-04-15T03:15:06.681474482Z [2024-04-15T03:15:06.680+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:15:06.681513465Z 2024-04-15T03:15:06.681782890Z [2024-04-15T03:15:06.681+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:15:06.683029770Z [2024-04-15T03:15:06.682+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:15:06.683072642Z 2024-04-15T03:15:06.687558807Z [2024-04-15T03:15:06.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:15:06.688171471Z [2024-04-15T03:15:06.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:15:06.755369416Z [2024-04-15T03:15:06.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status queued for try_number 1 2024-04-15T03:15:06.755477207Z [2024-04-15T03:15:06.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status success for try_number 1 2024-04-15T03:15:06.766346598Z [2024-04-15T03:15:06.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to 159cc263-9051-4225-8bc7-603921c77ce0 2024-04-15T03:15:06.766582874Z [2024-04-15T03:15:06.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:10:00+00:00, map_index=-1, run_start_date=2024-04-15 03:15:05.777222+00:00, run_end_date=2024-04-15 03:15:06.216382+00:00, run_duration=0.43916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:15:04.201337+00:00, queued_by_job_id=2, pid=8519 2024-04-15T03:15:10.670801304Z [2024-04-15T03:15:10.670+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:15:10.670844199Z 2024-04-15T03:15:10.670868086Z [2024-04-15T03:15:10.670+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:15:10.671796532Z [2024-04-15T03:15:10.671+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:15:10.671816904Z 2024-04-15T03:15:10.675615747Z [2024-04-15T03:15:10.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:15:10.675708891Z [2024-04-15T03:15:10.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:15:10.726613507Z [2024-04-15T03:15:10.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status queued for try_number 1 2024-04-15T03:15:10.726876439Z [2024-04-15T03:15:10.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status success for try_number 1 2024-04-15T03:15:10.734603538Z [2024-04-15T03:15:10.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab58872f-4705-4521-b2f5-437a0b987759 2024-04-15T03:15:10.735376692Z [2024-04-15T03:15:10.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:10:00+00:00, map_index=0, run_start_date=2024-04-15 03:15:08.242702+00:00, run_end_date=2024-04-15 03:15:09.509877+00:00, run_duration=1.267175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:15:06.683742+00:00, queued_by_job_id=2, pid=8531 2024-04-15T03:15:12.884765512Z [2024-04-15T03:15:12.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:15:12.884792358Z [2024-04-15T03:15:12.884+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:10:00+00:00, run_id=scheduled__2024-04-15T03:10:00+00:00, run_start_date=2024-04-15 03:15:00.416126+00:00, run_end_date=2024-04-15 03:15:12.884422+00:00, run_duration=12.468296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:10:00+00:00, data_interval_end=2024-04-15 03:15:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:15:12.890044943Z [2024-04-15T03:15:12.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:15:00+00:00, run_after=2024-04-15T03:20:00+00:00 2024-04-15T03:15:12.923868544Z [2024-04-15T03:15:12.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:10:00+00:00 exited with status success for try_number 1 2024-04-15T03:15:12.928880693Z [2024-04-15T03:15:12.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:10:00+00:00, map_index=-1, run_start_date=2024-04-15 03:15:12.259697+00:00, run_end_date=2024-04-15 03:15:12.591215+00:00, run_duration=0.331518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:15:10.672259+00:00, queued_by_job_id=2, pid=8552 2024-04-15T03:15:41.240995841Z [2024-04-15T03:15:41.240+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:16:00.330943903Z [2024-04-15T03:16:00.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:16:00+00:00, run_after=2024-04-15T03:17:00+00:00 2024-04-15T03:16:00.341500994Z [2024-04-15T03:16:00.341+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:16:00.349635124Z [2024-04-15T03:16:00.349+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:16:00.448086753Z [2024-04-15T03:16:00.447+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:16:00.448133077Z 2024-04-15T03:16:00.448144044Z 2024-04-15T03:16:00.448153246Z 2024-04-15T03:16:00.448166031Z [2024-04-15T03:16:00.447+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:16:00.448225631Z [2024-04-15T03:16:00.447+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:16:00.448600954Z [2024-04-15T03:16:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:16:00.449533118Z [2024-04-15T03:16:00.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:16:00.449551584Z 2024-04-15T03:16:00.449561171Z 2024-04-15T03:16:00.449569712Z 2024-04-15T03:16:00.454307941Z [2024-04-15T03:16:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:16:00.454547696Z [2024-04-15T03:16:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:16:00.454840247Z [2024-04-15T03:16:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:16:00.454868368Z [2024-04-15T03:16:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:16:00.455279963Z [2024-04-15T03:16:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:16:00.455308623Z [2024-04-15T03:16:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:16:00.663436611Z [2024-04-15T03:16:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:14:00+00:00 exited with status queued for try_number 1 2024-04-15T03:16:00.663608828Z [2024-04-15T03:16:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status queued for try_number 1 2024-04-15T03:16:00.663749863Z [2024-04-15T03:16:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status queued for try_number 1 2024-04-15T03:16:00.671130708Z [2024-04-15T03:16:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3814e872-781f-43a9-b436-c83125791949 2024-04-15T03:16:00.671383114Z [2024-04-15T03:16:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e97bab5-e58f-4a07-a7e3-042e6b22fc13 2024-04-15T03:16:00.671567291Z [2024-04-15T03:16:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce58ba39-593a-4a2c-a005-5c207a1a5451 2024-04-15T03:16:01.867289999Z [2024-04-15T03:16:01.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:16:01.869923346Z [2024-04-15T03:16:01.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:14:00+00:00, run_id=scheduled__2024-04-15T03:14:00+00:00, run_start_date=2024-04-15 03:16:00.363302+00:00, run_end_date=2024-04-15 03:16:01.867227+00:00, run_duration=1.503925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:14:00+00:00, data_interval_end=2024-04-15 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:16:01.881729870Z [2024-04-15T03:16:01.881+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:16:00+00:00, run_after=2024-04-15T03:18:00+00:00 2024-04-15T03:16:01.975639828Z [2024-04-15T03:16:01.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:14:00+00:00 exited with status success for try_number 1 2024-04-15T03:16:01.996749223Z [2024-04-15T03:16:01.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:14:00+00:00, map_index=-1, run_start_date=2024-04-15 03:16:01.303396+00:00, run_end_date=2024-04-15 03:16:01.638976+00:00, run_duration=0.33558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:16:00.450573+00:00, queued_by_job_id=2, pid=8569 2024-04-15T03:16:04.149720475Z [2024-04-15T03:16:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:16:04.150863431Z [2024-04-15T03:16:04.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:15:00+00:00, run_id=scheduled__2024-04-15T03:15:00+00:00, run_start_date=2024-04-15 03:16:00.364905+00:00, run_end_date=2024-04-15 03:16:04.149578+00:00, run_duration=3.784673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:15:00+00:00, data_interval_end=2024-04-15 03:16:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:16:04.168426046Z [2024-04-15T03:16:04.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:16:00+00:00, run_after=2024-04-15T03:17:00+00:00 2024-04-15T03:16:04.223568978Z [2024-04-15T03:16:04.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status success for try_number 1 2024-04-15T03:16:04.229353105Z [2024-04-15T03:16:04.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:15:00+00:00, map_index=-1, run_start_date=2024-04-15 03:16:02.494665+00:00, run_end_date=2024-04-15 03:16:03.743111+00:00, run_duration=1.248446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:16:00.450573+00:00, queued_by_job_id=2, pid=8599 2024-04-15T03:16:05.290961932Z [2024-04-15T03:16:05.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:16:05.291629151Z [2024-04-15T03:16:05.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:15:00+00:00, run_id=scheduled__2024-04-15T03:15:00+00:00, run_start_date=2024-04-15 03:16:00.366222+00:00, run_end_date=2024-04-15 03:16:05.291040+00:00, run_duration=4.924818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:15:00+00:00, data_interval_end=2024-04-15 03:16:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:16:05.306672461Z [2024-04-15T03:16:05.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:16:00+00:00, run_after=2024-04-15T03:17:00+00:00 2024-04-15T03:16:05.347966030Z [2024-04-15T03:16:05.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status success for try_number 1 2024-04-15T03:16:05.356271725Z [2024-04-15T03:16:05.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:15:00+00:00, map_index=-1, run_start_date=2024-04-15 03:16:02.624010+00:00, run_end_date=2024-04-15 03:16:04.316667+00:00, run_duration=1.692657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:16:00.450573+00:00, queued_by_job_id=2, pid=8600 2024-04-15T03:17:00.706018218Z [2024-04-15T03:17:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:17:00+00:00, run_after=2024-04-15T03:18:00+00:00 2024-04-15T03:17:00.728884954Z [2024-04-15T03:17:00.727+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:17:00.824931853Z [2024-04-15T03:17:00.819+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:17:00.824961516Z 2024-04-15T03:17:00.824984609Z 2024-04-15T03:17:00.824988229Z [2024-04-15T03:17:00.819+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:17:00.824991228Z [2024-04-15T03:17:00.819+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:17:00.824995045Z [2024-04-15T03:17:00.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:17:00.824998286Z 2024-04-15T03:17:00.825001654Z 2024-04-15T03:17:00.825015370Z [2024-04-15T03:17:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:17:00.825019039Z [2024-04-15T03:17:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:17:00.825022105Z [2024-04-15T03:17:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:17:00.825025188Z [2024-04-15T03:17:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:17:01.094652179Z [2024-04-15T03:17:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:16:00+00:00 exited with status queued for try_number 1 2024-04-15T03:17:01.094756528Z [2024-04-15T03:17:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:16:00+00:00 exited with status queued for try_number 1 2024-04-15T03:17:01.103316231Z [2024-04-15T03:17:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6fe87d8-ae5e-45db-be03-a92c50439f22 2024-04-15T03:17:01.103476334Z [2024-04-15T03:17:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c419427-0728-422d-80a7-2b20f8849349 2024-04-15T03:17:04.945887893Z [2024-04-15T03:17:04.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:17:04.946477338Z [2024-04-15T03:17:04.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:16:00+00:00, run_id=scheduled__2024-04-15T03:16:00+00:00, run_start_date=2024-04-15 03:17:00.745865+00:00, run_end_date=2024-04-15 03:17:04.945777+00:00, run_duration=4.199912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:16:00+00:00, data_interval_end=2024-04-15 03:17:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:17:04.958391170Z [2024-04-15T03:17:04.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:17:00+00:00, run_after=2024-04-15T03:18:00+00:00 2024-04-15T03:17:05.010337218Z [2024-04-15T03:17:05.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:16:00+00:00 exited with status success for try_number 1 2024-04-15T03:17:05.022091404Z [2024-04-15T03:17:05.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:16:00+00:00, map_index=-1, run_start_date=2024-04-15 03:17:02.972280+00:00, run_end_date=2024-04-15 03:17:04.647309+00:00, run_duration=1.675029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:17:00.821375+00:00, queued_by_job_id=2, pid=8654 2024-04-15T03:17:06.088822839Z [2024-04-15T03:17:06.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:17:06.088960686Z [2024-04-15T03:17:06.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:16:00+00:00, run_id=scheduled__2024-04-15T03:16:00+00:00, run_start_date=2024-04-15 03:17:00.747322+00:00, run_end_date=2024-04-15 03:17:06.087887+00:00, run_duration=5.340565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:16:00+00:00, data_interval_end=2024-04-15 03:17:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:17:06.113700417Z [2024-04-15T03:17:06.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:17:00+00:00, run_after=2024-04-15T03:18:00+00:00 2024-04-15T03:17:06.169144403Z [2024-04-15T03:17:06.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:16:00+00:00 exited with status success for try_number 1 2024-04-15T03:17:06.175339128Z [2024-04-15T03:17:06.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:16:00+00:00, map_index=-1, run_start_date=2024-04-15 03:17:02.958898+00:00, run_end_date=2024-04-15 03:17:05.642075+00:00, run_duration=2.683177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:17:00.821375+00:00, queued_by_job_id=2, pid=8653 2024-04-15T03:18:01.085147218Z [2024-04-15T03:18:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:18:00+00:00, run_after=2024-04-15T03:19:00+00:00 2024-04-15T03:18:01.095108720Z [2024-04-15T03:18:01.094+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:18:01.105044349Z [2024-04-15T03:18:01.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:18:01.207353229Z [2024-04-15T03:18:01.206+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:18:01.207375958Z 2024-04-15T03:18:01.207380698Z 2024-04-15T03:18:01.207384017Z 2024-04-15T03:18:01.207512570Z [2024-04-15T03:18:01.207+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:18:01.207681907Z [2024-04-15T03:18:01.207+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:18:01.207857326Z [2024-04-15T03:18:01.207+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:18:01.208946300Z [2024-04-15T03:18:01.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:18:01.208959157Z 2024-04-15T03:18:01.208962940Z 2024-04-15T03:18:01.208966240Z 2024-04-15T03:18:01.213930070Z [2024-04-15T03:18:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:18:01.214159086Z [2024-04-15T03:18:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:18:01.214537972Z [2024-04-15T03:18:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:18:01.214700744Z [2024-04-15T03:18:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:18:01.215062734Z [2024-04-15T03:18:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:18:01.215232867Z [2024-04-15T03:18:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:18:01.500987616Z [2024-04-15T03:18:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:16:00+00:00 exited with status queued for try_number 1 2024-04-15T03:18:01.501302698Z [2024-04-15T03:18:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:17:00+00:00 exited with status queued for try_number 1 2024-04-15T03:18:01.501506528Z [2024-04-15T03:18:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:17:00+00:00 exited with status queued for try_number 1 2024-04-15T03:18:01.509271577Z [2024-04-15T03:18:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01273292-bfc5-495e-9097-c2eb80aa0183 2024-04-15T03:18:01.509566371Z [2024-04-15T03:18:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1180e992-8db7-4297-b05d-a22322cb6eb5 2024-04-15T03:18:01.509837995Z [2024-04-15T03:18:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65cd962e-3941-4126-a663-e7dbd1edd5ea 2024-04-15T03:18:03.668598128Z [2024-04-15T03:18:03.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:18:03.668788018Z [2024-04-15T03:18:03.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:16:00+00:00, run_id=scheduled__2024-04-15T03:16:00+00:00, run_start_date=2024-04-15 03:18:01.119033+00:00, run_end_date=2024-04-15 03:18:03.668494+00:00, run_duration=2.549461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:16:00+00:00, data_interval_end=2024-04-15 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:18:03.682054844Z [2024-04-15T03:18:03.681+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:18:00+00:00, run_after=2024-04-15T03:20:00+00:00 2024-04-15T03:18:03.734322535Z [2024-04-15T03:18:03.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:16:00+00:00 exited with status success for try_number 1 2024-04-15T03:18:03.742184012Z [2024-04-15T03:18:03.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:16:00+00:00, map_index=-1, run_start_date=2024-04-15 03:18:02.248957+00:00, run_end_date=2024-04-15 03:18:02.788924+00:00, run_duration=0.539967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:18:01.210147+00:00, queued_by_job_id=2, pid=8689 2024-04-15T03:18:05.928277742Z [2024-04-15T03:18:05.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:18:05.928700121Z [2024-04-15T03:18:05.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:17:00+00:00, run_id=scheduled__2024-04-15T03:17:00+00:00, run_start_date=2024-04-15 03:18:01.121793+00:00, run_end_date=2024-04-15 03:18:05.928084+00:00, run_duration=4.806291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:17:00+00:00, data_interval_end=2024-04-15 03:18:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:18:05.940393653Z [2024-04-15T03:18:05.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:18:00+00:00, run_after=2024-04-15T03:19:00+00:00 2024-04-15T03:18:05.947591427Z [2024-04-15T03:18:05.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:18:05.947662008Z [2024-04-15T03:18:05.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:17:00+00:00, run_id=scheduled__2024-04-15T03:17:00+00:00, run_start_date=2024-04-15 03:18:01.123388+00:00, run_end_date=2024-04-15 03:18:05.947406+00:00, run_duration=4.824018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:17:00+00:00, data_interval_end=2024-04-15 03:18:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:18:05.956904542Z [2024-04-15T03:18:05.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:18:00+00:00, run_after=2024-04-15T03:19:00+00:00 2024-04-15T03:18:06.006918934Z [2024-04-15T03:18:06.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:17:00+00:00 exited with status success for try_number 1 2024-04-15T03:18:06.007620016Z [2024-04-15T03:18:06.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:17:00+00:00 exited with status success for try_number 1 2024-04-15T03:18:06.019869511Z [2024-04-15T03:18:06.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:17:00+00:00, map_index=-1, run_start_date=2024-04-15 03:18:03.415346+00:00, run_end_date=2024-04-15 03:18:04.954905+00:00, run_duration=1.539559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:18:01.210147+00:00, queued_by_job_id=2, pid=8712 2024-04-15T03:18:06.020506785Z [2024-04-15T03:18:06.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:17:00+00:00, map_index=-1, run_start_date=2024-04-15 03:18:03.642456+00:00, run_end_date=2024-04-15 03:18:05.498691+00:00, run_duration=1.856235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:18:01.210147+00:00, queued_by_job_id=2, pid=8720 2024-04-15T03:19:00.064588025Z [2024-04-15T03:19:00.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:19:00.080763692Z [2024-04-15T03:19:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:19:00+00:00, run_after=2024-04-15T03:20:00+00:00 2024-04-15T03:19:00.138755377Z [2024-04-15T03:19:00.138+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:19:00.138776702Z 2024-04-15T03:19:00.138780165Z 2024-04-15T03:19:00.138783379Z [2024-04-15T03:19:00.138+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:19:00.138797657Z [2024-04-15T03:19:00.138+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:19:00.139304550Z [2024-04-15T03:19:00.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:19:00.139312144Z 2024-04-15T03:19:00.139315761Z 2024-04-15T03:19:00.142229737Z [2024-04-15T03:19:00.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:19:00.142282131Z [2024-04-15T03:19:00.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:19:00.142475307Z [2024-04-15T03:19:00.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:19:00.142529825Z [2024-04-15T03:19:00.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:19:00.302744289Z [2024-04-15T03:19:00.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:18:00+00:00 exited with status queued for try_number 1 2024-04-15T03:19:00.302806785Z [2024-04-15T03:19:00.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:18:00+00:00 exited with status queued for try_number 1 2024-04-15T03:19:00.310771433Z [2024-04-15T03:19:00.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2095465a-24bb-443f-bd86-5e30fe708d80 2024-04-15T03:19:00.310793427Z [2024-04-15T03:19:00.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bfe9310-5f80-4b81-bf45-8f3c5aa426a3 2024-04-15T03:19:04.707788887Z [2024-04-15T03:19:04.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:19:04.708658515Z [2024-04-15T03:19:04.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:18:00+00:00, run_id=scheduled__2024-04-15T03:18:00+00:00, run_start_date=2024-04-15 03:19:00.090971+00:00, run_end_date=2024-04-15 03:19:04.707755+00:00, run_duration=4.616784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:18:00+00:00, data_interval_end=2024-04-15 03:19:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:19:04.722607591Z [2024-04-15T03:19:04.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:19:00+00:00, run_after=2024-04-15T03:20:00+00:00 2024-04-15T03:19:04.732742927Z [2024-04-15T03:19:04.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:19:04.733311707Z [2024-04-15T03:19:04.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:18:00+00:00, run_id=scheduled__2024-04-15T03:18:00+00:00, run_start_date=2024-04-15 03:19:00.089897+00:00, run_end_date=2024-04-15 03:19:04.732682+00:00, run_duration=4.642785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:18:00+00:00, data_interval_end=2024-04-15 03:19:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:19:04.751474460Z [2024-04-15T03:19:04.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:19:00+00:00, run_after=2024-04-15T03:20:00+00:00 2024-04-15T03:19:04.807677034Z [2024-04-15T03:19:04.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:18:00+00:00 exited with status success for try_number 1 2024-04-15T03:19:04.807696009Z [2024-04-15T03:19:04.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:18:00+00:00 exited with status success for try_number 1 2024-04-15T03:19:04.813069566Z [2024-04-15T03:19:04.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:18:00+00:00, map_index=-1, run_start_date=2024-04-15 03:19:02.315872+00:00, run_end_date=2024-04-15 03:19:04.346255+00:00, run_duration=2.030383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:19:00.140045+00:00, queued_by_job_id=2, pid=8774 2024-04-15T03:19:04.813102595Z [2024-04-15T03:19:04.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:18:00+00:00, map_index=-1, run_start_date=2024-04-15 03:19:02.379972+00:00, run_end_date=2024-04-15 03:19:04.039882+00:00, run_duration=1.65991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:19:00.140045+00:00, queued_by_job_id=2, pid=8775 2024-04-15T03:20:00.541664424Z [2024-04-15T03:20:00.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:20:00+00:00, run_after=2024-04-15T03:25:00+00:00 2024-04-15T03:20:00.558149930Z [2024-04-15T03:20:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:20:00+00:00, run_after=2024-04-15T03:21:00+00:00 2024-04-15T03:20:00.567467191Z [2024-04-15T03:20:00.567+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:20:00.582759684Z [2024-04-15T03:20:00.582+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:20:00.702139940Z [2024-04-15T03:20:00.701+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T03:20:00.702170419Z 2024-04-15T03:20:00.702176240Z 2024-04-15T03:20:00.702182294Z 2024-04-15T03:20:00.702187420Z 2024-04-15T03:20:00.702503785Z [2024-04-15T03:20:00.702+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:20:00.702877249Z [2024-04-15T03:20:00.702+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:20:00.703185294Z [2024-04-15T03:20:00.702+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:20:00.703505923Z [2024-04-15T03:20:00.703+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:20:00.704612794Z [2024-04-15T03:20:00.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:20:00.704631601Z 2024-04-15T03:20:00.704638397Z 2024-04-15T03:20:00.704644633Z 2024-04-15T03:20:00.704650187Z 2024-04-15T03:20:00.708974050Z [2024-04-15T03:20:00.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:20:00.709266569Z [2024-04-15T03:20:00.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:20:00.709702020Z [2024-04-15T03:20:00.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:20:00.709942211Z [2024-04-15T03:20:00.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:20:00.710295967Z [2024-04-15T03:20:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:20:00.710520082Z [2024-04-15T03:20:00.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:20:00.710875977Z [2024-04-15T03:20:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:20:00.711106744Z [2024-04-15T03:20:00.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:20:01.163716779Z [2024-04-15T03:20:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status queued for try_number 1 2024-04-15T03:20:01.163805120Z [2024-04-15T03:20:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:18:00+00:00 exited with status queued for try_number 1 2024-04-15T03:20:01.163811301Z [2024-04-15T03:20:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:19:00+00:00 exited with status queued for try_number 1 2024-04-15T03:20:01.163854998Z [2024-04-15T03:20:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:19:00+00:00 exited with status queued for try_number 1 2024-04-15T03:20:01.182534921Z [2024-04-15T03:20:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a280801-bacd-4c35-8215-cd03d916ced0 2024-04-15T03:20:01.182636325Z [2024-04-15T03:20:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0788bebe-04c1-4ad1-acf7-7a8c855f5a78 2024-04-15T03:20:01.182643727Z [2024-04-15T03:20:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9463b2bd-8f08-4da3-917f-2a0ff34d6510 2024-04-15T03:20:01.182736168Z [2024-04-15T03:20:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a939153-242a-4aea-9839-41edc03d848e 2024-04-15T03:20:02.459402019Z [2024-04-15T03:20:02.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:20:02.459582805Z [2024-04-15T03:20:02.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:18:00+00:00, run_id=scheduled__2024-04-15T03:18:00+00:00, run_start_date=2024-04-15 03:20:00.608678+00:00, run_end_date=2024-04-15 03:20:02.459292+00:00, run_duration=1.850614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:18:00+00:00, data_interval_end=2024-04-15 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:20:02.481649944Z [2024-04-15T03:20:02.481+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:20:00+00:00, run_after=2024-04-15T03:22:00+00:00 2024-04-15T03:20:02.600300528Z [2024-04-15T03:20:02.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:18:00+00:00 exited with status success for try_number 1 2024-04-15T03:20:02.625001740Z [2024-04-15T03:20:02.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:18:00+00:00, map_index=-1, run_start_date=2024-04-15 03:20:01.660982+00:00, run_end_date=2024-04-15 03:20:02.212606+00:00, run_duration=0.551624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:20:00.706140+00:00, queued_by_job_id=2, pid=8811 2024-04-15T03:20:04.592789147Z [2024-04-15T03:20:04.592+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:20:04.592824273Z 2024-04-15T03:20:04.592830449Z [2024-04-15T03:20:04.592+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:20:04.593690642Z [2024-04-15T03:20:04.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:20:04.593707521Z 2024-04-15T03:20:04.596956118Z [2024-04-15T03:20:04.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:20:04.597072160Z [2024-04-15T03:20:04.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:20:04.656674652Z [2024-04-15T03:20:04.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status queued for try_number 1 2024-04-15T03:20:04.657107931Z [2024-04-15T03:20:04.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status success for try_number 1 2024-04-15T03:20:04.662861657Z [2024-04-15T03:20:04.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ef114ab-8f3e-41fc-8197-270b192bff68 2024-04-15T03:20:04.662992754Z [2024-04-15T03:20:04.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:15:00+00:00, map_index=-1, run_start_date=2024-04-15 03:20:03.804213+00:00, run_end_date=2024-04-15 03:20:04.303052+00:00, run_duration=0.498839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:20:00.706140+00:00, queued_by_job_id=2, pid=8871 2024-04-15T03:20:05.820441988Z [2024-04-15T03:20:05.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:20:05.820912434Z [2024-04-15T03:20:05.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:19:00+00:00, run_id=scheduled__2024-04-15T03:19:00+00:00, run_start_date=2024-04-15 03:20:00.611198+00:00, run_end_date=2024-04-15 03:20:05.820218+00:00, run_duration=5.20902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:19:00+00:00, data_interval_end=2024-04-15 03:20:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:20:05.830457496Z [2024-04-15T03:20:05.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:20:00+00:00, run_after=2024-04-15T03:21:00+00:00 2024-04-15T03:20:05.836199192Z [2024-04-15T03:20:05.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:20:05.836636425Z [2024-04-15T03:20:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:19:00+00:00, run_id=scheduled__2024-04-15T03:19:00+00:00, run_start_date=2024-04-15 03:20:00.613652+00:00, run_end_date=2024-04-15 03:20:05.836046+00:00, run_duration=5.222394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:19:00+00:00, data_interval_end=2024-04-15 03:20:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:20:05.845306066Z [2024-04-15T03:20:05.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:20:00+00:00, run_after=2024-04-15T03:21:00+00:00 2024-04-15T03:20:05.896532591Z [2024-04-15T03:20:05.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:19:00+00:00 exited with status success for try_number 1 2024-04-15T03:20:05.897074843Z [2024-04-15T03:20:05.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:19:00+00:00 exited with status success for try_number 1 2024-04-15T03:20:05.912617641Z [2024-04-15T03:20:05.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:19:00+00:00, map_index=-1, run_start_date=2024-04-15 03:20:03.414922+00:00, run_end_date=2024-04-15 03:20:04.813799+00:00, run_duration=1.398877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:20:00.706140+00:00, queued_by_job_id=2, pid=8843 2024-04-15T03:20:05.913379286Z [2024-04-15T03:20:05.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:19:00+00:00, map_index=-1, run_start_date=2024-04-15 03:20:03.383191+00:00, run_end_date=2024-04-15 03:20:05.081344+00:00, run_duration=1.698153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:20:00.706140+00:00, queued_by_job_id=2, pid=8842 2024-04-15T03:20:06.991581708Z [2024-04-15T03:20:06.991+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:20:06.991633068Z 2024-04-15T03:20:06.992018664Z [2024-04-15T03:20:06.991+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:20:06.992944522Z [2024-04-15T03:20:06.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:20:06.992961945Z 2024-04-15T03:20:06.995897514Z [2024-04-15T03:20:06.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:20:06.996220664Z [2024-04-15T03:20:06.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:20:07.056818937Z [2024-04-15T03:20:07.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status queued for try_number 1 2024-04-15T03:20:07.056863835Z [2024-04-15T03:20:07.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status success for try_number 1 2024-04-15T03:20:07.065309416Z [2024-04-15T03:20:07.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37787385-9cb2-4f4c-b13c-1a383e85bc69 2024-04-15T03:20:07.065518199Z [2024-04-15T03:20:07.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:15:00+00:00, map_index=-1, run_start_date=2024-04-15 03:20:06.334466+00:00, run_end_date=2024-04-15 03:20:06.719823+00:00, run_duration=0.385357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:20:04.594283+00:00, queued_by_job_id=2, pid=8892 2024-04-15T03:20:10.873000143Z [2024-04-15T03:20:10.872+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:20:10.873025652Z 2024-04-15T03:20:10.873031792Z [2024-04-15T03:20:10.872+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:20:10.876433148Z [2024-04-15T03:20:10.872+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:20:10.876450957Z 2024-04-15T03:20:10.876456582Z [2024-04-15T03:20:10.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:20:10.876468198Z [2024-04-15T03:20:10.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:20:10.915839630Z [2024-04-15T03:20:10.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status queued for try_number 1 2024-04-15T03:20:10.916297965Z [2024-04-15T03:20:10.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status success for try_number 1 2024-04-15T03:20:10.922906883Z [2024-04-15T03:20:10.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d5f84b0-a68b-4b99-aa05-a848c8dade79 2024-04-15T03:20:10.923141798Z [2024-04-15T03:20:10.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:15:00+00:00, map_index=0, run_start_date=2024-04-15 03:20:08.549506+00:00, run_end_date=2024-04-15 03:20:09.812883+00:00, run_duration=1.263377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:20:06.993442+00:00, queued_by_job_id=2, pid=8904 2024-04-15T03:20:13.469956654Z [2024-04-15T03:20:13.469+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:20:13.470448240Z [2024-04-15T03:20:13.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:15:00+00:00, run_id=scheduled__2024-04-15T03:15:00+00:00, run_start_date=2024-04-15 03:20:00.606190+00:00, run_end_date=2024-04-15 03:20:13.469714+00:00, run_duration=12.863524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:15:00+00:00, data_interval_end=2024-04-15 03:20:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:20:13.480267896Z [2024-04-15T03:20:13.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:20:00+00:00, run_after=2024-04-15T03:25:00+00:00 2024-04-15T03:20:13.527459875Z [2024-04-15T03:20:13.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:15:00+00:00 exited with status success for try_number 1 2024-04-15T03:20:13.535996335Z [2024-04-15T03:20:13.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:15:00+00:00, map_index=-1, run_start_date=2024-04-15 03:20:12.407118+00:00, run_end_date=2024-04-15 03:20:12.806103+00:00, run_duration=0.398985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:20:10.873464+00:00, queued_by_job_id=2, pid=8924 2024-04-15T03:20:41.285028146Z [2024-04-15T03:20:41.284+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:21:00.497377177Z [2024-04-15T03:21:00.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:21:00+00:00, run_after=2024-04-15T03:22:00+00:00 2024-04-15T03:21:00.506025264Z [2024-04-15T03:21:00.505+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:21:00.558668033Z [2024-04-15T03:21:00.558+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:21:00.558696455Z 2024-04-15T03:21:00.558706017Z 2024-04-15T03:21:00.559073217Z [2024-04-15T03:21:00.558+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:21:00.559389159Z [2024-04-15T03:21:00.559+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:21:00.560004537Z [2024-04-15T03:21:00.559+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:21:00.560015926Z 2024-04-15T03:21:00.560019913Z 2024-04-15T03:21:00.562687062Z [2024-04-15T03:21:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:21:00.562986943Z [2024-04-15T03:21:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:21:00.563370085Z [2024-04-15T03:21:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:21:00.563606706Z [2024-04-15T03:21:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:21:00.720030814Z [2024-04-15T03:21:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status queued for try_number 1 2024-04-15T03:21:00.720050432Z [2024-04-15T03:21:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status queued for try_number 1 2024-04-15T03:21:00.729266612Z [2024-04-15T03:21:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1166c4b-f4c8-45f0-b0bd-f095f28c3227 2024-04-15T03:21:00.729329055Z [2024-04-15T03:21:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to d41eee91-eea2-4721-b7d0-d39b0d42a0d0 2024-04-15T03:21:04.930273188Z [2024-04-15T03:21:04.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:21:04.931149839Z [2024-04-15T03:21:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:20:00+00:00, run_id=scheduled__2024-04-15T03:20:00+00:00, run_start_date=2024-04-15 03:21:00.515264+00:00, run_end_date=2024-04-15 03:21:04.930751+00:00, run_duration=4.415487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:20:00+00:00, data_interval_end=2024-04-15 03:21:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:21:04.940733351Z [2024-04-15T03:21:04.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:21:00+00:00, run_after=2024-04-15T03:22:00+00:00 2024-04-15T03:21:04.946679587Z [2024-04-15T03:21:04.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:21:04.947134380Z [2024-04-15T03:21:04.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:20:00+00:00, run_id=scheduled__2024-04-15T03:20:00+00:00, run_start_date=2024-04-15 03:21:00.516404+00:00, run_end_date=2024-04-15 03:21:04.946849+00:00, run_duration=4.430445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:20:00+00:00, data_interval_end=2024-04-15 03:21:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:21:04.958102927Z [2024-04-15T03:21:04.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:21:00+00:00, run_after=2024-04-15T03:22:00+00:00 2024-04-15T03:21:05.000200995Z [2024-04-15T03:21:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status success for try_number 1 2024-04-15T03:21:05.004508534Z [2024-04-15T03:21:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status success for try_number 1 2024-04-15T03:21:05.016348007Z [2024-04-15T03:21:05.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:20:00+00:00, map_index=-1, run_start_date=2024-04-15 03:21:02.786814+00:00, run_end_date=2024-04-15 03:21:03.995922+00:00, run_duration=1.209108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:21:00.560694+00:00, queued_by_job_id=2, pid=8959 2024-04-15T03:21:05.016692639Z [2024-04-15T03:21:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:20:00+00:00, map_index=-1, run_start_date=2024-04-15 03:21:02.799250+00:00, run_end_date=2024-04-15 03:21:04.615611+00:00, run_duration=1.816361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:21:00.560694+00:00, queued_by_job_id=2, pid=8960 2024-04-15T03:21:44.100714466Z [2024-04-15T03:21:44.100+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:21:44.100740220Z 2024-04-15T03:21:44.101010980Z [2024-04-15T03:21:44.100+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-15T03:21:44.101675417Z [2024-04-15T03:21:44.101+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:21:44.101700612Z 2024-04-15T03:21:44.105583115Z [2024-04-15T03:21:44.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240415032143_017362', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:21:44.105862266Z [2024-04-15T03:21:44.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240415032143_017362', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-15T03:21:44.159501941Z [2024-04-15T03:21:44.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415032143_017362 exited with status queued for try_number 1 2024-04-15T03:21:44.165890827Z [2024-04-15T03:21:44.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd0c38e3-745e-4896-8f57-5036dea52611 2024-04-15T03:21:45.871319829Z [2024-04-15T03:21:45.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:21:45.871945271Z [2024-04-15T03:21:45.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-15 03:21:43.933492+00:00, run_id=scaleout_vdu_20240415032143_017362, run_start_date=2024-04-15 03:21:44.064019+00:00, run_end_date=2024-04-15 03:21:45.871102+00:00, run_duration=1.807083, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 03:21:43.933492+00:00, data_interval_end=2024-04-15 03:21:43.933492+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-15T03:21:45.882317890Z [2024-04-15T03:21:45.881+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-15T03:21:45.922237255Z [2024-04-15T03:21:45.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415032143_017362 exited with status success for try_number 1 2024-04-15T03:21:45.929879081Z [2024-04-15T03:21:45.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240415032143_017362, map_index=-1, run_start_date=2024-04-15 03:21:44.866563+00:00, run_end_date=2024-04-15 03:21:45.295730+00:00, run_duration=0.429167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:21:44.102070+00:00, queued_by_job_id=2, pid=8993 2024-04-15T03:22:00.906281770Z [2024-04-15T03:22:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:22:00+00:00, run_after=2024-04-15T03:23:00+00:00 2024-04-15T03:22:00.912816109Z [2024-04-15T03:22:00.912+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:22:00.918825175Z [2024-04-15T03:22:00.918+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:22:00.981055988Z [2024-04-15T03:22:00.980+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:22:00.981125494Z 2024-04-15T03:22:00.981130087Z 2024-04-15T03:22:00.981165684Z 2024-04-15T03:22:00.981170960Z [2024-04-15T03:22:00.980+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:22:00.981187733Z [2024-04-15T03:22:00.981+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:22:00.981195351Z [2024-04-15T03:22:00.981+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:22:00.981664664Z [2024-04-15T03:22:00.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:22:00.981676123Z 2024-04-15T03:22:00.981681384Z 2024-04-15T03:22:00.981684648Z 2024-04-15T03:22:00.984336460Z [2024-04-15T03:22:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:22:00.984416594Z [2024-04-15T03:22:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:22:00.984591793Z [2024-04-15T03:22:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:22:00.984666584Z [2024-04-15T03:22:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:22:00.984826239Z [2024-04-15T03:22:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:22:00.984896864Z [2024-04-15T03:22:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:22:01.471997325Z [2024-04-15T03:22:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status queued for try_number 1 2024-04-15T03:22:01.472104164Z [2024-04-15T03:22:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:21:00+00:00 exited with status queued for try_number 1 2024-04-15T03:22:01.472109424Z [2024-04-15T03:22:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:21:00+00:00 exited with status queued for try_number 1 2024-04-15T03:22:01.491107831Z [2024-04-15T03:22:01.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8d7af88-2560-4d6e-9d61-e04742851af6 2024-04-15T03:22:01.491175930Z [2024-04-15T03:22:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb43185a-c870-4443-9939-5ab3db95ed50 2024-04-15T03:22:01.491379985Z [2024-04-15T03:22:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9378ff14-94d5-4948-8026-e6532dba6801 2024-04-15T03:22:03.287414219Z [2024-04-15T03:22:03.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:22:03.287598888Z [2024-04-15T03:22:03.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:20:00+00:00, run_id=scheduled__2024-04-15T03:20:00+00:00, run_start_date=2024-04-15 03:22:00.930232+00:00, run_end_date=2024-04-15 03:22:03.287314+00:00, run_duration=2.357082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:20:00+00:00, data_interval_end=2024-04-15 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:22:03.296049454Z [2024-04-15T03:22:03.295+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:22:00+00:00, run_after=2024-04-15T03:24:00+00:00 2024-04-15T03:22:03.352752965Z [2024-04-15T03:22:03.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status success for try_number 1 2024-04-15T03:22:03.358021249Z [2024-04-15T03:22:03.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:20:00+00:00, map_index=-1, run_start_date=2024-04-15 03:22:01.785034+00:00, run_end_date=2024-04-15 03:22:02.400313+00:00, run_duration=0.615279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:22:00.982283+00:00, queued_by_job_id=2, pid=9007 2024-04-15T03:22:05.523385283Z [2024-04-15T03:22:05.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:22:05.523792992Z [2024-04-15T03:22:05.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:21:00+00:00, run_id=scheduled__2024-04-15T03:21:00+00:00, run_start_date=2024-04-15 03:22:00.931242+00:00, run_end_date=2024-04-15 03:22:05.523209+00:00, run_duration=4.591967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:21:00+00:00, data_interval_end=2024-04-15 03:22:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:22:05.536348702Z [2024-04-15T03:22:05.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:22:00+00:00, run_after=2024-04-15T03:23:00+00:00 2024-04-15T03:22:05.585632885Z [2024-04-15T03:22:05.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:21:00+00:00 exited with status success for try_number 1 2024-04-15T03:22:05.595768290Z [2024-04-15T03:22:05.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:21:00+00:00, map_index=-1, run_start_date=2024-04-15 03:22:03.603153+00:00, run_end_date=2024-04-15 03:22:05.039130+00:00, run_duration=1.435977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:22:00.982283+00:00, queued_by_job_id=2, pid=9027 2024-04-15T03:22:06.645865756Z [2024-04-15T03:22:06.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:22:06.646318951Z [2024-04-15T03:22:06.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:21:00+00:00, run_id=scheduled__2024-04-15T03:21:00+00:00, run_start_date=2024-04-15 03:22:00.932249+00:00, run_end_date=2024-04-15 03:22:06.645754+00:00, run_duration=5.713505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:21:00+00:00, data_interval_end=2024-04-15 03:22:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:22:06.656783745Z [2024-04-15T03:22:06.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:22:00+00:00, run_after=2024-04-15T03:23:00+00:00 2024-04-15T03:22:06.695469491Z [2024-04-15T03:22:06.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:21:00+00:00 exited with status success for try_number 1 2024-04-15T03:22:06.701358241Z [2024-04-15T03:22:06.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:21:00+00:00, map_index=-1, run_start_date=2024-04-15 03:22:03.924863+00:00, run_end_date=2024-04-15 03:22:05.569281+00:00, run_duration=1.644418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:22:00.982283+00:00, queued_by_job_id=2, pid=9037 2024-04-15T03:23:00.096383879Z [2024-04-15T03:23:00.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:23:00+00:00, run_after=2024-04-15T03:24:00+00:00 2024-04-15T03:23:00.103372194Z [2024-04-15T03:23:00.102+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:23:00.149585117Z [2024-04-15T03:23:00.149+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:23:00.149623038Z 2024-04-15T03:23:00.149632884Z 2024-04-15T03:23:00.150495027Z [2024-04-15T03:23:00.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:23:00.151203392Z [2024-04-15T03:23:00.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:23:00.152791063Z [2024-04-15T03:23:00.152+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:23:00.152817052Z 2024-04-15T03:23:00.152826696Z 2024-04-15T03:23:00.157996367Z [2024-04-15T03:23:00.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:23:00.158639803Z [2024-04-15T03:23:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:23:00.159362838Z [2024-04-15T03:23:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:23:00.159961533Z [2024-04-15T03:23:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:23:00.347798332Z [2024-04-15T03:23:00.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:22:00+00:00 exited with status queued for try_number 1 2024-04-15T03:23:00.348097568Z [2024-04-15T03:23:00.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:22:00+00:00 exited with status queued for try_number 1 2024-04-15T03:23:00.358177444Z [2024-04-15T03:23:00.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4d43ae5-80a9-4b90-9382-f60891452f34 2024-04-15T03:23:00.358562547Z [2024-04-15T03:23:00.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3524e29-a66a-4447-b682-ae3a0c1ea8bc 2024-04-15T03:23:03.757755122Z [2024-04-15T03:23:03.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:23:03.758083968Z [2024-04-15T03:23:03.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:22:00+00:00, run_id=scheduled__2024-04-15T03:22:00+00:00, run_start_date=2024-04-15 03:23:00.112083+00:00, run_end_date=2024-04-15 03:23:03.757628+00:00, run_duration=3.645545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:22:00+00:00, data_interval_end=2024-04-15 03:23:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:23:03.766348054Z [2024-04-15T03:23:03.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:23:00+00:00, run_after=2024-04-15T03:24:00+00:00 2024-04-15T03:23:03.821127390Z [2024-04-15T03:23:03.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:22:00+00:00 exited with status success for try_number 1 2024-04-15T03:23:03.829418691Z [2024-04-15T03:23:03.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:22:00+00:00, map_index=-1, run_start_date=2024-04-15 03:23:02.174122+00:00, run_end_date=2024-04-15 03:23:03.475516+00:00, run_duration=1.301394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:23:00.154328+00:00, queued_by_job_id=2, pid=9091 2024-04-15T03:23:04.881949809Z [2024-04-15T03:23:04.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:23:04.881969223Z [2024-04-15T03:23:04.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:22:00+00:00, run_id=scheduled__2024-04-15T03:22:00+00:00, run_start_date=2024-04-15 03:23:00.113206+00:00, run_end_date=2024-04-15 03:23:04.881604+00:00, run_duration=4.768398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:22:00+00:00, data_interval_end=2024-04-15 03:23:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:23:04.891377153Z [2024-04-15T03:23:04.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:23:00+00:00, run_after=2024-04-15T03:24:00+00:00 2024-04-15T03:23:04.925986385Z [2024-04-15T03:23:04.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:22:00+00:00 exited with status success for try_number 1 2024-04-15T03:23:04.929249717Z [2024-04-15T03:23:04.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:22:00+00:00, map_index=-1, run_start_date=2024-04-15 03:23:02.207983+00:00, run_end_date=2024-04-15 03:23:03.988859+00:00, run_duration=1.780876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:23:00.154328+00:00, queued_by_job_id=2, pid=9092 2024-04-15T03:24:00.622319364Z [2024-04-15T03:24:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:24:00+00:00, run_after=2024-04-15T03:25:00+00:00 2024-04-15T03:24:00.629434175Z [2024-04-15T03:24:00.629+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:24:00.634921193Z [2024-04-15T03:24:00.634+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:24:00.727810205Z [2024-04-15T03:24:00.727+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:24:00.727848432Z 2024-04-15T03:24:00.727857503Z 2024-04-15T03:24:00.727864978Z 2024-04-15T03:24:00.728002266Z [2024-04-15T03:24:00.727+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:24:00.728239149Z [2024-04-15T03:24:00.728+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:24:00.728504191Z [2024-04-15T03:24:00.728+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:24:00.729328351Z [2024-04-15T03:24:00.729+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:24:00.729340319Z 2024-04-15T03:24:00.729348028Z 2024-04-15T03:24:00.729355433Z 2024-04-15T03:24:00.734362256Z [2024-04-15T03:24:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:24:00.734824262Z [2024-04-15T03:24:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:24:00.735197720Z [2024-04-15T03:24:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:24:00.735392075Z [2024-04-15T03:24:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:24:00.735786981Z [2024-04-15T03:24:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:24:00.735816115Z [2024-04-15T03:24:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:24:01.009353410Z [2024-04-15T03:24:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:22:00+00:00 exited with status queued for try_number 1 2024-04-15T03:24:01.009387914Z [2024-04-15T03:24:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:23:00+00:00 exited with status queued for try_number 1 2024-04-15T03:24:01.009494441Z [2024-04-15T03:24:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:23:00+00:00 exited with status queued for try_number 1 2024-04-15T03:24:01.020300426Z [2024-04-15T03:24:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f117892-6e4b-4b04-a0b2-adfa2ac42992 2024-04-15T03:24:01.020427828Z [2024-04-15T03:24:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5153ff18-6190-4cb6-85cb-a06505dfceb3 2024-04-15T03:24:01.020585457Z [2024-04-15T03:24:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cda5b66-ab29-4ebb-b58c-b18f1197b6ec 2024-04-15T03:24:03.048069739Z [2024-04-15T03:24:03.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:24:03.048367935Z [2024-04-15T03:24:03.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:22:00+00:00, run_id=scheduled__2024-04-15T03:22:00+00:00, run_start_date=2024-04-15 03:24:00.652094+00:00, run_end_date=2024-04-15 03:24:03.048033+00:00, run_duration=2.395939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:22:00+00:00, data_interval_end=2024-04-15 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:24:03.062117036Z [2024-04-15T03:24:03.061+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:24:00+00:00, run_after=2024-04-15T03:26:00+00:00 2024-04-15T03:24:03.141112306Z [2024-04-15T03:24:03.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:22:00+00:00 exited with status success for try_number 1 2024-04-15T03:24:03.149745736Z [2024-04-15T03:24:03.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:22:00+00:00, map_index=-1, run_start_date=2024-04-15 03:24:01.885012+00:00, run_end_date=2024-04-15 03:24:02.381397+00:00, run_duration=0.496385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:24:00.730281+00:00, queued_by_job_id=2, pid=9127 2024-04-15T03:24:05.752690777Z [2024-04-15T03:24:05.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:24:05.752965907Z [2024-04-15T03:24:05.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:23:00+00:00, run_id=scheduled__2024-04-15T03:23:00+00:00, run_start_date=2024-04-15 03:24:00.654386+00:00, run_end_date=2024-04-15 03:24:05.752552+00:00, run_duration=5.098166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:23:00+00:00, data_interval_end=2024-04-15 03:24:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:24:05.768336132Z [2024-04-15T03:24:05.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:24:00+00:00, run_after=2024-04-15T03:25:00+00:00 2024-04-15T03:24:05.828704851Z [2024-04-15T03:24:05.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:23:00+00:00 exited with status success for try_number 1 2024-04-15T03:24:05.837454759Z [2024-04-15T03:24:05.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:23:00+00:00, map_index=-1, run_start_date=2024-04-15 03:24:03.291017+00:00, run_end_date=2024-04-15 03:24:04.790859+00:00, run_duration=1.499842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:24:00.730281+00:00, queued_by_job_id=2, pid=9158 2024-04-15T03:24:06.902643977Z [2024-04-15T03:24:06.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:24:06.903229574Z [2024-04-15T03:24:06.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:23:00+00:00, run_id=scheduled__2024-04-15T03:23:00+00:00, run_start_date=2024-04-15 03:24:00.656387+00:00, run_end_date=2024-04-15 03:24:06.902511+00:00, run_duration=6.246124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:23:00+00:00, data_interval_end=2024-04-15 03:24:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:24:06.915492709Z [2024-04-15T03:24:06.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:24:00+00:00, run_after=2024-04-15T03:25:00+00:00 2024-04-15T03:24:06.960768555Z [2024-04-15T03:24:06.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:23:00+00:00 exited with status success for try_number 1 2024-04-15T03:24:06.969865857Z [2024-04-15T03:24:06.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:23:00+00:00, map_index=-1, run_start_date=2024-04-15 03:24:03.240429+00:00, run_end_date=2024-04-15 03:24:05.826237+00:00, run_duration=2.585808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:24:00.730281+00:00, queued_by_job_id=2, pid=9157 2024-04-15T03:25:00.469547352Z [2024-04-15T03:25:00.468+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:25:00.487552400Z [2024-04-15T03:25:00.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:25:00+00:00, run_after=2024-04-15T03:26:00+00:00 2024-04-15T03:25:00.501263692Z [2024-04-15T03:25:00.500+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:25:00+00:00, run_after=2024-04-15T03:30:00+00:00 2024-04-15T03:25:00.585370345Z [2024-04-15T03:25:00.584+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:25:00.585409451Z 2024-04-15T03:25:00.585421073Z 2024-04-15T03:25:00.585431057Z 2024-04-15T03:25:00.585485751Z [2024-04-15T03:25:00.585+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:25:00.585641927Z [2024-04-15T03:25:00.585+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:25:00.585988988Z [2024-04-15T03:25:00.585+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:25:00.586825498Z [2024-04-15T03:25:00.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:25:00.586841691Z 2024-04-15T03:25:00.586847503Z 2024-04-15T03:25:00.586853394Z 2024-04-15T03:25:00.593944887Z [2024-04-15T03:25:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:25:00.594527023Z [2024-04-15T03:25:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:25:00.595322037Z [2024-04-15T03:25:00.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:25:00.595786214Z [2024-04-15T03:25:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:25:00.596916369Z [2024-04-15T03:25:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:25:00.597377738Z [2024-04-15T03:25:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:25:00.925636778Z [2024-04-15T03:25:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status queued for try_number 1 2024-04-15T03:25:00.925666473Z [2024-04-15T03:25:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:24:00+00:00 exited with status queued for try_number 1 2024-04-15T03:25:00.925748667Z [2024-04-15T03:25:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:24:00+00:00 exited with status queued for try_number 1 2024-04-15T03:25:00.942965910Z [2024-04-15T03:25:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 964e271a-6bfe-4af7-8485-40fab77f6aef 2024-04-15T03:25:00.943027567Z [2024-04-15T03:25:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b2dc7fd-39bd-4a84-b308-f65e2b0dcf24 2024-04-15T03:25:00.943129076Z [2024-04-15T03:25:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to b273c94e-29fa-4ced-a868-620ae50164a2 2024-04-15T03:25:03.615908038Z [2024-04-15T03:25:03.615+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:25:03.615935392Z 2024-04-15T03:25:03.616508056Z [2024-04-15T03:25:03.616+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:25:03.617874936Z [2024-04-15T03:25:03.617+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:25:03.617880621Z 2024-04-15T03:25:03.622511235Z [2024-04-15T03:25:03.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:25:03.622896214Z [2024-04-15T03:25:03.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:25:03.685029909Z [2024-04-15T03:25:03.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status queued for try_number 1 2024-04-15T03:25:03.685236754Z [2024-04-15T03:25:03.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status success for try_number 1 2024-04-15T03:25:03.696292989Z [2024-04-15T03:25:03.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70c91b1d-f1f5-46ab-8934-7cb414e0d100 2024-04-15T03:25:03.696610540Z [2024-04-15T03:25:03.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:20:00+00:00, map_index=-1, run_start_date=2024-04-15 03:25:02.976401+00:00, run_end_date=2024-04-15 03:25:03.344054+00:00, run_duration=0.367653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:25:00.588582+00:00, queued_by_job_id=2, pid=9224 2024-04-15T03:25:04.490963947Z [2024-04-15T03:25:04.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:25:04.491378560Z [2024-04-15T03:25:04.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:24:00+00:00, run_id=scheduled__2024-04-15T03:24:00+00:00, run_start_date=2024-04-15 03:25:00.516049+00:00, run_end_date=2024-04-15 03:25:04.490999+00:00, run_duration=3.97495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:24:00+00:00, data_interval_end=2024-04-15 03:25:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:25:04.500156480Z [2024-04-15T03:25:04.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:25:00+00:00, run_after=2024-04-15T03:26:00+00:00 2024-04-15T03:25:04.564241196Z [2024-04-15T03:25:04.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:24:00+00:00 exited with status success for try_number 1 2024-04-15T03:25:04.569659217Z [2024-04-15T03:25:04.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:24:00+00:00, map_index=-1, run_start_date=2024-04-15 03:25:03.155589+00:00, run_end_date=2024-04-15 03:25:04.343603+00:00, run_duration=1.188014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:25:00.588582+00:00, queued_by_job_id=2, pid=9225 2024-04-15T03:25:05.659262067Z [2024-04-15T03:25:05.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:25:05.659973409Z [2024-04-15T03:25:05.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:24:00+00:00, run_id=scheduled__2024-04-15T03:24:00+00:00, run_start_date=2024-04-15 03:25:00.517405+00:00, run_end_date=2024-04-15 03:25:05.659401+00:00, run_duration=5.141996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:24:00+00:00, data_interval_end=2024-04-15 03:25:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:25:05.672259104Z [2024-04-15T03:25:05.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:25:00+00:00, run_after=2024-04-15T03:26:00+00:00 2024-04-15T03:25:05.708444217Z [2024-04-15T03:25:05.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:24:00+00:00 exited with status success for try_number 1 2024-04-15T03:25:05.713079199Z [2024-04-15T03:25:05.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:24:00+00:00, map_index=-1, run_start_date=2024-04-15 03:25:02.901135+00:00, run_end_date=2024-04-15 03:25:04.702970+00:00, run_duration=1.801835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:25:00.588582+00:00, queued_by_job_id=2, pid=9223 2024-04-15T03:25:06.794112365Z [2024-04-15T03:25:06.793+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:25:06.794167150Z 2024-04-15T03:25:06.794177459Z [2024-04-15T03:25:06.793+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:25:06.794520540Z [2024-04-15T03:25:06.794+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:25:06.794541204Z 2024-04-15T03:25:06.802159038Z [2024-04-15T03:25:06.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:25:06.802557254Z [2024-04-15T03:25:06.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:25:06.882061062Z [2024-04-15T03:25:06.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status queued for try_number 1 2024-04-15T03:25:06.882346815Z [2024-04-15T03:25:06.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status success for try_number 1 2024-04-15T03:25:06.890673555Z [2024-04-15T03:25:06.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86fe18ad-79e5-48f8-9c5f-cf2c3b8d06fd 2024-04-15T03:25:06.890970431Z [2024-04-15T03:25:06.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:20:00+00:00, map_index=-1, run_start_date=2024-04-15 03:25:05.463889+00:00, run_end_date=2024-04-15 03:25:05.810192+00:00, run_duration=0.346303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:25:03.618875+00:00, queued_by_job_id=2, pid=9264 2024-04-15T03:25:10.773392926Z [2024-04-15T03:25:10.772+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:25:10.773429336Z 2024-04-15T03:25:10.773790075Z [2024-04-15T03:25:10.773+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:25:10.775791039Z [2024-04-15T03:25:10.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:25:10.775810852Z 2024-04-15T03:25:10.780672907Z [2024-04-15T03:25:10.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:25:10.781295631Z [2024-04-15T03:25:10.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:25:10.843892412Z [2024-04-15T03:25:10.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status queued for try_number 1 2024-04-15T03:25:10.844048653Z [2024-04-15T03:25:10.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status success for try_number 1 2024-04-15T03:25:10.853809325Z [2024-04-15T03:25:10.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c49aa4d-af42-43df-83da-997de1bc621a 2024-04-15T03:25:10.854055818Z [2024-04-15T03:25:10.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:20:00+00:00, map_index=0, run_start_date=2024-04-15 03:25:08.411994+00:00, run_end_date=2024-04-15 03:25:10.166052+00:00, run_duration=1.754058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:25:06.794886+00:00, queued_by_job_id=2, pid=9276 2024-04-15T03:25:13.094447343Z [2024-04-15T03:25:13.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:25:13.094736812Z [2024-04-15T03:25:13.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:20:00+00:00, run_id=scheduled__2024-04-15T03:20:00+00:00, run_start_date=2024-04-15 03:25:00.514748+00:00, run_end_date=2024-04-15 03:25:13.094333+00:00, run_duration=12.579585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:20:00+00:00, data_interval_end=2024-04-15 03:25:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:25:13.106757933Z [2024-04-15T03:25:13.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:25:00+00:00, run_after=2024-04-15T03:30:00+00:00 2024-04-15T03:25:13.780936470Z [2024-04-15T03:25:13.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:20:00+00:00 exited with status success for try_number 1 2024-04-15T03:25:13.786536462Z [2024-04-15T03:25:13.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:20:00+00:00, map_index=-1, run_start_date=2024-04-15 03:25:12.476832+00:00, run_end_date=2024-04-15 03:25:12.974120+00:00, run_duration=0.497288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:25:10.776872+00:00, queued_by_job_id=2, pid=9297 2024-04-15T03:25:41.355289542Z [2024-04-15T03:25:41.354+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:25:45.077440562Z [2024-04-15T03:25:45.077+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:25:45.077489682Z 2024-04-15T03:25:45.077625888Z [2024-04-15T03:25:45.077+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-15T03:25:45.078197591Z [2024-04-15T03:25:45.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:25:45.078221756Z 2024-04-15T03:25:45.080622632Z [2024-04-15T03:25:45.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240415032543_944907', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:25:45.080901788Z [2024-04-15T03:25:45.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240415032543_944907', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-15T03:25:45.138945238Z [2024-04-15T03:25:45.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415032543_944907 exited with status queued for try_number 1 2024-04-15T03:25:45.143412358Z [2024-04-15T03:25:45.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86b7740f-1bc4-4a7c-b642-5cc07c4817e4 2024-04-15T03:25:46.288600607Z [2024-04-15T03:25:46.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:25:46.288895441Z [2024-04-15T03:25:46.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-15 03:25:43.946867+00:00, run_id=scaleout_vdu_20240415032543_944907, run_start_date=2024-04-15 03:25:45.037185+00:00, run_end_date=2024-04-15 03:25:46.288438+00:00, run_duration=1.251253, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 03:25:43.946867+00:00, data_interval_end=2024-04-15 03:25:43.946867+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-15T03:25:46.292132317Z [2024-04-15T03:25:46.291+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-15T03:25:46.672186343Z [2024-04-15T03:25:46.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415032543_944907 exited with status success for try_number 1 2024-04-15T03:25:46.681189161Z [2024-04-15T03:25:46.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240415032543_944907, map_index=-1, run_start_date=2024-04-15 03:25:45.790623+00:00, run_end_date=2024-04-15 03:25:46.138261+00:00, run_duration=0.347638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:25:45.078486+00:00, queued_by_job_id=2, pid=9311 2024-04-15T03:26:00.408202367Z [2024-04-15T03:26:00.407+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:26:00.420532911Z [2024-04-15T03:26:00.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:26:00+00:00, run_after=2024-04-15T03:27:00+00:00 2024-04-15T03:26:00.427034328Z [2024-04-15T03:26:00.426+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:26:00.476502464Z [2024-04-15T03:26:00.476+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:26:00.476524894Z 2024-04-15T03:26:00.476529398Z 2024-04-15T03:26:00.476532655Z 2024-04-15T03:26:00.476773250Z [2024-04-15T03:26:00.476+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:26:00.476931315Z [2024-04-15T03:26:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:26:00.477130876Z [2024-04-15T03:26:00.476+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:26:00.477754602Z [2024-04-15T03:26:00.477+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:26:00.477766984Z 2024-04-15T03:26:00.477778439Z 2024-04-15T03:26:00.477781791Z 2024-04-15T03:26:00.480265267Z [2024-04-15T03:26:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:26:00.480518077Z [2024-04-15T03:26:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:26:00.480905755Z [2024-04-15T03:26:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:26:00.481088401Z [2024-04-15T03:26:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:26:00.481433873Z [2024-04-15T03:26:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:26:00.481612441Z [2024-04-15T03:26:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:26:00.832627302Z [2024-04-15T03:26:00.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:24:00+00:00 exited with status queued for try_number 1 2024-04-15T03:26:00.832659595Z [2024-04-15T03:26:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status queued for try_number 1 2024-04-15T03:26:00.832663384Z [2024-04-15T03:26:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status queued for try_number 1 2024-04-15T03:26:00.847238003Z [2024-04-15T03:26:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64ac7cf2-72b8-4024-9db2-0e711f28ca69 2024-04-15T03:26:00.847278267Z [2024-04-15T03:26:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1553e2d3-9df5-4a14-a5ae-f753de22d801 2024-04-15T03:26:00.847328663Z [2024-04-15T03:26:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dc638fe-b2ca-49e8-9f38-8058cfef6cf6 2024-04-15T03:26:02.876886682Z [2024-04-15T03:26:02.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:26:02.876914083Z [2024-04-15T03:26:02.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:24:00+00:00, run_id=scheduled__2024-04-15T03:24:00+00:00, run_start_date=2024-04-15 03:26:00.437019+00:00, run_end_date=2024-04-15 03:26:02.874687+00:00, run_duration=2.437668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:24:00+00:00, data_interval_end=2024-04-15 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:26:02.894300111Z [2024-04-15T03:26:02.893+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:26:00+00:00, run_after=2024-04-15T03:28:00+00:00 2024-04-15T03:26:02.965259898Z [2024-04-15T03:26:02.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:24:00+00:00 exited with status success for try_number 1 2024-04-15T03:26:02.969379474Z [2024-04-15T03:26:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:24:00+00:00, map_index=-1, run_start_date=2024-04-15 03:26:01.292509+00:00, run_end_date=2024-04-15 03:26:01.871582+00:00, run_duration=0.579073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:26:00.478362+00:00, queued_by_job_id=2, pid=9324 2024-04-15T03:26:04.133371643Z [2024-04-15T03:26:04.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:26:04.133577204Z [2024-04-15T03:26:04.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:25:00+00:00, run_id=scheduled__2024-04-15T03:25:00+00:00, run_start_date=2024-04-15 03:26:00.438221+00:00, run_end_date=2024-04-15 03:26:04.133132+00:00, run_duration=3.694911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:25:00+00:00, data_interval_end=2024-04-15 03:26:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:26:04.146528263Z [2024-04-15T03:26:04.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:26:00+00:00, run_after=2024-04-15T03:27:00+00:00 2024-04-15T03:26:04.204683429Z [2024-04-15T03:26:04.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status success for try_number 1 2024-04-15T03:26:04.212671657Z [2024-04-15T03:26:04.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:25:00+00:00, map_index=-1, run_start_date=2024-04-15 03:26:02.529795+00:00, run_end_date=2024-04-15 03:26:03.940139+00:00, run_duration=1.410344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:26:00.478362+00:00, queued_by_job_id=2, pid=9345 2024-04-15T03:26:05.951541656Z [2024-04-15T03:26:05.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:26:05.951658175Z [2024-04-15T03:26:05.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:25:00+00:00, run_id=scheduled__2024-04-15T03:25:00+00:00, run_start_date=2024-04-15 03:26:00.439136+00:00, run_end_date=2024-04-15 03:26:05.951210+00:00, run_duration=5.512074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:25:00+00:00, data_interval_end=2024-04-15 03:26:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:26:05.959751093Z [2024-04-15T03:26:05.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:26:00+00:00, run_after=2024-04-15T03:27:00+00:00 2024-04-15T03:26:05.990270780Z [2024-04-15T03:26:05.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status success for try_number 1 2024-04-15T03:26:05.995189007Z [2024-04-15T03:26:05.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:25:00+00:00, map_index=-1, run_start_date=2024-04-15 03:26:03.044770+00:00, run_end_date=2024-04-15 03:26:05.287468+00:00, run_duration=2.242698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:26:00.478362+00:00, queued_by_job_id=2, pid=9364 2024-04-15T03:27:01.012065742Z [2024-04-15T03:27:01.011+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:27:01.033444726Z [2024-04-15T03:27:01.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:27:00+00:00, run_after=2024-04-15T03:28:00+00:00 2024-04-15T03:27:01.099361667Z [2024-04-15T03:27:01.099+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:27:01.099411584Z 2024-04-15T03:27:01.099422655Z 2024-04-15T03:27:01.099444372Z [2024-04-15T03:27:01.099+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:27:01.099606810Z [2024-04-15T03:27:01.099+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:27:01.100397416Z [2024-04-15T03:27:01.100+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:27:01.100411667Z 2024-04-15T03:27:01.100420041Z 2024-04-15T03:27:01.104299200Z [2024-04-15T03:27:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:27:01.104475933Z [2024-04-15T03:27:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:27:01.104701129Z [2024-04-15T03:27:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:27:01.104857533Z [2024-04-15T03:27:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:27:01.264221880Z [2024-04-15T03:27:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:26:00+00:00 exited with status queued for try_number 1 2024-04-15T03:27:01.264248018Z [2024-04-15T03:27:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:26:00+00:00 exited with status queued for try_number 1 2024-04-15T03:27:01.272799626Z [2024-04-15T03:27:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf50648f-5e87-4b0a-8062-4ca72fd2fd62 2024-04-15T03:27:01.272830889Z [2024-04-15T03:27:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f7e3b76-0d92-437d-be0b-f482c90fad21 2024-04-15T03:27:04.614425540Z [2024-04-15T03:27:04.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:27:04.614724603Z [2024-04-15T03:27:04.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:26:00+00:00, run_id=scheduled__2024-04-15T03:26:00+00:00, run_start_date=2024-04-15 03:27:01.050204+00:00, run_end_date=2024-04-15 03:27:04.614170+00:00, run_duration=3.563966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:26:00+00:00, data_interval_end=2024-04-15 03:27:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:27:04.627264974Z [2024-04-15T03:27:04.626+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:27:00+00:00, run_after=2024-04-15T03:28:00+00:00 2024-04-15T03:27:04.670713046Z [2024-04-15T03:27:04.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:26:00+00:00 exited with status success for try_number 1 2024-04-15T03:27:04.678516766Z [2024-04-15T03:27:04.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:26:00+00:00, map_index=-1, run_start_date=2024-04-15 03:27:02.984611+00:00, run_end_date=2024-04-15 03:27:04.337796+00:00, run_duration=1.353185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:27:01.101102+00:00, queued_by_job_id=2, pid=9409 2024-04-15T03:27:05.769072179Z [2024-04-15T03:27:05.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:27:05.769461890Z [2024-04-15T03:27:05.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:26:00+00:00, run_id=scheduled__2024-04-15T03:26:00+00:00, run_start_date=2024-04-15 03:27:01.052872+00:00, run_end_date=2024-04-15 03:27:05.769163+00:00, run_duration=4.716291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:26:00+00:00, data_interval_end=2024-04-15 03:27:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:27:05.776914250Z [2024-04-15T03:27:05.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:27:00+00:00, run_after=2024-04-15T03:28:00+00:00 2024-04-15T03:27:05.803629166Z [2024-04-15T03:27:05.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:26:00+00:00 exited with status success for try_number 1 2024-04-15T03:27:05.808375328Z [2024-04-15T03:27:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:26:00+00:00, map_index=-1, run_start_date=2024-04-15 03:27:02.989603+00:00, run_end_date=2024-04-15 03:27:05.415661+00:00, run_duration=2.426058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:27:01.101102+00:00, queued_by_job_id=2, pid=9410 2024-04-15T03:28:00.822077176Z [2024-04-15T03:28:00.820+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:28:00.834584335Z [2024-04-15T03:28:00.831+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:28:00.856875652Z [2024-04-15T03:28:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:28:00+00:00, run_after=2024-04-15T03:29:00+00:00 2024-04-15T03:28:00.923482444Z [2024-04-15T03:28:00.923+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:28:00.923513005Z 2024-04-15T03:28:00.923519629Z 2024-04-15T03:28:00.923524002Z 2024-04-15T03:28:00.923597173Z [2024-04-15T03:28:00.923+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:28:00.923620595Z [2024-04-15T03:28:00.923+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:28:00.923673883Z [2024-04-15T03:28:00.923+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:28:00.924136875Z [2024-04-15T03:28:00.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:28:00.924150619Z 2024-04-15T03:28:00.924156572Z 2024-04-15T03:28:00.924169199Z 2024-04-15T03:28:00.927950317Z [2024-04-15T03:28:00.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:28:00.928034266Z [2024-04-15T03:28:00.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:28:00.928174589Z [2024-04-15T03:28:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:28:00.928329794Z [2024-04-15T03:28:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:28:00.928566945Z [2024-04-15T03:28:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:28:00.928642639Z [2024-04-15T03:28:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:28:01.232178986Z [2024-04-15T03:28:01.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:26:00+00:00 exited with status queued for try_number 1 2024-04-15T03:28:01.232265900Z [2024-04-15T03:28:01.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:27:00+00:00 exited with status queued for try_number 1 2024-04-15T03:28:01.232270925Z [2024-04-15T03:28:01.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:27:00+00:00 exited with status queued for try_number 1 2024-04-15T03:28:01.239420644Z [2024-04-15T03:28:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bad6cc7-3291-4a96-b21d-a56587a895fa 2024-04-15T03:28:01.239525142Z [2024-04-15T03:28:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe40935d-90a6-4cdb-845f-1fdbf7494151 2024-04-15T03:28:01.239564129Z [2024-04-15T03:28:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e011f9d-25a4-464e-822e-52e8380cc9f0 2024-04-15T03:28:02.728882192Z [2024-04-15T03:28:02.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:28:02.729594687Z [2024-04-15T03:28:02.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:26:00+00:00, run_id=scheduled__2024-04-15T03:26:00+00:00, run_start_date=2024-04-15 03:28:00.868603+00:00, run_end_date=2024-04-15 03:28:02.728962+00:00, run_duration=1.860359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:26:00+00:00, data_interval_end=2024-04-15 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:28:02.741456269Z [2024-04-15T03:28:02.740+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:28:00+00:00, run_after=2024-04-15T03:30:00+00:00 2024-04-15T03:28:02.789051822Z [2024-04-15T03:28:02.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:26:00+00:00 exited with status success for try_number 1 2024-04-15T03:28:02.795736463Z [2024-04-15T03:28:02.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:26:00+00:00, map_index=-1, run_start_date=2024-04-15 03:28:02.077142+00:00, run_end_date=2024-04-15 03:28:02.453213+00:00, run_duration=0.376071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:28:00.925104+00:00, queued_by_job_id=2, pid=9446 2024-04-15T03:28:04.997751471Z [2024-04-15T03:28:04.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:28:04.998338014Z [2024-04-15T03:28:04.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:27:00+00:00, run_id=scheduled__2024-04-15T03:27:00+00:00, run_start_date=2024-04-15 03:28:00.869947+00:00, run_end_date=2024-04-15 03:28:04.997591+00:00, run_duration=4.127644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:27:00+00:00, data_interval_end=2024-04-15 03:28:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:28:05.013923579Z [2024-04-15T03:28:05.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:28:00+00:00, run_after=2024-04-15T03:29:00+00:00 2024-04-15T03:28:05.082141083Z [2024-04-15T03:28:05.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:27:00+00:00 exited with status success for try_number 1 2024-04-15T03:28:05.093333865Z [2024-04-15T03:28:05.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:27:00+00:00, map_index=-1, run_start_date=2024-04-15 03:28:02.982680+00:00, run_end_date=2024-04-15 03:28:04.162728+00:00, run_duration=1.180048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:28:00.925104+00:00, queued_by_job_id=2, pid=9466 2024-04-15T03:28:06.154400101Z [2024-04-15T03:28:06.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:28:06.154433172Z [2024-04-15T03:28:06.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:27:00+00:00, run_id=scheduled__2024-04-15T03:27:00+00:00, run_start_date=2024-04-15 03:28:00.870973+00:00, run_end_date=2024-04-15 03:28:06.154137+00:00, run_duration=5.283164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:27:00+00:00, data_interval_end=2024-04-15 03:28:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:28:06.162321797Z [2024-04-15T03:28:06.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:28:00+00:00, run_after=2024-04-15T03:29:00+00:00 2024-04-15T03:28:06.195644985Z [2024-04-15T03:28:06.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:27:00+00:00 exited with status success for try_number 1 2024-04-15T03:28:06.200984859Z [2024-04-15T03:28:06.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:27:00+00:00, map_index=-1, run_start_date=2024-04-15 03:28:03.429654+00:00, run_end_date=2024-04-15 03:28:05.163196+00:00, run_duration=1.733542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:28:00.925104+00:00, queued_by_job_id=2, pid=9485 2024-04-15T03:29:00.759210816Z [2024-04-15T03:29:00.758+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:29:00.772421158Z [2024-04-15T03:29:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:29:00+00:00, run_after=2024-04-15T03:30:00+00:00 2024-04-15T03:29:00.829179778Z [2024-04-15T03:29:00.828+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:29:00.829209912Z 2024-04-15T03:29:00.829215593Z 2024-04-15T03:29:00.829220471Z [2024-04-15T03:29:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:29:00.829225296Z [2024-04-15T03:29:00.828+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:29:00.829480404Z [2024-04-15T03:29:00.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:29:00.829507611Z 2024-04-15T03:29:00.829512709Z 2024-04-15T03:29:00.832137780Z [2024-04-15T03:29:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:29:00.832164311Z [2024-04-15T03:29:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:29:00.832414993Z [2024-04-15T03:29:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:29:00.832438680Z [2024-04-15T03:29:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:29:01.034734262Z [2024-04-15T03:29:01.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:28:00+00:00 exited with status queued for try_number 1 2024-04-15T03:29:01.034935080Z [2024-04-15T03:29:01.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:28:00+00:00 exited with status queued for try_number 1 2024-04-15T03:29:01.043179626Z [2024-04-15T03:29:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12dac5d5-b80f-469d-86c7-b84b86190122 2024-04-15T03:29:01.043437974Z [2024-04-15T03:29:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a0df226-3796-4676-b866-0b1630de8050 2024-04-15T03:29:04.824307237Z [2024-04-15T03:29:04.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:29:04.824466038Z [2024-04-15T03:29:04.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:28:00+00:00, run_id=scheduled__2024-04-15T03:28:00+00:00, run_start_date=2024-04-15 03:29:00.787910+00:00, run_end_date=2024-04-15 03:29:04.824125+00:00, run_duration=4.036215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:28:00+00:00, data_interval_end=2024-04-15 03:29:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:29:04.834287951Z [2024-04-15T03:29:04.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:29:00+00:00, run_after=2024-04-15T03:30:00+00:00 2024-04-15T03:29:04.840088832Z [2024-04-15T03:29:04.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:29:04.840229890Z [2024-04-15T03:29:04.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:28:00+00:00, run_id=scheduled__2024-04-15T03:28:00+00:00, run_start_date=2024-04-15 03:29:00.786487+00:00, run_end_date=2024-04-15 03:29:04.840002+00:00, run_duration=4.053515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:28:00+00:00, data_interval_end=2024-04-15 03:29:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:29:04.857623581Z [2024-04-15T03:29:04.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:29:00+00:00, run_after=2024-04-15T03:30:00+00:00 2024-04-15T03:29:04.893247664Z [2024-04-15T03:29:04.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:28:00+00:00 exited with status success for try_number 1 2024-04-15T03:29:04.893266562Z [2024-04-15T03:29:04.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:28:00+00:00 exited with status success for try_number 1 2024-04-15T03:29:04.896271966Z [2024-04-15T03:29:04.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:28:00+00:00, map_index=-1, run_start_date=2024-04-15 03:29:02.918800+00:00, run_end_date=2024-04-15 03:29:04.172475+00:00, run_duration=1.253675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:29:00.829955+00:00, queued_by_job_id=2, pid=9532 2024-04-15T03:29:04.896372707Z [2024-04-15T03:29:04.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:28:00+00:00, map_index=-1, run_start_date=2024-04-15 03:29:02.742598+00:00, run_end_date=2024-04-15 03:29:04.517870+00:00, run_duration=1.775272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:29:00.829955+00:00, queued_by_job_id=2, pid=9531 2024-04-15T03:30:00.751534999Z [2024-04-15T03:30:00.751+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:30:00.768349389Z [2024-04-15T03:30:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:30:00+00:00, run_after=2024-04-15T03:35:00+00:00 2024-04-15T03:30:00.786658938Z [2024-04-15T03:30:00.782+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:30:00.810063910Z [2024-04-15T03:30:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:30:00+00:00, run_after=2024-04-15T03:31:00+00:00 2024-04-15T03:30:00.885595664Z [2024-04-15T03:30:00.885+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T03:30:00.885622446Z 2024-04-15T03:30:00.885627696Z 2024-04-15T03:30:00.885633103Z 2024-04-15T03:30:00.885637485Z 2024-04-15T03:30:00.886175925Z [2024-04-15T03:30:00.885+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:30:00.886306956Z [2024-04-15T03:30:00.886+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:30:00.886462666Z [2024-04-15T03:30:00.886+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:30:00.886612797Z [2024-04-15T03:30:00.886+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:30:00.887261722Z [2024-04-15T03:30:00.887+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:30:00.887276703Z 2024-04-15T03:30:00.887282399Z 2024-04-15T03:30:00.887287671Z 2024-04-15T03:30:00.887292058Z 2024-04-15T03:30:00.891559158Z [2024-04-15T03:30:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:30:00.891708103Z [2024-04-15T03:30:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:30:00.891968313Z [2024-04-15T03:30:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:30:00.892100860Z [2024-04-15T03:30:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:30:00.892328010Z [2024-04-15T03:30:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:30:00.892466159Z [2024-04-15T03:30:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:30:00.892712917Z [2024-04-15T03:30:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:30:00.892908747Z [2024-04-15T03:30:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:30:01.265850550Z [2024-04-15T03:30:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status queued for try_number 1 2024-04-15T03:30:01.267197750Z [2024-04-15T03:30:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:28:00+00:00 exited with status queued for try_number 1 2024-04-15T03:30:01.267432670Z [2024-04-15T03:30:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:29:00+00:00 exited with status queued for try_number 1 2024-04-15T03:30:01.267651924Z [2024-04-15T03:30:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:29:00+00:00 exited with status queued for try_number 1 2024-04-15T03:30:01.285443057Z [2024-04-15T03:30:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 919c5770-f853-4930-b0ae-c9b0b6e67ce7 2024-04-15T03:30:01.285761511Z [2024-04-15T03:30:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9a15e0f-396b-4de9-9f83-f64f6e32622d 2024-04-15T03:30:01.286029837Z [2024-04-15T03:30:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to c441848a-2126-4f14-84cd-28ec4be8cfcd 2024-04-15T03:30:01.286275455Z [2024-04-15T03:30:01.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9539e642-efbf-498b-8766-59c583002d3a 2024-04-15T03:30:02.932565593Z [2024-04-15T03:30:02.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:30:02.932591013Z [2024-04-15T03:30:02.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:28:00+00:00, run_id=scheduled__2024-04-15T03:28:00+00:00, run_start_date=2024-04-15 03:30:00.818266+00:00, run_end_date=2024-04-15 03:30:02.927101+00:00, run_duration=2.108835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:28:00+00:00, data_interval_end=2024-04-15 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:30:02.948388750Z [2024-04-15T03:30:02.948+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:30:00+00:00, run_after=2024-04-15T03:32:00+00:00 2024-04-15T03:30:03.061196984Z [2024-04-15T03:30:03.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:28:00+00:00 exited with status success for try_number 1 2024-04-15T03:30:03.071578796Z [2024-04-15T03:30:03.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:28:00+00:00, map_index=-1, run_start_date=2024-04-15 03:30:02.314946+00:00, run_end_date=2024-04-15 03:30:02.789680+00:00, run_duration=0.474734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:30:00.888752+00:00, queued_by_job_id=2, pid=9569 2024-04-15T03:30:04.164690416Z [2024-04-15T03:30:04.164+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:30:04.164718266Z 2024-04-15T03:30:04.164791677Z [2024-04-15T03:30:04.164+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:30:04.165978091Z [2024-04-15T03:30:04.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:30:04.165994574Z 2024-04-15T03:30:04.168484836Z [2024-04-15T03:30:04.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:30:04.168743099Z [2024-04-15T03:30:04.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:30:04.228609532Z [2024-04-15T03:30:04.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status queued for try_number 1 2024-04-15T03:30:04.229671840Z [2024-04-15T03:30:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status success for try_number 1 2024-04-15T03:30:04.241706794Z [2024-04-15T03:30:04.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d8dafdb-e520-44bd-9d9d-12d9431c2cfd 2024-04-15T03:30:04.242229311Z [2024-04-15T03:30:04.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:25:00+00:00, map_index=-1, run_start_date=2024-04-15 03:30:03.229820+00:00, run_end_date=2024-04-15 03:30:03.583362+00:00, run_duration=0.353542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:30:00.888752+00:00, queued_by_job_id=2, pid=9590 2024-04-15T03:30:05.851709418Z [2024-04-15T03:30:05.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:30:05.852346732Z [2024-04-15T03:30:05.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:29:00+00:00, run_id=scheduled__2024-04-15T03:29:00+00:00, run_start_date=2024-04-15 03:30:00.820011+00:00, run_end_date=2024-04-15 03:30:05.851599+00:00, run_duration=5.031588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:29:00+00:00, data_interval_end=2024-04-15 03:30:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:30:05.864608180Z [2024-04-15T03:30:05.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:30:00+00:00, run_after=2024-04-15T03:31:00+00:00 2024-04-15T03:30:05.872015442Z [2024-04-15T03:30:05.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:30:05.872382116Z [2024-04-15T03:30:05.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:29:00+00:00, run_id=scheduled__2024-04-15T03:29:00+00:00, run_start_date=2024-04-15 03:30:00.819122+00:00, run_end_date=2024-04-15 03:30:05.871915+00:00, run_duration=5.052793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:29:00+00:00, data_interval_end=2024-04-15 03:30:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:30:05.882635921Z [2024-04-15T03:30:05.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:30:00+00:00, run_after=2024-04-15T03:31:00+00:00 2024-04-15T03:30:05.930635480Z [2024-04-15T03:30:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:29:00+00:00 exited with status success for try_number 1 2024-04-15T03:30:05.930796534Z [2024-04-15T03:30:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:29:00+00:00 exited with status success for try_number 1 2024-04-15T03:30:05.936879021Z [2024-04-15T03:30:05.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:29:00+00:00, map_index=-1, run_start_date=2024-04-15 03:30:03.762868+00:00, run_end_date=2024-04-15 03:30:05.371925+00:00, run_duration=1.609057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:30:00.888752+00:00, queued_by_job_id=2, pid=9618 2024-04-15T03:30:05.937078739Z [2024-04-15T03:30:05.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:29:00+00:00, map_index=-1, run_start_date=2024-04-15 03:30:03.920894+00:00, run_end_date=2024-04-15 03:30:05.201713+00:00, run_duration=1.280819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:30:00.888752+00:00, queued_by_job_id=2, pid=9619 2024-04-15T03:30:07.025681062Z [2024-04-15T03:30:07.025+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:30:07.025715410Z 2024-04-15T03:30:07.025895680Z [2024-04-15T03:30:07.025+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:30:07.027314201Z [2024-04-15T03:30:07.026+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:30:07.027331429Z 2024-04-15T03:30:07.030573900Z [2024-04-15T03:30:07.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:30:07.030742319Z [2024-04-15T03:30:07.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:30:07.107924725Z [2024-04-15T03:30:07.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status queued for try_number 1 2024-04-15T03:30:07.108013685Z [2024-04-15T03:30:07.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status success for try_number 1 2024-04-15T03:30:07.119189759Z [2024-04-15T03:30:07.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0c15166-6c6f-4080-ae26-15f40f6a088c 2024-04-15T03:30:07.119686208Z [2024-04-15T03:30:07.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:25:00+00:00, map_index=-1, run_start_date=2024-04-15 03:30:05.771620+00:00, run_end_date=2024-04-15 03:30:06.118442+00:00, run_duration=0.346822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:30:04.166358+00:00, queued_by_job_id=2, pid=9648 2024-04-15T03:30:11.050676019Z [2024-04-15T03:30:11.050+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:30:11.050705787Z 2024-04-15T03:30:11.050784634Z [2024-04-15T03:30:11.050+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:30:11.051394253Z [2024-04-15T03:30:11.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:30:11.051405163Z 2024-04-15T03:30:11.053864735Z [2024-04-15T03:30:11.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:30:11.053995672Z [2024-04-15T03:30:11.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:30:11.118610385Z [2024-04-15T03:30:11.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status queued for try_number 1 2024-04-15T03:30:11.118688409Z [2024-04-15T03:30:11.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status success for try_number 1 2024-04-15T03:30:11.130893491Z [2024-04-15T03:30:11.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0313b56-fa16-43f4-9e5e-aec6ef9b5c21 2024-04-15T03:30:11.131264993Z [2024-04-15T03:30:11.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:25:00+00:00, map_index=0, run_start_date=2024-04-15 03:30:08.792428+00:00, run_end_date=2024-04-15 03:30:09.918786+00:00, run_duration=1.126358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:30:07.027922+00:00, queued_by_job_id=2, pid=9660 2024-04-15T03:30:13.367249650Z [2024-04-15T03:30:13.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:30:13.367711586Z [2024-04-15T03:30:13.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:25:00+00:00, run_id=scheduled__2024-04-15T03:25:00+00:00, run_start_date=2024-04-15 03:30:00.817200+00:00, run_end_date=2024-04-15 03:30:13.367197+00:00, run_duration=12.549997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:25:00+00:00, data_interval_end=2024-04-15 03:30:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:30:13.378799684Z [2024-04-15T03:30:13.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:30:00+00:00, run_after=2024-04-15T03:35:00+00:00 2024-04-15T03:30:13.411707943Z [2024-04-15T03:30:13.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:25:00+00:00 exited with status success for try_number 1 2024-04-15T03:30:13.417151194Z [2024-04-15T03:30:13.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:25:00+00:00, map_index=-1, run_start_date=2024-04-15 03:30:12.652296+00:00, run_end_date=2024-04-15 03:30:13.008036+00:00, run_duration=0.35574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:30:11.051694+00:00, queued_by_job_id=2, pid=9681 2024-04-15T03:30:41.409272046Z [2024-04-15T03:30:41.408+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:31:00.537512265Z [2024-04-15T03:31:00.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:31:00+00:00, run_after=2024-04-15T03:32:00+00:00 2024-04-15T03:31:00.545329818Z [2024-04-15T03:31:00.544+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:31:00.612485256Z [2024-04-15T03:31:00.611+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:31:00.612529301Z 2024-04-15T03:31:00.612540589Z 2024-04-15T03:31:00.613585427Z [2024-04-15T03:31:00.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:31:00.614084480Z [2024-04-15T03:31:00.613+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:31:00.615303835Z [2024-04-15T03:31:00.614+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:31:00.615322573Z 2024-04-15T03:31:00.615329057Z 2024-04-15T03:31:00.620181485Z [2024-04-15T03:31:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:31:00.620641934Z [2024-04-15T03:31:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:31:00.621505820Z [2024-04-15T03:31:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:31:00.622035898Z [2024-04-15T03:31:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:31:00.799342826Z [2024-04-15T03:31:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status queued for try_number 1 2024-04-15T03:31:00.799362463Z [2024-04-15T03:31:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status queued for try_number 1 2024-04-15T03:31:00.802086460Z [2024-04-15T03:31:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 208c1597-6bbe-44de-9142-9a7b58237b4d 2024-04-15T03:31:00.802111446Z [2024-04-15T03:31:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26491b5e-a700-4ba9-a2de-06112c60cc98 2024-04-15T03:31:05.535028038Z [2024-04-15T03:31:05.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:31:05.535664263Z [2024-04-15T03:31:05.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:30:00+00:00, run_id=scheduled__2024-04-15T03:30:00+00:00, run_start_date=2024-04-15 03:31:00.557616+00:00, run_end_date=2024-04-15 03:31:05.534999+00:00, run_duration=4.977383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:30:00+00:00, data_interval_end=2024-04-15 03:31:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:31:05.549690514Z [2024-04-15T03:31:05.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:31:00+00:00, run_after=2024-04-15T03:32:00+00:00 2024-04-15T03:31:05.565449195Z [2024-04-15T03:31:05.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:31:05.566231839Z [2024-04-15T03:31:05.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:30:00+00:00, run_id=scheduled__2024-04-15T03:30:00+00:00, run_start_date=2024-04-15 03:31:00.558904+00:00, run_end_date=2024-04-15 03:31:05.565405+00:00, run_duration=5.006501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:30:00+00:00, data_interval_end=2024-04-15 03:31:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:31:05.582670856Z [2024-04-15T03:31:05.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:31:00+00:00, run_after=2024-04-15T03:32:00+00:00 2024-04-15T03:31:05.627659277Z [2024-04-15T03:31:05.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status success for try_number 1 2024-04-15T03:31:05.627692988Z [2024-04-15T03:31:05.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status success for try_number 1 2024-04-15T03:31:05.640473048Z [2024-04-15T03:31:05.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:30:00+00:00, map_index=-1, run_start_date=2024-04-15 03:31:03.053048+00:00, run_end_date=2024-04-15 03:31:04.962541+00:00, run_duration=1.909493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:31:00.616464+00:00, queued_by_job_id=2, pid=9719 2024-04-15T03:31:05.640943689Z [2024-04-15T03:31:05.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:30:00+00:00, map_index=-1, run_start_date=2024-04-15 03:31:02.909334+00:00, run_end_date=2024-04-15 03:31:04.997124+00:00, run_duration=2.08779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:31:00.616464+00:00, queued_by_job_id=2, pid=9718 2024-04-15T03:32:01.018197405Z [2024-04-15T03:32:01.017+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:32:00+00:00, run_after=2024-04-15T03:33:00+00:00 2024-04-15T03:32:01.025408903Z [2024-04-15T03:32:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:32:01.031568446Z [2024-04-15T03:32:01.031+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:32:01.085226204Z [2024-04-15T03:32:01.084+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:32:01.085248985Z 2024-04-15T03:32:01.085253382Z 2024-04-15T03:32:01.085256941Z 2024-04-15T03:32:01.085354875Z [2024-04-15T03:32:01.085+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:32:01.085379705Z [2024-04-15T03:32:01.085+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:32:01.085404759Z [2024-04-15T03:32:01.085+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:32:01.085990664Z [2024-04-15T03:32:01.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:32:01.086009029Z 2024-04-15T03:32:01.086015534Z 2024-04-15T03:32:01.086021321Z 2024-04-15T03:32:01.088704381Z [2024-04-15T03:32:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:32:01.088780346Z [2024-04-15T03:32:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:32:01.089036869Z [2024-04-15T03:32:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:32:01.089196871Z [2024-04-15T03:32:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:32:01.089392829Z [2024-04-15T03:32:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:32:01.089465057Z [2024-04-15T03:32:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:32:01.430474683Z [2024-04-15T03:32:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status queued for try_number 1 2024-04-15T03:32:01.430721003Z [2024-04-15T03:32:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:31:00+00:00 exited with status queued for try_number 1 2024-04-15T03:32:01.430878538Z [2024-04-15T03:32:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:31:00+00:00 exited with status queued for try_number 1 2024-04-15T03:32:01.449873533Z [2024-04-15T03:32:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1373ab34-cc3a-478e-af6d-8391808cc51b 2024-04-15T03:32:01.450221309Z [2024-04-15T03:32:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cb3e370-c77c-4e6b-bd9b-21fa8cb4e966 2024-04-15T03:32:01.450400656Z [2024-04-15T03:32:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0f929ca-d52a-4432-af3e-afe16f7cf6c4 2024-04-15T03:32:03.048900642Z [2024-04-15T03:32:03.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:32:03.049076875Z [2024-04-15T03:32:03.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:30:00+00:00, run_id=scheduled__2024-04-15T03:30:00+00:00, run_start_date=2024-04-15 03:32:01.040318+00:00, run_end_date=2024-04-15 03:32:03.048667+00:00, run_duration=2.008349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:30:00+00:00, data_interval_end=2024-04-15 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:32:03.055617756Z [2024-04-15T03:32:03.055+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:32:00+00:00, run_after=2024-04-15T03:34:00+00:00 2024-04-15T03:32:03.117249816Z [2024-04-15T03:32:03.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status success for try_number 1 2024-04-15T03:32:03.124149584Z [2024-04-15T03:32:03.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:30:00+00:00, map_index=-1, run_start_date=2024-04-15 03:32:01.943618+00:00, run_end_date=2024-04-15 03:32:02.366093+00:00, run_duration=0.422475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:32:01.086541+00:00, queued_by_job_id=2, pid=9754 2024-04-15T03:32:05.768811875Z [2024-04-15T03:32:05.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:32:05.769143702Z [2024-04-15T03:32:05.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:31:00+00:00, run_id=scheduled__2024-04-15T03:31:00+00:00, run_start_date=2024-04-15 03:32:01.041514+00:00, run_end_date=2024-04-15 03:32:05.768725+00:00, run_duration=4.727211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:31:00+00:00, data_interval_end=2024-04-15 03:32:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:32:05.778437546Z [2024-04-15T03:32:05.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:32:00+00:00, run_after=2024-04-15T03:33:00+00:00 2024-04-15T03:32:05.785463864Z [2024-04-15T03:32:05.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:32:05.785734573Z [2024-04-15T03:32:05.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:31:00+00:00, run_id=scheduled__2024-04-15T03:31:00+00:00, run_start_date=2024-04-15 03:32:01.042502+00:00, run_end_date=2024-04-15 03:32:05.785402+00:00, run_duration=4.7429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:31:00+00:00, data_interval_end=2024-04-15 03:32:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:32:05.794531886Z [2024-04-15T03:32:05.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:32:00+00:00, run_after=2024-04-15T03:33:00+00:00 2024-04-15T03:32:05.826648628Z [2024-04-15T03:32:05.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:31:00+00:00 exited with status success for try_number 1 2024-04-15T03:32:05.826677672Z [2024-04-15T03:32:05.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:31:00+00:00 exited with status success for try_number 1 2024-04-15T03:32:05.839098283Z [2024-04-15T03:32:05.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:31:00+00:00, map_index=-1, run_start_date=2024-04-15 03:32:03.310174+00:00, run_end_date=2024-04-15 03:32:05.085834+00:00, run_duration=1.77566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:32:01.086541+00:00, queued_by_job_id=2, pid=9785 2024-04-15T03:32:05.839248834Z [2024-04-15T03:32:05.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:31:00+00:00, map_index=-1, run_start_date=2024-04-15 03:32:03.281420+00:00, run_end_date=2024-04-15 03:32:04.682702+00:00, run_duration=1.401282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:32:01.086541+00:00, queued_by_job_id=2, pid=9784 2024-04-15T03:33:01.027004099Z [2024-04-15T03:33:01.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:33:00+00:00, run_after=2024-04-15T03:34:00+00:00 2024-04-15T03:33:01.038693128Z [2024-04-15T03:33:01.038+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:33:01.088647141Z [2024-04-15T03:33:01.088+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:33:01.088672373Z 2024-04-15T03:33:01.088676771Z 2024-04-15T03:33:01.088897230Z [2024-04-15T03:33:01.088+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:33:01.089086155Z [2024-04-15T03:33:01.088+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:33:01.089636681Z [2024-04-15T03:33:01.089+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:33:01.089650261Z 2024-04-15T03:33:01.089654891Z 2024-04-15T03:33:01.092533358Z [2024-04-15T03:33:01.092+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:33:01.092738750Z [2024-04-15T03:33:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:33:01.092968969Z [2024-04-15T03:33:01.092+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:33:01.093109588Z [2024-04-15T03:33:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:33:01.355084825Z [2024-04-15T03:33:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:32:00+00:00 exited with status queued for try_number 1 2024-04-15T03:33:01.355448491Z [2024-04-15T03:33:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:32:00+00:00 exited with status queued for try_number 1 2024-04-15T03:33:01.364960565Z [2024-04-15T03:33:01.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd76190c-1a4c-4721-81a8-03c65e0d8391 2024-04-15T03:33:01.365104527Z [2024-04-15T03:33:01.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to c18a8ab1-5f0d-4475-a709-85e6649f89b2 2024-04-15T03:33:04.960072509Z [2024-04-15T03:33:04.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:33:04.960797181Z [2024-04-15T03:33:04.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:32:00+00:00, run_id=scheduled__2024-04-15T03:32:00+00:00, run_start_date=2024-04-15 03:33:01.048247+00:00, run_end_date=2024-04-15 03:33:04.959855+00:00, run_duration=3.911608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:32:00+00:00, data_interval_end=2024-04-15 03:33:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:33:04.972491674Z [2024-04-15T03:33:04.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:33:00+00:00, run_after=2024-04-15T03:34:00+00:00 2024-04-15T03:33:05.014781743Z [2024-04-15T03:33:05.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:32:00+00:00 exited with status success for try_number 1 2024-04-15T03:33:05.024971319Z [2024-04-15T03:33:05.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:32:00+00:00, map_index=-1, run_start_date=2024-04-15 03:33:03.087197+00:00, run_end_date=2024-04-15 03:33:04.744163+00:00, run_duration=1.656966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:33:01.090358+00:00, queued_by_job_id=2, pid=9839 2024-04-15T03:33:06.087197268Z [2024-04-15T03:33:06.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:33:06.087655392Z [2024-04-15T03:33:06.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:32:00+00:00, run_id=scheduled__2024-04-15T03:32:00+00:00, run_start_date=2024-04-15 03:33:01.049538+00:00, run_end_date=2024-04-15 03:33:06.087016+00:00, run_duration=5.037478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:32:00+00:00, data_interval_end=2024-04-15 03:33:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:33:06.098883922Z [2024-04-15T03:33:06.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:33:00+00:00, run_after=2024-04-15T03:34:00+00:00 2024-04-15T03:33:06.138420362Z [2024-04-15T03:33:06.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:32:00+00:00 exited with status success for try_number 1 2024-04-15T03:33:06.146926929Z [2024-04-15T03:33:06.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:32:00+00:00, map_index=-1, run_start_date=2024-04-15 03:33:03.119257+00:00, run_end_date=2024-04-15 03:33:05.385356+00:00, run_duration=2.266099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:33:01.090358+00:00, queued_by_job_id=2, pid=9840 2024-04-15T03:34:00.795812389Z [2024-04-15T03:34:00.795+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:34:00.807821542Z [2024-04-15T03:34:00.807+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:34:00.821699507Z [2024-04-15T03:34:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:34:00+00:00, run_after=2024-04-15T03:35:00+00:00 2024-04-15T03:34:00.893783835Z [2024-04-15T03:34:00.893+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:34:00.893806208Z 2024-04-15T03:34:00.893809514Z 2024-04-15T03:34:00.893812580Z 2024-04-15T03:34:00.893971614Z [2024-04-15T03:34:00.893+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:34:00.894169525Z [2024-04-15T03:34:00.894+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:34:00.894301133Z [2024-04-15T03:34:00.894+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:34:00.894973905Z [2024-04-15T03:34:00.894+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:34:00.894985353Z 2024-04-15T03:34:00.894988888Z 2024-04-15T03:34:00.894991962Z 2024-04-15T03:34:00.899676121Z [2024-04-15T03:34:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:34:00.900965247Z [2024-04-15T03:34:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:34:00.901666203Z [2024-04-15T03:34:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:34:00.901687335Z [2024-04-15T03:34:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:34:00.901690259Z [2024-04-15T03:34:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:34:00.901692891Z [2024-04-15T03:34:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:34:01.359978324Z [2024-04-15T03:34:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:32:00+00:00 exited with status queued for try_number 1 2024-04-15T03:34:01.362348242Z [2024-04-15T03:34:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:33:00+00:00 exited with status queued for try_number 1 2024-04-15T03:34:01.362367042Z [2024-04-15T03:34:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:33:00+00:00 exited with status queued for try_number 1 2024-04-15T03:34:01.386314792Z [2024-04-15T03:34:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 682d89c2-049d-4f40-a103-12b9cdf92e66 2024-04-15T03:34:01.386477411Z [2024-04-15T03:34:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47d7745e-711b-4ea5-bbd2-004d71796d3b 2024-04-15T03:34:01.386584866Z [2024-04-15T03:34:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4330c9a6-b5ea-47ce-aa11-590ec14c8b47 2024-04-15T03:34:02.729556683Z [2024-04-15T03:34:02.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:32:00+00:00 exited with status success for try_number 1 2024-04-15T03:34:02.751532155Z [2024-04-15T03:34:02.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:32:00+00:00, map_index=-1, run_start_date=2024-04-15 03:34:02.099651+00:00, run_end_date=2024-04-15 03:34:02.575488+00:00, run_duration=0.475837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:34:00.895689+00:00, queued_by_job_id=2, pid=9876 2024-04-15T03:34:03.748738628Z [2024-04-15T03:34:03.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:34:03.749385292Z [2024-04-15T03:34:03.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:32:00+00:00, run_id=scheduled__2024-04-15T03:32:00+00:00, run_start_date=2024-04-15 03:34:00.833204+00:00, run_end_date=2024-04-15 03:34:03.748689+00:00, run_duration=2.915485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:32:00+00:00, data_interval_end=2024-04-15 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:34:03.761011389Z [2024-04-15T03:34:03.760+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:34:00+00:00, run_after=2024-04-15T03:36:00+00:00 2024-04-15T03:34:05.280575953Z [2024-04-15T03:34:05.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:34:05.280978975Z [2024-04-15T03:34:05.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:33:00+00:00, run_id=scheduled__2024-04-15T03:33:00+00:00, run_start_date=2024-04-15 03:34:00.834681+00:00, run_end_date=2024-04-15 03:34:05.280366+00:00, run_duration=4.445685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:33:00+00:00, data_interval_end=2024-04-15 03:34:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:34:05.293685709Z [2024-04-15T03:34:05.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:34:00+00:00, run_after=2024-04-15T03:35:00+00:00 2024-04-15T03:34:05.338084073Z [2024-04-15T03:34:05.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:33:00+00:00 exited with status success for try_number 1 2024-04-15T03:34:05.344411965Z [2024-04-15T03:34:05.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:33:00+00:00, map_index=-1, run_start_date=2024-04-15 03:34:03.169498+00:00, run_end_date=2024-04-15 03:34:04.633321+00:00, run_duration=1.463823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:34:00.895689+00:00, queued_by_job_id=2, pid=9905 2024-04-15T03:34:06.401366039Z [2024-04-15T03:34:06.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:34:06.401821176Z [2024-04-15T03:34:06.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:33:00+00:00, run_id=scheduled__2024-04-15T03:33:00+00:00, run_start_date=2024-04-15 03:34:00.835913+00:00, run_end_date=2024-04-15 03:34:06.401268+00:00, run_duration=5.565355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:33:00+00:00, data_interval_end=2024-04-15 03:34:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:34:06.409701716Z [2024-04-15T03:34:06.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:34:00+00:00, run_after=2024-04-15T03:35:00+00:00 2024-04-15T03:34:06.441217512Z [2024-04-15T03:34:06.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:33:00+00:00 exited with status success for try_number 1 2024-04-15T03:34:06.446690433Z [2024-04-15T03:34:06.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:33:00+00:00, map_index=-1, run_start_date=2024-04-15 03:34:03.338738+00:00, run_end_date=2024-04-15 03:34:05.388784+00:00, run_duration=2.050046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:34:00.895689+00:00, queued_by_job_id=2, pid=9906 2024-04-15T03:35:00.719502376Z [2024-04-15T03:35:00.718+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:35:00.737536158Z [2024-04-15T03:35:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:35:00+00:00, run_after=2024-04-15T03:36:00+00:00 2024-04-15T03:35:00.768807004Z [2024-04-15T03:35:00.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:35:00+00:00, run_after=2024-04-15T03:40:00+00:00 2024-04-15T03:35:00.851763804Z [2024-04-15T03:35:00.851+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:35:00.851783264Z 2024-04-15T03:35:00.851786841Z 2024-04-15T03:35:00.851790403Z 2024-04-15T03:35:00.851793200Z [2024-04-15T03:35:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:35:00.851839152Z [2024-04-15T03:35:00.851+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:35:00.852057089Z [2024-04-15T03:35:00.851+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:35:00.854558532Z [2024-04-15T03:35:00.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:35:00.854572589Z 2024-04-15T03:35:00.854575965Z 2024-04-15T03:35:00.854579315Z 2024-04-15T03:35:00.859340571Z [2024-04-15T03:35:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:35:00.859352893Z [2024-04-15T03:35:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:35:00.860079007Z [2024-04-15T03:35:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:35:00.860911328Z [2024-04-15T03:35:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:35:00.861144556Z [2024-04-15T03:35:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:35:00.861237817Z [2024-04-15T03:35:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:35:01.092059205Z [2024-04-15T03:35:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status queued for try_number 1 2024-04-15T03:35:01.092463566Z [2024-04-15T03:35:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:34:00+00:00 exited with status queued for try_number 1 2024-04-15T03:35:01.092652474Z [2024-04-15T03:35:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:34:00+00:00 exited with status queued for try_number 1 2024-04-15T03:35:01.100923540Z [2024-04-15T03:35:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad4d5cc5-f9b4-471b-a6f8-4ee629e62e65 2024-04-15T03:35:01.101151841Z [2024-04-15T03:35:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c6c63c4-8c5b-4ba3-9c36-b7c006e80dcf 2024-04-15T03:35:01.101354148Z [2024-04-15T03:35:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ad819e4-91af-4e6a-aa8e-348575fd855b 2024-04-15T03:35:04.530519050Z [2024-04-15T03:35:04.530+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:35:04.530541220Z 2024-04-15T03:35:04.530705474Z [2024-04-15T03:35:04.530+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:35:04.531933062Z [2024-04-15T03:35:04.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:35:04.531949012Z 2024-04-15T03:35:04.534591828Z [2024-04-15T03:35:04.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:35:04.534820754Z [2024-04-15T03:35:04.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:35:04.614647707Z [2024-04-15T03:35:04.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status queued for try_number 1 2024-04-15T03:35:04.614746724Z [2024-04-15T03:35:04.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status success for try_number 1 2024-04-15T03:35:04.620827187Z [2024-04-15T03:35:04.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55f45611-8ae9-447c-9b24-c7b84175ac6e 2024-04-15T03:35:04.621005603Z [2024-04-15T03:35:04.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:30:00+00:00, map_index=-1, run_start_date=2024-04-15 03:35:03.185087+00:00, run_end_date=2024-04-15 03:35:03.535088+00:00, run_duration=0.350001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:35:00.855215+00:00, queued_by_job_id=2, pid=9971 2024-04-15T03:35:04.661853842Z [2024-04-15T03:35:04.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:35:04.662077675Z [2024-04-15T03:35:04.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:34:00+00:00, run_id=scheduled__2024-04-15T03:34:00+00:00, run_start_date=2024-04-15 03:35:00.787709+00:00, run_end_date=2024-04-15 03:35:04.661736+00:00, run_duration=3.874027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:34:00+00:00, data_interval_end=2024-04-15 03:35:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:35:04.671001043Z [2024-04-15T03:35:04.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:35:00+00:00, run_after=2024-04-15T03:36:00+00:00 2024-04-15T03:35:04.724144898Z [2024-04-15T03:35:04.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:34:00+00:00 exited with status success for try_number 1 2024-04-15T03:35:04.729735380Z [2024-04-15T03:35:04.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:34:00+00:00, map_index=-1, run_start_date=2024-04-15 03:35:03.239350+00:00, run_end_date=2024-04-15 03:35:04.540191+00:00, run_duration=1.300841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:35:00.855215+00:00, queued_by_job_id=2, pid=9972 2024-04-15T03:35:05.811311452Z [2024-04-15T03:35:05.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:35:05.811793779Z [2024-04-15T03:35:05.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:34:00+00:00, run_id=scheduled__2024-04-15T03:34:00+00:00, run_start_date=2024-04-15 03:35:00.788976+00:00, run_end_date=2024-04-15 03:35:05.811163+00:00, run_duration=5.022187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:34:00+00:00, data_interval_end=2024-04-15 03:35:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:35:05.826926877Z [2024-04-15T03:35:05.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:35:00+00:00, run_after=2024-04-15T03:36:00+00:00 2024-04-15T03:35:05.888124330Z [2024-04-15T03:35:05.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:34:00+00:00 exited with status success for try_number 1 2024-04-15T03:35:05.896184965Z [2024-04-15T03:35:05.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:34:00+00:00, map_index=-1, run_start_date=2024-04-15 03:35:03.260720+00:00, run_end_date=2024-04-15 03:35:04.880649+00:00, run_duration=1.619929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:35:00.855215+00:00, queued_by_job_id=2, pid=9973 2024-04-15T03:35:06.996696960Z [2024-04-15T03:35:06.996+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:35:06.996811909Z 2024-04-15T03:35:06.996843051Z [2024-04-15T03:35:06.996+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:35:06.998224354Z [2024-04-15T03:35:06.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:35:06.998251285Z 2024-04-15T03:35:07.005739434Z [2024-04-15T03:35:07.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:35:07.005818164Z [2024-04-15T03:35:07.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:35:07.067438279Z [2024-04-15T03:35:07.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status queued for try_number 1 2024-04-15T03:35:07.068044722Z [2024-04-15T03:35:07.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status success for try_number 1 2024-04-15T03:35:07.074754464Z [2024-04-15T03:35:07.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1275a905-5d5c-4be6-bc73-4f226d932763 2024-04-15T03:35:07.074989529Z [2024-04-15T03:35:07.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:30:00+00:00, map_index=-1, run_start_date=2024-04-15 03:35:06.199577+00:00, run_end_date=2024-04-15 03:35:06.590585+00:00, run_duration=0.391008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:35:04.532331+00:00, queued_by_job_id=2, pid=10012 2024-04-15T03:35:09.806339692Z [2024-04-15T03:35:09.805+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:35:09.806375097Z 2024-04-15T03:35:09.806509383Z [2024-04-15T03:35:09.806+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:35:09.807036194Z [2024-04-15T03:35:09.806+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:35:09.807050214Z 2024-04-15T03:35:09.809002817Z [2024-04-15T03:35:09.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:35:09.809250829Z [2024-04-15T03:35:09.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:35:09.861960411Z [2024-04-15T03:35:09.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status queued for try_number 1 2024-04-15T03:35:09.864761511Z [2024-04-15T03:35:09.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status success for try_number 1 2024-04-15T03:35:09.869949214Z [2024-04-15T03:35:09.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25d26ec7-74d7-4a3b-a695-fb5b6bdb2fab 2024-04-15T03:35:09.870356613Z [2024-04-15T03:35:09.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:30:00+00:00, map_index=0, run_start_date=2024-04-15 03:35:08.452252+00:00, run_end_date=2024-04-15 03:35:09.598083+00:00, run_duration=1.145831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:35:06.998843+00:00, queued_by_job_id=2, pid=10024 2024-04-15T03:35:12.088432583Z [2024-04-15T03:35:12.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:35:12.088670416Z [2024-04-15T03:35:12.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:30:00+00:00, run_id=scheduled__2024-04-15T03:30:00+00:00, run_start_date=2024-04-15 03:35:00.785715+00:00, run_end_date=2024-04-15 03:35:12.088247+00:00, run_duration=11.302532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:30:00+00:00, data_interval_end=2024-04-15 03:35:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:35:12.094480324Z [2024-04-15T03:35:12.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:35:00+00:00, run_after=2024-04-15T03:40:00+00:00 2024-04-15T03:35:12.141121447Z [2024-04-15T03:35:12.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:30:00+00:00 exited with status success for try_number 1 2024-04-15T03:35:12.153311861Z [2024-04-15T03:35:12.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:30:00+00:00, map_index=-1, run_start_date=2024-04-15 03:35:11.502848+00:00, run_end_date=2024-04-15 03:35:11.897015+00:00, run_duration=0.394167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:35:09.807425+00:00, queued_by_job_id=2, pid=10045 2024-04-15T03:35:41.475963143Z [2024-04-15T03:35:41.474+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:36:00.349218113Z [2024-04-15T03:36:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:36:00+00:00, run_after=2024-04-15T03:37:00+00:00 2024-04-15T03:36:00.356214458Z [2024-04-15T03:36:00.355+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:36:00.362324684Z [2024-04-15T03:36:00.362+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:36:00.419878291Z [2024-04-15T03:36:00.419+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:36:00.419899650Z 2024-04-15T03:36:00.419905675Z 2024-04-15T03:36:00.419908968Z 2024-04-15T03:36:00.419913404Z [2024-04-15T03:36:00.419+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:36:00.420065706Z [2024-04-15T03:36:00.419+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:36:00.420098246Z [2024-04-15T03:36:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:36:00.420616375Z [2024-04-15T03:36:00.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:36:00.420625891Z 2024-04-15T03:36:00.420629387Z 2024-04-15T03:36:00.420632565Z 2024-04-15T03:36:00.423925455Z [2024-04-15T03:36:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:36:00.424139620Z [2024-04-15T03:36:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:36:00.424448621Z [2024-04-15T03:36:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:36:00.424593525Z [2024-04-15T03:36:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:36:00.424936897Z [2024-04-15T03:36:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:36:00.424944687Z [2024-04-15T03:36:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:36:00.660241927Z [2024-04-15T03:36:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:34:00+00:00 exited with status queued for try_number 1 2024-04-15T03:36:00.662180671Z [2024-04-15T03:36:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status queued for try_number 1 2024-04-15T03:36:00.662409588Z [2024-04-15T03:36:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status queued for try_number 1 2024-04-15T03:36:00.672659866Z [2024-04-15T03:36:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c1def4d-93a5-4c84-8551-9a70dc6a5646 2024-04-15T03:36:00.672944474Z [2024-04-15T03:36:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a55d04e-17df-4bdc-9f14-5fff1445642e 2024-04-15T03:36:00.673174082Z [2024-04-15T03:36:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60703e43-5350-4fad-b0b5-dd381bbab8ad 2024-04-15T03:36:01.846339022Z [2024-04-15T03:36:01.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:36:01.846710900Z [2024-04-15T03:36:01.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:34:00+00:00, run_id=scheduled__2024-04-15T03:34:00+00:00, run_start_date=2024-04-15 03:36:00.371336+00:00, run_end_date=2024-04-15 03:36:01.846275+00:00, run_duration=1.474939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:34:00+00:00, data_interval_end=2024-04-15 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:36:01.860856955Z [2024-04-15T03:36:01.856+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:36:00+00:00, run_after=2024-04-15T03:38:00+00:00 2024-04-15T03:36:01.898173540Z [2024-04-15T03:36:01.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:34:00+00:00 exited with status success for try_number 1 2024-04-15T03:36:01.902705188Z [2024-04-15T03:36:01.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:34:00+00:00, map_index=-1, run_start_date=2024-04-15 03:36:01.089968+00:00, run_end_date=2024-04-15 03:36:01.418965+00:00, run_duration=0.328997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:36:00.421323+00:00, queued_by_job_id=2, pid=10062 2024-04-15T03:36:04.883210745Z [2024-04-15T03:36:04.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:36:04.883521114Z [2024-04-15T03:36:04.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:35:00+00:00, run_id=scheduled__2024-04-15T03:35:00+00:00, run_start_date=2024-04-15 03:36:00.372356+00:00, run_end_date=2024-04-15 03:36:04.883147+00:00, run_duration=4.510791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:35:00+00:00, data_interval_end=2024-04-15 03:36:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:36:04.891386854Z [2024-04-15T03:36:04.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:36:00+00:00, run_after=2024-04-15T03:37:00+00:00 2024-04-15T03:36:04.924020845Z [2024-04-15T03:36:04.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status success for try_number 1 2024-04-15T03:36:04.928741309Z [2024-04-15T03:36:04.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:35:00+00:00, map_index=-1, run_start_date=2024-04-15 03:36:02.791350+00:00, run_end_date=2024-04-15 03:36:04.257450+00:00, run_duration=1.4661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:36:00.421323+00:00, queued_by_job_id=2, pid=10093 2024-04-15T03:36:05.751919702Z [2024-04-15T03:36:05.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:36:05.752160388Z [2024-04-15T03:36:05.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:35:00+00:00, run_id=scheduled__2024-04-15T03:35:00+00:00, run_start_date=2024-04-15 03:36:00.373329+00:00, run_end_date=2024-04-15 03:36:05.751848+00:00, run_duration=5.378519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:35:00+00:00, data_interval_end=2024-04-15 03:36:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:36:05.760152057Z [2024-04-15T03:36:05.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:36:00+00:00, run_after=2024-04-15T03:37:00+00:00 2024-04-15T03:36:05.789195762Z [2024-04-15T03:36:05.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status success for try_number 1 2024-04-15T03:36:05.794179505Z [2024-04-15T03:36:05.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:35:00+00:00, map_index=-1, run_start_date=2024-04-15 03:36:02.680719+00:00, run_end_date=2024-04-15 03:36:05.305526+00:00, run_duration=2.624807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:36:00.421323+00:00, queued_by_job_id=2, pid=10092 2024-04-15T03:36:42.419234275Z [2024-04-15T03:36:42.418+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:36:42.419276275Z 2024-04-15T03:36:42.419605175Z [2024-04-15T03:36:42.419+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-15T03:36:42.420708630Z [2024-04-15T03:36:42.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:36:42.420723037Z 2024-04-15T03:36:42.424072417Z [2024-04-15T03:36:42.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240415033641_174613', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:36:42.424365760Z [2024-04-15T03:36:42.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240415033641_174613', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-15T03:36:42.500003925Z [2024-04-15T03:36:42.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415033641_174613 exited with status queued for try_number 1 2024-04-15T03:36:42.508768874Z [2024-04-15T03:36:42.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c37e6d8-accc-448e-9f44-d519dbcd05c9 2024-04-15T03:36:43.668331938Z [2024-04-15T03:36:43.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:36:43.668802735Z [2024-04-15T03:36:43.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-15 03:36:42.001634+00:00, run_id=vdu_alarm_20240415033641_174613, run_start_date=2024-04-15 03:36:42.376859+00:00, run_end_date=2024-04-15 03:36:43.668202+00:00, run_duration=1.291343, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 03:36:42.001634+00:00, data_interval_end=2024-04-15 03:36:42.001634+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-15T03:36:43.672146307Z [2024-04-15T03:36:43.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-15T03:36:44.777021760Z [2024-04-15T03:36:44.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415033641_174613 exited with status success for try_number 1 2024-04-15T03:36:44.783957207Z [2024-04-15T03:36:44.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240415033641_174613, map_index=-1, run_start_date=2024-04-15 03:36:43.126955+00:00, run_end_date=2024-04-15 03:36:43.554734+00:00, run_duration=0.427779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:36:42.421037+00:00, queued_by_job_id=2, pid=10126 2024-04-15T03:37:00.778672016Z [2024-04-15T03:37:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:37:00+00:00, run_after=2024-04-15T03:38:00+00:00 2024-04-15T03:37:00.793108569Z [2024-04-15T03:37:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:37:00.854105873Z [2024-04-15T03:37:00.853+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:37:00.854138196Z 2024-04-15T03:37:00.854142722Z 2024-04-15T03:37:00.854281785Z [2024-04-15T03:37:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:37:00.854288505Z [2024-04-15T03:37:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:37:00.854622004Z [2024-04-15T03:37:00.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:37:00.854630804Z 2024-04-15T03:37:00.854634774Z 2024-04-15T03:37:00.856833286Z [2024-04-15T03:37:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:37:00.856883772Z [2024-04-15T03:37:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:37:00.857082379Z [2024-04-15T03:37:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:37:00.857164155Z [2024-04-15T03:37:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:37:01.090217073Z [2024-04-15T03:37:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:36:00+00:00 exited with status queued for try_number 1 2024-04-15T03:37:01.090603632Z [2024-04-15T03:37:01.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:36:00+00:00 exited with status queued for try_number 1 2024-04-15T03:37:01.099540062Z [2024-04-15T03:37:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 377d653b-06eb-479c-992f-810e0eaee2a9 2024-04-15T03:37:01.099960495Z [2024-04-15T03:37:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d70401a-3327-4549-bdfa-82759cdd4019 2024-04-15T03:37:04.938381563Z [2024-04-15T03:37:04.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:37:04.938935923Z [2024-04-15T03:37:04.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:36:00+00:00, run_id=scheduled__2024-04-15T03:36:00+00:00, run_start_date=2024-04-15 03:37:00.807707+00:00, run_end_date=2024-04-15 03:37:04.938294+00:00, run_duration=4.130587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:36:00+00:00, data_interval_end=2024-04-15 03:37:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:37:04.951188712Z [2024-04-15T03:37:04.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:37:00+00:00, run_after=2024-04-15T03:38:00+00:00 2024-04-15T03:37:05.001298594Z [2024-04-15T03:37:05.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:36:00+00:00 exited with status success for try_number 1 2024-04-15T03:37:05.014973123Z [2024-04-15T03:37:05.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:36:00+00:00, map_index=-1, run_start_date=2024-04-15 03:37:02.644487+00:00, run_end_date=2024-04-15 03:37:04.666117+00:00, run_duration=2.02163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:37:00.855027+00:00, queued_by_job_id=2, pid=10149 2024-04-15T03:37:06.256289548Z [2024-04-15T03:37:06.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:37:06.256822863Z [2024-04-15T03:37:06.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:36:00+00:00, run_id=scheduled__2024-04-15T03:36:00+00:00, run_start_date=2024-04-15 03:37:00.809043+00:00, run_end_date=2024-04-15 03:37:06.256102+00:00, run_duration=5.447059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:36:00+00:00, data_interval_end=2024-04-15 03:37:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:37:06.269505528Z [2024-04-15T03:37:06.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:37:00+00:00, run_after=2024-04-15T03:38:00+00:00 2024-04-15T03:37:06.309448046Z [2024-04-15T03:37:06.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:36:00+00:00 exited with status success for try_number 1 2024-04-15T03:37:06.316498426Z [2024-04-15T03:37:06.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:36:00+00:00, map_index=-1, run_start_date=2024-04-15 03:37:03.202978+00:00, run_end_date=2024-04-15 03:37:05.232665+00:00, run_duration=2.029687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:37:00.855027+00:00, queued_by_job_id=2, pid=10168 2024-04-15T03:38:00.127787329Z [2024-04-15T03:38:00.127+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:38:00.144398874Z [2024-04-15T03:38:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:38:00+00:00, run_after=2024-04-15T03:39:00+00:00 2024-04-15T03:38:00.152415696Z [2024-04-15T03:38:00.152+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:38:00.206539526Z [2024-04-15T03:38:00.206+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:38:00.206565585Z 2024-04-15T03:38:00.206571386Z 2024-04-15T03:38:00.206575530Z 2024-04-15T03:38:00.206580528Z [2024-04-15T03:38:00.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:38:00.206593166Z [2024-04-15T03:38:00.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:38:00.206673895Z [2024-04-15T03:38:00.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:38:00.207307847Z [2024-04-15T03:38:00.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:38:00.207332013Z 2024-04-15T03:38:00.207337566Z 2024-04-15T03:38:00.207341719Z 2024-04-15T03:38:00.210144816Z [2024-04-15T03:38:00.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:38:00.210800770Z [2024-04-15T03:38:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:38:00.211006749Z [2024-04-15T03:38:00.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:38:00.211056199Z [2024-04-15T03:38:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:38:00.211257852Z [2024-04-15T03:38:00.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:38:00.211614267Z [2024-04-15T03:38:00.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:38:00.487926365Z [2024-04-15T03:38:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:36:00+00:00 exited with status queued for try_number 1 2024-04-15T03:38:00.487973616Z [2024-04-15T03:38:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:37:00+00:00 exited with status queued for try_number 1 2024-04-15T03:38:00.487990284Z [2024-04-15T03:38:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:37:00+00:00 exited with status queued for try_number 1 2024-04-15T03:38:00.495616270Z [2024-04-15T03:38:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9109936-94bf-49ac-81c9-5e4dbae86b51 2024-04-15T03:38:00.495661338Z [2024-04-15T03:38:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94f7e0d5-a07a-474c-9eb7-0fe05d0a7938 2024-04-15T03:38:00.495761552Z [2024-04-15T03:38:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0874b0ad-932f-4af3-a341-effe5dadef43 2024-04-15T03:38:01.617605170Z [2024-04-15T03:38:01.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:38:01.619245182Z [2024-04-15T03:38:01.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:36:00+00:00, run_id=scheduled__2024-04-15T03:36:00+00:00, run_start_date=2024-04-15 03:38:00.162339+00:00, run_end_date=2024-04-15 03:38:01.617528+00:00, run_duration=1.455189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:36:00+00:00, data_interval_end=2024-04-15 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:38:01.627880070Z [2024-04-15T03:38:01.627+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:38:00+00:00, run_after=2024-04-15T03:40:00+00:00 2024-04-15T03:38:01.703484702Z [2024-04-15T03:38:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:36:00+00:00 exited with status success for try_number 1 2024-04-15T03:38:01.708710812Z [2024-04-15T03:38:01.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:36:00+00:00, map_index=-1, run_start_date=2024-04-15 03:38:00.891871+00:00, run_end_date=2024-04-15 03:38:01.336666+00:00, run_duration=0.444795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:38:00.207809+00:00, queued_by_job_id=2, pid=10194 2024-04-15T03:38:03.714761889Z [2024-04-15T03:38:03.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:38:03.714866135Z [2024-04-15T03:38:03.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:37:00+00:00, run_id=scheduled__2024-04-15T03:37:00+00:00, run_start_date=2024-04-15 03:38:00.163651+00:00, run_end_date=2024-04-15 03:38:03.714458+00:00, run_duration=3.550807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:37:00+00:00, data_interval_end=2024-04-15 03:38:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:38:03.722992315Z [2024-04-15T03:38:03.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:38:00+00:00, run_after=2024-04-15T03:39:00+00:00 2024-04-15T03:38:03.764460136Z [2024-04-15T03:38:03.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:37:00+00:00 exited with status success for try_number 1 2024-04-15T03:38:03.770045045Z [2024-04-15T03:38:03.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:37:00+00:00, map_index=-1, run_start_date=2024-04-15 03:38:02.162795+00:00, run_end_date=2024-04-15 03:38:03.582845+00:00, run_duration=1.42005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:38:00.207809+00:00, queued_by_job_id=2, pid=10215 2024-04-15T03:38:05.386617704Z [2024-04-15T03:38:05.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:38:05.387034666Z [2024-04-15T03:38:05.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:37:00+00:00, run_id=scheduled__2024-04-15T03:37:00+00:00, run_start_date=2024-04-15 03:38:00.164731+00:00, run_end_date=2024-04-15 03:38:05.386426+00:00, run_duration=5.221695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:37:00+00:00, data_interval_end=2024-04-15 03:38:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:38:05.398313879Z [2024-04-15T03:38:05.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:38:00+00:00, run_after=2024-04-15T03:39:00+00:00 2024-04-15T03:38:05.440725187Z [2024-04-15T03:38:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:37:00+00:00 exited with status success for try_number 1 2024-04-15T03:38:05.452270734Z [2024-04-15T03:38:05.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:37:00+00:00, map_index=-1, run_start_date=2024-04-15 03:38:02.806869+00:00, run_end_date=2024-04-15 03:38:04.863381+00:00, run_duration=2.056512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:38:00.207809+00:00, queued_by_job_id=2, pid=10234 2024-04-15T03:39:00.542802912Z [2024-04-15T03:39:00.542+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:39:00.558127376Z [2024-04-15T03:39:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:39:00+00:00, run_after=2024-04-15T03:40:00+00:00 2024-04-15T03:39:00.605980311Z [2024-04-15T03:39:00.605+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:39:00.606019488Z 2024-04-15T03:39:00.606029887Z 2024-04-15T03:39:00.606038795Z [2024-04-15T03:39:00.605+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:39:00.606061971Z [2024-04-15T03:39:00.605+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:39:00.606611133Z [2024-04-15T03:39:00.606+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:39:00.606629293Z 2024-04-15T03:39:00.606638087Z 2024-04-15T03:39:00.608945507Z [2024-04-15T03:39:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:39:00.609262047Z [2024-04-15T03:39:00.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:39:00.609398539Z [2024-04-15T03:39:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:39:00.609514478Z [2024-04-15T03:39:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:39:00.908332926Z [2024-04-15T03:39:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:38:00+00:00 exited with status queued for try_number 1 2024-04-15T03:39:00.910899031Z [2024-04-15T03:39:00.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:38:00+00:00 exited with status queued for try_number 1 2024-04-15T03:39:00.917424163Z [2024-04-15T03:39:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2987b33-71d6-42ab-964d-ec6be8d05f05 2024-04-15T03:39:00.917717258Z [2024-04-15T03:39:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34f694a9-a051-4107-b647-b8585a39e209 2024-04-15T03:39:05.659922669Z [2024-04-15T03:39:05.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:39:05.660709419Z [2024-04-15T03:39:05.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:38:00+00:00, run_id=scheduled__2024-04-15T03:38:00+00:00, run_start_date=2024-04-15 03:39:00.567891+00:00, run_end_date=2024-04-15 03:39:05.659828+00:00, run_duration=5.091937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:38:00+00:00, data_interval_end=2024-04-15 03:39:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:39:05.673032036Z [2024-04-15T03:39:05.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:39:00+00:00, run_after=2024-04-15T03:40:00+00:00 2024-04-15T03:39:05.680764870Z [2024-04-15T03:39:05.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:39:05.681262784Z [2024-04-15T03:39:05.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:38:00+00:00, run_id=scheduled__2024-04-15T03:38:00+00:00, run_start_date=2024-04-15 03:39:00.566979+00:00, run_end_date=2024-04-15 03:39:05.680687+00:00, run_duration=5.113708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:38:00+00:00, data_interval_end=2024-04-15 03:39:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:39:05.691677960Z [2024-04-15T03:39:05.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:39:00+00:00, run_after=2024-04-15T03:40:00+00:00 2024-04-15T03:39:05.715866025Z [2024-04-15T03:39:05.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:38:00+00:00 exited with status success for try_number 1 2024-04-15T03:39:05.716059948Z [2024-04-15T03:39:05.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:38:00+00:00 exited with status success for try_number 1 2024-04-15T03:39:05.724599610Z [2024-04-15T03:39:05.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:38:00+00:00, map_index=-1, run_start_date=2024-04-15 03:39:02.691646+00:00, run_end_date=2024-04-15 03:39:05.254451+00:00, run_duration=2.562805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:39:00.607020+00:00, queued_by_job_id=2, pid=10270 2024-04-15T03:39:05.725021897Z [2024-04-15T03:39:05.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:38:00+00:00, map_index=-1, run_start_date=2024-04-15 03:39:03.371002+00:00, run_end_date=2024-04-15 03:39:05.118852+00:00, run_duration=1.74785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:39:00.607020+00:00, queued_by_job_id=2, pid=10289 2024-04-15T03:40:00.938764710Z [2024-04-15T03:40:00.938+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:40:00.957462702Z [2024-04-15T03:40:00.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:40:00+00:00, run_after=2024-04-15T03:41:00+00:00 2024-04-15T03:40:00.970060169Z [2024-04-15T03:40:00.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:40:00+00:00, run_after=2024-04-15T03:45:00+00:00 2024-04-15T03:40:00.976231245Z [2024-04-15T03:40:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:40:01.049890803Z [2024-04-15T03:40:01.049+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T03:40:01.049943921Z 2024-04-15T03:40:01.049947555Z 2024-04-15T03:40:01.049951504Z 2024-04-15T03:40:01.049966825Z 2024-04-15T03:40:01.050019620Z [2024-04-15T03:40:01.049+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:40:01.050209090Z [2024-04-15T03:40:01.050+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:40:01.050311162Z [2024-04-15T03:40:01.050+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:40:01.050436558Z [2024-04-15T03:40:01.050+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:40:01.051400415Z [2024-04-15T03:40:01.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:40:01.051413294Z 2024-04-15T03:40:01.051417399Z 2024-04-15T03:40:01.051420397Z 2024-04-15T03:40:01.051422917Z 2024-04-15T03:40:01.054391984Z [2024-04-15T03:40:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:40:01.054511031Z [2024-04-15T03:40:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:40:01.054743666Z [2024-04-15T03:40:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:40:01.054851749Z [2024-04-15T03:40:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:40:01.055126782Z [2024-04-15T03:40:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:40:01.055230269Z [2024-04-15T03:40:01.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:40:01.055586982Z [2024-04-15T03:40:01.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:40:01.055645199Z [2024-04-15T03:40:01.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:40:01.565369512Z [2024-04-15T03:40:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status queued for try_number 1 2024-04-15T03:40:01.565784951Z [2024-04-15T03:40:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:38:00+00:00 exited with status queued for try_number 1 2024-04-15T03:40:01.565965650Z [2024-04-15T03:40:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:39:00+00:00 exited with status queued for try_number 1 2024-04-15T03:40:01.572058581Z [2024-04-15T03:40:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:39:00+00:00 exited with status queued for try_number 1 2024-04-15T03:40:01.627490967Z [2024-04-15T03:40:01.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd56c2d6-764a-467a-b189-10307e0c5c55 2024-04-15T03:40:01.627776503Z [2024-04-15T03:40:01.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6a615ad-8191-4530-95ad-68b0d11892af 2024-04-15T03:40:01.628046622Z [2024-04-15T03:40:01.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d93da00-74b3-43b2-b585-3b16b83d9048 2024-04-15T03:40:01.628217069Z [2024-04-15T03:40:01.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08fec16a-968b-4850-a316-c4f41fa6a1d1 2024-04-15T03:40:04.387981647Z [2024-04-15T03:40:04.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:40:04.388582386Z [2024-04-15T03:40:04.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:38:00+00:00, run_id=scheduled__2024-04-15T03:38:00+00:00, run_start_date=2024-04-15 03:40:00.989188+00:00, run_end_date=2024-04-15 03:40:04.388084+00:00, run_duration=3.398896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:38:00+00:00, data_interval_end=2024-04-15 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:40:04.415174429Z [2024-04-15T03:40:04.409+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:40:00+00:00, run_after=2024-04-15T03:42:00+00:00 2024-04-15T03:40:04.567311541Z [2024-04-15T03:40:04.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:38:00+00:00 exited with status success for try_number 1 2024-04-15T03:40:04.587972582Z [2024-04-15T03:40:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:38:00+00:00, map_index=-1, run_start_date=2024-04-15 03:40:03.029423+00:00, run_end_date=2024-04-15 03:40:03.456230+00:00, run_duration=0.426807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:01.052047+00:00, queued_by_job_id=2, pid=10319 2024-04-15T03:40:05.739907250Z [2024-04-15T03:40:05.739+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:40:05.739936055Z 2024-04-15T03:40:05.740296069Z [2024-04-15T03:40:05.739+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:40:05.740914672Z [2024-04-15T03:40:05.740+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:40:05.740927425Z 2024-04-15T03:40:05.742960538Z [2024-04-15T03:40:05.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:40:05.743067553Z [2024-04-15T03:40:05.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:40:05.834318525Z [2024-04-15T03:40:05.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status queued for try_number 1 2024-04-15T03:40:05.834365463Z [2024-04-15T03:40:05.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status success for try_number 1 2024-04-15T03:40:05.841012453Z [2024-04-15T03:40:05.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfde1c36-50c8-44d0-b564-a152c45d89ab 2024-04-15T03:40:05.841354752Z [2024-04-15T03:40:05.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:35:00+00:00, map_index=-1, run_start_date=2024-04-15 03:40:04.411524+00:00, run_end_date=2024-04-15 03:40:04.930512+00:00, run_duration=0.518988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:01.052047+00:00, queued_by_job_id=2, pid=10340 2024-04-15T03:40:07.014480920Z [2024-04-15T03:40:07.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:40:07.014897684Z [2024-04-15T03:40:07.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:39:00+00:00, run_id=scheduled__2024-04-15T03:39:00+00:00, run_start_date=2024-04-15 03:40:00.990133+00:00, run_end_date=2024-04-15 03:40:07.014399+00:00, run_duration=6.024266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:39:00+00:00, data_interval_end=2024-04-15 03:40:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:40:07.025659191Z [2024-04-15T03:40:07.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:40:00+00:00, run_after=2024-04-15T03:41:00+00:00 2024-04-15T03:40:07.031855022Z [2024-04-15T03:40:07.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:40:07.032202028Z [2024-04-15T03:40:07.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:39:00+00:00, run_id=scheduled__2024-04-15T03:39:00+00:00, run_start_date=2024-04-15 03:40:00.991134+00:00, run_end_date=2024-04-15 03:40:07.031797+00:00, run_duration=6.040663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:39:00+00:00, data_interval_end=2024-04-15 03:40:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:40:07.041255893Z [2024-04-15T03:40:07.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:40:00+00:00, run_after=2024-04-15T03:41:00+00:00 2024-04-15T03:40:07.079071322Z [2024-04-15T03:40:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:39:00+00:00 exited with status success for try_number 1 2024-04-15T03:40:07.079672461Z [2024-04-15T03:40:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:39:00+00:00 exited with status success for try_number 1 2024-04-15T03:40:07.087144507Z [2024-04-15T03:40:07.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:39:00+00:00, map_index=-1, run_start_date=2024-04-15 03:40:04.902837+00:00, run_end_date=2024-04-15 03:40:06.474621+00:00, run_duration=1.571784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:01.052047+00:00, queued_by_job_id=2, pid=10368 2024-04-15T03:40:07.088581603Z [2024-04-15T03:40:07.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:39:00+00:00, map_index=-1, run_start_date=2024-04-15 03:40:05.049120+00:00, run_end_date=2024-04-15 03:40:06.336111+00:00, run_duration=1.286991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:01.052047+00:00, queued_by_job_id=2, pid=10369 2024-04-15T03:40:08.172179842Z [2024-04-15T03:40:08.171+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:40:08.172245582Z 2024-04-15T03:40:08.172261249Z [2024-04-15T03:40:08.172+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:40:08.173135495Z [2024-04-15T03:40:08.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:40:08.173164972Z 2024-04-15T03:40:08.176464745Z [2024-04-15T03:40:08.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:40:08.176580170Z [2024-04-15T03:40:08.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:40:08.235098329Z [2024-04-15T03:40:08.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status queued for try_number 1 2024-04-15T03:40:08.235122603Z [2024-04-15T03:40:08.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status success for try_number 1 2024-04-15T03:40:08.240686013Z [2024-04-15T03:40:08.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d7cf02b-e5a5-4186-b4f4-9e941e99a364 2024-04-15T03:40:08.241013325Z [2024-04-15T03:40:08.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:35:00+00:00, map_index=-1, run_start_date=2024-04-15 03:40:07.395440+00:00, run_end_date=2024-04-15 03:40:07.746094+00:00, run_duration=0.350654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:05.741256+00:00, queued_by_job_id=2, pid=10399 2024-04-15T03:40:11.065949547Z [2024-04-15T03:40:11.065+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:40:11.065989391Z 2024-04-15T03:40:11.066247162Z [2024-04-15T03:40:11.065+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:40:11.067222656Z [2024-04-15T03:40:11.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:40:11.067238274Z 2024-04-15T03:40:11.070355387Z [2024-04-15T03:40:11.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:40:11.070689806Z [2024-04-15T03:40:11.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:40:11.161240073Z [2024-04-15T03:40:11.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status queued for try_number 1 2024-04-15T03:40:11.161579723Z [2024-04-15T03:40:11.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status success for try_number 1 2024-04-15T03:40:11.166863625Z [2024-04-15T03:40:11.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b0b2536-f2d2-4943-ae29-56a46606f4f6 2024-04-15T03:40:11.167172768Z [2024-04-15T03:40:11.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:35:00+00:00, map_index=0, run_start_date=2024-04-15 03:40:09.750083+00:00, run_end_date=2024-04-15 03:40:10.074315+00:00, run_duration=0.324232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:08.173521+00:00, queued_by_job_id=2, pid=10411 2024-04-15T03:40:13.409860779Z [2024-04-15T03:40:13.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:40:13.410740971Z [2024-04-15T03:40:13.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:35:00+00:00, run_id=scheduled__2024-04-15T03:35:00+00:00, run_start_date=2024-04-15 03:40:00.987960+00:00, run_end_date=2024-04-15 03:40:13.409732+00:00, run_duration=12.421772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:35:00+00:00, data_interval_end=2024-04-15 03:40:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:40:13.428597505Z [2024-04-15T03:40:13.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:40:00+00:00, run_after=2024-04-15T03:45:00+00:00 2024-04-15T03:40:13.477978363Z [2024-04-15T03:40:13.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:35:00+00:00 exited with status success for try_number 1 2024-04-15T03:40:13.487254321Z [2024-04-15T03:40:13.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:35:00+00:00, map_index=-1, run_start_date=2024-04-15 03:40:12.682021+00:00, run_end_date=2024-04-15 03:40:13.069148+00:00, run_duration=0.387127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:11.067753+00:00, queued_by_job_id=2, pid=10423 2024-04-15T03:40:41.532999843Z [2024-04-15T03:40:41.532+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:40:42.597773307Z [2024-04-15T03:40:42.597+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:40:42.597810899Z 2024-04-15T03:40:42.597958046Z [2024-04-15T03:40:42.597+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-15T03:40:42.598661855Z [2024-04-15T03:40:42.598+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:40:42.598673429Z 2024-04-15T03:40:42.600982239Z [2024-04-15T03:40:42.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240415034041_721035', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:40:42.601173344Z [2024-04-15T03:40:42.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240415034041_721035', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-15T03:40:42.672998383Z [2024-04-15T03:40:42.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415034041_721035 exited with status queued for try_number 1 2024-04-15T03:40:42.680791839Z [2024-04-15T03:40:42.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 423c6d07-1e3b-4219-900d-50788becd4b9 2024-04-15T03:40:43.824372182Z [2024-04-15T03:40:43.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:40:43.824794448Z [2024-04-15T03:40:43.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-15 03:40:41.985392+00:00, run_id=vdu_alarm_20240415034041_721035, run_start_date=2024-04-15 03:40:42.565494+00:00, run_end_date=2024-04-15 03:40:43.824316+00:00, run_duration=1.258822, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 03:40:41.985392+00:00, data_interval_end=2024-04-15 03:40:41.985392+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-15T03:40:43.829330097Z [2024-04-15T03:40:43.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-15T03:40:43.884680611Z [2024-04-15T03:40:43.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415034041_721035 exited with status success for try_number 1 2024-04-15T03:40:43.896418881Z [2024-04-15T03:40:43.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240415034041_721035, map_index=-1, run_start_date=2024-04-15 03:40:43.237219+00:00, run_end_date=2024-04-15 03:40:43.639476+00:00, run_duration=0.402257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:40:42.599012+00:00, queued_by_job_id=2, pid=10438 2024-04-15T03:41:00.283796696Z [2024-04-15T03:41:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:41:00+00:00, run_after=2024-04-15T03:42:00+00:00 2024-04-15T03:41:00.294411959Z [2024-04-15T03:41:00.293+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:41:00.370775186Z [2024-04-15T03:41:00.370+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:41:00.370816757Z 2024-04-15T03:41:00.370827483Z 2024-04-15T03:41:00.370852674Z [2024-04-15T03:41:00.370+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:41:00.371129098Z [2024-04-15T03:41:00.370+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:41:00.372131066Z [2024-04-15T03:41:00.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:41:00.372151160Z 2024-04-15T03:41:00.372160685Z 2024-04-15T03:41:00.376747252Z [2024-04-15T03:41:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:41:00.376785273Z [2024-04-15T03:41:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:41:00.377104456Z [2024-04-15T03:41:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:41:00.377134459Z [2024-04-15T03:41:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:41:00.520055095Z [2024-04-15T03:41:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status queued for try_number 1 2024-04-15T03:41:00.520172926Z [2024-04-15T03:41:00.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status queued for try_number 1 2024-04-15T03:41:00.530221179Z [2024-04-15T03:41:00.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d46be58-f59f-46e4-9585-d997ce121915 2024-04-15T03:41:00.530583513Z [2024-04-15T03:41:00.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 084eba4d-5a9f-44c8-90ff-d76b59d59219 2024-04-15T03:41:03.934519776Z [2024-04-15T03:41:03.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:41:03.934942257Z [2024-04-15T03:41:03.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:40:00+00:00, run_id=scheduled__2024-04-15T03:40:00+00:00, run_start_date=2024-04-15 03:41:00.315504+00:00, run_end_date=2024-04-15 03:41:03.934562+00:00, run_duration=3.619058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:40:00+00:00, data_interval_end=2024-04-15 03:41:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:41:03.943837516Z [2024-04-15T03:41:03.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:41:00+00:00, run_after=2024-04-15T03:42:00+00:00 2024-04-15T03:41:03.998387220Z [2024-04-15T03:41:03.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status success for try_number 1 2024-04-15T03:41:04.005275320Z [2024-04-15T03:41:04.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:40:00+00:00, map_index=-1, run_start_date=2024-04-15 03:41:02.121376+00:00, run_end_date=2024-04-15 03:41:03.338286+00:00, run_duration=1.21691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:41:00.373122+00:00, queued_by_job_id=2, pid=10461 2024-04-15T03:41:05.063703775Z [2024-04-15T03:41:05.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:41:05.063776645Z [2024-04-15T03:41:05.063+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:40:00+00:00, run_id=scheduled__2024-04-15T03:40:00+00:00, run_start_date=2024-04-15 03:41:00.318419+00:00, run_end_date=2024-04-15 03:41:05.063361+00:00, run_duration=4.744942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:40:00+00:00, data_interval_end=2024-04-15 03:41:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:41:05.076093895Z [2024-04-15T03:41:05.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:41:00+00:00, run_after=2024-04-15T03:42:00+00:00 2024-04-15T03:41:05.637146849Z [2024-04-15T03:41:05.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status success for try_number 1 2024-04-15T03:41:05.645283089Z [2024-04-15T03:41:05.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:40:00+00:00, map_index=-1, run_start_date=2024-04-15 03:41:02.380595+00:00, run_end_date=2024-04-15 03:41:04.994681+00:00, run_duration=2.614086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:41:00.373122+00:00, queued_by_job_id=2, pid=10479 2024-04-15T03:42:00.590972829Z [2024-04-15T03:42:00.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:42:00+00:00, run_after=2024-04-15T03:43:00+00:00 2024-04-15T03:42:00.600995628Z [2024-04-15T03:42:00.600+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:42:00.609545481Z [2024-04-15T03:42:00.609+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:42:00.689341451Z [2024-04-15T03:42:00.688+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:42:00.689408042Z 2024-04-15T03:42:00.689419839Z 2024-04-15T03:42:00.689428816Z 2024-04-15T03:42:00.689624664Z [2024-04-15T03:42:00.689+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:42:00.690041075Z [2024-04-15T03:42:00.689+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:42:00.690349899Z [2024-04-15T03:42:00.690+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:42:00.691251764Z [2024-04-15T03:42:00.690+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:42:00.691267849Z 2024-04-15T03:42:00.691273470Z 2024-04-15T03:42:00.691278720Z 2024-04-15T03:42:00.695951418Z [2024-04-15T03:42:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:42:00.696608233Z [2024-04-15T03:42:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:42:00.697359345Z [2024-04-15T03:42:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:42:00.697796238Z [2024-04-15T03:42:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:42:00.698674273Z [2024-04-15T03:42:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:42:00.699048964Z [2024-04-15T03:42:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:42:01.035645858Z [2024-04-15T03:42:01.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status queued for try_number 1 2024-04-15T03:42:01.037928757Z [2024-04-15T03:42:01.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:41:00+00:00 exited with status queued for try_number 1 2024-04-15T03:42:01.038207898Z [2024-04-15T03:42:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:41:00+00:00 exited with status queued for try_number 1 2024-04-15T03:42:01.056583591Z [2024-04-15T03:42:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd3b36ba-89ef-4583-9100-2a4ff1e838f7 2024-04-15T03:42:01.056845077Z [2024-04-15T03:42:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 519dee62-4f4a-495a-8869-e1affa2357be 2024-04-15T03:42:01.057066032Z [2024-04-15T03:42:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0c2279e-a05f-4990-9e4c-03b957782c2c 2024-04-15T03:42:02.529270215Z [2024-04-15T03:42:02.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:42:02.530840097Z [2024-04-15T03:42:02.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:40:00+00:00, run_id=scheduled__2024-04-15T03:40:00+00:00, run_start_date=2024-04-15 03:42:00.624014+00:00, run_end_date=2024-04-15 03:42:02.529189+00:00, run_duration=1.905175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:40:00+00:00, data_interval_end=2024-04-15 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:42:02.541833333Z [2024-04-15T03:42:02.541+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:42:00+00:00, run_after=2024-04-15T03:44:00+00:00 2024-04-15T03:42:02.589716716Z [2024-04-15T03:42:02.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status success for try_number 1 2024-04-15T03:42:02.596632897Z [2024-04-15T03:42:02.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:40:00+00:00, map_index=-1, run_start_date=2024-04-15 03:42:01.644091+00:00, run_end_date=2024-04-15 03:42:02.257363+00:00, run_duration=0.613272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:42:00.692257+00:00, queued_by_job_id=2, pid=10506 2024-04-15T03:42:04.747724661Z [2024-04-15T03:42:04.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:42:04.747974863Z [2024-04-15T03:42:04.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:41:00+00:00, run_id=scheduled__2024-04-15T03:41:00+00:00, run_start_date=2024-04-15 03:42:00.625503+00:00, run_end_date=2024-04-15 03:42:04.747675+00:00, run_duration=4.122172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:41:00+00:00, data_interval_end=2024-04-15 03:42:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:42:04.756493738Z [2024-04-15T03:42:04.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:42:00+00:00, run_after=2024-04-15T03:43:00+00:00 2024-04-15T03:42:04.802025173Z [2024-04-15T03:42:04.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:41:00+00:00 exited with status success for try_number 1 2024-04-15T03:42:04.806248595Z [2024-04-15T03:42:04.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:41:00+00:00, map_index=-1, run_start_date=2024-04-15 03:42:03.290576+00:00, run_end_date=2024-04-15 03:42:04.607904+00:00, run_duration=1.317328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:42:00.692257+00:00, queued_by_job_id=2, pid=10536 2024-04-15T03:42:05.863061978Z [2024-04-15T03:42:05.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:42:05.863746809Z [2024-04-15T03:42:05.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:41:00+00:00, run_id=scheduled__2024-04-15T03:41:00+00:00, run_start_date=2024-04-15 03:42:00.626609+00:00, run_end_date=2024-04-15 03:42:05.862812+00:00, run_duration=5.236203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:41:00+00:00, data_interval_end=2024-04-15 03:42:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:42:05.885600786Z [2024-04-15T03:42:05.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:42:00+00:00, run_after=2024-04-15T03:43:00+00:00 2024-04-15T03:42:05.925232199Z [2024-04-15T03:42:05.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:41:00+00:00 exited with status success for try_number 1 2024-04-15T03:42:05.932391336Z [2024-04-15T03:42:05.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:41:00+00:00, map_index=-1, run_start_date=2024-04-15 03:42:03.354309+00:00, run_end_date=2024-04-15 03:42:05.172845+00:00, run_duration=1.818536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:42:00.692257+00:00, queued_by_job_id=2, pid=10537 2024-04-15T03:43:00.510773451Z [2024-04-15T03:43:00.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:43:00+00:00, run_after=2024-04-15T03:44:00+00:00 2024-04-15T03:43:00.519634716Z [2024-04-15T03:43:00.519+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:43:00.567745564Z [2024-04-15T03:43:00.567+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:43:00.567798452Z 2024-04-15T03:43:00.567828226Z 2024-04-15T03:43:00.568754270Z [2024-04-15T03:43:00.567+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:43:00.569241313Z [2024-04-15T03:43:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:43:00.570984599Z [2024-04-15T03:43:00.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:43:00.571039133Z 2024-04-15T03:43:00.571044846Z 2024-04-15T03:43:00.576349407Z [2024-04-15T03:43:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:43:00.576626586Z [2024-04-15T03:43:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:43:00.577100074Z [2024-04-15T03:43:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:43:00.577442400Z [2024-04-15T03:43:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:43:00.717382769Z [2024-04-15T03:43:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:42:00+00:00 exited with status queued for try_number 1 2024-04-15T03:43:00.718190522Z [2024-04-15T03:43:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:42:00+00:00 exited with status queued for try_number 1 2024-04-15T03:43:00.727874780Z [2024-04-15T03:43:00.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to 516ee86f-ba1a-4274-bf5f-b8a4894b801e 2024-04-15T03:43:00.730278943Z [2024-04-15T03:43:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 017a033b-3d94-44d3-b806-047df5ddabd7 2024-04-15T03:43:04.577729328Z [2024-04-15T03:43:04.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:43:04.578121374Z [2024-04-15T03:43:04.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:42:00+00:00, run_id=scheduled__2024-04-15T03:42:00+00:00, run_start_date=2024-04-15 03:43:00.528539+00:00, run_end_date=2024-04-15 03:43:04.577471+00:00, run_duration=4.048932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:42:00+00:00, data_interval_end=2024-04-15 03:43:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:43:04.595106774Z [2024-04-15T03:43:04.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:43:00+00:00, run_after=2024-04-15T03:44:00+00:00 2024-04-15T03:43:04.605713978Z [2024-04-15T03:43:04.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:43:04.605870481Z [2024-04-15T03:43:04.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:42:00+00:00, run_id=scheduled__2024-04-15T03:42:00+00:00, run_start_date=2024-04-15 03:43:00.529924+00:00, run_end_date=2024-04-15 03:43:04.605271+00:00, run_duration=4.075347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:42:00+00:00, data_interval_end=2024-04-15 03:43:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:43:04.620681051Z [2024-04-15T03:43:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:43:00+00:00, run_after=2024-04-15T03:44:00+00:00 2024-04-15T03:43:04.657585607Z [2024-04-15T03:43:04.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:42:00+00:00 exited with status success for try_number 1 2024-04-15T03:43:04.658256793Z [2024-04-15T03:43:04.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:42:00+00:00 exited with status success for try_number 1 2024-04-15T03:43:04.675938241Z [2024-04-15T03:43:04.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:42:00+00:00, map_index=-1, run_start_date=2024-04-15 03:43:02.541517+00:00, run_end_date=2024-04-15 03:43:04.263960+00:00, run_duration=1.722443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:43:00.572349+00:00, queued_by_job_id=2, pid=10590 2024-04-15T03:43:04.676678523Z [2024-04-15T03:43:04.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:42:00+00:00, map_index=-1, run_start_date=2024-04-15 03:43:02.601827+00:00, run_end_date=2024-04-15 03:43:03.992301+00:00, run_duration=1.390474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:43:00.572349+00:00, queued_by_job_id=2, pid=10591 2024-04-15T03:44:00.351149674Z [2024-04-15T03:44:00.350+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:44:00.370824146Z [2024-04-15T03:44:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:44:00+00:00, run_after=2024-04-15T03:45:00+00:00 2024-04-15T03:44:00.379887125Z [2024-04-15T03:44:00.379+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:44:00.451464432Z [2024-04-15T03:44:00.451+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:44:00.451482659Z 2024-04-15T03:44:00.451486793Z 2024-04-15T03:44:00.451490154Z 2024-04-15T03:44:00.451728477Z [2024-04-15T03:44:00.451+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:44:00.451949342Z [2024-04-15T03:44:00.451+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:44:00.452171797Z [2024-04-15T03:44:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:44:00.452913675Z [2024-04-15T03:44:00.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:44:00.452925328Z 2024-04-15T03:44:00.452929026Z 2024-04-15T03:44:00.452932657Z 2024-04-15T03:44:00.456871511Z [2024-04-15T03:44:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:44:00.457147899Z [2024-04-15T03:44:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:44:00.457461944Z [2024-04-15T03:44:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:44:00.457684854Z [2024-04-15T03:44:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:44:00.458002057Z [2024-04-15T03:44:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:44:00.458208031Z [2024-04-15T03:44:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:44:00.649554643Z [2024-04-15T03:44:00.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:42:00+00:00 exited with status queued for try_number 1 2024-04-15T03:44:00.649709835Z [2024-04-15T03:44:00.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:43:00+00:00 exited with status queued for try_number 1 2024-04-15T03:44:00.649865406Z [2024-04-15T03:44:00.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:43:00+00:00 exited with status queued for try_number 1 2024-04-15T03:44:00.659638196Z [2024-04-15T03:44:00.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28776e17-a5a7-458f-a848-9df4792a3f67 2024-04-15T03:44:00.659821924Z [2024-04-15T03:44:00.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2907d45-e679-4000-8d4d-56894528c1f1 2024-04-15T03:44:00.660033321Z [2024-04-15T03:44:00.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fc46e8d-660d-473f-bb25-f5873ac55e9f 2024-04-15T03:44:01.796250624Z [2024-04-15T03:44:01.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:44:01.796528603Z [2024-04-15T03:44:01.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:42:00+00:00, run_id=scheduled__2024-04-15T03:42:00+00:00, run_start_date=2024-04-15 03:44:00.393796+00:00, run_end_date=2024-04-15 03:44:01.796226+00:00, run_duration=1.40243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:42:00+00:00, data_interval_end=2024-04-15 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:44:01.806798747Z [2024-04-15T03:44:01.806+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:44:00+00:00, run_after=2024-04-15T03:46:00+00:00 2024-04-15T03:44:02.984609644Z [2024-04-15T03:44:02.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:42:00+00:00 exited with status success for try_number 1 2024-04-15T03:44:02.991264770Z [2024-04-15T03:44:02.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:42:00+00:00, map_index=-1, run_start_date=2024-04-15 03:44:01.243774+00:00, run_end_date=2024-04-15 03:44:01.717073+00:00, run_duration=0.473299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:44:00.453758+00:00, queued_by_job_id=2, pid=10625 2024-04-15T03:44:04.428714034Z [2024-04-15T03:44:04.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:44:04.428758407Z [2024-04-15T03:44:04.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:43:00+00:00, run_id=scheduled__2024-04-15T03:43:00+00:00, run_start_date=2024-04-15 03:44:00.395687+00:00, run_end_date=2024-04-15 03:44:04.423828+00:00, run_duration=4.028141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:43:00+00:00, data_interval_end=2024-04-15 03:44:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:44:04.454694340Z [2024-04-15T03:44:04.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:44:00+00:00, run_after=2024-04-15T03:45:00+00:00 2024-04-15T03:44:04.490261922Z [2024-04-15T03:44:04.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:43:00+00:00 exited with status success for try_number 1 2024-04-15T03:44:04.498914305Z [2024-04-15T03:44:04.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:43:00+00:00, map_index=-1, run_start_date=2024-04-15 03:44:02.663969+00:00, run_end_date=2024-04-15 03:44:04.047527+00:00, run_duration=1.383558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:44:00.453758+00:00, queued_by_job_id=2, pid=10656 2024-04-15T03:44:05.548062502Z [2024-04-15T03:44:05.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:44:05.548233012Z [2024-04-15T03:44:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:43:00+00:00, run_id=scheduled__2024-04-15T03:43:00+00:00, run_start_date=2024-04-15 03:44:00.397563+00:00, run_end_date=2024-04-15 03:44:05.547940+00:00, run_duration=5.150377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:43:00+00:00, data_interval_end=2024-04-15 03:44:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:44:05.557057568Z [2024-04-15T03:44:05.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:44:00+00:00, run_after=2024-04-15T03:45:00+00:00 2024-04-15T03:44:05.598181446Z [2024-04-15T03:44:05.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:43:00+00:00 exited with status success for try_number 1 2024-04-15T03:44:05.604445087Z [2024-04-15T03:44:05.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:43:00+00:00, map_index=-1, run_start_date=2024-04-15 03:44:02.496667+00:00, run_end_date=2024-04-15 03:44:04.436933+00:00, run_duration=1.940266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:44:00.453758+00:00, queued_by_job_id=2, pid=10655 2024-04-15T03:45:00.226683157Z [2024-04-15T03:45:00.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:45:00+00:00, run_after=2024-04-15T03:46:00+00:00 2024-04-15T03:45:00.241172328Z [2024-04-15T03:45:00.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:45:00+00:00, run_after=2024-04-15T03:50:00+00:00 2024-04-15T03:45:00.249315891Z [2024-04-15T03:45:00.248+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:45:00.357045722Z [2024-04-15T03:45:00.356+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:45:00.357092015Z 2024-04-15T03:45:00.357103082Z 2024-04-15T03:45:00.357112789Z 2024-04-15T03:45:00.357391167Z [2024-04-15T03:45:00.356+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:45:00.357661822Z [2024-04-15T03:45:00.357+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:45:00.358042211Z [2024-04-15T03:45:00.357+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:45:00.359006436Z [2024-04-15T03:45:00.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:45:00.359039812Z 2024-04-15T03:45:00.359049783Z 2024-04-15T03:45:00.359059158Z 2024-04-15T03:45:00.363417567Z [2024-04-15T03:45:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:45:00.363938021Z [2024-04-15T03:45:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:45:00.364450369Z [2024-04-15T03:45:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:45:00.364887682Z [2024-04-15T03:45:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:45:00.365518429Z [2024-04-15T03:45:00.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:45:00.365855635Z [2024-04-15T03:45:00.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:45:00.691301042Z [2024-04-15T03:45:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status queued for try_number 1 2024-04-15T03:45:00.691325629Z [2024-04-15T03:45:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:44:00+00:00 exited with status queued for try_number 1 2024-04-15T03:45:00.691674989Z [2024-04-15T03:45:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:44:00+00:00 exited with status queued for try_number 1 2024-04-15T03:45:00.711130940Z [2024-04-15T03:45:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c1923be-46a5-4669-b155-cfdf90d969c3 2024-04-15T03:45:00.712723735Z [2024-04-15T03:45:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79464445-1199-40b6-9f12-19b086bcd0fd 2024-04-15T03:45:00.712735416Z [2024-04-15T03:45:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to c34d3e91-11af-4f1f-ac8c-a6775d0b5138 2024-04-15T03:45:04.274817211Z [2024-04-15T03:45:04.274+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:45:04.274847765Z 2024-04-15T03:45:04.275196325Z [2024-04-15T03:45:04.275+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:45:04.275839429Z [2024-04-15T03:45:04.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:45:04.275849753Z 2024-04-15T03:45:04.278719977Z [2024-04-15T03:45:04.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:45:04.278969333Z [2024-04-15T03:45:04.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:45:04.350609628Z [2024-04-15T03:45:04.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status queued for try_number 1 2024-04-15T03:45:04.351271595Z [2024-04-15T03:45:04.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status success for try_number 1 2024-04-15T03:45:04.361327591Z [2024-04-15T03:45:04.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e86c758-2c02-4595-b01a-28195db7d86c 2024-04-15T03:45:04.361875701Z [2024-04-15T03:45:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:40:00+00:00, map_index=-1, run_start_date=2024-04-15 03:45:02.882683+00:00, run_end_date=2024-04-15 03:45:03.303894+00:00, run_duration=0.421211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:45:00.359863+00:00, queued_by_job_id=2, pid=10704 2024-04-15T03:45:05.526394093Z [2024-04-15T03:45:05.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:45:05.526960590Z [2024-04-15T03:45:05.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:44:00+00:00, run_id=scheduled__2024-04-15T03:44:00+00:00, run_start_date=2024-04-15 03:45:00.264091+00:00, run_end_date=2024-04-15 03:45:05.526293+00:00, run_duration=5.262202, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:44:00+00:00, data_interval_end=2024-04-15 03:45:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:45:05.537194683Z [2024-04-15T03:45:05.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:45:00+00:00, run_after=2024-04-15T03:46:00+00:00 2024-04-15T03:45:05.543044769Z [2024-04-15T03:45:05.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:45:05.543311298Z [2024-04-15T03:45:05.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:44:00+00:00, run_id=scheduled__2024-04-15T03:44:00+00:00, run_start_date=2024-04-15 03:45:00.266938+00:00, run_end_date=2024-04-15 03:45:05.542931+00:00, run_duration=5.275993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:44:00+00:00, data_interval_end=2024-04-15 03:45:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:45:05.551879520Z [2024-04-15T03:45:05.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:45:00+00:00, run_after=2024-04-15T03:46:00+00:00 2024-04-15T03:45:05.599805741Z [2024-04-15T03:45:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:44:00+00:00 exited with status success for try_number 1 2024-04-15T03:45:05.600169182Z [2024-04-15T03:45:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:44:00+00:00 exited with status success for try_number 1 2024-04-15T03:45:05.608906966Z [2024-04-15T03:45:05.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:44:00+00:00, map_index=-1, run_start_date=2024-04-15 03:45:03.380270+00:00, run_end_date=2024-04-15 03:45:04.809188+00:00, run_duration=1.428918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:45:00.359863+00:00, queued_by_job_id=2, pid=10732 2024-04-15T03:45:05.609358119Z [2024-04-15T03:45:05.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:44:00+00:00, map_index=-1, run_start_date=2024-04-15 03:45:03.259543+00:00, run_end_date=2024-04-15 03:45:05.172483+00:00, run_duration=1.91294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:45:00.359863+00:00, queued_by_job_id=2, pid=10731 2024-04-15T03:45:06.661383434Z [2024-04-15T03:45:06.660+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:45:06.661412156Z 2024-04-15T03:45:06.661941726Z [2024-04-15T03:45:06.661+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:45:06.663344225Z [2024-04-15T03:45:06.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:45:06.663353172Z 2024-04-15T03:45:06.667099350Z [2024-04-15T03:45:06.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:45:06.667402333Z [2024-04-15T03:45:06.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:45:06.726411938Z [2024-04-15T03:45:06.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status queued for try_number 1 2024-04-15T03:45:06.726717218Z [2024-04-15T03:45:06.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status success for try_number 1 2024-04-15T03:45:06.733738400Z [2024-04-15T03:45:06.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58484564-f20c-4280-92d6-130b0cb0cb01 2024-04-15T03:45:06.734548479Z [2024-04-15T03:45:06.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:40:00+00:00, map_index=-1, run_start_date=2024-04-15 03:45:05.960054+00:00, run_end_date=2024-04-15 03:45:06.377803+00:00, run_duration=0.417749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:45:04.276282+00:00, queued_by_job_id=2, pid=10762 2024-04-15T03:45:09.271772273Z [2024-04-15T03:45:09.271+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:45:09.271820186Z 2024-04-15T03:45:09.271993449Z [2024-04-15T03:45:09.271+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:45:09.273313465Z [2024-04-15T03:45:09.273+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:45:09.273327088Z 2024-04-15T03:45:09.276097881Z [2024-04-15T03:45:09.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:45:09.276361541Z [2024-04-15T03:45:09.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:45:09.325794277Z [2024-04-15T03:45:09.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status queued for try_number 1 2024-04-15T03:45:09.326096667Z [2024-04-15T03:45:09.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status success for try_number 1 2024-04-15T03:45:09.335074891Z [2024-04-15T03:45:09.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fced27b-6c41-4083-ae82-aff5aa98944d 2024-04-15T03:45:09.335466335Z [2024-04-15T03:45:09.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:40:00+00:00, map_index=0, run_start_date=2024-04-15 03:45:08.217735+00:00, run_end_date=2024-04-15 03:45:08.599695+00:00, run_duration=0.38196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:45:06.664287+00:00, queued_by_job_id=2, pid=10774 2024-04-15T03:45:11.580225353Z [2024-04-15T03:45:11.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:45:11.580740101Z [2024-04-15T03:45:11.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:40:00+00:00, run_id=scheduled__2024-04-15T03:40:00+00:00, run_start_date=2024-04-15 03:45:00.262624+00:00, run_end_date=2024-04-15 03:45:11.580072+00:00, run_duration=11.317448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:40:00+00:00, data_interval_end=2024-04-15 03:45:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:45:11.590898385Z [2024-04-15T03:45:11.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:45:00+00:00, run_after=2024-04-15T03:50:00+00:00 2024-04-15T03:45:11.629535230Z [2024-04-15T03:45:11.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:40:00+00:00 exited with status success for try_number 1 2024-04-15T03:45:11.636834042Z [2024-04-15T03:45:11.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:40:00+00:00, map_index=-1, run_start_date=2024-04-15 03:45:10.891864+00:00, run_end_date=2024-04-15 03:45:11.203598+00:00, run_duration=0.311734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:45:09.274274+00:00, queued_by_job_id=2, pid=10786 2024-04-15T03:45:41.594698699Z [2024-04-15T03:45:41.594+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:46:00.193317681Z [2024-04-15T03:46:00.192+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:46:00.226585589Z [2024-04-15T03:46:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:46:00+00:00, run_after=2024-04-15T03:47:00+00:00 2024-04-15T03:46:00.240552353Z [2024-04-15T03:46:00.239+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:46:00.341511113Z [2024-04-15T03:46:00.341+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:46:00.341549126Z 2024-04-15T03:46:00.341558491Z 2024-04-15T03:46:00.341567254Z 2024-04-15T03:46:00.341676477Z [2024-04-15T03:46:00.341+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:46:00.341868483Z [2024-04-15T03:46:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:46:00.342077574Z [2024-04-15T03:46:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:46:00.342850471Z [2024-04-15T03:46:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:46:00.342857566Z 2024-04-15T03:46:00.342870523Z 2024-04-15T03:46:00.342875119Z 2024-04-15T03:46:00.347013532Z [2024-04-15T03:46:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:46:00.347289776Z [2024-04-15T03:46:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:46:00.347732728Z [2024-04-15T03:46:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:46:00.348056799Z [2024-04-15T03:46:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:46:00.348528377Z [2024-04-15T03:46:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:46:00.348840299Z [2024-04-15T03:46:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:46:00.590018786Z [2024-04-15T03:46:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:44:00+00:00 exited with status queued for try_number 1 2024-04-15T03:46:00.590302495Z [2024-04-15T03:46:00.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status queued for try_number 1 2024-04-15T03:46:00.590405353Z [2024-04-15T03:46:00.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status queued for try_number 1 2024-04-15T03:46:00.599758309Z [2024-04-15T03:46:00.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8f5b696-af14-4dfe-a451-18879e0077df 2024-04-15T03:46:00.599975489Z [2024-04-15T03:46:00.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to da46c917-ecad-4822-8580-235568a4a8ca 2024-04-15T03:46:00.600174852Z [2024-04-15T03:46:00.600+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92d448bd-eb77-4958-a0f9-22fd18a8599c 2024-04-15T03:46:01.727246311Z [2024-04-15T03:46:01.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:46:01.727636840Z [2024-04-15T03:46:01.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:44:00+00:00, run_id=scheduled__2024-04-15T03:44:00+00:00, run_start_date=2024-04-15 03:46:00.263344+00:00, run_end_date=2024-04-15 03:46:01.727184+00:00, run_duration=1.46384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:44:00+00:00, data_interval_end=2024-04-15 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:46:01.742780983Z [2024-04-15T03:46:01.742+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:46:00+00:00, run_after=2024-04-15T03:48:00+00:00 2024-04-15T03:46:01.842845409Z [2024-04-15T03:46:01.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:44:00+00:00 exited with status success for try_number 1 2024-04-15T03:46:01.857206542Z [2024-04-15T03:46:01.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:44:00+00:00, map_index=-1, run_start_date=2024-04-15 03:46:01.000597+00:00, run_end_date=2024-04-15 03:46:01.362170+00:00, run_duration=0.361573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:46:00.343908+00:00, queued_by_job_id=2, pid=10803 2024-04-15T03:46:04.754581119Z [2024-04-15T03:46:04.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:46:04.754924871Z [2024-04-15T03:46:04.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:45:00+00:00, run_id=scheduled__2024-04-15T03:45:00+00:00, run_start_date=2024-04-15 03:46:00.269246+00:00, run_end_date=2024-04-15 03:46:04.754495+00:00, run_duration=4.485249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:45:00+00:00, data_interval_end=2024-04-15 03:46:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:46:04.763719720Z [2024-04-15T03:46:04.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:46:00+00:00, run_after=2024-04-15T03:47:00+00:00 2024-04-15T03:46:04.771629832Z [2024-04-15T03:46:04.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:46:04.772005193Z [2024-04-15T03:46:04.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:45:00+00:00, run_id=scheduled__2024-04-15T03:45:00+00:00, run_start_date=2024-04-15 03:46:00.266558+00:00, run_end_date=2024-04-15 03:46:04.771726+00:00, run_duration=4.505168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:45:00+00:00, data_interval_end=2024-04-15 03:46:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:46:04.784434636Z [2024-04-15T03:46:04.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:46:00+00:00, run_after=2024-04-15T03:47:00+00:00 2024-04-15T03:46:04.844481366Z [2024-04-15T03:46:04.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status success for try_number 1 2024-04-15T03:46:04.846727388Z [2024-04-15T03:46:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status success for try_number 1 2024-04-15T03:46:04.852629835Z [2024-04-15T03:46:04.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:45:00+00:00, map_index=-1, run_start_date=2024-04-15 03:46:02.432946+00:00, run_end_date=2024-04-15 03:46:04.104889+00:00, run_duration=1.671943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:46:00.343908+00:00, queued_by_job_id=2, pid=10833 2024-04-15T03:46:04.852957627Z [2024-04-15T03:46:04.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:45:00+00:00, map_index=-1, run_start_date=2024-04-15 03:46:02.518692+00:00, run_end_date=2024-04-15 03:46:03.827414+00:00, run_duration=1.308722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:46:00.343908+00:00, queued_by_job_id=2, pid=10834 2024-04-15T03:47:00.556142478Z [2024-04-15T03:47:00.555+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:47:00.582038496Z [2024-04-15T03:47:00.581+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:47:00+00:00, run_after=2024-04-15T03:48:00+00:00 2024-04-15T03:47:00.647126518Z [2024-04-15T03:47:00.646+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:47:00.647176938Z 2024-04-15T03:47:00.647187359Z 2024-04-15T03:47:00.647211056Z [2024-04-15T03:47:00.646+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:47:00.647517292Z [2024-04-15T03:47:00.647+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:47:00.649066246Z [2024-04-15T03:47:00.648+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:47:00.649080500Z 2024-04-15T03:47:00.649085579Z 2024-04-15T03:47:00.655028813Z [2024-04-15T03:47:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:47:00.655312522Z [2024-04-15T03:47:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:47:00.655820545Z [2024-04-15T03:47:00.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:47:00.656029031Z [2024-04-15T03:47:00.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:47:00.865394245Z [2024-04-15T03:47:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:46:00+00:00 exited with status queued for try_number 1 2024-04-15T03:47:00.865593846Z [2024-04-15T03:47:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:46:00+00:00 exited with status queued for try_number 1 2024-04-15T03:47:00.871971801Z [2024-04-15T03:47:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90d2d9c6-0a02-4b0e-8286-51c036f5de47 2024-04-15T03:47:00.872214553Z [2024-04-15T03:47:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1818d2ae-a204-4bb4-89eb-d767bf31ccc3 2024-04-15T03:47:05.202888322Z [2024-04-15T03:47:05.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:47:05.203432899Z [2024-04-15T03:47:05.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:46:00+00:00, run_id=scheduled__2024-04-15T03:46:00+00:00, run_start_date=2024-04-15 03:47:00.595762+00:00, run_end_date=2024-04-15 03:47:05.202954+00:00, run_duration=4.607192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:46:00+00:00, data_interval_end=2024-04-15 03:47:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:47:05.220965849Z [2024-04-15T03:47:05.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:47:00+00:00, run_after=2024-04-15T03:48:00+00:00 2024-04-15T03:47:05.229131955Z [2024-04-15T03:47:05.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:47:05.229314631Z [2024-04-15T03:47:05.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:46:00+00:00, run_id=scheduled__2024-04-15T03:46:00+00:00, run_start_date=2024-04-15 03:47:00.597150+00:00, run_end_date=2024-04-15 03:47:05.229053+00:00, run_duration=4.631903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:46:00+00:00, data_interval_end=2024-04-15 03:47:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:47:05.238063815Z [2024-04-15T03:47:05.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:47:00+00:00, run_after=2024-04-15T03:48:00+00:00 2024-04-15T03:47:05.278761762Z [2024-04-15T03:47:05.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:46:00+00:00 exited with status success for try_number 1 2024-04-15T03:47:05.278801302Z [2024-04-15T03:47:05.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:46:00+00:00 exited with status success for try_number 1 2024-04-15T03:47:05.285578031Z [2024-04-15T03:47:05.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:46:00+00:00, map_index=-1, run_start_date=2024-04-15 03:47:02.942366+00:00, run_end_date=2024-04-15 03:47:04.657797+00:00, run_duration=1.715431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:47:00.650305+00:00, queued_by_job_id=2, pid=10889 2024-04-15T03:47:05.286023759Z [2024-04-15T03:47:05.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:46:00+00:00, map_index=-1, run_start_date=2024-04-15 03:47:02.691568+00:00, run_end_date=2024-04-15 03:47:04.007563+00:00, run_duration=1.315995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:47:00.650305+00:00, queued_by_job_id=2, pid=10888 2024-04-15T03:48:00.644366502Z [2024-04-15T03:48:00.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:48:00+00:00, run_after=2024-04-15T03:49:00+00:00 2024-04-15T03:48:00.653731598Z [2024-04-15T03:48:00.653+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:48:00.663221012Z [2024-04-15T03:48:00.662+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:48:00.753016303Z [2024-04-15T03:48:00.752+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:48:00.753054746Z 2024-04-15T03:48:00.753063010Z 2024-04-15T03:48:00.753070320Z 2024-04-15T03:48:00.753532969Z [2024-04-15T03:48:00.753+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:48:00.753918726Z [2024-04-15T03:48:00.753+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:48:00.754281149Z [2024-04-15T03:48:00.754+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:48:00.755418849Z [2024-04-15T03:48:00.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:48:00.755431961Z 2024-04-15T03:48:00.755437390Z 2024-04-15T03:48:00.755442480Z 2024-04-15T03:48:00.761493984Z [2024-04-15T03:48:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:48:00.761850667Z [2024-04-15T03:48:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:48:00.762509114Z [2024-04-15T03:48:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:48:00.762923865Z [2024-04-15T03:48:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:48:00.763481300Z [2024-04-15T03:48:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:48:00.763754575Z [2024-04-15T03:48:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:48:01.213495723Z [2024-04-15T03:48:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:46:00+00:00 exited with status queued for try_number 1 2024-04-15T03:48:01.216319077Z [2024-04-15T03:48:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:47:00+00:00 exited with status queued for try_number 1 2024-04-15T03:48:01.216576982Z [2024-04-15T03:48:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:47:00+00:00 exited with status queued for try_number 1 2024-04-15T03:48:01.224443634Z [2024-04-15T03:48:01.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58641f2a-26f8-47d4-8685-5659c9e22577 2024-04-15T03:48:01.225878600Z [2024-04-15T03:48:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0b6f60b-105b-45e4-89d1-a7b3a06e48d9 2024-04-15T03:48:01.226305467Z [2024-04-15T03:48:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to dccd5434-5644-431f-b8d0-a92c16c1ff5f 2024-04-15T03:48:03.474690156Z [2024-04-15T03:48:03.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:48:03.475454320Z [2024-04-15T03:48:03.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:46:00+00:00, run_id=scheduled__2024-04-15T03:46:00+00:00, run_start_date=2024-04-15 03:48:00.677725+00:00, run_end_date=2024-04-15 03:48:03.474645+00:00, run_duration=2.79692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:46:00+00:00, data_interval_end=2024-04-15 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:48:03.483023805Z [2024-04-15T03:48:03.482+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:48:00+00:00, run_after=2024-04-15T03:50:00+00:00 2024-04-15T03:48:03.590834512Z [2024-04-15T03:48:03.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:46:00+00:00 exited with status success for try_number 1 2024-04-15T03:48:03.600741817Z [2024-04-15T03:48:03.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:46:00+00:00, map_index=-1, run_start_date=2024-04-15 03:48:01.981751+00:00, run_end_date=2024-04-15 03:48:02.512506+00:00, run_duration=0.530755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:48:00.756895+00:00, queued_by_job_id=2, pid=10924 2024-04-15T03:48:05.770898204Z [2024-04-15T03:48:05.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:48:05.771195222Z [2024-04-15T03:48:05.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:47:00+00:00, run_id=scheduled__2024-04-15T03:47:00+00:00, run_start_date=2024-04-15 03:48:00.679518+00:00, run_end_date=2024-04-15 03:48:05.770822+00:00, run_duration=5.091304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:47:00+00:00, data_interval_end=2024-04-15 03:48:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:48:05.780465281Z [2024-04-15T03:48:05.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:48:00+00:00, run_after=2024-04-15T03:49:00+00:00 2024-04-15T03:48:05.829801118Z [2024-04-15T03:48:05.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:47:00+00:00 exited with status success for try_number 1 2024-04-15T03:48:05.839403238Z [2024-04-15T03:48:05.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:47:00+00:00, map_index=-1, run_start_date=2024-04-15 03:48:03.644380+00:00, run_end_date=2024-04-15 03:48:05.178635+00:00, run_duration=1.534255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:48:00.756895+00:00, queued_by_job_id=2, pid=10955 2024-04-15T03:48:06.905716015Z [2024-04-15T03:48:06.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:48:06.906790489Z [2024-04-15T03:48:06.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:47:00+00:00, run_id=scheduled__2024-04-15T03:47:00+00:00, run_start_date=2024-04-15 03:48:00.680913+00:00, run_end_date=2024-04-15 03:48:06.905995+00:00, run_duration=6.225082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:47:00+00:00, data_interval_end=2024-04-15 03:48:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:48:06.924701749Z [2024-04-15T03:48:06.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:48:00+00:00, run_after=2024-04-15T03:49:00+00:00 2024-04-15T03:48:06.961977645Z [2024-04-15T03:48:06.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:47:00+00:00 exited with status success for try_number 1 2024-04-15T03:48:06.971469148Z [2024-04-15T03:48:06.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:47:00+00:00, map_index=-1, run_start_date=2024-04-15 03:48:03.653008+00:00, run_end_date=2024-04-15 03:48:06.468352+00:00, run_duration=2.815344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:48:00.756895+00:00, queued_by_job_id=2, pid=10954 2024-04-15T03:49:00.542400588Z [2024-04-15T03:49:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:49:00+00:00, run_after=2024-04-15T03:50:00+00:00 2024-04-15T03:49:00.551940768Z [2024-04-15T03:49:00.551+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:49:00.625868195Z [2024-04-15T03:49:00.625+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:49:00.625922624Z 2024-04-15T03:49:00.625933077Z 2024-04-15T03:49:00.626373612Z [2024-04-15T03:49:00.625+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:49:00.626969372Z [2024-04-15T03:49:00.626+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:49:00.628240092Z [2024-04-15T03:49:00.627+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:49:00.628253897Z 2024-04-15T03:49:00.628259801Z 2024-04-15T03:49:00.632541666Z [2024-04-15T03:49:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:49:00.632894802Z [2024-04-15T03:49:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:49:00.633317558Z [2024-04-15T03:49:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:49:00.633492175Z [2024-04-15T03:49:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:49:00.806044853Z [2024-04-15T03:49:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:48:00+00:00 exited with status queued for try_number 1 2024-04-15T03:49:00.806068091Z [2024-04-15T03:49:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:48:00+00:00 exited with status queued for try_number 1 2024-04-15T03:49:00.814283515Z [2024-04-15T03:49:00.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to 814f5453-c014-4ae2-9513-cdbccd7066e1 2024-04-15T03:49:00.814300161Z [2024-04-15T03:49:00.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to 469ef80d-0667-4607-9460-8d7fec9d1cac 2024-04-15T03:49:05.086807693Z [2024-04-15T03:49:05.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:49:05.087251886Z [2024-04-15T03:49:05.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:48:00+00:00, run_id=scheduled__2024-04-15T03:48:00+00:00, run_start_date=2024-04-15 03:49:00.564326+00:00, run_end_date=2024-04-15 03:49:05.086671+00:00, run_duration=4.522345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:48:00+00:00, data_interval_end=2024-04-15 03:49:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:49:05.099205932Z [2024-04-15T03:49:05.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:49:00+00:00, run_after=2024-04-15T03:50:00+00:00 2024-04-15T03:49:05.109233892Z [2024-04-15T03:49:05.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:49:05.109571954Z [2024-04-15T03:49:05.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:48:00+00:00, run_id=scheduled__2024-04-15T03:48:00+00:00, run_start_date=2024-04-15 03:49:00.565714+00:00, run_end_date=2024-04-15 03:49:05.109127+00:00, run_duration=4.543413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:48:00+00:00, data_interval_end=2024-04-15 03:49:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:49:05.133052261Z [2024-04-15T03:49:05.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:49:00+00:00, run_after=2024-04-15T03:50:00+00:00 2024-04-15T03:49:05.184001021Z [2024-04-15T03:49:05.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:48:00+00:00 exited with status success for try_number 1 2024-04-15T03:49:05.184869512Z [2024-04-15T03:49:05.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:48:00+00:00 exited with status success for try_number 1 2024-04-15T03:49:05.197242839Z [2024-04-15T03:49:05.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:48:00+00:00, map_index=-1, run_start_date=2024-04-15 03:49:02.523090+00:00, run_end_date=2024-04-15 03:49:04.576931+00:00, run_duration=2.053841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:49:00.629262+00:00, queued_by_job_id=2, pid=11009 2024-04-15T03:49:05.197639235Z [2024-04-15T03:49:05.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:48:00+00:00, map_index=-1, run_start_date=2024-04-15 03:49:02.562319+00:00, run_end_date=2024-04-15 03:49:04.233180+00:00, run_duration=1.670861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:49:00.629262+00:00, queued_by_job_id=2, pid=11010 2024-04-15T03:50:00.387708787Z [2024-04-15T03:50:00.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:50:00+00:00, run_after=2024-04-15T03:51:00+00:00 2024-04-15T03:50:00.404190346Z [2024-04-15T03:50:00.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:50:00+00:00, run_after=2024-04-15T03:55:00+00:00 2024-04-15T03:50:00.411992503Z [2024-04-15T03:50:00.411+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:50:00.418932138Z [2024-04-15T03:50:00.418+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:50:00.520334425Z [2024-04-15T03:50:00.519+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T03:50:00.520377008Z 2024-04-15T03:50:00.520386697Z 2024-04-15T03:50:00.520396288Z 2024-04-15T03:50:00.520405060Z 2024-04-15T03:50:00.520693827Z [2024-04-15T03:50:00.520+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:50:00.521058152Z [2024-04-15T03:50:00.520+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:50:00.521388878Z [2024-04-15T03:50:00.521+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:50:00.521702886Z [2024-04-15T03:50:00.521+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:50:00.523112304Z [2024-04-15T03:50:00.522+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:50:00.523132850Z 2024-04-15T03:50:00.523142995Z 2024-04-15T03:50:00.523152081Z 2024-04-15T03:50:00.523160680Z 2024-04-15T03:50:00.530015045Z [2024-04-15T03:50:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:50:00.530422713Z [2024-04-15T03:50:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:50:00.531295977Z [2024-04-15T03:50:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:50:00.531652809Z [2024-04-15T03:50:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:50:00.532259324Z [2024-04-15T03:50:00.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:50:00.532640562Z [2024-04-15T03:50:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:50:00.533238894Z [2024-04-15T03:50:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:50:00.533591010Z [2024-04-15T03:50:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:50:00.931360397Z [2024-04-15T03:50:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status queued for try_number 1 2024-04-15T03:50:00.931406731Z [2024-04-15T03:50:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:48:00+00:00 exited with status queued for try_number 1 2024-04-15T03:50:00.931410965Z [2024-04-15T03:50:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:49:00+00:00 exited with status queued for try_number 1 2024-04-15T03:50:00.931413991Z [2024-04-15T03:50:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:49:00+00:00 exited with status queued for try_number 1 2024-04-15T03:50:00.955102283Z [2024-04-15T03:50:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0aa97997-5d85-47fe-bf72-911ce53d8644 2024-04-15T03:50:00.955370183Z [2024-04-15T03:50:00.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to f33b77a4-7fa7-483a-80da-ac6bb0fbadfa 2024-04-15T03:50:00.955616674Z [2024-04-15T03:50:00.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to f77d170b-9ee6-40c6-9010-f48cb7af238a 2024-04-15T03:50:00.955866179Z [2024-04-15T03:50:00.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ece7048-9289-4ff9-b62d-4e4fba189ba1 2024-04-15T03:50:02.286249334Z [2024-04-15T03:50:02.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:50:02.286887790Z [2024-04-15T03:50:02.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:48:00+00:00, run_id=scheduled__2024-04-15T03:48:00+00:00, run_start_date=2024-04-15 03:50:00.432731+00:00, run_end_date=2024-04-15 03:50:02.286475+00:00, run_duration=1.853744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:48:00+00:00, data_interval_end=2024-04-15 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:50:02.304127971Z [2024-04-15T03:50:02.303+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:50:00+00:00, run_after=2024-04-15T03:52:00+00:00 2024-04-15T03:50:03.575838485Z [2024-04-15T03:50:03.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:48:00+00:00 exited with status success for try_number 1 2024-04-15T03:50:03.589432132Z [2024-04-15T03:50:03.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:48:00+00:00, map_index=-1, run_start_date=2024-04-15 03:50:01.701711+00:00, run_end_date=2024-04-15 03:50:02.218731+00:00, run_duration=0.51702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:50:00.525108+00:00, queued_by_job_id=2, pid=11046 2024-04-15T03:50:04.426660807Z [2024-04-15T03:50:04.426+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:50:04.426704254Z 2024-04-15T03:50:04.426818527Z [2024-04-15T03:50:04.426+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:50:04.427415362Z [2024-04-15T03:50:04.427+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:50:04.427438181Z 2024-04-15T03:50:04.430422630Z [2024-04-15T03:50:04.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:50:04.430581018Z [2024-04-15T03:50:04.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:50:04.468957824Z [2024-04-15T03:50:04.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status queued for try_number 1 2024-04-15T03:50:04.469021056Z [2024-04-15T03:50:04.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status success for try_number 1 2024-04-15T03:50:04.482098485Z [2024-04-15T03:50:04.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68d2f152-bc4b-49ac-a906-bbdc267221ab 2024-04-15T03:50:04.482368913Z [2024-04-15T03:50:04.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:45:00+00:00, map_index=-1, run_start_date=2024-04-15 03:50:03.162686+00:00, run_end_date=2024-04-15 03:50:03.555956+00:00, run_duration=0.39327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:50:00.525108+00:00, queued_by_job_id=2, pid=11077 2024-04-15T03:50:04.552203859Z [2024-04-15T03:50:04.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:50:04.552448931Z [2024-04-15T03:50:04.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:49:00+00:00, run_id=scheduled__2024-04-15T03:49:00+00:00, run_start_date=2024-04-15 03:50:00.433786+00:00, run_end_date=2024-04-15 03:50:04.552164+00:00, run_duration=4.118378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:49:00+00:00, data_interval_end=2024-04-15 03:50:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:50:04.561162253Z [2024-04-15T03:50:04.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:50:00+00:00, run_after=2024-04-15T03:51:00+00:00 2024-04-15T03:50:05.681075264Z [2024-04-15T03:50:05.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:50:05.681246051Z [2024-04-15T03:50:05.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:49:00+00:00, run_id=scheduled__2024-04-15T03:49:00+00:00, run_start_date=2024-04-15 03:50:00.434900+00:00, run_end_date=2024-04-15 03:50:05.680910+00:00, run_duration=5.24601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:49:00+00:00, data_interval_end=2024-04-15 03:50:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:50:05.693771596Z [2024-04-15T03:50:05.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:50:00+00:00, run_after=2024-04-15T03:51:00+00:00 2024-04-15T03:50:05.763611491Z [2024-04-15T03:50:05.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:49:00+00:00 exited with status success for try_number 1 2024-04-15T03:50:05.763761470Z [2024-04-15T03:50:05.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:49:00+00:00 exited with status success for try_number 1 2024-04-15T03:50:05.772941925Z [2024-04-15T03:50:05.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:49:00+00:00, map_index=-1, run_start_date=2024-04-15 03:50:03.249402+00:00, run_end_date=2024-04-15 03:50:04.514261+00:00, run_duration=1.264859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:50:00.525108+00:00, queued_by_job_id=2, pid=11078 2024-04-15T03:50:05.773363384Z [2024-04-15T03:50:05.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:49:00+00:00, map_index=-1, run_start_date=2024-04-15 03:50:03.465221+00:00, run_end_date=2024-04-15 03:50:05.076435+00:00, run_duration=1.611214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:50:00.525108+00:00, queued_by_job_id=2, pid=11097 2024-04-15T03:50:06.834178616Z [2024-04-15T03:50:06.833+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:50:06.834204006Z 2024-04-15T03:50:06.834388905Z [2024-04-15T03:50:06.834+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:50:06.834913372Z [2024-04-15T03:50:06.834+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:50:06.834918755Z 2024-04-15T03:50:06.836628941Z [2024-04-15T03:50:06.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:50:06.836772651Z [2024-04-15T03:50:06.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:50:06.886669669Z [2024-04-15T03:50:06.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status queued for try_number 1 2024-04-15T03:50:06.886923751Z [2024-04-15T03:50:06.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status success for try_number 1 2024-04-15T03:50:06.892390493Z [2024-04-15T03:50:06.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2ba02b3-e90e-41d8-8ac7-01f5f776a9ae 2024-04-15T03:50:06.892722171Z [2024-04-15T03:50:06.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:45:00+00:00, map_index=-1, run_start_date=2024-04-15 03:50:06.088375+00:00, run_end_date=2024-04-15 03:50:06.507853+00:00, run_duration=0.419478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:50:04.427645+00:00, queued_by_job_id=2, pid=11127 2024-04-15T03:50:09.471525516Z [2024-04-15T03:50:09.470+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:50:09.471556604Z 2024-04-15T03:50:09.471713370Z [2024-04-15T03:50:09.471+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:50:09.473996094Z [2024-04-15T03:50:09.472+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:50:09.474016793Z 2024-04-15T03:50:09.475753914Z [2024-04-15T03:50:09.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:50:09.475975153Z [2024-04-15T03:50:09.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:50:09.552817957Z [2024-04-15T03:50:09.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status queued for try_number 1 2024-04-15T03:50:09.553051819Z [2024-04-15T03:50:09.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status success for try_number 1 2024-04-15T03:50:09.563764689Z [2024-04-15T03:50:09.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b7c5b76-ecc7-4c09-b9ea-c0b9e86cd036 2024-04-15T03:50:09.564154253Z [2024-04-15T03:50:09.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:45:00+00:00, map_index=0, run_start_date=2024-04-15 03:50:08.380218+00:00, run_end_date=2024-04-15 03:50:08.753149+00:00, run_duration=0.372931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:50:06.835184+00:00, queued_by_job_id=2, pid=11139 2024-04-15T03:50:11.841441200Z [2024-04-15T03:50:11.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:50:11.841953440Z [2024-04-15T03:50:11.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:45:00+00:00, run_id=scheduled__2024-04-15T03:45:00+00:00, run_start_date=2024-04-15 03:50:00.431479+00:00, run_end_date=2024-04-15 03:50:11.841397+00:00, run_duration=11.409918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:45:00+00:00, data_interval_end=2024-04-15 03:50:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:50:11.849526507Z [2024-04-15T03:50:11.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:50:00+00:00, run_after=2024-04-15T03:55:00+00:00 2024-04-15T03:50:11.879358804Z [2024-04-15T03:50:11.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:45:00+00:00 exited with status success for try_number 1 2024-04-15T03:50:11.886122659Z [2024-04-15T03:50:11.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:45:00+00:00, map_index=-1, run_start_date=2024-04-15 03:50:11.286989+00:00, run_end_date=2024-04-15 03:50:11.619722+00:00, run_duration=0.332733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:50:09.473677+00:00, queued_by_job_id=2, pid=11151 2024-04-15T03:50:41.649363053Z [2024-04-15T03:50:41.648+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:51:00.262029163Z [2024-04-15T03:51:00.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:51:00+00:00, run_after=2024-04-15T03:52:00+00:00 2024-04-15T03:51:00.270608280Z [2024-04-15T03:51:00.270+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:51:00.338430684Z [2024-04-15T03:51:00.337+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:51:00.338543382Z 2024-04-15T03:51:00.338557365Z 2024-04-15T03:51:00.338639431Z [2024-04-15T03:51:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:51:00.338650708Z [2024-04-15T03:51:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:51:00.339461357Z [2024-04-15T03:51:00.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:51:00.339483529Z 2024-04-15T03:51:00.339492983Z 2024-04-15T03:51:00.342810739Z [2024-04-15T03:51:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:51:00.342846370Z [2024-04-15T03:51:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:51:00.343130342Z [2024-04-15T03:51:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:51:00.343195968Z [2024-04-15T03:51:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:51:00.499660897Z [2024-04-15T03:51:00.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status queued for try_number 1 2024-04-15T03:51:00.499862655Z [2024-04-15T03:51:00.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status queued for try_number 1 2024-04-15T03:51:00.507134318Z [2024-04-15T03:51:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5713763-56cb-499b-b33c-06a07c3a183d 2024-04-15T03:51:00.507307113Z [2024-04-15T03:51:00.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07f5ffb6-7759-416d-9508-d55c5ceb6478 2024-04-15T03:51:03.844784359Z [2024-04-15T03:51:03.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:51:03.845225146Z [2024-04-15T03:51:03.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:50:00+00:00, run_id=scheduled__2024-04-15T03:50:00+00:00, run_start_date=2024-04-15 03:51:00.285173+00:00, run_end_date=2024-04-15 03:51:03.844703+00:00, run_duration=3.55953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:50:00+00:00, data_interval_end=2024-04-15 03:51:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:51:03.853799465Z [2024-04-15T03:51:03.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:51:00+00:00, run_after=2024-04-15T03:52:00+00:00 2024-04-15T03:51:03.890574808Z [2024-04-15T03:51:03.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status success for try_number 1 2024-04-15T03:51:03.894679448Z [2024-04-15T03:51:03.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:50:00+00:00, map_index=-1, run_start_date=2024-04-15 03:51:02.092559+00:00, run_end_date=2024-04-15 03:51:03.473502+00:00, run_duration=1.380943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:51:00.339963+00:00, queued_by_job_id=2, pid=11177 2024-04-15T03:51:04.914906683Z [2024-04-15T03:51:04.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:51:04.915410166Z [2024-04-15T03:51:04.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:50:00+00:00, run_id=scheduled__2024-04-15T03:50:00+00:00, run_start_date=2024-04-15 03:51:00.287317+00:00, run_end_date=2024-04-15 03:51:04.914805+00:00, run_duration=4.627488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:50:00+00:00, data_interval_end=2024-04-15 03:51:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:51:04.928626930Z [2024-04-15T03:51:04.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:51:00+00:00, run_after=2024-04-15T03:52:00+00:00 2024-04-15T03:51:04.978292956Z [2024-04-15T03:51:04.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status success for try_number 1 2024-04-15T03:51:04.988941912Z [2024-04-15T03:51:04.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:50:00+00:00, map_index=-1, run_start_date=2024-04-15 03:51:02.425188+00:00, run_end_date=2024-04-15 03:51:04.100054+00:00, run_duration=1.674866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:51:00.339963+00:00, queued_by_job_id=2, pid=11187 2024-04-15T03:52:00.607705267Z [2024-04-15T03:52:00.607+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:52:00.617633289Z [2024-04-15T03:52:00.617+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:52:00.634876837Z [2024-04-15T03:52:00.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:52:00+00:00, run_after=2024-04-15T03:53:00+00:00 2024-04-15T03:52:00.739321194Z [2024-04-15T03:52:00.738+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:52:00.739379941Z 2024-04-15T03:52:00.739388550Z 2024-04-15T03:52:00.739395330Z 2024-04-15T03:52:00.741232649Z [2024-04-15T03:52:00.739+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:52:00.741563561Z [2024-04-15T03:52:00.741+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:52:00.742281586Z [2024-04-15T03:52:00.741+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:52:00.744008260Z [2024-04-15T03:52:00.743+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:52:00.744018195Z 2024-04-15T03:52:00.744021707Z 2024-04-15T03:52:00.744024605Z 2024-04-15T03:52:00.750588357Z [2024-04-15T03:52:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:52:00.750809721Z [2024-04-15T03:52:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:52:00.751245782Z [2024-04-15T03:52:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:52:00.751528019Z [2024-04-15T03:52:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:52:00.752044279Z [2024-04-15T03:52:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:52:00.752355281Z [2024-04-15T03:52:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:52:01.142898417Z [2024-04-15T03:52:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status queued for try_number 1 2024-04-15T03:52:01.143037300Z [2024-04-15T03:52:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:51:00+00:00 exited with status queued for try_number 1 2024-04-15T03:52:01.143145571Z [2024-04-15T03:52:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:51:00+00:00 exited with status queued for try_number 1 2024-04-15T03:52:01.162747578Z [2024-04-15T03:52:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3ac2ac2-34f2-4a7c-8b5e-eb3103045632 2024-04-15T03:52:01.162935311Z [2024-04-15T03:52:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 086f887d-642c-4afc-9187-8efcd180fa71 2024-04-15T03:52:01.163084750Z [2024-04-15T03:52:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to a54fb706-de70-4cef-8619-6161a5fd6a27 2024-04-15T03:52:03.565542572Z [2024-04-15T03:52:03.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:52:03.566267529Z [2024-04-15T03:52:03.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:50:00+00:00, run_id=scheduled__2024-04-15T03:50:00+00:00, run_start_date=2024-04-15 03:52:00.652967+00:00, run_end_date=2024-04-15 03:52:03.565751+00:00, run_duration=2.912784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:50:00+00:00, data_interval_end=2024-04-15 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:52:03.576280906Z [2024-04-15T03:52:03.575+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:52:00+00:00, run_after=2024-04-15T03:54:00+00:00 2024-04-15T03:52:03.648956384Z [2024-04-15T03:52:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status success for try_number 1 2024-04-15T03:52:03.661214885Z [2024-04-15T03:52:03.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:50:00+00:00, map_index=-1, run_start_date=2024-04-15 03:52:02.268659+00:00, run_end_date=2024-04-15 03:52:02.657211+00:00, run_duration=0.388552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:52:00.745705+00:00, queued_by_job_id=2, pid=11224 2024-04-15T03:52:04.732841500Z [2024-04-15T03:52:04.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:52:04.733115408Z [2024-04-15T03:52:04.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:51:00+00:00, run_id=scheduled__2024-04-15T03:51:00+00:00, run_start_date=2024-04-15 03:52:00.657025+00:00, run_end_date=2024-04-15 03:52:04.732733+00:00, run_duration=4.075708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:51:00+00:00, data_interval_end=2024-04-15 03:52:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:52:04.746928875Z [2024-04-15T03:52:04.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:52:00+00:00, run_after=2024-04-15T03:53:00+00:00 2024-04-15T03:52:04.821446075Z [2024-04-15T03:52:04.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:51:00+00:00 exited with status success for try_number 1 2024-04-15T03:52:04.830005357Z [2024-04-15T03:52:04.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:51:00+00:00, map_index=-1, run_start_date=2024-04-15 03:52:02.979056+00:00, run_end_date=2024-04-15 03:52:04.284687+00:00, run_duration=1.305631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:52:00.745705+00:00, queued_by_job_id=2, pid=11252 2024-04-15T03:52:06.464800553Z [2024-04-15T03:52:06.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:52:06.465413782Z [2024-04-15T03:52:06.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:51:00+00:00, run_id=scheduled__2024-04-15T03:51:00+00:00, run_start_date=2024-04-15 03:52:00.659818+00:00, run_end_date=2024-04-15 03:52:06.464819+00:00, run_duration=5.805001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:51:00+00:00, data_interval_end=2024-04-15 03:52:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:52:06.479920318Z [2024-04-15T03:52:06.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:52:00+00:00, run_after=2024-04-15T03:53:00+00:00 2024-04-15T03:52:06.518227236Z [2024-04-15T03:52:06.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:51:00+00:00 exited with status success for try_number 1 2024-04-15T03:52:06.527582667Z [2024-04-15T03:52:06.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:51:00+00:00, map_index=-1, run_start_date=2024-04-15 03:52:03.141069+00:00, run_end_date=2024-04-15 03:52:05.293333+00:00, run_duration=2.152264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:52:00.745705+00:00, queued_by_job_id=2, pid=11253 2024-04-15T03:53:00.502574043Z [2024-04-15T03:53:00.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:53:00+00:00, run_after=2024-04-15T03:54:00+00:00 2024-04-15T03:53:00.514640654Z [2024-04-15T03:53:00.514+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:53:00.593040817Z [2024-04-15T03:53:00.592+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:53:00.593061197Z 2024-04-15T03:53:00.593079537Z 2024-04-15T03:53:00.593306318Z [2024-04-15T03:53:00.592+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:53:00.593314143Z [2024-04-15T03:53:00.593+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:53:00.593858321Z [2024-04-15T03:53:00.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:53:00.593869696Z 2024-04-15T03:53:00.593873047Z 2024-04-15T03:53:00.597079401Z [2024-04-15T03:53:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:53:00.597209747Z [2024-04-15T03:53:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:53:00.597630361Z [2024-04-15T03:53:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:53:00.597889483Z [2024-04-15T03:53:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:53:00.772048247Z [2024-04-15T03:53:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:52:00+00:00 exited with status queued for try_number 1 2024-04-15T03:53:00.772080692Z [2024-04-15T03:53:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:52:00+00:00 exited with status queued for try_number 1 2024-04-15T03:53:00.785330577Z [2024-04-15T03:53:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 700880d6-8975-4b3f-8eae-f6ea1d8d0021 2024-04-15T03:53:00.786009784Z [2024-04-15T03:53:00.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46955310-dc66-4f36-9503-70c5d4f9cf4a 2024-04-15T03:53:04.628833573Z [2024-04-15T03:53:04.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:53:04.629220347Z [2024-04-15T03:53:04.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:52:00+00:00, run_id=scheduled__2024-04-15T03:52:00+00:00, run_start_date=2024-04-15 03:53:00.528874+00:00, run_end_date=2024-04-15 03:53:04.628771+00:00, run_duration=4.099897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:52:00+00:00, data_interval_end=2024-04-15 03:53:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:53:04.641215138Z [2024-04-15T03:53:04.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:53:00+00:00, run_after=2024-04-15T03:54:00+00:00 2024-04-15T03:53:04.690872741Z [2024-04-15T03:53:04.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:52:00+00:00 exited with status success for try_number 1 2024-04-15T03:53:04.701190725Z [2024-04-15T03:53:04.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:52:00+00:00, map_index=-1, run_start_date=2024-04-15 03:53:02.647639+00:00, run_end_date=2024-04-15 03:53:04.334371+00:00, run_duration=1.686732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:53:00.594376+00:00, queued_by_job_id=2, pid=11308 2024-04-15T03:53:05.756579149Z [2024-04-15T03:53:05.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:53:05.756930744Z [2024-04-15T03:53:05.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:52:00+00:00, run_id=scheduled__2024-04-15T03:52:00+00:00, run_start_date=2024-04-15 03:53:00.530462+00:00, run_end_date=2024-04-15 03:53:05.756430+00:00, run_duration=5.225968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:52:00+00:00, data_interval_end=2024-04-15 03:53:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:53:05.768891167Z [2024-04-15T03:53:05.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:53:00+00:00, run_after=2024-04-15T03:54:00+00:00 2024-04-15T03:53:05.808554834Z [2024-04-15T03:53:05.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:52:00+00:00 exited with status success for try_number 1 2024-04-15T03:53:05.816704855Z [2024-04-15T03:53:05.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:52:00+00:00, map_index=-1, run_start_date=2024-04-15 03:53:02.401543+00:00, run_end_date=2024-04-15 03:53:04.710398+00:00, run_duration=2.308855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:53:00.594376+00:00, queued_by_job_id=2, pid=11298 2024-04-15T03:54:00.387439061Z [2024-04-15T03:54:00.386+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:54:00.395206382Z [2024-04-15T03:54:00.394+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:54:00.406049393Z [2024-04-15T03:54:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:54:00+00:00, run_after=2024-04-15T03:55:00+00:00 2024-04-15T03:54:00.488218536Z [2024-04-15T03:54:00.487+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:54:00.488243610Z 2024-04-15T03:54:00.488250905Z 2024-04-15T03:54:00.488256530Z 2024-04-15T03:54:00.488400991Z [2024-04-15T03:54:00.488+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:54:00.488761777Z [2024-04-15T03:54:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:54:00.488994357Z [2024-04-15T03:54:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:54:00.489951201Z [2024-04-15T03:54:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:54:00.489978070Z 2024-04-15T03:54:00.489988532Z 2024-04-15T03:54:00.489997384Z 2024-04-15T03:54:00.494195836Z [2024-04-15T03:54:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:54:00.494376225Z [2024-04-15T03:54:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:54:00.494719051Z [2024-04-15T03:54:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:54:00.494919047Z [2024-04-15T03:54:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:54:00.495280784Z [2024-04-15T03:54:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:54:00.495459322Z [2024-04-15T03:54:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:54:00.696131167Z [2024-04-15T03:54:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:52:00+00:00 exited with status queued for try_number 1 2024-04-15T03:54:00.696176662Z [2024-04-15T03:54:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:53:00+00:00 exited with status queued for try_number 1 2024-04-15T03:54:00.696593103Z [2024-04-15T03:54:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:53:00+00:00 exited with status queued for try_number 1 2024-04-15T03:54:00.704703810Z [2024-04-15T03:54:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9fcec69-4b63-470d-9e40-fba35bbe3b97 2024-04-15T03:54:00.704794269Z [2024-04-15T03:54:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed9a813f-d7c8-48e9-a264-b92ebae7002b 2024-04-15T03:54:00.705837939Z [2024-04-15T03:54:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0b99b66-9c3b-4cc4-99ca-943973874bf8 2024-04-15T03:54:01.853362314Z [2024-04-15T03:54:01.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:54:01.853700764Z [2024-04-15T03:54:01.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:52:00+00:00, run_id=scheduled__2024-04-15T03:52:00+00:00, run_start_date=2024-04-15 03:54:00.419872+00:00, run_end_date=2024-04-15 03:54:01.853276+00:00, run_duration=1.433404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:52:00+00:00, data_interval_end=2024-04-15 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:54:01.866655034Z [2024-04-15T03:54:01.866+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:54:00+00:00, run_after=2024-04-15T03:56:00+00:00 2024-04-15T03:54:01.955606972Z [2024-04-15T03:54:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:52:00+00:00 exited with status success for try_number 1 2024-04-15T03:54:01.966851103Z [2024-04-15T03:54:01.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:52:00+00:00, map_index=-1, run_start_date=2024-04-15 03:54:01.232373+00:00, run_end_date=2024-04-15 03:54:01.675229+00:00, run_duration=0.442856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:54:00.490913+00:00, queued_by_job_id=2, pid=11343 2024-04-15T03:54:04.434039957Z [2024-04-15T03:54:04.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:54:04.434324271Z [2024-04-15T03:54:04.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:53:00+00:00, run_id=scheduled__2024-04-15T03:53:00+00:00, run_start_date=2024-04-15 03:54:00.423315+00:00, run_end_date=2024-04-15 03:54:04.433779+00:00, run_duration=4.010464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:53:00+00:00, data_interval_end=2024-04-15 03:54:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:54:04.443326372Z [2024-04-15T03:54:04.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:54:00+00:00, run_after=2024-04-15T03:55:00+00:00 2024-04-15T03:54:04.516479035Z [2024-04-15T03:54:04.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:53:00+00:00 exited with status success for try_number 1 2024-04-15T03:54:04.522349215Z [2024-04-15T03:54:04.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:53:00+00:00, map_index=-1, run_start_date=2024-04-15 03:54:02.783825+00:00, run_end_date=2024-04-15 03:54:04.252695+00:00, run_duration=1.46887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:54:00.490913+00:00, queued_by_job_id=2, pid=11373 2024-04-15T03:54:05.594386363Z [2024-04-15T03:54:05.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:54:05.595216153Z [2024-04-15T03:54:05.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:53:00+00:00, run_id=scheduled__2024-04-15T03:53:00+00:00, run_start_date=2024-04-15 03:54:00.425106+00:00, run_end_date=2024-04-15 03:54:05.594615+00:00, run_duration=5.169509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:53:00+00:00, data_interval_end=2024-04-15 03:54:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:54:05.608443891Z [2024-04-15T03:54:05.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:54:00+00:00, run_after=2024-04-15T03:55:00+00:00 2024-04-15T03:54:05.633287839Z [2024-04-15T03:54:05.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:53:00+00:00 exited with status success for try_number 1 2024-04-15T03:54:05.640275951Z [2024-04-15T03:54:05.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:53:00+00:00, map_index=-1, run_start_date=2024-04-15 03:54:02.945626+00:00, run_end_date=2024-04-15 03:54:05.129203+00:00, run_duration=2.183577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:54:00.490913+00:00, queued_by_job_id=2, pid=11374 2024-04-15T03:55:00.284756333Z [2024-04-15T03:55:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:55:00.306118901Z [2024-04-15T03:55:00.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:55:00+00:00, run_after=2024-04-15T04:00:00+00:00 2024-04-15T03:55:00.322333221Z [2024-04-15T03:55:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:55:00+00:00, run_after=2024-04-15T03:56:00+00:00 2024-04-15T03:55:00.383423353Z [2024-04-15T03:55:00.383+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:55:00.383447278Z 2024-04-15T03:55:00.383450752Z 2024-04-15T03:55:00.383453564Z 2024-04-15T03:55:00.383456424Z [2024-04-15T03:55:00.383+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:55:00.383732370Z [2024-04-15T03:55:00.383+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:55:00.383910486Z [2024-04-15T03:55:00.383+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:55:00.384580035Z [2024-04-15T03:55:00.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:55:00.384593404Z 2024-04-15T03:55:00.384597637Z 2024-04-15T03:55:00.384601226Z 2024-04-15T03:55:00.388149419Z [2024-04-15T03:55:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T03:55:00.388386048Z [2024-04-15T03:55:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:55:00.388719711Z [2024-04-15T03:55:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:55:00.388967786Z [2024-04-15T03:55:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:55:00.389369341Z [2024-04-15T03:55:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:55:00.389635791Z [2024-04-15T03:55:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:55:00.619654387Z [2024-04-15T03:55:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status queued for try_number 1 2024-04-15T03:55:00.619908633Z [2024-04-15T03:55:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:54:00+00:00 exited with status queued for try_number 1 2024-04-15T03:55:00.620255682Z [2024-04-15T03:55:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:54:00+00:00 exited with status queued for try_number 1 2024-04-15T03:55:00.633336290Z [2024-04-15T03:55:00.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to c04399b6-1b84-46d6-b37c-e31580422f67 2024-04-15T03:55:00.633758469Z [2024-04-15T03:55:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7167a2a1-6248-43df-be5e-70f0bb97c6e6 2024-04-15T03:55:00.634153987Z [2024-04-15T03:55:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d2aca6c-b3de-43f7-afa1-9f5004b9935a 2024-04-15T03:55:04.076077779Z [2024-04-15T03:55:04.075+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:55:04.076127861Z 2024-04-15T03:55:04.076139566Z [2024-04-15T03:55:04.075+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:55:04.076564541Z [2024-04-15T03:55:04.076+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:55:04.076592184Z 2024-04-15T03:55:04.079327467Z [2024-04-15T03:55:04.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='split_metrics', run_id='scheduled__2024-04-15T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T03:55:04.079363413Z [2024-04-15T03:55:04.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:55:04.142858605Z [2024-04-15T03:55:04.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status queued for try_number 1 2024-04-15T03:55:04.143425349Z [2024-04-15T03:55:04.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status success for try_number 1 2024-04-15T03:55:04.155106470Z [2024-04-15T03:55:04.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6eee4a8-fa74-4110-9016-1f154aa7e599 2024-04-15T03:55:04.155848653Z [2024-04-15T03:55:04.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T03:50:00+00:00, map_index=-1, run_start_date=2024-04-15 03:55:02.875859+00:00, run_end_date=2024-04-15 03:55:03.252912+00:00, run_duration=0.377053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:55:00.385448+00:00, queued_by_job_id=2, pid=11450 2024-04-15T03:55:05.357097861Z [2024-04-15T03:55:05.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:55:05.357343646Z [2024-04-15T03:55:05.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:54:00+00:00, run_id=scheduled__2024-04-15T03:54:00+00:00, run_start_date=2024-04-15 03:55:00.335131+00:00, run_end_date=2024-04-15 03:55:05.356980+00:00, run_duration=5.021849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:54:00+00:00, data_interval_end=2024-04-15 03:55:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:55:05.368947532Z [2024-04-15T03:55:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:55:00+00:00, run_after=2024-04-15T03:56:00+00:00 2024-04-15T03:55:05.377403479Z [2024-04-15T03:55:05.377+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:55:05.377536757Z [2024-04-15T03:55:05.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:54:00+00:00, run_id=scheduled__2024-04-15T03:54:00+00:00, run_start_date=2024-04-15 03:55:00.334155+00:00, run_end_date=2024-04-15 03:55:05.377267+00:00, run_duration=5.043112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:54:00+00:00, data_interval_end=2024-04-15 03:55:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:55:05.388108917Z [2024-04-15T03:55:05.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:55:00+00:00, run_after=2024-04-15T03:56:00+00:00 2024-04-15T03:55:05.444051452Z [2024-04-15T03:55:05.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:54:00+00:00 exited with status success for try_number 1 2024-04-15T03:55:05.444079584Z [2024-04-15T03:55:05.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:54:00+00:00 exited with status success for try_number 1 2024-04-15T03:55:05.457482882Z [2024-04-15T03:55:05.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:54:00+00:00, map_index=-1, run_start_date=2024-04-15 03:55:02.565308+00:00, run_end_date=2024-04-15 03:55:05.165281+00:00, run_duration=2.599973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:55:00.385448+00:00, queued_by_job_id=2, pid=11421 2024-04-15T03:55:05.457527933Z [2024-04-15T03:55:05.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:54:00+00:00, map_index=-1, run_start_date=2024-04-15 03:55:02.790412+00:00, run_end_date=2024-04-15 03:55:04.333509+00:00, run_duration=1.543097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:55:00.385448+00:00, queued_by_job_id=2, pid=11440 2024-04-15T03:55:06.527054870Z [2024-04-15T03:55:06.526+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:55:06.527089552Z 2024-04-15T03:55:06.527296048Z [2024-04-15T03:55:06.526+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:55:06.528309142Z [2024-04-15T03:55:06.527+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:55:06.528342576Z 2024-04-15T03:55:06.531376151Z [2024-04-15T03:55:06.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='collect_metrics', run_id='scheduled__2024-04-15T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T03:55:06.531648155Z [2024-04-15T03:55:06.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:55:06.588779398Z [2024-04-15T03:55:06.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status queued for try_number 1 2024-04-15T03:55:06.589033148Z [2024-04-15T03:55:06.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.split_metrics run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status success for try_number 1 2024-04-15T03:55:06.594775739Z [2024-04-15T03:55:06.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8649bfdf-3e73-4e0e-b66a-3cdf2c75089c 2024-04-15T03:55:06.595095836Z [2024-04-15T03:55:06.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=split_metrics, run_id=scheduled__2024-04-15T03:50:00+00:00, map_index=-1, run_start_date=2024-04-15 03:55:05.615046+00:00, run_end_date=2024-04-15 03:55:05.998906+00:00, run_duration=0.38386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:55:04.076822+00:00, queued_by_job_id=2, pid=11480 2024-04-15T03:55:08.863020756Z [2024-04-15T03:55:08.862+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T03:55:08.863045106Z 2024-04-15T03:55:08.863256011Z [2024-04-15T03:55:08.862+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:55:08.863925596Z [2024-04-15T03:55:08.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:55:08.863935770Z 2024-04-15T03:55:08.866908060Z [2024-04-15T03:55:08.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='send_prometheus', run_id='scheduled__2024-04-15T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:55:08.867130183Z [2024-04-15T03:55:08.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:55:08.935458215Z [2024-04-15T03:55:08.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status queued for try_number 1 2024-04-15T03:55:08.935737827Z [2024-04-15T03:55:08.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.collect_metrics run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status success for try_number 1 2024-04-15T03:55:08.947194787Z [2024-04-15T03:55:08.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 998d6d66-c29e-4c12-bc3f-e542a657c205 2024-04-15T03:55:08.947650201Z [2024-04-15T03:55:08.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=collect_metrics, run_id=scheduled__2024-04-15T03:50:00+00:00, map_index=0, run_start_date=2024-04-15 03:55:08.085330+00:00, run_end_date=2024-04-15 03:55:08.433240+00:00, run_duration=0.34791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:55:06.528805+00:00, queued_by_job_id=2, pid=11492 2024-04-15T03:55:11.801160757Z [2024-04-15T03:55:11.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:55:11.801197773Z [2024-04-15T03:55:11.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:50:00+00:00, run_id=scheduled__2024-04-15T03:50:00+00:00, run_start_date=2024-04-15 03:55:00.333024+00:00, run_end_date=2024-04-15 03:55:11.800316+00:00, run_duration=11.467292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:50:00+00:00, data_interval_end=2024-04-15 03:55:00+00:00, dag_hash=9b9e96c2cb6a2c7e28bd819bdd8feaa7 2024-04-15T03:55:11.806292880Z [2024-04-15T03:55:11.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:55:00+00:00, run_after=2024-04-15T04:00:00+00:00 2024-04-15T03:55:11.844322598Z [2024-04-15T03:55:11.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f.send_prometheus run_id=scheduled__2024-04-15T03:50:00+00:00 exited with status success for try_number 1 2024-04-15T03:55:11.852471306Z [2024-04-15T03:55:11.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=send_prometheus, run_id=scheduled__2024-04-15T03:50:00+00:00, map_index=-1, run_start_date=2024-04-15 03:55:10.641848+00:00, run_end_date=2024-04-15 03:55:10.954259+00:00, run_duration=0.312411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:55:08.864750+00:00, queued_by_job_id=2, pid=11504 2024-04-15T03:55:41.719571750Z [2024-04-15T03:55:41.719+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T03:56:00.071041767Z [2024-04-15T03:56:00.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:56:00.078551985Z [2024-04-15T03:56:00.078+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:56:00.090382720Z [2024-04-15T03:56:00.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:56:00+00:00, run_after=2024-04-15T03:57:00+00:00 2024-04-15T03:56:00.170665356Z [2024-04-15T03:56:00.170+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:56:00.170694074Z 2024-04-15T03:56:00.170698405Z 2024-04-15T03:56:00.170701964Z 2024-04-15T03:56:00.170765049Z [2024-04-15T03:56:00.170+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:56:00.170952627Z [2024-04-15T03:56:00.170+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:56:00.171131796Z [2024-04-15T03:56:00.170+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:56:00.171843378Z [2024-04-15T03:56:00.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:56:00.171854794Z 2024-04-15T03:56:00.171858304Z 2024-04-15T03:56:00.171861217Z 2024-04-15T03:56:00.175314582Z [2024-04-15T03:56:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:56:00.175413778Z [2024-04-15T03:56:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:56:00.176043403Z [2024-04-15T03:56:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:56:00.176204670Z [2024-04-15T03:56:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:56:00.176403883Z [2024-04-15T03:56:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:56:00.176477508Z [2024-04-15T03:56:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:56:00.553413835Z [2024-04-15T03:56:00.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:54:00+00:00 exited with status queued for try_number 1 2024-04-15T03:56:00.554177378Z [2024-04-15T03:56:00.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:55:00+00:00 exited with status queued for try_number 1 2024-04-15T03:56:00.555257684Z [2024-04-15T03:56:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:55:00+00:00 exited with status queued for try_number 1 2024-04-15T03:56:00.564588021Z [2024-04-15T03:56:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56891cd1-e345-4d9a-94ac-3723e71ada38 2024-04-15T03:56:00.564743290Z [2024-04-15T03:56:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a439f0e-a56c-47eb-a48d-f9504152cce8 2024-04-15T03:56:00.564904505Z [2024-04-15T03:56:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 419c45c9-0951-4192-b52f-e58a719c2bde 2024-04-15T03:56:03.021310685Z [2024-04-15T03:56:03.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:56:03.028066393Z [2024-04-15T03:56:03.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:54:00+00:00, run_id=scheduled__2024-04-15T03:54:00+00:00, run_start_date=2024-04-15 03:56:00.101513+00:00, run_end_date=2024-04-15 03:56:03.021272+00:00, run_duration=2.919759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:54:00+00:00, data_interval_end=2024-04-15 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:56:03.040567228Z [2024-04-15T03:56:03.040+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:56:00+00:00, run_after=2024-04-15T03:58:00+00:00 2024-04-15T03:56:03.130920254Z [2024-04-15T03:56:03.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:54:00+00:00 exited with status success for try_number 1 2024-04-15T03:56:03.141223367Z [2024-04-15T03:56:03.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:54:00+00:00, map_index=-1, run_start_date=2024-04-15 03:56:01.526754+00:00, run_end_date=2024-04-15 03:56:02.272670+00:00, run_duration=0.745916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:56:00.172922+00:00, queued_by_job_id=2, pid=11522 2024-04-15T03:56:05.321347155Z [2024-04-15T03:56:05.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:56:05.322418691Z [2024-04-15T03:56:05.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:55:00+00:00, run_id=scheduled__2024-04-15T03:55:00+00:00, run_start_date=2024-04-15 03:56:00.106849+00:00, run_end_date=2024-04-15 03:56:05.321628+00:00, run_duration=5.214779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:55:00+00:00, data_interval_end=2024-04-15 03:56:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:56:05.340809646Z [2024-04-15T03:56:05.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:56:00+00:00, run_after=2024-04-15T03:57:00+00:00 2024-04-15T03:56:05.378866216Z [2024-04-15T03:56:05.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:55:00+00:00 exited with status success for try_number 1 2024-04-15T03:56:05.383747194Z [2024-04-15T03:56:05.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:55:00+00:00, map_index=-1, run_start_date=2024-04-15 03:56:03.167385+00:00, run_end_date=2024-04-15 03:56:04.647873+00:00, run_duration=1.480488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:56:00.172922+00:00, queued_by_job_id=2, pid=11551 2024-04-15T03:56:05.658882680Z [2024-04-15T03:56:05.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:56:05.659439063Z [2024-04-15T03:56:05.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:55:00+00:00, run_id=scheduled__2024-04-15T03:55:00+00:00, run_start_date=2024-04-15 03:56:00.109873+00:00, run_end_date=2024-04-15 03:56:05.658926+00:00, run_duration=5.549053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:55:00+00:00, data_interval_end=2024-04-15 03:56:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:56:05.672249958Z [2024-04-15T03:56:05.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:56:00+00:00, run_after=2024-04-15T03:57:00+00:00 2024-04-15T03:56:05.718683437Z [2024-04-15T03:56:05.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:55:00+00:00 exited with status success for try_number 1 2024-04-15T03:56:05.728061225Z [2024-04-15T03:56:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:55:00+00:00, map_index=-1, run_start_date=2024-04-15 03:56:03.205723+00:00, run_end_date=2024-04-15 03:56:05.371004+00:00, run_duration=2.165281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:56:00.172922+00:00, queued_by_job_id=2, pid=11552 2024-04-15T03:57:00.522444471Z [2024-04-15T03:57:00.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:57:00+00:00, run_after=2024-04-15T03:58:00+00:00 2024-04-15T03:57:00.532384509Z [2024-04-15T03:57:00.532+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:57:00.592693241Z [2024-04-15T03:57:00.592+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:57:00.592726593Z 2024-04-15T03:57:00.592734847Z 2024-04-15T03:57:00.593043001Z [2024-04-15T03:57:00.592+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:57:00.593369900Z [2024-04-15T03:57:00.593+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:57:00.594215075Z [2024-04-15T03:57:00.594+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:57:00.594227485Z 2024-04-15T03:57:00.594233637Z 2024-04-15T03:57:00.597061685Z [2024-04-15T03:57:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:57:00.597335184Z [2024-04-15T03:57:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:57:00.597745039Z [2024-04-15T03:57:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:57:00.597960181Z [2024-04-15T03:57:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:57:00.743778071Z [2024-04-15T03:57:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:56:00+00:00 exited with status queued for try_number 1 2024-04-15T03:57:00.744000467Z [2024-04-15T03:57:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:56:00+00:00 exited with status queued for try_number 1 2024-04-15T03:57:00.750253378Z [2024-04-15T03:57:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to afcd61cc-b5bb-47e2-bc0d-305eacc5ac08 2024-04-15T03:57:00.750656058Z [2024-04-15T03:57:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 540986aa-2d65-4d31-a478-3a9255fcaedd 2024-04-15T03:57:04.994866872Z [2024-04-15T03:57:04.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:57:04.995094766Z [2024-04-15T03:57:04.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:56:00+00:00, run_id=scheduled__2024-04-15T03:56:00+00:00, run_start_date=2024-04-15 03:57:00.543980+00:00, run_end_date=2024-04-15 03:57:04.994741+00:00, run_duration=4.450761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:56:00+00:00, data_interval_end=2024-04-15 03:57:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:57:05.007630121Z [2024-04-15T03:57:05.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:57:00+00:00, run_after=2024-04-15T03:58:00+00:00 2024-04-15T03:57:05.020844088Z [2024-04-15T03:57:05.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:57:05.021227922Z [2024-04-15T03:57:05.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:56:00+00:00, run_id=scheduled__2024-04-15T03:56:00+00:00, run_start_date=2024-04-15 03:57:00.545335+00:00, run_end_date=2024-04-15 03:57:05.020784+00:00, run_duration=4.475449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:56:00+00:00, data_interval_end=2024-04-15 03:57:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:57:05.038127694Z [2024-04-15T03:57:05.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:57:00+00:00, run_after=2024-04-15T03:58:00+00:00 2024-04-15T03:57:05.074308499Z [2024-04-15T03:57:05.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:56:00+00:00 exited with status success for try_number 1 2024-04-15T03:57:05.074528187Z [2024-04-15T03:57:05.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:56:00+00:00 exited with status success for try_number 1 2024-04-15T03:57:05.087173145Z [2024-04-15T03:57:05.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:56:00+00:00, map_index=-1, run_start_date=2024-04-15 03:57:02.607473+00:00, run_end_date=2024-04-15 03:57:03.968898+00:00, run_duration=1.361425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:57:00.594714+00:00, queued_by_job_id=2, pid=11606 2024-04-15T03:57:05.087367823Z [2024-04-15T03:57:05.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:56:00+00:00, map_index=-1, run_start_date=2024-04-15 03:57:02.609481+00:00, run_end_date=2024-04-15 03:57:04.369156+00:00, run_duration=1.759675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:57:00.594714+00:00, queued_by_job_id=2, pid=11605 2024-04-15T03:58:00.937751267Z [2024-04-15T03:58:00.937+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:58:00.956843983Z [2024-04-15T03:58:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:58:00+00:00, run_after=2024-04-15T03:59:00+00:00 2024-04-15T03:58:00.965934937Z [2024-04-15T03:58:00.965+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:58:01.040884007Z [2024-04-15T03:58:01.040+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T03:58:01.040908077Z 2024-04-15T03:58:01.040912212Z 2024-04-15T03:58:01.040915674Z 2024-04-15T03:58:01.040973368Z [2024-04-15T03:58:01.040+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T03:58:01.041021014Z [2024-04-15T03:58:01.040+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:58:01.041090845Z [2024-04-15T03:58:01.040+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:58:01.041623437Z [2024-04-15T03:58:01.041+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:58:01.041632383Z 2024-04-15T03:58:01.041635782Z 2024-04-15T03:58:01.041638892Z 2024-04-15T03:58:01.045441427Z [2024-04-15T03:58:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:58:01.045568177Z [2024-04-15T03:58:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:58:01.045780197Z [2024-04-15T03:58:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:58:01.045854648Z [2024-04-15T03:58:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:58:01.046064202Z [2024-04-15T03:58:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:58:01.046133523Z [2024-04-15T03:58:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:58:01.306373783Z [2024-04-15T03:58:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:56:00+00:00 exited with status queued for try_number 1 2024-04-15T03:58:01.306466756Z [2024-04-15T03:58:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:57:00+00:00 exited with status queued for try_number 1 2024-04-15T03:58:01.306511696Z [2024-04-15T03:58:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:57:00+00:00 exited with status queued for try_number 1 2024-04-15T03:58:01.327941447Z [2024-04-15T03:58:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57bcb0a6-a951-4a5b-ac2a-d5905c09c425 2024-04-15T03:58:01.328168571Z [2024-04-15T03:58:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04b9555e-6c5c-4efd-8e31-c65e1a2dd50e 2024-04-15T03:58:01.328358147Z [2024-04-15T03:58:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 773090cd-0e10-4f5e-83c5-995559609ee7 2024-04-15T03:58:03.729018539Z [2024-04-15T03:58:03.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:58:03.729315355Z [2024-04-15T03:58:03.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 03:56:00+00:00, run_id=scheduled__2024-04-15T03:56:00+00:00, run_start_date=2024-04-15 03:58:00.978681+00:00, run_end_date=2024-04-15 03:58:03.728794+00:00, run_duration=2.750113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:56:00+00:00, data_interval_end=2024-04-15 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T03:58:03.741774772Z [2024-04-15T03:58:03.741+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T03:58:00+00:00, run_after=2024-04-15T04:00:00+00:00 2024-04-15T03:58:03.797716525Z [2024-04-15T03:58:03.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T03:56:00+00:00 exited with status success for try_number 1 2024-04-15T03:58:03.805578245Z [2024-04-15T03:58:03.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T03:56:00+00:00, map_index=-1, run_start_date=2024-04-15 03:58:02.307229+00:00, run_end_date=2024-04-15 03:58:02.730018+00:00, run_duration=0.422789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:58:01.042459+00:00, queued_by_job_id=2, pid=11642 2024-04-15T03:58:04.869712684Z [2024-04-15T03:58:04.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:58:04.870650931Z [2024-04-15T03:58:04.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:57:00+00:00, run_id=scheduled__2024-04-15T03:57:00+00:00, run_start_date=2024-04-15 03:58:00.979999+00:00, run_end_date=2024-04-15 03:58:04.870318+00:00, run_duration=3.890319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:57:00+00:00, data_interval_end=2024-04-15 03:58:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:58:04.881444017Z [2024-04-15T03:58:04.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:58:00+00:00, run_after=2024-04-15T03:59:00+00:00 2024-04-15T03:58:05.995281715Z [2024-04-15T03:58:05.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:58:05.995749654Z [2024-04-15T03:58:05.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:57:00+00:00, run_id=scheduled__2024-04-15T03:57:00+00:00, run_start_date=2024-04-15 03:58:00.981135+00:00, run_end_date=2024-04-15 03:58:05.995168+00:00, run_duration=5.014033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:57:00+00:00, data_interval_end=2024-04-15 03:58:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:58:06.013361332Z [2024-04-15T03:58:06.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:58:00+00:00, run_after=2024-04-15T03:59:00+00:00 2024-04-15T03:58:06.051952039Z [2024-04-15T03:58:06.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:57:00+00:00 exited with status success for try_number 1 2024-04-15T03:58:06.052422645Z [2024-04-15T03:58:06.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:57:00+00:00 exited with status success for try_number 1 2024-04-15T03:58:06.067128342Z [2024-04-15T03:58:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:57:00+00:00, map_index=-1, run_start_date=2024-04-15 03:58:03.343069+00:00, run_end_date=2024-04-15 03:58:04.793983+00:00, run_duration=1.450914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:58:01.042459+00:00, queued_by_job_id=2, pid=11672 2024-04-15T03:58:06.067705150Z [2024-04-15T03:58:06.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:57:00+00:00, map_index=-1, run_start_date=2024-04-15 03:58:03.233099+00:00, run_end_date=2024-04-15 03:58:05.100276+00:00, run_duration=1.867177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:58:01.042459+00:00, queued_by_job_id=2, pid=11671 2024-04-15T03:59:00.541102116Z [2024-04-15T03:59:00.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:59:00+00:00, run_after=2024-04-15T04:00:00+00:00 2024-04-15T03:59:00.556519227Z [2024-04-15T03:59:00.556+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T03:59:00.618264525Z [2024-04-15T03:59:00.617+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T03:59:00.618324424Z 2024-04-15T03:59:00.618335070Z 2024-04-15T03:59:00.618700118Z [2024-04-15T03:59:00.618+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:59:00.618994289Z [2024-04-15T03:59:00.618+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f has 0/16 running and queued tasks 2024-04-15T03:59:00.619769427Z [2024-04-15T03:59:00.619+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T03:59:00.619785463Z 2024-04-15T03:59:00.619790823Z 2024-04-15T03:59:00.623953437Z [2024-04-15T03:59:00.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:59:00.624388527Z [2024-04-15T03:59:00.624+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:59:00.624907773Z [2024-04-15T03:59:00.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac231340-6e28-42af-a241-50b013558a9f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T03:59:00.625208146Z [2024-04-15T03:59:00.624+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:59:00.763760595Z [2024-04-15T03:59:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:58:00+00:00 exited with status queued for try_number 1 2024-04-15T03:59:00.763842256Z [2024-04-15T03:59:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:58:00+00:00 exited with status queued for try_number 1 2024-04-15T03:59:00.769691481Z [2024-04-15T03:59:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f623472-7b7b-49d1-9174-4d58bb75f9d3 2024-04-15T03:59:00.769866628Z [2024-04-15T03:59:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 880f1447-a106-446d-9e0b-6638da0b5dde 2024-04-15T03:59:04.601007457Z [2024-04-15T03:59:04.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:59:04.601314906Z [2024-04-15T03:59:04.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:58:00+00:00, run_id=scheduled__2024-04-15T03:58:00+00:00, run_start_date=2024-04-15 03:59:00.570288+00:00, run_end_date=2024-04-15 03:59:04.600830+00:00, run_duration=4.030542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:58:00+00:00, data_interval_end=2024-04-15 03:59:00+00:00, dag_hash=1bf37aa8f5c4f023a67756a0cc8b8f0d 2024-04-15T03:59:04.609127112Z [2024-04-15T03:59:04.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:59:00+00:00, run_after=2024-04-15T04:00:00+00:00 2024-04-15T03:59:04.655179561Z [2024-04-15T03:59:04.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac231340-6e28-42af-a241-50b013558a9f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:58:00+00:00 exited with status success for try_number 1 2024-04-15T03:59:04.663858539Z [2024-04-15T03:59:04.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:58:00+00:00, map_index=-1, run_start_date=2024-04-15 03:59:02.676508+00:00, run_end_date=2024-04-15 03:59:03.905846+00:00, run_duration=1.229338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:59:00.620699+00:00, queued_by_job_id=2, pid=11727 2024-04-15T03:59:05.731298655Z [2024-04-15T03:59:05.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T03:59:05.731958969Z [2024-04-15T03:59:05.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, execution_date=2024-04-15 03:58:00+00:00, run_id=scheduled__2024-04-15T03:58:00+00:00, run_start_date=2024-04-15 03:59:00.571691+00:00, run_end_date=2024-04-15 03:59:05.731207+00:00, run_duration=5.159516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 03:58:00+00:00, data_interval_end=2024-04-15 03:59:00+00:00, dag_hash=1c54bbda8cf204fbc71e56943734b20d 2024-04-15T03:59:05.760286716Z [2024-04-15T03:59:05.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f to 2024-04-15T03:59:00+00:00, run_after=2024-04-15T04:00:00+00:00 2024-04-15T03:59:05.812450380Z [2024-04-15T03:59:05.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T03:58:00+00:00 exited with status success for try_number 1 2024-04-15T03:59:05.823132978Z [2024-04-15T03:59:05.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T03:58:00+00:00, map_index=-1, run_start_date=2024-04-15 03:59:02.462028+00:00, run_end_date=2024-04-15 03:59:05.273711+00:00, run_duration=2.811683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 03:59:00.620699+00:00, queued_by_job_id=2, pid=11717 2024-04-15T01:25:30.764416723Z 2024-04-15T01:25:30.772857613Z Cleaning logs every 900 seconds 2024-04-15T01:25:30.772872469Z Trimming airflow logs to 15 days. 2024-04-15T01:30:00.831020740Z Trimming airflow logs to 15 days. 2024-04-15T01:30:01.866534290Z Trimming airflow logs to 15 days. 2024-04-15T01:45:00.899518751Z Trimming airflow logs to 15 days. 2024-04-15T01:45:01.934649658Z Trimming airflow logs to 15 days. 2024-04-15T02:00:01.010274283Z Trimming airflow logs to 15 days. 2024-04-15T02:15:00.059970946Z Trimming airflow logs to 15 days. 2024-04-15T02:15:01.082809166Z Trimming airflow logs to 15 days. 2024-04-15T02:30:00.124106606Z Trimming airflow logs to 15 days. 2024-04-15T02:30:01.164516522Z Trimming airflow logs to 15 days. 2024-04-15T02:45:00.228369849Z Trimming airflow logs to 15 days. 2024-04-15T02:45:01.251855410Z Trimming airflow logs to 15 days. 2024-04-15T03:00:00.289375235Z Trimming airflow logs to 15 days. 2024-04-15T03:00:01.314465247Z Trimming airflow logs to 15 days. 2024-04-15T03:15:00.348914556Z Trimming airflow logs to 15 days. 2024-04-15T03:15:01.378898010Z Trimming airflow logs to 15 days. 2024-04-15T03:30:00.410088260Z Trimming airflow logs to 15 days. 2024-04-15T03:30:01.439660244Z Trimming airflow logs to 15 days. 2024-04-15T03:45:00.482444249Z Trimming airflow logs to 15 days. 2024-04-15T03:45:01.502865009Z Trimming airflow logs to 15 days.